-- Logs begin at Mon 2022-10-03 09:38:09 UTC, end at Mon 2022-10-03 12:30:29 UTC. -- Oct 03 10:19:53.467964 n-d-858383-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 10:19:53.475292 n-d-858383-3 devstack@n-api.service[106237]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 10:19:53 2022] *** Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: nodename: n-d-858383-3 Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: machine: x86_64 Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: clock source: unix Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: pcre jit disabled Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: detected number of CPU cores: 4 Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: current working directory: / Oct 03 10:19:53.478484 n-d-858383-3 devstack@n-api.service[106237]: detected binary path: /usr/bin/uwsgi-core Oct 03 10:19:53.479875 n-d-858383-3 devstack@n-api.service[106237]: your processes number limit is 47680 Oct 03 10:19:53.479875 n-d-858383-3 devstack@n-api.service[106237]: your memory page size is 4096 bytes Oct 03 10:19:53.479875 n-d-858383-3 devstack@n-api.service[106237]: detected max file descriptor number: 2048 Oct 03 10:19:53.479875 n-d-858383-3 devstack@n-api.service[106237]: lock engine: pthread robust mutexes Oct 03 10:19:53.479875 n-d-858383-3 devstack@n-api.service[106237]: thunder lock: enabled Oct 03 10:19:53.479875 n-d-858383-3 devstack@n-api.service[106237]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 10:19:53.479875 n-d-858383-3 devstack@n-api.service[106237]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 10:19:53.517642 n-d-858383-3 devstack@n-api.service[106237]: Python main interpreter initialized at 0x559a754629c0 Oct 03 10:19:53.517642 n-d-858383-3 devstack@n-api.service[106237]: python threads support enabled Oct 03 10:19:53.517642 n-d-858383-3 devstack@n-api.service[106237]: your server socket listen backlog is limited to 100 connections Oct 03 10:19:53.517642 n-d-858383-3 devstack@n-api.service[106237]: your mercy for graceful operations on workers is 90 seconds Oct 03 10:19:53.517998 n-d-858383-3 devstack@n-api.service[106237]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 10:19:53.518082 n-d-858383-3 devstack@n-api.service[106237]: *** Operational MODE: preforking *** Oct 03 10:19:53.518545 n-d-858383-3 devstack@n-api.service[106237]: *** uWSGI is running in multiple interpreter mode *** Oct 03 10:19:53.518545 n-d-858383-3 devstack@n-api.service[106237]: spawned uWSGI master process (pid: 106237) Oct 03 10:19:53.518739 n-d-858383-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 03 10:19:53.522784 n-d-858383-3 devstack@n-api.service[106237]: spawned uWSGI worker 1 (pid: 106238, cores: 1) Oct 03 10:19:53.522784 n-d-858383-3 devstack@n-api.service[106237]: spawned uWSGI worker 2 (pid: 106239, cores: 1) Oct 03 10:19:53.522784 n-d-858383-3 devstack@n-api.service[106237]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 10:19:54.175439 n-d-858383-3 devstack@n-api.service[106238]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 10:19:54.180042 n-d-858383-3 devstack@n-api.service[106239]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 10:19:55.257268 n-d-858383-3 devstack@n-api.service[106238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:19:55.257268 n-d-858383-3 devstack@n-api.service[106238]: from cryptography.utils import int_from_bytes Oct 03 10:19:55.257895 n-d-858383-3 devstack@n-api.service[106238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:19:55.257895 n-d-858383-3 devstack@n-api.service[106238]: from cryptography.utils import int_from_bytes Oct 03 10:19:55.259621 n-d-858383-3 devstack@n-api.service[106239]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:19:55.259621 n-d-858383-3 devstack@n-api.service[106239]: from cryptography.utils import int_from_bytes Oct 03 10:19:55.260533 n-d-858383-3 devstack@n-api.service[106239]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:19:55.260533 n-d-858383-3 devstack@n-api.service[106239]: from cryptography.utils import int_from_bytes Oct 03 10:19:57.739703 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 10:19:57.740361 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 10:19:57.740471 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 10:19:57.740796 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 10:19:57.741171 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 10:19:57.741267 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 10:19:57.741343 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 10:19:57.741480 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.741562 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 10:19:57.741770 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.741920 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 10:19:57.742087 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.742184 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 10:19:57.742400 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.742545 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.742726 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.742865 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.743037 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.743182 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.743353 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.743494 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.743667 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.743819 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.743992 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.744127 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.744251 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.744468 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.744587 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.744856 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.745064 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.745154 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.745238 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.745389 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.745536 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.745684 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.745842 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.746003 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.746156 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.746323 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.746457 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.746626 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.746774 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.746930 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.747075 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.747241 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.747542 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.747637 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.747860 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.748004 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.748159 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.748299 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.748608 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.748737 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.748964 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.749084 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.749274 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.749394 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.749577 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.749709 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.749892 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.750025 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.750198 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.750336 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.750502 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.750627 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.750810 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.750941 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.751112 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.751237 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.751435 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.751559 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.751742 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.751869 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.752096 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.752221 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.752436 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.752569 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.752747 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.752893 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.753086 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.753223 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.753420 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.753552 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.753739 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.753872 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.754043 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.754182 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.754366 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.754493 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.754683 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.754811 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.754988 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.755113 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.755301 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.755426 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.755602 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.755728 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.755906 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.756032 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.756211 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.756337 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.756515 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.756640 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.756837 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.756963 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.757140 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.757267 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.757399 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.757534 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.757805 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.757932 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758053 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758174 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758296 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758431 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758577 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758699 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758824 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.758951 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.759074 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.759215 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.759368 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.759497 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.759685 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.759820 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.759964 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.760088 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.760276 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.760409 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.760595 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.760728 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.760920 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.761061 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.761224 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.761355 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.761525 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.761768 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.761902 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.762026 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.762147 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.762279 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.762403 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.762536 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.762703 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.762831 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.763005 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.763132 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.763310 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.763447 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.763621 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.763752 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.763936 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.764089 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.764235 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.764374 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.764535 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.764661 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.764892 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.765042 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.765178 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.765300 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.765480 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.765606 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.765806 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.765931 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.766122 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.766248 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.766426 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.766552 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.766727 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.766855 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.767033 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.767159 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.767334 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.767458 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.767636 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.767763 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.767939 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.768065 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.768187 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.768315 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.768740 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.768907 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.769064 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.769197 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.769377 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.769511 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.769674 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.769810 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.769973 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.770101 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.770275 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.770400 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.770574 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.770713 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.770875 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.771001 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.771177 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.771301 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.771473 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.771605 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.771776 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.771901 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.772079 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.772205 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.772379 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.772505 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.772678 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.772860 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.772996 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.773120 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.773292 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.773419 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.773591 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.773715 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.773890 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.774023 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.774191 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.774325 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.774491 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.774628 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.774793 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.774927 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.775094 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.775227 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.775397 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.775531 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.776219 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.776353 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.776521 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.776648 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.776844 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.776970 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.777161 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.777298 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.777463 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.777588 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.777761 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.777896 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.778075 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.778210 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.778375 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.778500 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.778675 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.778802 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.778988 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.779123 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.779289 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.779417 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.779590 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.779715 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.779902 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.780035 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.780200 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.780334 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.780497 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.780623 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.780820 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.780964 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.781123 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.781248 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.781421 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.781547 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.781719 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.781852 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.782016 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.782148 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.782313 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.782445 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.782611 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.782749 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.782907 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.783047 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.783207 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.783334 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.783506 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.783642 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.783805 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.783936 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.784105 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.784231 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.784416 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.784550 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.784719 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.784863 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.785046 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.785180 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.785362 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:19:57.785489 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.785696 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.785824 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.786028 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.786154 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.786354 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.786486 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.786669 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.786804 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.786981 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.787128 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.787292 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.787426 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.787613 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.787739 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.787919 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.788053 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.788227 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.788360 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.788535 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.788660 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.788870 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.789086 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.789211 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.789340 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.789482 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.789608 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.789782 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.789925 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.790098 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.790225 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.790411 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.790536 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.790718 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.790860 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.791031 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.791159 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.791915 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.792049 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.792229 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.792401 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.792526 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.792647 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.792891 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.793021 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.793212 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.793338 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.793523 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.793650 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.793846 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.793972 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.794164 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.794298 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.794474 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.794600 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.794782 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.794909 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.795089 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.795217 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.795401 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.795526 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.795710 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.795837 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.796016 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.796144 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.796330 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.796449 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.796637 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.796832 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.796969 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.797092 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.797276 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.797413 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.797582 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.797715 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.797889 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.798023 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.798198 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.798331 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.798502 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.798635 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.798808 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.798934 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.799118 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.799245 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.799425 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.799564 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.799740 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.799873 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.800049 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.800183 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.800364 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.800503 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.800672 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.800818 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.801001 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.801126 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.801310 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.801444 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.801613 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.801740 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.801914 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.802052 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.802216 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.802344 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.802517 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.802642 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.802817 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.802942 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.803117 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.803242 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.803421 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.803550 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.803722 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.803849 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.804037 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.804164 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.804338 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.804463 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.804645 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.804817 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.804978 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.805115 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.805285 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.805419 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.805587 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.805727 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.805891 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.806023 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.806196 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.806332 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.806496 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.806635 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.806804 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.806931 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.807133 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.807259 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.807435 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.807570 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.807753 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.807888 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.808056 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.808183 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.808355 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.808480 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.808663 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.808811 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.808990 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.809116 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.809294 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.809429 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.809600 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.809732 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.809905 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.810038 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.810215 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.810349 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.810522 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.810647 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.810826 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.810961 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.811147 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.811274 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.811454 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.811581 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.811760 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.811968 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.812093 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.812204 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.812391 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.812518 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.812704 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.812880 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.813031 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.813157 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.813339 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.813467 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.813641 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.813785 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.813944 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.814079 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.814245 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.814372 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.814545 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.814683 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.814844 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.814970 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.815145 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.815277 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.815447 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.815573 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.815745 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.815883 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.816046 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.816172 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.816345 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.816478 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.816648 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.816803 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.816988 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.817126 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.817291 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.817421 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.817590 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.817716 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.817890 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.818016 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.818191 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.818330 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.818492 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.818619 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.818828 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.818964 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.819131 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.819251 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.819468 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.819658 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.819786 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.819909 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.820076 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.820210 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.820384 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.820510 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.820692 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.820847 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.821021 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.821148 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.821329 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.821466 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.821720 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.822360 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.822564 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.822674 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.822674 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.822868 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.822980 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823093 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823198 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823300 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823403 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823515 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823628 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823732 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823842 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.823976 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.824232 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.824348 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.824467 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.824574 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.824700 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.824905 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.825019 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.825221 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.825347 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.825570 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.825691 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.825927 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.826058 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.826225 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.826360 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.826534 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.826662 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.826841 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.826969 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.827147 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.827275 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.827463 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.827598 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.827769 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.827903 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.828076 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.828202 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.828380 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.828506 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.828694 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.828837 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.829024 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.829150 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.829338 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.829471 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.829640 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.829767 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.829956 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.830081 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.830254 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.830379 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.830571 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.830707 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.830875 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.831001 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.831183 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.831311 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.831500 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.831639 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.831809 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.831937 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.832116 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.832243 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.832422 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.832561 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.832726 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.832872 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.833051 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.833178 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.833359 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.833503 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.833667 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.833792 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.833971 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.834105 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.834273 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.834405 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.834577 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.834711 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.834888 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.835014 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.835193 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.835319 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.835497 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.835631 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.835799 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.835925 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.836107 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.836235 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.836414 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.836539 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.836716 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.836889 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.837028 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.837151 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.837342 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.837469 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.837654 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.837779 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.837959 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.838570 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.838790 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.838916 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.839095 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.839230 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.839399 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.839529 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.839702 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.839826 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.840002 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.840134 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.840319 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.840444 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.840623 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.840749 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.840951 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.841160 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.841288 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.841417 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.841571 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.841697 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.841878 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.842012 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.842183 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.842311 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.842488 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.842614 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.842797 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.842935 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.843105 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.843231 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.843414 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.843539 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.843719 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.843853 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.844023 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.844155 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.844328 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.844456 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.844635 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.844813 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.844967 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.845094 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.845274 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.845401 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.845578 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.845704 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.845884 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.846011 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.846190 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.846328 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.846491 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.846616 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.846798 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.846926 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.847106 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.847240 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.847414 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.847665 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.847799 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.847993 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.848120 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.848306 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.848434 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.848623 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.848884 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.849014 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.849219 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.849356 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.849533 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.849662 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.849849 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.849977 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.850192 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.850328 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.850501 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.850636 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.850808 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.850935 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.851112 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.851239 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.851414 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.851550 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.851722 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.851850 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.852023 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.852157 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.852323 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.852459 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.852624 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.852752 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.852955 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.853082 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.853257 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.853391 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.853556 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.853693 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.854396 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.854709 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.855014 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.855318 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.855621 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.855926 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.856238 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.856544 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.856878 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.857188 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.857511 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.857818 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.857953 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.858121 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.858261 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.858424 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.858593 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.858720 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.858931 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.859089 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.859272 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.859485 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.859692 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.859902 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.860100 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.860328 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.860532 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.860731 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.860968 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.861101 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.861227 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.861360 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.861360 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.861593 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.861715 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.861845 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.862014 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.862152 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.862384 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.862598 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.862721 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.862985 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.863160 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.863364 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.863575 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.863793 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864000 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864150 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864286 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864408 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864530 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864660 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864809 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.864943 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.865076 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.865199 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.865363 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.865489 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.865671 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.865810 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.865974 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.866142 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.866338 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.866545 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.866765 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.866972 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.867170 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.867373 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.867585 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.867787 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.868003 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.868319 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.868526 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.868730 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.869010 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.869010 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.869010 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.869010 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.869730 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.869730 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.869961 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.870090 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.870214 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.870344 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.870470 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.870713 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.870839 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.871014 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.871319 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.871445 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.871620 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.871921 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.872047 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.872227 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.872502 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.872629 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.872876 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.873102 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.873301 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.873521 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.873752 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.873956 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.874158 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.874158 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.874530 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.874721 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.874926 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.875118 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.875298 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.875478 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.875656 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.875850 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.875998 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.876121 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.876244 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.876365 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.876739 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.876940 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877064 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877185 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877296 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877415 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877536 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877670 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877792 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.877913 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878034 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878154 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878274 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878403 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878526 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878646 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878767 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.878887 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879021 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879143 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879270 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879391 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879512 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879633 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879763 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.879885 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880006 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880127 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880248 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880368 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880497 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880619 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880740 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.880903 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.881028 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.881206 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.881348 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.881516 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.881644 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.881820 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.881955 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.882122 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.882249 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.882447 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.882573 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.882756 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.882890 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.883059 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.883186 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.883375 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.883500 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.883682 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.883807 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.883992 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.884120 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.884298 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.884424 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.884601 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.884728 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.884988 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.885119 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.885294 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.885425 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.885651 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.885786 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.885959 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.886087 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.886275 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.886403 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.886584 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.886719 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.886892 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.887019 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.887201 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.887336 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.887509 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.887644 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.887812 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.887938 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.888117 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.888242 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.888424 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.888559 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.888726 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.888901 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.889052 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.889178 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.889355 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.889485 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.889656 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.889782 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.889961 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.890096 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.890261 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.890388 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.890567 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.890702 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.890869 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.890997 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.891196 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.891323 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.891502 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.891631 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.891812 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.891939 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.892120 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.892248 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.892453 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.892587 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.892736 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.892897 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.893068 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.893196 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.893637 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.893768 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.893944 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.894083 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.894251 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.894377 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.894561 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.894690 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.894870 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.895005 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.895172 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.895307 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.895480 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.895608 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.895785 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.895922 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.896088 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.896216 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.896410 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.896544 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.896711 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.896864 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.897040 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.897167 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.897344 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.897478 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.897682 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.897807 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.897937 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.898060 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.898228 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.898356 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.898655 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.898782 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.898963 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.899090 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.899264 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.899390 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.899564 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.899690 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.899871 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.900007 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.900180 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.900319 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.900492 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.901160 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.901338 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.901466 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.901644 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.901784 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.902066 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.902216 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.902372 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.902507 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.902681 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.902819 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.902988 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.903117 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.903291 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.903419 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.903598 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.903734 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.903906 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.904033 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.904214 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.904340 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.904514 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.904650 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.904837 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.904979 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.905142 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.905277 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.905463 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.905590 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.905765 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.905901 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.906085 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.906214 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.906474 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.906593 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.906797 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.906925 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.907099 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.907225 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.907412 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.907545 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.907716 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.907852 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.908023 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.908150 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.908327 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.908458 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.908654 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.908802 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.908974 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.909102 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.909280 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.909422 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.909589 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.909717 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.909897 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.910025 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.910202 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.910338 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.910506 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.910641 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.910808 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.910937 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.911127 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.911256 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.911429 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.911563 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.911746 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.911872 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.912059 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.912199 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.912367 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.912492 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.912689 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.912865 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.913007 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.913131 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.913326 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.913453 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.913633 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.913761 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.913936 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.914071 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.914239 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.914366 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.914540 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.914668 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.914880 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.915008 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.915184 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.915312 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.915500 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.915635 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.915816 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.915942 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.916136 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.916308 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.917005 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.917143 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.917318 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.917446 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.917628 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.917757 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.917935 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.918071 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.918238 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.918367 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.918541 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.918677 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.918863 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.918999 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.919164 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.919290 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.919467 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.919594 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.919774 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.919912 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.920076 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.920203 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.920378 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.920493 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.920694 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.920877 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.921006 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.921142 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.921291 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.921420 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.921592 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.921728 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.921894 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.922020 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.922198 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.922325 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.922506 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.922632 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.922828 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.922955 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.923131 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.923258 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.923433 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.923561 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.923734 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.923869 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.924036 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.924173 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.924375 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.924503 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.924676 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.924821 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.925029 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.925175 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.925336 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.925464 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.925650 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.925775 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.925964 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.926103 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.926266 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.926392 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.926569 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.926697 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.926877 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.927013 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.927180 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.927308 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.927481 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.927609 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.927785 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.927913 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.928090 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.928215 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.928390 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.928515 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.928691 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.928835 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.929024 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.929152 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.929346 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.929563 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.929703 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.929892 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.930038 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.930198 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.930328 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.930509 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.930645 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.930817 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.930952 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.931116 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.931242 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.931425 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.931551 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.931734 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.931886 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.932084 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.932210 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.932393 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.932521 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.932709 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.932867 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.933050 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.933176 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.933366 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.933489 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.933683 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.933816 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.933996 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.934132 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.934307 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.934442 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.934621 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.934755 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.934934 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.935069 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.935239 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.935365 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.935551 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.935679 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.935862 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.935998 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.936178 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.936305 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.936489 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.936720 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.936895 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.937073 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.937201 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.937387 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.937522 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.937700 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.937903 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.938028 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.938151 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.938309 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.938436 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.938613 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.938749 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.938920 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.939048 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.939228 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.939361 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.939537 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.939666 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.939846 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.939974 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.940170 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.940297 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.940487 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.940613 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.940819 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.940964 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.941137 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.941265 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.941452 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.941580 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.941763 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.941965 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.942093 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.942277 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.942412 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.942613 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.942747 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.942938 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.943075 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.943261 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.943390 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.943579 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.943713 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.943895 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.944025 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.944202 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.944329 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.944511 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.944639 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.944838 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.944979 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.945149 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.945278 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.945462 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.945620 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.945752 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.945889 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.946073 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.946202 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.946382 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.946511 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.946687 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.946823 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.947005 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.947144 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.947310 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.947452 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.947666 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.947886 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.948015 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.948241 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.948369 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.948563 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.948699 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.948921 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.949108 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.949237 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.949421 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.949555 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.949753 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.949881 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.950079 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.950207 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.950401 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.950529 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.950716 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.950843 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.951033 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.951161 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.951356 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.951496 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.951661 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.951786 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.951964 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.952089 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.952273 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.952409 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.952578 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.952712 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.952905 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.953042 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.953208 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.953343 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.953513 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.953641 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.953814 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.953940 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.954131 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.954272 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.954436 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.954562 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.954742 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.954959 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.955096 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.955304 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.955432 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.955618 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.955746 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.955928 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.956067 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.956233 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.956360 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.956546 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.956681 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.956875 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.957011 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.957186 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.957311 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.957492 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.957625 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.957796 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.957937 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.958111 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.958238 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.958419 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.958547 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.958724 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.958851 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.959028 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.959155 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.959336 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.959461 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.959642 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.959777 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.959943 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.960068 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.960250 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.960377 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.960551 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.960678 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.960894 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.961024 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.961199 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.961324 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.961490 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.961618 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.961795 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.961930 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.962108 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.962350 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.962478 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.962687 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.962815 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.962990 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.963637 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.963820 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.963972 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.964158 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.964315 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.964449 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.964573 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.964705 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.964858 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.965035 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.965162 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.965344 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.965471 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.965673 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.965800 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.965985 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.966120 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.966285 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.966424 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.966590 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.966716 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.966896 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.967022 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.967199 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.967400 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.967525 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.967647 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.967798 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.967932 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.968103 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.968232 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.968410 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.968538 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.968716 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.968870 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.969047 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.969174 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.969352 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.969479 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.969658 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.969896 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.970033 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.970236 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.970363 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.970560 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.970694 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.970891 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.971026 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.971203 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.971331 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.971515 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.971642 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.971825 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.971961 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.972129 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.972255 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.972440 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.972565 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.972748 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.972893 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.973082 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.973207 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.973391 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.973519 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.973698 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.973834 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.973999 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.974124 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.974304 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.974611 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.974745 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.974918 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.975044 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.975223 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.975350 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.975528 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.975656 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.975831 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.975966 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.976136 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.976270 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.976442 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.976578 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.976751 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.976922 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.977068 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.977196 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.977407 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.977544 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.977723 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.977857 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.978036 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.978173 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.978346 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.978473 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.978672 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.979390 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.979522 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.979656 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.979804 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.979931 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.980112 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.980239 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.980418 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.980553 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.980729 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.980906 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.981065 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.981191 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.981371 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.981499 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.981676 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.981802 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.981984 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.982288 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.982423 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.982598 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.982725 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.982903 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.983029 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.983208 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.983345 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.983516 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.983644 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.983819 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.983948 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.984122 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.984262 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.984424 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.984558 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.984726 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.984891 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.985055 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.985183 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.985361 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.985488 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.985667 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.985794 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.985971 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.986107 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.986275 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.986402 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.986577 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.986711 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.986879 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.987008 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.987182 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.987316 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.987501 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.987639 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.987818 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.987946 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.988128 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.988257 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.988429 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.988564 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.988732 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.988894 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.989066 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.989163 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.989366 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.989475 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.989668 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.989758 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.989971 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.990070 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.990274 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.990372 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.990578 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.990668 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.990879 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.990966 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.991181 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.991272 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.991487 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.991575 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.991789 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.991884 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.992093 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.992236 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.992411 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.992575 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.992700 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.992884 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.993020 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.993145 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.993269 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.993392 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.993573 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.993708 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.993874 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.994002 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.994176 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.994322 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.994512 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.994652 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.994847 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.994981 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.995158 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.995284 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.995478 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.995613 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.995784 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.995910 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.996093 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.996221 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.996399 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.996601 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.996727 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.996884 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.997008 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.997131 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.997324 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.997454 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.997632 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.997759 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.997938 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.998073 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.998250 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.998385 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.998557 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.998689 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.998867 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.998993 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.999175 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.999310 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.999481 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.999615 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.999785 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:57.999911 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.000106 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.000233 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.000429 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.000556 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.000734 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.000899 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.001080 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.001207 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.001398 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.001529 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.001709 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.001843 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.002019 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.002153 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.002323 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.002450 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.002572 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 10:19:58.002705 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.002942 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.003248 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.003553 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.003859 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.004164 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.004474 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.004795 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.005108 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.005419 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.005729 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.006053 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.006375 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.006681 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.007007 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.007331 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.007674 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.007985 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.008323 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.008649 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.008995 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.009306 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.009610 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:19:58.009851 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 10:19:58.155801 n-d-858383-3 devstack@n-api.service[106238]: INFO dbcounter [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Registered counter for database nova_api Oct 03 10:19:58.163540 n-d-858383-3 devstack@n-api.service[106239]: INFO dbcounter [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Registered counter for database nova_api Oct 03 10:19:58.176947 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_db.sqlalchemy.engines [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.183490 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.184131 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writer thread running {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.191336 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.244229 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.context [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=106238) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 10:19:58.248149 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_concurrency.lockutils [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:19:58.248623 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_concurrency.lockutils [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:19:58.250202 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_concurrency.lockutils [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:19:58.250932 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_concurrency.lockutils [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:19:58.251374 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_concurrency.lockutils [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:19:58.252436 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.context [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=106239) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 10:19:58.253377 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_concurrency.lockutils [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:19:58.255352 n-d-858383-3 devstack@n-api.service[106238]: INFO dbcounter [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Registered counter for database nova_cell0 Oct 03 10:19:58.256268 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:19:58.256738 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:19:58.258464 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:19:58.259192 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:19:58.259491 n-d-858383-3 devstack@n-api.service[106238]: INFO dbcounter [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Registered counter for database nova_cell1 Oct 03 10:19:58.259633 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:19:58.262255 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:19:58.264235 n-d-858383-3 devstack@n-api.service[106239]: INFO dbcounter [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Registered counter for database nova_cell0 Oct 03 10:19:58.267848 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_db.sqlalchemy.engines [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.268674 n-d-858383-3 devstack@n-api.service[106239]: INFO dbcounter [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Registered counter for database nova_cell1 Oct 03 10:19:58.269408 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_db.sqlalchemy.engines [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.275624 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.276459 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writer thread running {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.278354 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.278764 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writer thread running {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.282506 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.424241 n-d-858383-3 devstack@n-api.service[106238]: INFO dbcounter [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Registered counter for database nova_cell0 Oct 03 10:19:58.424537 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.433044 n-d-858383-3 devstack@n-api.service[106238]: DEBUG oslo_db.sqlalchemy.engines [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.434721 n-d-858383-3 devstack@n-api.service[106239]: INFO dbcounter [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Registered counter for database nova_cell0 Oct 03 10:19:58.437745 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writer thread running {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.443090 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:19:58.448258 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:19:58.775042 n-d-858383-3 devstack@n-api.service[106238]: WARNING keystonemiddleware.auth_token [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:19:58.775562 n-d-858383-3 devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:19:58.782414 n-d-858383-3 devstack@n-api.service[106238]: WARNING keystonemiddleware.auth_token [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:19:58.782722 n-d-858383-3 devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:19:59.122000 n-d-858383-3 devstack@n-api.service[106238]: WARNING keystonemiddleware.auth_token [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:19:59.125319 n-d-858383-3 devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:19:59.127868 n-d-858383-3 devstack@n-api.service[106238]: WARNING keystonemiddleware.auth_token [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:19:59.131264 n-d-858383-3 devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:19:59.133349 n-d-858383-3 devstack@n-api.service[106238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a754629c0 pid: 106238 (default app) Oct 03 10:19:59.135911 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:19:59.137075 n-d-858383-3 devstack@n-api.service[106239]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a754629c0 pid: 106239 (default app) Oct 03 10:19:59.137180 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-1785a039-faa0-4f4a-b288-fd5bdcd912ea None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002226 Oct 03 10:19:59.137498 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Mon Oct 3 10:19:59 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:20.891961 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:20.893867 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Oct 03 10:21:20.894345 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:20.911229 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_api:SELECT=3 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:20.913023 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_cell0:SELECT=3 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:20.914074 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_cell1:SELECT=3 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:20.915121 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:21.800939 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-24a06bda-0d51-47bc-8066-380ae9193c83 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:21.833704 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-24a06bda-0d51-47bc-8066-380ae9193c83 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933253 Oct 03 10:21:21.834365 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:21:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:24.448405 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:24.449468 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-64e36c94-cd16-400c-bc9d-114fd7bd6669 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002669 Oct 03 10:21:24.449868 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 2/4] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:24.892151 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-af440e4b-d62d-41ca-9e84-14b1f8e247a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "ram": 256}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:24.941329 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-af440e4b-d62d-41ca-9e84-14b1f8e247a1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.484575 Oct 03 10:21:24.941902 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 3/5] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:21:24.956134 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:SELECT=3 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:24.956438 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell0:SELECT=3 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:24.958359 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell1:SELECT=3 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:24.959105 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:25.181898 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-7184e8d5-22f8-4ce1-9031-4de1e02b5542 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:25.261646 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-7184e8d5-22f8-4ce1-9031-4de1e02b5542 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.311279 Oct 03 10:21:25.263832 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 3/6] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 3 10:21:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:27.949163 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-af440e4b-d62d-41ca-9e84-14b1f8e247a1 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:27.950742 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-af440e4b-d62d-41ca-9e84-14b1f8e247a1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002488 Oct 03 10:21:27.951141 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 4/7] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:28.755230 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-a78a5e4e-3ce0-407b-a71e-46427dda742e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "vcpus": 1, "disk": 5}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:28.824195 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-a78a5e4e-3ce0-407b-a71e-46427dda742e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.865614 Oct 03 10:21:28.825791 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 4/8] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:21:28.841637 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-5014ab3d-477e-4d9c-8614-2650cc3c0c86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:28.898908 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-5014ab3d-477e-4d9c-8614-2650cc3c0c86 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061835 Oct 03 10:21:28.899502 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 5/9] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 3 10:21:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:31.834329 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-a78a5e4e-3ce0-407b-a71e-46427dda742e admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:31.835561 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-a78a5e4e-3ce0-407b-a71e-46427dda742e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 03 10:21:31.835879 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:32.386331 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-97069af1-4ac3-43ff-aa50-e4c0f780ad7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:32.408461 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-97069af1-4ac3-43ff-aa50-e4c0f780ad7b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561749 Oct 03 10:21:32.409061 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 6/11] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:21:32.422001 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-3d2e0297-90d6-4fb8-ba3d-381dc43db7fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:32.455256 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-3d2e0297-90d6-4fb8-ba3d-381dc43db7fe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037801 Oct 03 10:21:32.455928 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 6/12] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 3 10:21:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:21:35.075102 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-97069af1-4ac3-43ff-aa50-e4c0f780ad7b admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:35.077132 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-97069af1-4ac3-43ff-aa50-e4c0f780ad7b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002289 Oct 03 10:21:35.078170 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 7/13] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:35.549481 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-00f37062-b37c-42da-91fc-c9fd8ae61a1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "name": "ds2G", "disk": 10}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:35.574303 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-00f37062-b37c-42da-91fc-c9fd8ae61a1b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489284 Oct 03 10:21:35.575595 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 7/14] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:21:35.588002 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-826a7a3a-200b-41e6-a9d9-fcdcced6f149 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:35.620288 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-826a7a3a-200b-41e6-a9d9-fcdcced6f149 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036801 Oct 03 10:21:35.621309 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 8/15] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 3 10:21:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:38.365766 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-00f37062-b37c-42da-91fc-c9fd8ae61a1b admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:38.367494 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-00f37062-b37c-42da-91fc-c9fd8ae61a1b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002179 Oct 03 10:21:38.368113 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 8/16] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:38.820598 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-c5047c8d-0fba-4aba-9baa-3f53b7ab20b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "ram": 4096}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:38.839385 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-c5047c8d-0fba-4aba-9baa-3f53b7ab20b2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464462 Oct 03 10:21:38.840817 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 9/17] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:21:38.852109 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-662c5510-8fa6-4570-b8c8-98404a98266d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:38.886135 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-662c5510-8fa6-4570-b8c8-98404a98266d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037578 Oct 03 10:21:38.887887 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 9/18] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Oct 3 10:21:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:41.600053 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-c5047c8d-0fba-4aba-9baa-3f53b7ab20b2 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:41.601115 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-c5047c8d-0fba-4aba-9baa-3f53b7ab20b2 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 03 10:21:41.601526 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 10/19] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:42.036937 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-dcab4d81-3cf0-4e2b-b246-1ce21de78a59 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:42.062311 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-dcab4d81-3cf0-4e2b-b246-1ce21de78a59 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452767 Oct 03 10:21:42.062867 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 10/20] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:21:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:21:44.784786 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-c5047c8d-0fba-4aba-9baa-3f53b7ab20b2 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:44.785832 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-c5047c8d-0fba-4aba-9baa-3f53b7ab20b2 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 03 10:21:44.786245 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 11/21] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:45.248391 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-5c58caa0-9e89-4008-9b82-daf726881eb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:45.275043 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-5c58caa0-9e89-4008-9b82-daf726881eb4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.482250 Oct 03 10:21:45.275826 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 11/22] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:21:45.287832 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-0bf7ece5-1e97-4676-9971-fc8b92733f52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:45.315590 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-0bf7ece5-1e97-4676-9971-fc8b92733f52 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031406 Oct 03 10:21:45.316179 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 12/23] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 3 10:21:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:48.129543 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-5c58caa0-9e89-4008-9b82-daf726881eb4 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:48.130479 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-5c58caa0-9e89-4008-9b82-daf726881eb4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Oct 03 10:21:48.130880 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:48.526361 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-750682d9-6143-4106-8ea9-8c866d7a99d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2"}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:48.545559 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-750682d9-6143-4106-8ea9-8c866d7a99d6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408545 Oct 03 10:21:48.546110 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 13/25] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:21:48.558036 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-17e7155d-56f7-4dd8-a6fc-210fababb574 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:48.581900 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-17e7155d-56f7-4dd8-a6fc-210fababb574 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027513 Oct 03 10:21:48.582482 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 13/26] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 3 10:21:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:51.219868 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-750682d9-6143-4106-8ea9-8c866d7a99d6 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:51.220900 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-750682d9-6143-4106-8ea9-8c866d7a99d6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 03 10:21:51.221304 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:51.637133 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-74b51047-661c-48d7-ae6c-77af0481785a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "disk": 40, "ram": 4096}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:51.658173 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-74b51047-661c-48d7-ae6c-77af0481785a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.430427 Oct 03 10:21:51.659019 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 14/28] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:21:51.670802 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-3dd58cb0-0d94-4a5b-8a95-a3961254c3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:51.675638 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:51.702462 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-3dd58cb0-0d94-4a5b-8a95-a3961254c3d4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035381 Oct 03 10:21:51.703260 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 15/29] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 3 10:21:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:21:54.379639 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-74b51047-661c-48d7-ae6c-77af0481785a admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:54.380650 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-74b51047-661c-48d7-ae6c-77af0481785a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 03 10:21:54.381096 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:54.822069 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-e3bbe12e-f721-4b89-99e2-e1c59c0f42d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "name": "m1.large"}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:54.843859 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-e3bbe12e-f721-4b89-99e2-e1c59c0f42d1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456091 Oct 03 10:21:54.844421 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 16/31] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:21:54.856893 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-e0b3532f-bf26-4f44-8363-c375c5d50c6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:54.881420 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-e0b3532f-bf26-4f44-8363-c375c5d50c6d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028735 Oct 03 10:21:54.882387 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 16/32] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 3 10:21:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:21:57.495970 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-e3bbe12e-f721-4b89-99e2-e1c59c0f42d1 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:21:57.497693 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-e3bbe12e-f721-4b89-99e2-e1c59c0f42d1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002196 Oct 03 10:21:57.498099 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 17/33] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:21:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:21:57.944221 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-6f1f3715-2487-4fa3-929c-c0f363b9f041 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "swap": 0, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:57.954298 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:21:57.967160 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-6f1f3715-2487-4fa3-929c-c0f363b9f041 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463089 Oct 03 10:21:57.968025 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 17/34] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Oct 3 10:21:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:21:57.979986 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-d11d016b-1d02-49a5-9d23-febfab1d20b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:21:58.010023 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-d11d016b-1d02-49a5-9d23-febfab1d20b5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033550 Oct 03 10:21:58.010883 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 18/35] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Oct 3 10:21:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:22:18.797068 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-6f1f3715-2487-4fa3-929c-c0f363b9f041 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:18.798093 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-6f1f3715-2487-4fa3-929c-c0f363b9f041 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 03 10:22:18.798497 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 18/36] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:18.809430 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:22:19.190785 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-0894143c-dd47-49b9-813b-f8ff49c96b9f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:19.209208 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-0894143c-dd47-49b9-813b-f8ff49c96b9f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404773 Oct 03 10:22:19.209732 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 19/37] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:22:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:22:20.521307 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-6f1f3715-2487-4fa3-929c-c0f363b9f041 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:20.522577 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-6f1f3715-2487-4fa3-929c-c0f363b9f041 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Oct 03 10:22:20.522982 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 19/38] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:21.070691 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-4f2a77ec-6013-496a-adbd-0ffd5763f509 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:21.075931 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.wsgi [None req-4f2a77ec-6013-496a-adbd-0ffd5763f509 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-4f2a77ec-6013-496a-adbd-0ffd5763f509 admin admin] Request method failure captured: Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: Accept: application/json Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: Accept-Encoding: gzip, deflate Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: Connection: keep-alive Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: Content-Length: 0 Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: Host: 10.222.0.27 Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: Openstack-Api-Version: compute 2.92 Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: Openstack-System-Scope: None Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: User-Agent: python-novaclient Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Auth-Token: gAAAAABjOrfce8Ai9xpdeJZq-x-mMt4LaVJzsZu_v3nCBnlzOF7pXNI1BUo4mBqQvWpUR0t8oS8wnlmqykDfoEuybgiNdwbWAXSkto0cqny73eiRJPmdHOfm5VajW9s0xJFkzmNFFmkTVgep9zY_56QKmxtiBkTehUP3PV3ypT1uSEns7lRItD4 Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Domain-Id: None Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Domain-Name: None Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Identity-Status: Confirmed Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Is-Admin-Project: True Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Domain-Id: default Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Domain-Name: Default Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Name: admin Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Role: reader,member,admin Oct 03 10:22:21.079221 n-d-858383-3 devstack@n-api.service[106238]: X-Roles: reader,member,admin Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}] Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant: admin Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant-Name: admin Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-User: admin Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-User-Domain-Id: default Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-User-Domain-Name: Default Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-User-Id: 80953c3b7cb246f5b8c390e6f23cc89b Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: X-User-Name: admin Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: method: > Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: exception: Flavor 42 could not be found. Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: action_args: {'id': '42'} Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:22:21.082397 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:21.083552 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.084952 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-4f2a77ec-6013-496a-adbd-0ffd5763f509 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:22:21.087114 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-4f2a77ec-6013-496a-adbd-0ffd5763f509 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398616 Oct 03 10:22:21.087114 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 3 10:22:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:22:21.094213 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-660f6e33-20e8-4c3b-a278-8021ea4c130a admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:21.117192 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-660f6e33-20e8-4c3b-a278-8021ea4c130a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028126 Oct 03 10:22:21.117751 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 20/40] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 3 10:22:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:22:21.135934 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-821ce49b-4dc6-454a-869a-21e5f69dbb09 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:21.158387 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-821ce49b-4dc6-454a-869a-21e5f69dbb09 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026999 Oct 03 10:22:21.158935 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 3 10:22:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:22:21.169641 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-5f3ab50d-b3c5-467d-bc69-315b83763fcc admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:21.175118 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.wsgi [None req-5f3ab50d-b3c5-467d-bc69-315b83763fcc admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-5f3ab50d-b3c5-467d-bc69-315b83763fcc admin admin] Request method failure captured: Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: Accept: application/json Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: Accept-Encoding: gzip, deflate Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: Connection: keep-alive Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: Content-Length: 0 Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: Host: 10.222.0.27 Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: Openstack-Api-Version: compute 2.92 Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: Openstack-System-Scope: None Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: User-Agent: python-novaclient Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Auth-Token: gAAAAABjOrfce8Ai9xpdeJZq-x-mMt4LaVJzsZu_v3nCBnlzOF7pXNI1BUo4mBqQvWpUR0t8oS8wnlmqykDfoEuybgiNdwbWAXSkto0cqny73eiRJPmdHOfm5VajW9s0xJFkzmNFFmkTVgep9zY_56QKmxtiBkTehUP3PV3ypT1uSEns7lRItD4 Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Domain-Id: None Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Domain-Name: None Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Identity-Status: Confirmed Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Is-Admin-Project: True Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Domain-Id: default Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Domain-Name: Default Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Name: admin Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Role: reader,member,admin Oct 03 10:22:21.178345 n-d-858383-3 devstack@n-api.service[106239]: X-Roles: reader,member,admin Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}] Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant: admin Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant-Name: admin Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-User: admin Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-User-Domain-Id: default Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-User-Domain-Name: Default Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-User-Id: 80953c3b7cb246f5b8c390e6f23cc89b Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: X-User-Name: admin Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: method: > Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: exception: Flavor 42 could not be found. Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: action_args: {'id': '42'} Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:22:21.179878 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:21.180829 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:21.182156 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-5f3ab50d-b3c5-467d-bc69-315b83763fcc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:22:21.183402 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-5f3ab50d-b3c5-467d-bc69-315b83763fcc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015127 Oct 03 10:22:21.183402 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 21/42] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 3 10:22:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:22:22.393118 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-821ce49b-4dc6-454a-869a-21e5f69dbb09 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:22.394138 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-821ce49b-4dc6-454a-869a-21e5f69dbb09 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 03 10:22:22.394570 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:22.920572 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-716ab997-e523-4395-8032-584bf579edcf admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:22.925686 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.wsgi [None req-716ab997-e523-4395-8032-584bf579edcf admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-716ab997-e523-4395-8032-584bf579edcf admin admin] Request method failure captured: Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: Accept: application/json Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: Accept-Encoding: gzip, deflate Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: Connection: keep-alive Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: Content-Length: 0 Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: Host: 10.222.0.27 Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: Openstack-Api-Version: compute 2.92 Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: Openstack-System-Scope: None Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: User-Agent: python-novaclient Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Auth-Token: gAAAAABjOrfeu6JzxNe40A0-GgOpbms6NzBO_h8EZvUYEBx-cBEsSG9TNPxQ9Cx__wyAXkk9vLl2QVk4-H1D659imnNcOyxanItdZvoYuAD8fHFOWvY5qsadLU43_h4W1kRgYvig8u1_0H3Q_BgiSTnHD3Z8Qg4V6W2MBtknBNFuI7knhGV8rU8 Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Domain-Id: None Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Domain-Name: None Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Identity-Status: Confirmed Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Is-Admin-Project: True Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Domain-Id: default Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Domain-Name: Default Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Name: admin Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Role: reader,member,admin Oct 03 10:22:22.927174 n-d-858383-3 devstack@n-api.service[106239]: X-Roles: reader,member,admin Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}] Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant: admin Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant-Name: admin Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-User: admin Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-User-Domain-Id: default Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-User-Domain-Name: Default Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-User-Id: 80953c3b7cb246f5b8c390e6f23cc89b Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: X-User-Name: admin Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: method: > Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: exception: Flavor 84 could not be found. Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: action_args: {'id': '84'} Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:22:22.928730 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:22.929721 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:22.931060 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-716ab997-e523-4395-8032-584bf579edcf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:22:22.932436 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-716ab997-e523-4395-8032-584bf579edcf admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396930 Oct 03 10:22:22.932436 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 22/44] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 3 10:22:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:22:22.938318 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-b2d8203c-7b71-495e-ba59-048a8a5ea055 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:22.953615 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-b2d8203c-7b71-495e-ba59-048a8a5ea055 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018793 Oct 03 10:22:22.954445 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 3 10:22:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:22:22.965018 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ca0c8778-6c75-4829-84d2-bc5e64bf216d admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:22.980725 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-ca0c8778-6c75-4829-84d2-bc5e64bf216d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020196 Oct 03 10:22:22.981315 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 3 10:22:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:22:22.990849 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-ee385764-262b-4e17-98c1-84aa93298276 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:22.995939 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.wsgi [None req-ee385764-262b-4e17-98c1-84aa93298276 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-ee385764-262b-4e17-98c1-84aa93298276 admin admin] Request method failure captured: Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: Accept: application/json Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: Accept-Encoding: gzip, deflate Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: Connection: keep-alive Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: Content-Length: 0 Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: Host: 10.222.0.27 Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: Openstack-Api-Version: compute 2.92 Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: Openstack-System-Scope: None Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: User-Agent: python-novaclient Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Auth-Token: gAAAAABjOrfeu6JzxNe40A0-GgOpbms6NzBO_h8EZvUYEBx-cBEsSG9TNPxQ9Cx__wyAXkk9vLl2QVk4-H1D659imnNcOyxanItdZvoYuAD8fHFOWvY5qsadLU43_h4W1kRgYvig8u1_0H3Q_BgiSTnHD3Z8Qg4V6W2MBtknBNFuI7knhGV8rU8 Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Domain-Id: None Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Domain-Name: None Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Identity-Status: Confirmed Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Is-Admin-Project: True Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Domain-Id: default Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Domain-Name: Default Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Name: admin Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Role: reader,member,admin Oct 03 10:22:22.997479 n-d-858383-3 devstack@n-api.service[106238]: X-Roles: reader,member,admin Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}] Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant: admin Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant-Name: admin Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-User: admin Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-User-Domain-Id: default Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-User-Domain-Name: Default Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-User-Id: 80953c3b7cb246f5b8c390e6f23cc89b Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: X-User-Name: admin Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: method: > Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: exception: Flavor 84 could not be found. Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: action_args: {'id': '84'} Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:22:22.999027 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:23.000048 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:23.001626 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-ee385764-262b-4e17-98c1-84aa93298276 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:22:23.002976 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-ee385764-262b-4e17-98c1-84aa93298276 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011545 Oct 03 10:22:23.002976 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 24/47] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Oct 3 10:22:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 10:22:24.202044 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ca0c8778-6c75-4829-84d2-bc5e64bf216d admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:24.203043 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-ca0c8778-6c75-4829-84d2-bc5e64bf216d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 03 10:22:24.203439 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 24/48] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:24.719839 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-e7979f63-e887-4709-8fcc-2aec84897518 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:24.725647 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.wsgi [None req-e7979f63-e887-4709-8fcc-2aec84897518 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-e7979f63-e887-4709-8fcc-2aec84897518 admin admin] Request method failure captured: Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: Accept: application/json Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: Accept-Encoding: gzip, deflate Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: Connection: keep-alive Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: Content-Length: 0 Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: Host: 10.222.0.27 Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: Openstack-Api-Version: compute 2.92 Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: Openstack-System-Scope: None Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: User-Agent: python-novaclient Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Auth-Token: gAAAAABjOrfgcM8_V4DDjxkfOXD0BETndzNXWm-tvZ5H5HvkEGNk49rVjt4_gtCnxaGODNjMkZWahNVcK2A-F-hECDl-UpsGCQu1iWo7s6rpNUklbNwZcq-CYSWN0H1V7B59v8pAK-6d-N2vbkWAEUrzIkHturSyd6R-jUfDcRt2e8NwAYi2rFA Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Domain-Id: None Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Domain-Name: None Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Identity-Status: Confirmed Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Is-Admin-Project: True Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Domain-Id: default Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Domain-Name: Default Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Project-Name: admin Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Role: reader,member,admin Oct 03 10:22:24.727199 n-d-858383-3 devstack@n-api.service[106238]: X-Roles: reader,member,admin Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}] Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant: admin Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-Tenant-Name: admin Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-User: admin Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-User-Domain-Id: default Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-User-Domain-Name: Default Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-User-Id: 80953c3b7cb246f5b8c390e6f23cc89b Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: X-User-Name: admin Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: method: > Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: exception: Flavor 451 could not be found. Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: action_args: {'id': '451'} Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:22:24.729373 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:24.731361 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.732634 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-e7979f63-e887-4709-8fcc-2aec84897518 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:22:24.733738 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-e7979f63-e887-4709-8fcc-2aec84897518 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389191 Oct 03 10:22:24.733738 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 25/49] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 3 10:22:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:22:24.739094 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-eb371d72-e906-48ae-9b20-439e79ed3d07 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:24.753816 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-eb371d72-e906-48ae-9b20-439e79ed3d07 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018370 Oct 03 10:22:24.754345 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 25/50] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 3 10:22:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:22:24.763716 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:24.779468 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019399 Oct 03 10:22:24.780003 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 26/51] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Oct 3 10:22:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:22:24.789301 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ed1b1535-8265-4b98-a417-f093850aec28 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:24.794926 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.wsgi [None req-ed1b1535-8265-4b98-a417-f093850aec28 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ed1b1535-8265-4b98-a417-f093850aec28 admin admin] Request method failure captured: Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: Accept: application/json Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: Accept-Encoding: gzip, deflate Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: Connection: keep-alive Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: Content-Length: 0 Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: Host: 10.222.0.27 Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: Openstack-Api-Version: compute 2.92 Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: Openstack-System-Scope: None Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: User-Agent: python-novaclient Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Auth-Token: gAAAAABjOrfgcM8_V4DDjxkfOXD0BETndzNXWm-tvZ5H5HvkEGNk49rVjt4_gtCnxaGODNjMkZWahNVcK2A-F-hECDl-UpsGCQu1iWo7s6rpNUklbNwZcq-CYSWN0H1V7B59v8pAK-6d-N2vbkWAEUrzIkHturSyd6R-jUfDcRt2e8NwAYi2rFA Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Domain-Id: None Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Domain-Name: None Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Identity-Status: Confirmed Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Is-Admin-Project: True Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Domain-Id: default Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Domain-Name: Default Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Project-Name: admin Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Role: reader,member,admin Oct 03 10:22:24.796413 n-d-858383-3 devstack@n-api.service[106239]: X-Roles: reader,member,admin Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7bc18f83bc5841af84433b08705be9a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7bc18f83bc5841af84433b08705be9a8"}]}] Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant: admin Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant-Id: 7bc18f83bc5841af84433b08705be9a8 Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-Tenant-Name: admin Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-User: admin Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-User-Domain-Id: default Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-User-Domain-Name: Default Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-User-Id: 80953c3b7cb246f5b8c390e6f23cc89b Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: X-User-Name: admin Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: method: > Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: exception: Flavor 451 could not be found. Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: action_args: {'id': '451'} Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:22:24.797950 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:24.798892 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Oct 03 10:22:24.800031 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ed1b1535-8265-4b98-a417-f093850aec28 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:22:24.801085 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-ed1b1535-8265-4b98-a417-f093850aec28 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012108 Oct 03 10:22:24.801085 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 26/52] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 3 10:22:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 10:22:25.999813 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:26.000859 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 03 10:22:26.001257 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:26.522590 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-5a9e800a-1019-4a06-933b-3c62004af27c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:22:26.542656 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-5a9e800a-1019-4a06-933b-3c62004af27c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406481 Oct 03 10:22:26.543199 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 27/54] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 3 10:22:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:22:27.833550 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:27.833550 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Oct 03 10:22:27.834148 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:28.354314 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-8871a96d-4e5c-4c5c-bff1-a5aa6a1f2a4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:22:28.373230 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-8871a96d-4e5c-4c5c-bff1-a5aa6a1f2a4d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400146 Oct 03 10:22:28.373811 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 28/56] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 3 10:22:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:22:29.587495 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:29.588518 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 03 10:22:29.588951 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 29/57] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:30.103775 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-f53afad3-57fa-4b0c-81e2-15c42b067963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:22:30.122837 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-f53afad3-57fa-4b0c-81e2-15c42b067963 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398366 Oct 03 10:22:30.123381 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 29/58] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 3 10:22:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:22:31.348335 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:31.349383 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 03 10:22:31.349806 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 30/59] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:31.871121 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-785d1859-f842-4a30-8e82-e09cbcff9a88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:22:31.889820 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-785d1859-f842-4a30-8e82-e09cbcff9a88 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404705 Oct 03 10:22:31.890373 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 30/60] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Oct 3 10:22:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:22:33.112357 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:33.113408 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 03 10:22:33.113809 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 31/61] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:22:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:22:33.633841 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-6e132c6c-d1b3-42ca-9be4-8db4ae4f6086 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:22:33.654024 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-6e132c6c-d1b3-42ca-9be4-8db4ae4f6086 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403747 Oct 03 10:22:33.654559 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 31/62] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Oct 3 10:22:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:23:30.247181 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:23:30.248220 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-2d8720c1-a90e-41f6-bf6e-3e4486d3ff5f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 03 10:23:30.248634 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 32/63] 10.222.0.27 () {54 vars in 931 bytes} [Mon Oct 3 10:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:23:30.261133 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:23:30.642109 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-f4bd62c8-f3ce-406c-8d03-00e66c0faf5a admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:23:30.662980 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-f4bd62c8-f3ce-406c-8d03-00e66c0faf5a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407279 Oct 03 10:23:30.663523 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 32/64] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:23:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:23:30.684599 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_api:SELECT=14 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:23:30.688455 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-1d69171b-f3f9-4af7-8495-3ab419c500b4 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:23:30.695794 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-1d69171b-f3f9-4af7-8495-3ab419c500b4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012603 Oct 03 10:23:30.696317 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 33/65] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 3 10:23:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:23:30.707630 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-0d53db4a-3ca5-4c05-9f03-c18514731812 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:23:30.715286 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-0d53db4a-3ca5-4c05-9f03-c18514731812 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011161 Oct 03 10:23:30.715792 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 33/66] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 3 10:23:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:23:30.727434 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-395f0847-3d46-4cd1-889a-cb6b68036782 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:23:30.734379 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-395f0847-3d46-4cd1-889a-cb6b68036782 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010990 Oct 03 10:23:30.734887 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 34/67] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Oct 3 10:23:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:23:30.745883 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-9f4f4101-9e63-45e5-8cd4-8eebb39ce6e2 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:23:30.752993 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-9f4f4101-9e63-45e5-8cd4-8eebb39ce6e2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010515 Oct 03 10:23:30.753508 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 34/68] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Oct 3 10:23:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:28:48.992973 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-395f0847-3d46-4cd1-889a-cb6b68036782 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:28:48.994575 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-395f0847-3d46-4cd1-889a-cb6b68036782 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 03 10:28:48.994976 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 35/69] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:28:49.141399 n-d-858383-3 devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:SELECT=6 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:28:49.281567 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:28:49.286356 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:28:49.286822 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:28:49.287251 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:28:49.287947 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:28:49.288386 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:28:49.288821 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:28:49.327828 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-6df457dc-3e0e-4cba-8b86-17f88a0ff4f5 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.187664 Oct 03 10:28:49.328383 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 35/70] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 3 10:28:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:28:50.460307 n-d-858383-3 devstack@n-api.service[106238]: DEBUG nova.api.openstack.wsgi [None req-395f0847-3d46-4cd1-889a-cb6b68036782 admin admin] Calling method '>' {{(pid=106238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:28:50.461363 n-d-858383-3 devstack@n-api.service[106238]: INFO nova.api.openstack.requestlog [None req-395f0847-3d46-4cd1-889a-cb6b68036782 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 03 10:28:50.461822 n-d-858383-3 devstack@n-api.service[106238]: [pid: 106238|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Oct 3 10:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:28:50.677935 n-d-858383-3 devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:28:50.681931 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:28:50.682406 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:28:50.682856 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:28:50.683568 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:28:50.684010 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:28:50.684419 n-d-858383-3 devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:28:50.708587 n-d-858383-3 devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-86083515-9498-409c-9def-44a90e5837ce admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.084636 Oct 03 10:28:50.709190 n-d-858383-3 devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 36/72] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 3 10:28:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:29:35.071293 n-d-858383-3 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 03 10:29:35.072554 n-d-858383-3 devstack@n-api.service[106237]: Mon Oct 3 10:29:35 2022 - graceful shutdown triggered... Oct 03 10:29:35.073076 n-d-858383-3 devstack@n-api.service[106238]: Gracefully killing worker 1 (pid: 106238)... Oct 03 10:29:35.073513 n-d-858383-3 devstack@n-api.service[106239]: Gracefully killing worker 2 (pid: 106239)... Oct 03 10:29:35.209457 n-d-858383-3 devstack@n-api.service[106238]: DEBUG dbcounter [-] [106238] Writing DB stats nova_api:SELECT=4 {{(pid=106238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:29:36.072883 n-d-858383-3 devstack@n-api.service[106237]: worker 1 buried after 1 seconds Oct 03 10:29:36.072883 n-d-858383-3 devstack@n-api.service[106237]: worker 2 buried after 1 seconds Oct 03 10:29:36.072883 n-d-858383-3 devstack@n-api.service[106237]: goodbye to uWSGI. Oct 03 10:29:36.074503 n-d-858383-3 systemd[1]: devstack@n-api.service: Succeeded. Oct 03 10:29:36.075076 n-d-858383-3 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 03 10:29:36.078476 n-d-858383-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 10:29:36.097028 n-d-858383-3 devstack@n-api.service[122259]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 10:29:36 2022] *** Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: nodename: n-d-858383-3 Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: machine: x86_64 Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: clock source: unix Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: pcre jit disabled Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: detected number of CPU cores: 4 Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: current working directory: / Oct 03 10:29:36.115523 n-d-858383-3 devstack@n-api.service[122259]: detected binary path: /usr/bin/uwsgi-core Oct 03 10:29:36.116317 n-d-858383-3 devstack@n-api.service[122259]: your processes number limit is 47680 Oct 03 10:29:36.116317 n-d-858383-3 devstack@n-api.service[122259]: your memory page size is 4096 bytes Oct 03 10:29:36.116317 n-d-858383-3 devstack@n-api.service[122259]: detected max file descriptor number: 2048 Oct 03 10:29:36.116317 n-d-858383-3 devstack@n-api.service[122259]: lock engine: pthread robust mutexes Oct 03 10:29:36.116317 n-d-858383-3 devstack@n-api.service[122259]: thunder lock: enabled Oct 03 10:29:36.116317 n-d-858383-3 devstack@n-api.service[122259]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 10:29:36.116317 n-d-858383-3 devstack@n-api.service[122259]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 10:29:36.157596 n-d-858383-3 devstack@n-api.service[122259]: Python main interpreter initialized at 0x560de507e9c0 Oct 03 10:29:36.157596 n-d-858383-3 devstack@n-api.service[122259]: python threads support enabled Oct 03 10:29:36.157596 n-d-858383-3 devstack@n-api.service[122259]: your server socket listen backlog is limited to 100 connections Oct 03 10:29:36.157596 n-d-858383-3 devstack@n-api.service[122259]: your mercy for graceful operations on workers is 90 seconds Oct 03 10:29:36.158060 n-d-858383-3 devstack@n-api.service[122259]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 10:29:36.158060 n-d-858383-3 devstack@n-api.service[122259]: *** Operational MODE: preforking *** Oct 03 10:29:36.158291 n-d-858383-3 devstack@n-api.service[122259]: *** uWSGI is running in multiple interpreter mode *** Oct 03 10:29:36.158291 n-d-858383-3 devstack@n-api.service[122259]: spawned uWSGI master process (pid: 122259) Oct 03 10:29:36.158497 n-d-858383-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 03 10:29:36.160849 n-d-858383-3 devstack@n-api.service[122259]: spawned uWSGI worker 1 (pid: 122269, cores: 1) Oct 03 10:29:36.160849 n-d-858383-3 devstack@n-api.service[122259]: spawned uWSGI worker 2 (pid: 122270, cores: 1) Oct 03 10:29:36.160849 n-d-858383-3 devstack@n-api.service[122259]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 10:29:36.823358 n-d-858383-3 devstack@n-api.service[122270]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 10:29:36.823962 n-d-858383-3 devstack@n-api.service[122269]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 10:29:37.992933 n-d-858383-3 devstack@n-api.service[122269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:29:37.992933 n-d-858383-3 devstack@n-api.service[122269]: from cryptography.utils import int_from_bytes Oct 03 10:29:37.993670 n-d-858383-3 devstack@n-api.service[122270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:29:37.993670 n-d-858383-3 devstack@n-api.service[122270]: from cryptography.utils import int_from_bytes Oct 03 10:29:37.994092 n-d-858383-3 devstack@n-api.service[122269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:29:37.994092 n-d-858383-3 devstack@n-api.service[122269]: from cryptography.utils import int_from_bytes Oct 03 10:29:37.994251 n-d-858383-3 devstack@n-api.service[122270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 10:29:37.994251 n-d-858383-3 devstack@n-api.service[122270]: from cryptography.utils import int_from_bytes Oct 03 10:29:40.418452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 10:29:40.419642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 10:29:40.420024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 10:29:40.420116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 10:29:40.420207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 10:29:40.420292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 10:29:40.420374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 10:29:40.420471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 10:29:40.420562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 10:29:40.420656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 10:29:40.420748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.420870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.421069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.421179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.421393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.421495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.421716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.421828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.422048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.422151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.422363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.422505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.422685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.422786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.423994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.424343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.424441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.424670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.424879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.425003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.425103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.425324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.425434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.425645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.425746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.425954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.426046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.426280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.426405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.426587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.426738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.427087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.427247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.427532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.427661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.427840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.427968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.428295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.428468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.428468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.428727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.428884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.429026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.429163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.429291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.429427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.429572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.429739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.429895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.430063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.430178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.430375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.430482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.430774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.430877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.431093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.431202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.431408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.431500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.431725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.431827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.432139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.432274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.432466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.432637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.432820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.432983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.433146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.433304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.433456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.433606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.433760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.433930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.434089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.434234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.434377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.434535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.434751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.435407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.435643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.435803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.435947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.436088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.436242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.436393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.436545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.436687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.436871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.437032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.437182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.437334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.437495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.437647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.437806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.437950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.438108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.438267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.438410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.438560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.438703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.438852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.439005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.439165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.439313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.439468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.439612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.439755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.439937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.440084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.440246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.440397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.440542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.440699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.440896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.441055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.441208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.441358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.441500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.441652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.441801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.441953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.442106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.442248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.442390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.442542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.442693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.442835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.442984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.443144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.443293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.443463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.443614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.443758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.443900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.444047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.444197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.444354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.444550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.444707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.444877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.445034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.445202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.445356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.445507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.445670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.445897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.446046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.446204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.446347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.446489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.446638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.446787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.446936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.447092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.447252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.447395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.447544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.447694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.447836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.448036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.448184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.448333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.448477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.448619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.448789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.448957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.449118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.449268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.449418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.449567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.449722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.449865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.450008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.450150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.450299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.450455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.450611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.450754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.450895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.451055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.451205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.451349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.451503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.451654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.451796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.451945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.452097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.452248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.452400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.452553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.452702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.452890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.453060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.453285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.453441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.453593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.453743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.453892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.454034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.454194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.454393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.454551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.454694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.454843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.454985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.455151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.455295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.455448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.455607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.455762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.455929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.456156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.456313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.456461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.456603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.456752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.456938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.457090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.457242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.457392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.457542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.457691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.457853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.458015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.458158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.458300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.458449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.458599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.458754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.458903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.459061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.459203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.459352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.459503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.459655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.459797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.459979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.460126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.460276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.460418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.460574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.460730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.460915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.461069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.461225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.461374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.461529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.461679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.461822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.461964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.462115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.462272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.462415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.462557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.462705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.462853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.463005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.463156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.463298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.463440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.463590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.463732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.463873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.464093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.464253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.464404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.464554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.464704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.464887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 10:29:40.465058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.465202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.465358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.465509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.465658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.465819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.465970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.466137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.466354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.466502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.466653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.466868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.467026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.467177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.467320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.467469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.467612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.467776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.467926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.468069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.468217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.468359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.468514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.468664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.468880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.469042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.469192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.469349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.469501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.469654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.469806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.469957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.470099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.470240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.470388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.470546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.470696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.470857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.471010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.471160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.471302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.471457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.471607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.471757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.471899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.472049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.472192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.472347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.472490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.472641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.472814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.472965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.473137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.473341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.473497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.473668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.473810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.473952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.474103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.474252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.474401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.474550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.474700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.474858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.475945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.476222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.476222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.476582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.476582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.476941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.477086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.477237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.477380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.477522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.477673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.477826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.478009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.478163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.478306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.478479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.478714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.478871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.479013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.479156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.479305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.479449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.479603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.479756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.479899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.480040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.480188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.480373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.480538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.480689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.480880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.481028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.481178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.481329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.481484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.482133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.482133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.482133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.482133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.482133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.482805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.482955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.483098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.483256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.483406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.483563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.483713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.483864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.484007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.484157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.484306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.484463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.484607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.484756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.484948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.485092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.485243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.485401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.485551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.485702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.485851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.485993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.486148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.486291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.486433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.486593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.486812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.486961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.487117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.487269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.487419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.487570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.487728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.487899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.488056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.488209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.488359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.488508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.488657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.488831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.488994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.489155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.489297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.489451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.489606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.489757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.489901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.490049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.490199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.490342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.490483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.490634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.490776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.490920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.491077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.491264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.491415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.491567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.491710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.491858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.492001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.492149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.492292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.492443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.492593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.492742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.492918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.493072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.493231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.493374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.493524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.493667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.493817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.493966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.494122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.494271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.494421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.494563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.494704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.494857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.495009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.495160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.495309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.495451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.495593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.495734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.495982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.496153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.496298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.496441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.496583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.496734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.497019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.497216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.497877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.498030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.498173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.498325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.498476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.498626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.498776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.498918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.499065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.499221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.499364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.499526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.499669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.499810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.499961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.500116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.500259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.500409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.500550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.500698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.500878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.501031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.501173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.501322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.501483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.501634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.501785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.501927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.502074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.502216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.502358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.502500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.502655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.502799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.502940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.503087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.503230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.503381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.503537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.503679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.503819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.503960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.504108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.504313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.504468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.504468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.504813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.504965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.505108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.505282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.505425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.505576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.505719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.505871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.506021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.506171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.506321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.506463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.506613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.506755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.506897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.507141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.507310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.507461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.507611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.507778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.507954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.508192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.508355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.508499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.508648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.508864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.509036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.509189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.509337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.509490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.509633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.509775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.509931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.510073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.510222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.510365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.510506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.510654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.510880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.511028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.511170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.511321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.511480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.511631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.511783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.511933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.512075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.512231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.512381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.512532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.512675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.512878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.513035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.513178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.513320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.513486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.513630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.513782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.513926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.514088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.514283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.514439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.514588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.514730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.514879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.515029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.515172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.515332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.515486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.515636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.515778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.515927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.516079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.516221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.516370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.516513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.516654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.516829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.516996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.517158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.517396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.517545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.517694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.517846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.517998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.518149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.518299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.518448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.518589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.518736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.518887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.519036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.519178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.519337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.519480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.519629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.519784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.519950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.520094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.520237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.520237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.520527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.520527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.520820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.520971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.521123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.521283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.521436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.521585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.521737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.521879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.522021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.522170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.522322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.522464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.522613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.522613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.522890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.523034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.523195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.523344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.523494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.523636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.523778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.523931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.524073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.524222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.524371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.524521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.524970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.525130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.525292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.525435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.525584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.525736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.525887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.526038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.526187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.526337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.526480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.526630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.526779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.526930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.527080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.527240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.527401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.527647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.527896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.528047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.528191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.528368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.528570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.528724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.528907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.529052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.529202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.529354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.529531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.529691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.529843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.530036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.530181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.530330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.530473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.530622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.530780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.530940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.531105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.531255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.531449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.531602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.531762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.531913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.532071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.532221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.532370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.532527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.532686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.532896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.533051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.533200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.533350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.533509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.533672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.533823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.533974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.534124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.534273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.534422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.534581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.534739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.534890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.535039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.535197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.535361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.535530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.535688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.535838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.535988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.536146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.536310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.536461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.536617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.536863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.537023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.537174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.537408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.537561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.537825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.537982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.538142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.538295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.538454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.538605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.538755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.538913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.539071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.539250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.539431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.539584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.539745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.539895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.540044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.540208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.540359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.540509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.540665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.540843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.541011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.541175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.541334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.541484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.541643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.541813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.541971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.542131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.542283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.542432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.542582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.542731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.542890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.543048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.543198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.543357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.543507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.543664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.543838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.544527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.544700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.544887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.545051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.545211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.545442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.545604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.545755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.545912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.546063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.546220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.546384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.546548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.546706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.546864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.547022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.547190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.547341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.547493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.547657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.547834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.548061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.548232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.548395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.548566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.548717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.548907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.549060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.549225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.549383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.549541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.549693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.549843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.549993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.550153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.550303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.550452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.550617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.550768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.550926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.551944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.552984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.553946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.554844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.555056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.555234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.555396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.555554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.555705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.555862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.556020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.556184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.556341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.556491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.556651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.556830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.556997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.557157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.557307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.557463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.557613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.557762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.557911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.558091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.558324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.558480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.558629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.558789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.558945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.559105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.559263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.559421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.559577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.560325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.560501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.560660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.560834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.560991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.561153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.561312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.561482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.561640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.561799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.561957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.562107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.562258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.562422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.562581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.562732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.562895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.563077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.563229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.563387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.563549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.563699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.563850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.564058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.564220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.564382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.564539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.564696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.564891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.565043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.565205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.565364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.565522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.565690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.565841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.565990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.566154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.566323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.566494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.566645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.566794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.566945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.567104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.567263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.567415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.567575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.567725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.567903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.568562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.568729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.568910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.569062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.569223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.569383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.569537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.569687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.569844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.570003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.570165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.570340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.570499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.570651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.570800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.570949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.571099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.571258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.571416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.571566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.571723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.571874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.572037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.572198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.572356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.572508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.572662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.572831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.573000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.573151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.573301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.573458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.573609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.573759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.573995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.574156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.574317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.574468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.574617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.574767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.574930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.575081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.575261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.575418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.575568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.575724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.575884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.576042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.576207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.576366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.576523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.576687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.576874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.577028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.577178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.577335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.577485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.577644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.577795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.577952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.578103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.578262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.578419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.578600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.579411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.579568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.579728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.579886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.580047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.580205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.580359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.580509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.580659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.580892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.581059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.581210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.581375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.581541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.581700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.581858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.582008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.582167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.582324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.582484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.582634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.582791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.582958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.583115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.583265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.583424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.583574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.583724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.583873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.584023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.584180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.584344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.584501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.584665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.584841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.585007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.585159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.585325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.585484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.585635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.585783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.585941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.586104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.586267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.586520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.586686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.586838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.587009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.587171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.587337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.587494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.587645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.587794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.587951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.588121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.588280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.588431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.588582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.588739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.589046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.589256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.589412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.589577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.589729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.589887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.590058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.590217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.590380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.590532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.590691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.591367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.591570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.591570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.591880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.592039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.592198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.592349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.592512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.592665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.592844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.593011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.593171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.593329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.593493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.593645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.593813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.593964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.594129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.594129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.594430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.594580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.594738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.594896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.595056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.595216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.595375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.595526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.595684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.595852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.596003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.596162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.596313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.596470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.596621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.596790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.596960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.597193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.597346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.597503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.597654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.597811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.597982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.598140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.598306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.598465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.598616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.598766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.598926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.599174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.599338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.599496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.599647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.599804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.599978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.599978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.600291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.600452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.600603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.600752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.600950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.601102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.601253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.601410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.601560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.601724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.601875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.602048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.602207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.602357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.602514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.602678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.602836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.602986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.603136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.603286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.603444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.603609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.603760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.603917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.604078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.604237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.604386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.604549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.604699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.604873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.605024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.605185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.605349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.605499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.605657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.605806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.605962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.606123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.606282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.606433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.607148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.607313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.607464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.607613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.607773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.607931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.608082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.608241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.608400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.608559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.608723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.608940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.609094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.609332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.609502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.609668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.609818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.609967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.610124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.610292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.610455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.610614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.610774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.610989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.611144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.611144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.611440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.611440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.611740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.611897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.612055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.612213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.612371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.612540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.612691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.612882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.613035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.613185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.613346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.613497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.613649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.613797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.613954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.614104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.633535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.633699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.633819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.633880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.633933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.634919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.635021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.635093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.635164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.635220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.635273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.635527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.636040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.637080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.637794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.637932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.638070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.638758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.638925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.639958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.640948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.641949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.642888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.643027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.643248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.643450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.643624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.644707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.644707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.645318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.646622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.646622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.647839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.648156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.648325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.648555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.648750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.650822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.651860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.652989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.653086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.653171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.653256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.653334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.653939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.654911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.655999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.656932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.657998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.658552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.659607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.660912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.661973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.662973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.663967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.664473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.665943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.666981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.667951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.668948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.669183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.669761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.669835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.669904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.669972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.670956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.671033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.671270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.671356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.671631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.671750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.671963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.672065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.672283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.672362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.672598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.672674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.672959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.673043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.673278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.673357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.673601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.673745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.673909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.674067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.674218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.674385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.674530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.674703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.674831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.675018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.675142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.675354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.675454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.675685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.675772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.676000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.676078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.676330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.676409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.676655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.676750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.677003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.677082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.677327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.677406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.677644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.677736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.677968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.678046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.678283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.678359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.678598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.678686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.678912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.678991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.679226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.679306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.679540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.679625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.679857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.679935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.680168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.680245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.680481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.680561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.680820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.680902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.681142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.681221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.681459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.681540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.681801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.681887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.682113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.682201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.682442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.682520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.682778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.682885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.683089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.683213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.683420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.683520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.683755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.683841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.684076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.684173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.684399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.684483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.684741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.684850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.685077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.685160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.685322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 10:29:40.685419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.685708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.686027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.686344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.686686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.686982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.687298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.687614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.687938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.688259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.688594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.688954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.689279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.689613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.689946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.690303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.690622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.690973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.691312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.691634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.692008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.692262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 10:29:40.692509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 10:29:40.747382 n-d-858383-3 devstack@n-api.service[122270]: INFO dbcounter [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Registered counter for database nova_api Oct 03 10:29:40.760364 n-d-858383-3 devstack@n-api.service[122269]: INFO dbcounter [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Registered counter for database nova_api Oct 03 10:29:40.767953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_db.sqlalchemy.engines [None req-18af2d80-933e-4dde-8150-55343c402706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:40.774597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writer thread running {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:40.781367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:40.788078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writer thread running {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:40.833544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.context [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=122270) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 10:29:40.837601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:29:40.838074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:29:40.839647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:29:40.840382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:29:40.841389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:29:40.843538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:29:40.845462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.context [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=122269) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 10:29:40.845615 n-d-858383-3 devstack@n-api.service[122270]: INFO dbcounter [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Registered counter for database nova_cell0 Oct 03 10:29:40.849538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:29:40.849801 n-d-858383-3 devstack@n-api.service[122270]: INFO dbcounter [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Registered counter for database nova_cell1 Oct 03 10:29:40.850024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:29:40.851610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:29:40.852354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:29:40.852889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:29:40.854867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:29:40.857561 n-d-858383-3 devstack@n-api.service[122269]: INFO dbcounter [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Registered counter for database nova_cell0 Oct 03 10:29:40.857751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_db.sqlalchemy.engines [None req-18af2d80-933e-4dde-8150-55343c402706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:40.859467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_db.sqlalchemy.engines [None req-18af2d80-933e-4dde-8150-55343c402706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:40.861746 n-d-858383-3 devstack@n-api.service[122269]: INFO dbcounter [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Registered counter for database nova_cell1 Oct 03 10:29:40.865493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writer thread running {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:40.867826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writer thread running {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:40.869421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:40.871145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:40.878250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writer thread running {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:40.880554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writer thread running {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:41.016969 n-d-858383-3 devstack@n-api.service[122270]: INFO dbcounter [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Registered counter for database nova_cell0 Oct 03 10:29:41.023950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_db.sqlalchemy.engines [None req-18af2d80-933e-4dde-8150-55343c402706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:41.029652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writer thread running {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:41.034280 n-d-858383-3 devstack@n-api.service[122269]: INFO dbcounter [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Registered counter for database nova_cell0 Oct 03 10:29:41.041461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 10:29:41.046726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writer thread running {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 10:29:41.352794 n-d-858383-3 devstack@n-api.service[122270]: WARNING keystonemiddleware.auth_token [None req-18af2d80-933e-4dde-8150-55343c402706 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:29:41.360149 n-d-858383-3 devstack@n-api.service[122270]: WARNING keystonemiddleware.auth_token [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:29:41.370484 n-d-858383-3 devstack@n-api.service[122269]: WARNING keystonemiddleware.auth_token [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:29:41.379576 n-d-858383-3 devstack@n-api.service[122269]: WARNING keystonemiddleware.auth_token [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:29:41.703765 n-d-858383-3 devstack@n-api.service[122270]: WARNING keystonemiddleware.auth_token [None req-18af2d80-933e-4dde-8150-55343c402706 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:29:41.709703 n-d-858383-3 devstack@n-api.service[122270]: WARNING keystonemiddleware.auth_token [None req-18af2d80-933e-4dde-8150-55343c402706 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:29:41.714999 n-d-858383-3 devstack@n-api.service[122270]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560de507e9c0 pid: 122270 (default app) Oct 03 10:29:41.727824 n-d-858383-3 devstack@n-api.service[122269]: WARNING keystonemiddleware.auth_token [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 10:29:41.734415 n-d-858383-3 devstack@n-api.service[122269]: WARNING keystonemiddleware.auth_token [None req-9ad37538-af09-4f5b-bb85-c60cda0e72bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 10:29:41.739652 n-d-858383-3 devstack@n-api.service[122269]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560de507e9c0 pid: 122269 (default app) Oct 03 10:30:22.881567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:22.882687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:22.883473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:22.884411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:23.131097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:23.132532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:23.133818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:23.134765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:24.483465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1427708486", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:24.521473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-071d0c02-8a43-40ef-85cd-a73ab2544792 tempest-AZAdminNegativeTestJSON-1121253478 tempest-AZAdminNegativeTestJSON-1121253478-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:24.523222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-071d0c02-8a43-40ef-85cd-a73ab2544792 tempest-AZAdminNegativeTestJSON-1121253478 tempest-AZAdminNegativeTestJSON-1121253478-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '0952dd76037144e99012855bad716091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1691590f144565b2df12d234bd5556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-071d0c02-8a43-40ef-85cd-a73ab2544792 tempest-AZAdminNegativeTestJSON-1121253478 tempest-AZAdminNegativeTestJSON-1121253478-project] Request method failure captured: Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm8KyRp6ereUoMqBd8lIZvsBf0FmwM07l-R8AyQQ1IHeJyaOrPrTIcWzD8mkmxxYSnojoshP2EZk6sqEqL4Z-aQ4rRaysZAnLr5FRZ8Kvck-XeJCSSnNz2-4a8MARAAbxbUiz_05BTrXhKQocMEUA048DMeYciXl1-qTkYdFDE13FQ Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: da1691590f144565b2df12d234bd5556 Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1121253478 Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:30:24.527970 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da1691590f144565b2df12d234bd5556"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_da1691590f144565b2df12d234bd5556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/da1691590f144565b2df12d234bd5556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/da1691590f144565b2df12d234bd5556"}]}] Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AZAdminNegativeTestJSON-1121253478 Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: da1691590f144565b2df12d234bd5556 Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1121253478 Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AZAdminNegativeTestJSON-1121253478-project Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0952dd76037144e99012855bad716091 Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AZAdminNegativeTestJSON-1121253478-project Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 03 10:30:24.529529 n-d-858383-3 devstack@n-api.service[122269]: action_args: {} Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:24.530293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:24.531461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-071d0c02-8a43-40ef-85cd-a73ab2544792 tempest-AZAdminNegativeTestJSON-1121253478 tempest-AZAdminNegativeTestJSON-1121253478-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:24.532916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-071d0c02-8a43-40ef-85cd-a73ab2544792 tempest-AZAdminNegativeTestJSON-1121253478 tempest-AZAdminNegativeTestJSON-1121253478-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.406956 Oct 03 10:30:24.538941 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 3 10:30:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:24.730203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:24.735910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:24.736389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:24.736858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:24.737715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:24.738165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:24.738699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:24.784411 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-963d973b-a366-4d11-b0bc-efce7debc817 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.244093 Oct 03 10:30:24.785008 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2/2] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:30:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:25.008584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '.version_select at 0x7f0754ca7790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:25.015142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=122269) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 03 10:30:25.015859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:25.016327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:25.016907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:25.044982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:25.046025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:25.046567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:25.060527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:25.061079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:25.061518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:25.069335 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-db3515eb-16ef-42a1-8b00-6128264eb130 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.282833 Oct 03 10:30:25.070223 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3/3] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 3 10:30:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:25.206268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:30:25.248395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-698a794a-2253-438a-9c26-65f133c2b1ec tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-434469189", "ram": 512, "vcpus": 1, "disk": 10, "id": 1558927623, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:25.302643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-698a794a-2253-438a-9c26-65f133c2b1ec tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.231329 Oct 03 10:30:25.303339 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4/4] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:30:25 2022] POST /compute/v2.1/flavors => generated 415 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:25.304516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-698a794a-2253-438a-9c26-65f133c2b1ec tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:25.305582 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-698a794a-2253-438a-9c26-65f133c2b1ec tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001325 Oct 03 10:30:25.306363 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 5/5] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 3 10:30:25 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 03 10:30:25.548282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:30:25.549293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:30:25.550396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:30:25.550814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:30:25.551242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:30:25.565754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1752199479", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:25.569552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:25.570307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:25.570941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:25.571868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:25.572609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:25.573290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:25.614915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Getting quotas for project beb07b94d361455dad13c0e485e909c7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:30:25.627797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Getting quotas for user d19314a1cae1478eb870e7f7da5d0760 and project beb07b94d361455dad13c0e485e909c7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:30:25.654948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:30:25.657834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:30:25.743319 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-036ca149-6695-4d56-a036-1dc1af96ab3d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.867280 Oct 03 10:30:25.744209 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1/6] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:30:25.750030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a93dcf1a-13e8-481c-a25b-9ff5da38f59b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2026509253"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:25.753865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-a93dcf1a-13e8-481c-a25b-9ff5da38f59b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid da38d145-8048-4dfa-b263-79f98af05c9d for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:25.830608 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a93dcf1a-13e8-481c-a25b-9ff5da38f59b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084984 Oct 03 10:30:25.837641 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2/7] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:26.287394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15775aad-21a2-4cfd-a685-048e646f7f29 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:26.302331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-15775aad-21a2-4cfd-a685-048e646f7f29 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] HTTP exception thrown: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15775aad-21a2-4cfd-a685-048e646f7f29 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Request method failure captured: Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/flavors/1558927623/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm9LC4WPP0A-9zTrlMtpP5nAONCoFZ0NBfnVJKTwvUNhyVoqBrr0o4dNFqUtzSwhJCDMSdgtqqjOuncmWSPl-ZlVMzSd0lxxfs2BImvarIsiaVmB-P-VwoHiIGAL3MHfTrHwviPylCJJT93nZdJYIUQRQwg32yzYq_JotsohIXeTyg Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:30:26.312081 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}] Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 8b30b95b768e41fba04d6a34925d74f0 Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:26.313420 n-d-858383-3 devstack@n-api.service[122270]: exception: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'flavor_id': '1558927623', 'id': 'hw:cpu_thread_policy'} Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:26.314107 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15775aad-21a2-4cfd-a685-048e646f7f29 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Returning 404 to user: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-15775aad-21a2-4cfd-a685-048e646f7f29 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] 10.222.0.27 "GET /compute/v2.1/flavors/1558927623/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.475179 Oct 03 10:30:26.319725 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3/8] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 10:30:25 2022] GET /compute/v2.1/flavors/1558927623/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 476 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:26.327863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c06d560-dc65-4cdc-97c8-85fc8e46dd20 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:26.328500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c06d560-dc65-4cdc-97c8-85fc8e46dd20 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:26.508705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:30:26.645652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c06d560-dc65-4cdc-97c8-85fc8e46dd20 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:26.667530 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c06d560-dc65-4cdc-97c8-85fc8e46dd20 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1219 microversion: 2.1 time: 0.352026 Oct 03 10:30:26.673675 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 4/9] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:26 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1219 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:26.699741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acf6c89e-e1da-4897-9191-0ce09a9f73d8 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:26.741192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acf6c89e-e1da-4897-9191-0ce09a9f73d8 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:26.742171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acf6c89e-e1da-4897-9191-0ce09a9f73d8 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:26.744867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acf6c89e-e1da-4897-9191-0ce09a9f73d8 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:27.125160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:30:27.125779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:30:27.126447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:30:27.127365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:30:27.128083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:30:27.158586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:27.161079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:27.161580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:27.162422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:27.165235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:27.165749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:27.241089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Getting quotas for project 577957f991214f90b168e2854037028d. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:30:27.260344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Getting quotas for user f86ff2883585463e8a3994e14ec3d5c5 and project 577957f991214f90b168e2854037028d. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:30:27.289473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:30:27.292936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:30:27.430557 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-268eaa8c-0b5f-4f3d-86aa-d44aca819e32 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.122920 Oct 03 10:30:27.433546 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 6/10] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:30:27.439703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7bf22a93-1fdf-4e8b-8b9b-ccf2e75fce88 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:27.448209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7bf22a93-1fdf-4e8b-8b9b-ccf2e75fce88 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8b30b95b768e41fba04d6a34925d74f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f97959395423b9b33f46e236b4fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7bf22a93-1fdf-4e8b-8b9b-ccf2e75fce88 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Request method failure captured: Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/flavors/1558927623/os-extra_specs HTTP/1.1 Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 66 Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm9LC4WPP0A-9zTrlMtpP5nAONCoFZ0NBfnVJKTwvUNhyVoqBrr0o4dNFqUtzSwhJCDMSdgtqqjOuncmWSPl-ZlVMzSd0lxxfs2BImvarIsiaVmB-P-VwoHiIGAL3MHfTrHwviPylCJJT93nZdJYIUQRQwg32yzYq_JotsohIXeTyg Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:30:27.452190 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}] Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8b30b95b768e41fba04d6a34925d74f0 Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 03 10:30:27.453276 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'flavor_id': '1558927623', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:27.453990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 03 10:30:27.454876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.463786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7bf22a93-1fdf-4e8b-8b9b-ccf2e75fce88 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:27.470896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7bf22a93-1fdf-4e8b-8b9b-ccf2e75fce88 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] 10.222.0.27 "POST /compute/v2.1/flavors/1558927623/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.033650 Oct 03 10:30:27.472032 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 7/11] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 3 10:30:27 2022] POST /compute/v2.1/flavors/1558927623/os-extra_specs => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:27.477501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-69339b7d-3644-4fa9-bd41-f2720d54f9c0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:27.478280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-69339b7d-3644-4fa9-bd41-f2720d54f9c0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:27.507234 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-acf6c89e-e1da-4897-9191-0ce09a9f73d8 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.831284 Oct 03 10:30:27.507982 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 5/12] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:30:26 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:27.525662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55b9a7f2-3bbf-40fd-a71f-3625bf7a76e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:27.625242 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55b9a7f2-3bbf-40fd-a71f-3625bf7a76e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1558927623/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.109087 Oct 03 10:30:27.626773 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 6/13] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 3 10:30:27 2022] POST /compute/v2.1/flavors/1558927623/os-extra_specs => generated 66 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:30:27.633051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:27.649430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:27.650858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:27.661737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:27.666454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69339b7d-3644-4fa9-bd41-f2720d54f9c0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:27.703294 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-858383-3. Oct 03 10:30:27.713579 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-69339b7d-3644-4fa9-bd41-f2720d54f9c0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1220 microversion: 2.1 time: 0.240271 Oct 03 10:30:27.714244 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 8/14] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:27 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1220 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 39 Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:27.722804 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: {"add_host": {"host": "n-h2-858383-3"}} Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:27.724049 n-d-858383-3 devstack@n-api.service[122270]: exception: Aggregate 1 already has host n-h2-858383-3. Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-858383-3'}}} Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result.read() Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 10:30:27.724702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858383-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi session.flush() Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 10:30:27.725668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 10:30:27.726581 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 10:30:27.729202 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result.read() Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858383-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 3, 10, 30, 27, 684643), 'updated_at': None, 'host': 'n-h2-858383-3', 'aggregate_id': 1}] Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.731063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6651, in add_host_to_aggregate Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-858383-3. Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.732328 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-858383-3. Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:27.736849 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:27.739636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-858383-3. Oct 03 10:30:27.739636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d749f25-8472-4f6f-80ed-d1a99625f5cf tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d749f25-8472-4f6f-80ed-d1a99625f5cf tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8b30b95b768e41fba04d6a34925d74f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f97959395423b9b33f46e236b4fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d749f25-8472-4f6f-80ed-d1a99625f5cf tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Request method failure captured: Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:30:27.740460 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm9LC4WPP0A-9zTrlMtpP5nAONCoFZ0NBfnVJKTwvUNhyVoqBrr0o4dNFqUtzSwhJCDMSdgtqqjOuncmWSPl-ZlVMzSd0lxxfs2BImvarIsiaVmB-P-VwoHiIGAL3MHfTrHwviPylCJJT93nZdJYIUQRQwg32yzYq_JotsohIXeTyg Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}] Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:27.741624 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8b30b95b768e41fba04d6a34925d74f0 Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'flavor_id': '1558927623', 'id': 'hw:numa_nodes'} Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:27.742844 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:27.744531 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:27.745603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 03 10:30:27.745603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:27.745603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d749f25-8472-4f6f-80ed-d1a99625f5cf tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:27.745770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-858383-3. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:27.745770 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7306b87e-2900-414f-a14a-21ca4f6c82a1 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.107633 Oct 03 10:30:27.745770 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 7/15] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:30:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 03 10:30:27.750083 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d749f25-8472-4f6f-80ed-d1a99625f5cf tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009203 Oct 03 10:30:27.750706 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:30:27 2022] DELETE /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:27.757363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:27.758233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:27.759948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22302ee1-14d4-4cff-8e48-162af6cff711 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:27.765283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:27.766769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:27.767505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:27.768365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:27.772986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:27.773727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:27.825157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22302ee1-14d4-4cff-8e48-162af6cff711 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:27.850703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22302ee1-14d4-4cff-8e48-162af6cff711 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:27.851459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22302ee1-14d4-4cff-8e48-162af6cff711 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:28.026487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:28.057819 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9354c9f7-1dab-45ca-a0bc-5a64d8cbf93d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1223 microversion: 2.1 time: 0.313666 Oct 03 10:30:28.059556 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 8/17] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:27 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1223 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:28.076096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dd8c818a-3918-4dd8-9979-5c0b0a27224c tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:28.132322 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dd8c818a-3918-4dd8-9979-5c0b0a27224c tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1558927623/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069811 Oct 03 10:30:28.139788 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 9/18] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 3 10:30:28 2022] POST /compute/v2.1/flavors/1558927623/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:30:28.163679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13b65f3c-07c5-4d41-9a5b-6fb67029af30 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:28.177268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13b65f3c-07c5-4d41-9a5b-6fb67029af30 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8b30b95b768e41fba04d6a34925d74f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f97959395423b9b33f46e236b4fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13b65f3c-07c5-4d41-9a5b-6fb67029af30 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Request method failure captured: Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 22 Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm9LC4WPP0A-9zTrlMtpP5nAONCoFZ0NBfnVJKTwvUNhyVoqBrr0o4dNFqUtzSwhJCDMSdgtqqjOuncmWSPl-ZlVMzSd0lxxfs2BImvarIsiaVmB-P-VwoHiIGAL3MHfTrHwviPylCJJT93nZdJYIUQRQwg32yzYq_JotsohIXeTyg Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:30:28.183969 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a2f97959395423b9b33f46e236b4fb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a2f97959395423b9b33f46e236b4fb4"}]}] Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 5a2f97959395423b9b33f46e236b4fb4 Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 8b30b95b768e41fba04d6a34925d74f0 Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: {"hw:numa_nodes": "1"} Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:28.185389 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'flavor_id': '1558927623', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:28.186631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 03 10:30:28.187536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.188439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13b65f3c-07c5-4d41-9a5b-6fb67029af30 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:28.188439 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13b65f3c-07c5-4d41-9a5b-6fb67029af30 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775 tempest-FlavorsExtraSpecsNegativeTestJSON-251304775-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.043385 Oct 03 10:30:28.197620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 10/19] 10.222.0.27 () {60 vars in 1265 bytes} [Mon Oct 3 10:30:28 2022] PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes => generated 124 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:28.217401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4df190ad-cfa3-4dad-9d93-f2c5129b5f6e tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:28.236302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4df190ad-cfa3-4dad-9d93-f2c5129b5f6e tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] HTTP exception thrown: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4df190ad-cfa3-4dad-9d93-f2c5129b5f6e tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Request method failure captured: Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/flavors/1558927623/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_0EPxXaXtYfUpIxNvdAVxDCJLjaw1GmgAYZ_2NOBU7R2MmFOwViAPrWaFaqoG7OftSbvfYW1sKNt6geYbAxYWWScvXcDT1EdMHIgoqvqz3LG9IwdCt6O2oPJgEjISB2H6F5E5815Hu-AnFGcTA2czvo9Tt-B2v2qK1Ldwehp92p0 Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 42f8007fecca4f208481e280bb86b053 Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:28.241313 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42f8007fecca4f208481e280bb86b053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42f8007fecca4f208481e280bb86b053"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42f8007fecca4f208481e280bb86b053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42f8007fecca4f208481e280bb86b053"}]}] Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 42f8007fecca4f208481e280bb86b053 Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a02bd37f0f5147b2ad7a58e822d520c7 Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:28.242441 n-d-858383-3 devstack@n-api.service[122270]: exception: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'flavor_id': '1558927623', 'id': 'hw:cpu_thread_policy'} Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:28.242996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.244058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4df190ad-cfa3-4dad-9d93-f2c5129b5f6e tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Returning 404 to user: Flavor 1558927623 has no extra specs with key hw:cpu_thread_policy. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:28.244461 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4df190ad-cfa3-4dad-9d93-f2c5129b5f6e tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1558927623/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.040685 Oct 03 10:30:28.247975 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 11/20] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:30:28 2022] DELETE /compute/v2.1/flavors/1558927623/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:28.260416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b55b4536-240d-4aaa-a6a9-ebaf221c7657 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:28.277881 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b55b4536-240d-4aaa-a6a9-ebaf221c7657 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b55b4536-240d-4aaa-a6a9-ebaf221c7657 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Request method failure captured: Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 27 Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_0EPxXaXtYfUpIxNvdAVxDCJLjaw1GmgAYZ_2NOBU7R2MmFOwViAPrWaFaqoG7OftSbvfYW1sKNt6geYbAxYWWScvXcDT1EdMHIgoqvqz3LG9IwdCt6O2oPJgEjISB2H6F5E5815Hu-AnFGcTA2czvo9Tt-B2v2qK1Ldwehp92p0 Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 42f8007fecca4f208481e280bb86b053 Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:28.282082 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42f8007fecca4f208481e280bb86b053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42f8007fecca4f208481e280bb86b053"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42f8007fecca4f208481e280bb86b053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42f8007fecca4f208481e280bb86b053"}]}] Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 42f8007fecca4f208481e280bb86b053 Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a02bd37f0f5147b2ad7a58e822d520c7 Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: {"hw:cpu_policy": "shared"} Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:28.283602 n-d-858383-3 devstack@n-api.service[122270]: exception: Request body and URI mismatch Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'flavor_id': '1558927623', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.284383 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.286867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:28.286867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:28.286867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 03 10:30:28.286867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.286867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b55b4536-240d-4aaa-a6a9-ebaf221c7657 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:28.287326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b55b4536-240d-4aaa-a6a9-ebaf221c7657 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.032115 Oct 03 10:30:28.289737 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 12/21] 10.222.0.27 () {60 vars in 1265 bytes} [Mon Oct 3 10:30:28 2022] PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes => generated 73 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 03 10:30:28.303561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32e6aa20-68bf-43a9-8247-7212659c8570 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32e6aa20-68bf-43a9-8247-7212659c8570 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Request method failure captured: Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 49 Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_0EPxXaXtYfUpIxNvdAVxDCJLjaw1GmgAYZ_2NOBU7R2MmFOwViAPrWaFaqoG7OftSbvfYW1sKNt6geYbAxYWWScvXcDT1EdMHIgoqvqz3LG9IwdCt6O2oPJgEjISB2H6F5E5815Hu-AnFGcTA2czvo9Tt-B2v2qK1Ldwehp92p0 Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 42f8007fecca4f208481e280bb86b053 Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:28.312896 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42f8007fecca4f208481e280bb86b053"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42f8007fecca4f208481e280bb86b053"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42f8007fecca4f208481e280bb86b053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42f8007fecca4f208481e280bb86b053"}]}] Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 42f8007fecca4f208481e280bb86b053 Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a02bd37f0f5147b2ad7a58e822d520c7 Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 03 10:30:28.314385 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'flavor_id': '1558927623', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance: Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 03 10:30:28.315129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.316221 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32e6aa20-68bf-43a9-8247-7212659c8570 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-32e6aa20-68bf-43a9-8247-7212659c8570 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019413 Oct 03 10:30:28.317230 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 13/22] 10.222.0.27 () {60 vars in 1265 bytes} [Mon Oct 3 10:30:28 2022] PUT /compute/v2.1/flavors/1558927623/os-extra_specs/hw:numa_nodes => generated 117 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:30:28.324265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0e0619d-892e-424b-884d-983beb2cf7b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:28.386560 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0e0619d-892e-424b-884d-983beb2cf7b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1558927623" status: 202 len: 0 microversion: 2.1 time: 0.065385 Oct 03 10:30:28.390341 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 14/23] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:30:28 2022] DELETE /compute/v2.1/flavors/1558927623 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:30:28.411530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a070fac-da46-44bf-9f96-878e544e27f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:28.464408 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a070fac-da46-44bf-9f96-878e544e27f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674 tempest-FlavorsExtraSpecsNegativeTestJSON-1999410674-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071599 Oct 03 10:30:28.466531 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 15/24] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:30:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:28.740060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cd203f2-6402-4465-9acc-5b506557124b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:28.741184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6cd203f2-6402-4465-9acc-5b506557124b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:28.846137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cd203f2-6402-4465-9acc-5b506557124b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:28.853994 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cd203f2-6402-4465-9acc-5b506557124b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1220 microversion: 2.1 time: 0.118528 Oct 03 10:30:28.854579 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 16/25] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:28 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:28.909477 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22302ee1-14d4-4cff-8e48-162af6cff711 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.157395 Oct 03 10:30:28.914343 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 10/26] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:30:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:28.923384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63862345-2802-4fb0-96ce-0a01a88444fc tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:28.971562 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63862345-2802-4fb0-96ce-0a01a88444fc tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.053243 Oct 03 10:30:28.972152 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 17/27] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:28 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:30:28.984513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0369ce0-6ce5-483c-aca3-9eed13057196 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1054430536"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:28.988616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-f0369ce0-6ce5-483c-aca3-9eed13057196 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid 5a5121e1-3d49-4bc2-8b38-308219b39ebf for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:29.049456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c98f0f4e-7955-4d3e-96ea-7c4605b2fee9 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2124596347", "name": "tempest-test_aggregate-1742299058"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:29.072367 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0369ce0-6ce5-483c-aca3-9eed13057196 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093343 Oct 03 10:30:29.076725 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 11/28] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:30:29.100069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:29.100874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:29.132281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:29.133723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:29.134194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:29.134938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:29.135398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:29.135818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:29.137767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-c98f0f4e-7955-4d3e-96ea-7c4605b2fee9 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid 09c1664a-05f5-4c29-9df3-b990bb199c16 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:29.200165 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c98f0f4e-7955-4d3e-96ea-7c4605b2fee9 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.155312 Oct 03 10:30:29.203886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 18/29] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 3 10:30:29 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:30:29.669829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:29.688621 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-026ee656-9a40-491e-85fa-22ef307aa7e0 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1289 microversion: 2.1 time: 0.607184 Oct 03 10:30:29.707766 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 12/30] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:29 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1289 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:29.715950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5be4708-10ab-4de7-b802-432164306c9b tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:29.744438 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5be4708-10ab-4de7-b802-432164306c9b tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.035032 Oct 03 10:30:29.752078 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 13/31] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:30:29 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:29.762194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e72d9998-b66a-4216-a3c5-87fb8cb913a6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:29.780903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e12de820-f6a9-40d8-a1ec-3f79752cf883 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:29.784698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e12de820-f6a9-40d8-a1ec-3f79752cf883 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'de4ad4b38a3f4e3aa1b2ce4502066431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3084ef7da12432e80c8bc7b8b7349c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:29.789317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e72d9998-b66a-4216-a3c5-87fb8cb913a6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:29.791214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e72d9998-b66a-4216-a3c5-87fb8cb913a6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:29.791853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e72d9998-b66a-4216-a3c5-87fb8cb913a6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e12de820-f6a9-40d8-a1ec-3f79752cf883 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Request method failure captured: Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 39 Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm8zb64UcMHs8Oo-LWC_uvJCYBWMLRXH0fHCasy2UY8iV_smlafC7Ux-rvGxhTg6sdNv3H_N6Ch-LsD64BE5fw1Dr09un1cLgO0847arGW5OS9ukGBhEmoj-bO8iV2P_uMR-EiwgxqE3i9ouU2uYaFXzjTOSZKVEXWinKyBwLZ-t3A Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:30:29.793448 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}] Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: de4ad4b38a3f4e3aa1b2ce4502066431 Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: {"add_host": {"host": "n-h2-858383-3"}} Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:29.794839 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-858383-3'}}} Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:29.796270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 03 10:30:29.797530 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:29.803225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e12de820-f6a9-40d8-a1ec-3f79752cf883 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:29.805122 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e12de820-f6a9-40d8-a1ec-3f79752cf883 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.600046 Oct 03 10:30:29.811256 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 19/32] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:30:29 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 606 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:29.830562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5d3fd26c-9b23-44a1-9aa1-2c65ca2155b5 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:29.891415 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5d3fd26c-9b23-44a1-9aa1-2c65ca2155b5 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.073762 Oct 03 10:30:29.895357 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 20/33] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:29 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:30:29.906941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:29.909806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:29.913893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:29.930304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:29.930814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:29.932998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:29.934860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:29.935469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:29.936956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:30.122715 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e72d9998-b66a-4216-a3c5-87fb8cb913a6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.365591 Oct 03 10:30:30.127435 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 14/34] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:30:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:30.152231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7596c553-d281-4018-be3e-c02d84a0d3cc tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-438726978"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.160447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-7596c553-d281-4018-be3e-c02d84a0d3cc tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid 7eb69a61-da5d-4875-b95a-6c7bef1eeb4a for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:30.261539 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7596c553-d281-4018-be3e-c02d84a0d3cc tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.118181 Oct 03 10:30:30.288026 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 15/35] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:30.294691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:30.310384 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-324f8c02-c305-425a-b7cd-6a6c8bae5af9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1272 microversion: 2.1 time: 0.411877 Oct 03 10:30:30.316967 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 21/36] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:29 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1272 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:30.321722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-900048093"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.355305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:30.359305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:30.361779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:30.387011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:30.387852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:30.391616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:30.417089 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-900048093 could not be found. Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 57 Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:30:30.424003 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: {"add_host": {"host": "tempest-nonexist_host-900048093"}} Oct 03 10:30:30.425359 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: exception: Compute host tempest-nonexist_host-900048093 could not be found. Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-900048093'}}} Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-900048093' is not mapped to any cell Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.425967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6015, in _get_service_in_cell_by_host Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6631, in add_host_to_aggregate Oct 03 10:30:30.430701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _get_service_in_cell_by_host Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-900048093 could not be found. Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-900048093 could not be found. Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.432107 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-900048093 could not be found. Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-900048093 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:30.434175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1f26a623-c7c7-451a-9518-88dfe1bd2c13 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.133570 Oct 03 10:30:30.440625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b6b53998-5090-485e-af33-7909ede09c81 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:30.450658 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 16/37] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:30.482181 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b6b53998-5090-485e-af33-7909ede09c81 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.049387 Oct 03 10:30:30.484634 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 22/38] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:30 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 10:30:30.495928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbd788b0-e90a-4508-800b-511642c16088 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbd788b0-e90a-4508-800b-511642c16088 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 283 Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:30:30.511681 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.513206 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:30:30.513810 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:30.514387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.515386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.516205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:30:30.516205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:30:30.516205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:30:30.516205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.520510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbd788b0-e90a-4508-800b-511642c16088 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:30.527602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbd788b0-e90a-4508-800b-511642c16088 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.036804 Oct 03 10:30:30.531358 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 17/39] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:30:30.540026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c78de7c-bdeb-4949-aea2-abf02859fbe6 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c78de7c-bdeb-4949-aea2-abf02859fbe6 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 27 Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:30.545635 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: {"aggregate": {"name": ""}} Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:30.547030 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi '' Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:30.547813 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:30:30.549198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.550609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c78de7c-bdeb-4949-aea2-abf02859fbe6 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:30.552961 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c78de7c-bdeb-4949-aea2-abf02859fbe6 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011992 Oct 03 10:30:30.563253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 23/40] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:30:30.575183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c10eef10-5457-448b-a02d-e076041125a9 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-104714041"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.585137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c10eef10-5457-448b-a02d-e076041125a9 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'de4ad4b38a3f4e3aa1b2ce4502066431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3084ef7da12432e80c8bc7b8b7349c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c10eef10-5457-448b-a02d-e076041125a9 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Request method failure captured: Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 59 Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm8zb64UcMHs8Oo-LWC_uvJCYBWMLRXH0fHCasy2UY8iV_smlafC7Ux-rvGxhTg6sdNv3H_N6Ch-LsD64BE5fw1Dr09un1cLgO0847arGW5OS9ukGBhEmoj-bO8iV2P_uMR-EiwgxqE3i9ouU2uYaFXzjTOSZKVEXWinKyBwLZ-t3A Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:30:30.588304 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}] Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: de4ad4b38a3f4e3aa1b2ce4502066431 Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: {"aggregate": {"name": "tempest-test_aggregate-104714041"}} Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:30.589594 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-104714041'}}} Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:30.590495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:30.591593 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 03 10:30:30.592713 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.592713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c10eef10-5457-448b-a02d-e076041125a9 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:30.592713 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c10eef10-5457-448b-a02d-e076041125a9 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021542 Oct 03 10:30:30.592713 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 24/41] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:30.601370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92c1ffec-0704-46f6-85bd-ee2605dccf36 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1393297004"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.613805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-92c1ffec-0704-46f6-85bd-ee2605dccf36 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid c04750fa-d3df-4718-8562-02490f0dfff1 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:30.650858 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-92c1ffec-0704-46f6-85bd-ee2605dccf36 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052886 Oct 03 10:30:30.652785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 25/42] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:30.681588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d84974ae-ba92-44e0-a05b-b5c0abcbd64d tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1393297004"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.687398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-d84974ae-ba92-44e0-a05b-b5c0abcbd64d tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid 0335bc40-0125-4c0b-b43b-0b89300ce2d5 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:30.701462 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-d84974ae-ba92-44e0-a05b-b5c0abcbd64d tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1393297004 already exists. Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d84974ae-ba92-44e0-a05b-b5c0abcbd64d tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 60 Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:30.705083 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: {"aggregate": {"name": "tempest-test_aggregate-1393297004"}} Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:30.706220 n-d-858383-3 devstack@n-api.service[122270]: exception: Aggregate tempest-test_aggregate-1393297004 already exists. Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1393297004'}}} Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6468, in create_aggregate Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 03 10:30:30.706888 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1393297004 already exists. Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:30:30.707827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1393297004 already exists. Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1393297004 already exists. Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d84974ae-ba92-44e0-a05b-b5c0abcbd64d tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1393297004 already exists. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:30.708870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d84974ae-ba92-44e0-a05b-b5c0abcbd64d tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.045685 Oct 03 10:30:30.712705 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 26/43] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:30:30.720899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:30.722195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:30.730096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:30.730820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:30.731268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:30.731994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:30.733701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:30.733984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:30.864675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:30.875080 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3a3e8ea-c1d0-48dc-92df-8301ea506f61 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1299 microversion: 2.1 time: 0.161128 Oct 03 10:30:30.877972 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 27/44] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:30 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1299 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:30.887920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5228bd20-e402-4ade-b31a-a94d98a4cbfc tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:30.943702 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5228bd20-e402-4ade-b31a-a94d98a4cbfc tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.064453 Oct 03 10:30:30.945415 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 28/45] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:30 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:30:30.966509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b67d3a9-da6f-4ed6-bad1-5c5da1e9b623 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-463234469"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:30.983941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-2b67d3a9-da6f-4ed6-bad1-5c5da1e9b623 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid a5ea2958-9f10-4ef3-a572-cea3683b322e for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:31.038004 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b67d3a9-da6f-4ed6-bad1-5c5da1e9b623 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.087419 Oct 03 10:30:31.047822 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 29/46] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:31.053995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35be6d25-057f-498b-b191-fb5c707172ca tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.056321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-35be6d25-057f-498b-b191-fb5c707172ca tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'de4ad4b38a3f4e3aa1b2ce4502066431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3084ef7da12432e80c8bc7b8b7349c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35be6d25-057f-498b-b191-fb5c707172ca tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Request method failure captured: Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm8zb64UcMHs8Oo-LWC_uvJCYBWMLRXH0fHCasy2UY8iV_smlafC7Ux-rvGxhTg6sdNv3H_N6Ch-LsD64BE5fw1Dr09un1cLgO0847arGW5OS9ukGBhEmoj-bO8iV2P_uMR-EiwgxqE3i9ouU2uYaFXzjTOSZKVEXWinKyBwLZ-t3A Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:30:31.058199 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}] Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: de4ad4b38a3f4e3aa1b2ce4502066431 Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 03 10:30:31.059557 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '6'} Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:31.060231 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 03 10:30:31.062016 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.066682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35be6d25-057f-498b-b191-fb5c707172ca tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:31.067600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-35be6d25-057f-498b-b191-fb5c707172ca tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.017401 Oct 03 10:30:31.071793 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 30/47] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:31 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:31.078886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b4063d1-f759-429b-a09f-7780d3f3b891 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.115194 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b4063d1-f759-429b-a09f-7780d3f3b891 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.042118 Oct 03 10:30:31.116851 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 31/48] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:31 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:30:31.138188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4421112c-aa97-46bc-ac81-d92113b34912 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.140593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1639591755", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "availability_zone": "tempest-test_az-2124596347"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:31.163565 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4421112c-aa97-46bc-ac81-d92113b34912 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4421112c-aa97-46bc-ac81-d92113b34912 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:31.165611 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: exception: Aggregate -1 could not be found. Oct 03 10:30:31.167014 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '-1'} Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 10:30:31.167788 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.174051 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.176660 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.176660 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.176660 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:31.176660 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:31.176660 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 03 10:30:31.176660 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.177435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:31.177435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:31.177435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:31.177847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:31.178847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:31.178847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:31.184182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4421112c-aa97-46bc-ac81-d92113b34912 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:31.187272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4421112c-aa97-46bc-ac81-d92113b34912 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.061359 Oct 03 10:30:31.189699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 32/49] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:30:31 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:30:31.201021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52933167-88db-4b41-b371-ab6e48613333 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1092696619"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:31.206115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-52933167-88db-4b41-b371-ab6e48613333 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid 95b28288-ceaf-4e4e-abeb-a8cceb4d0992 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:30:31.254643 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52933167-88db-4b41-b371-ab6e48613333 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058018 Oct 03 10:30:31.257494 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 33/50] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:30:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:30:31.288421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3bde263-8c27-4244-9e5c-bb7605f2802f tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.303592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f3bde263-8c27-4244-9e5c-bb7605f2802f tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'de4ad4b38a3f4e3aa1b2ce4502066431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3084ef7da12432e80c8bc7b8b7349c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3bde263-8c27-4244-9e5c-bb7605f2802f tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Request method failure captured: Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm8zb64UcMHs8Oo-LWC_uvJCYBWMLRXH0fHCasy2UY8iV_smlafC7Ux-rvGxhTg6sdNv3H_N6Ch-LsD64BE5fw1Dr09un1cLgO0847arGW5OS9ukGBhEmoj-bO8iV2P_uMR-EiwgxqE3i9ouU2uYaFXzjTOSZKVEXWinKyBwLZ-t3A Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:30:31.306406 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}] Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: de4ad4b38a3f4e3aa1b2ce4502066431 Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 03 10:30:31.307498 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '7'} Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:31.308116 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 03 10:30:31.309176 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.313381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3bde263-8c27-4244-9e5c-bb7605f2802f tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:31.315084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f3bde263-8c27-4244-9e5c-bb7605f2802f tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.033195 Oct 03 10:30:31.316145 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 34/51] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:30:31 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:31.335856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f9534ac-ec42-4b1b-a045-468ca0dc063a tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.395924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:30:31.421850 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f9534ac-ec42-4b1b-a045-468ca0dc063a tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.100794 Oct 03 10:30:31.423490 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 35/52] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:31 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:30:31.432372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.434327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:31.459713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:31.460574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:31.461417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:31.463094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:31.463862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:31.464561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:31.802068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:31.820401 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1afedc9-044d-4dd8-8efd-385b2e56ae11 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1300 microversion: 2.1 time: 0.392388 Oct 03 10:30:31.824956 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 36/53] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:31 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1300 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:31.841271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f8034d0-b7a4-46a8-b330-7ee18758c248 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.868743 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9f8034d0-b7a4-46a8-b330-7ee18758c248 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f8034d0-b7a4-46a8-b330-7ee18758c248 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:31.892460 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: exception: Aggregate -1 could not be found. Oct 03 10:30:31.893778 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '-1'} Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.894612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 03 10:30:31.895677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:31.903463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f8034d0-b7a4-46a8-b330-7ee18758c248 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:31.910067 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f8034d0-b7a4-46a8-b330-7ee18758c248 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.083174 Oct 03 10:30:31.919089 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 37/54] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:30:31 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:30:31.934139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:31.939463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:31.972985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:31.973491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:31.973940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:31.974667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:31.975129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:31.975557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:32.571312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:32.584076 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-139113a3-4bef-49f3-8283-42e81b2b3dbf tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.661130 Oct 03 10:30:32.584691 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 38/55] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:31 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:32.602523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23d60168-6705-4d0e-9af2-946784c1b4df tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:32.617777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-23d60168-6705-4d0e-9af2-946784c1b4df tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'de4ad4b38a3f4e3aa1b2ce4502066431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3084ef7da12432e80c8bc7b8b7349c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23d60168-6705-4d0e-9af2-946784c1b4df tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Request method failure captured: Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm8zb64UcMHs8Oo-LWC_uvJCYBWMLRXH0fHCasy2UY8iV_smlafC7Ux-rvGxhTg6sdNv3H_N6Ch-LsD64BE5fw1Dr09un1cLgO0847arGW5OS9ukGBhEmoj-bO8iV2P_uMR-EiwgxqE3i9ouU2uYaFXzjTOSZKVEXWinKyBwLZ-t3A Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:30:32.619391 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}] Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: de4ad4b38a3f4e3aa1b2ce4502066431 Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 03 10:30:32.620539 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:32.621258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:32.622514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23d60168-6705-4d0e-9af2-946784c1b4df tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:32.624448 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-23d60168-6705-4d0e-9af2-946784c1b4df tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.035131 Oct 03 10:30:32.624448 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 39/56] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:30:32 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:32.679021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:30:32.679627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:30:32.680481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:30:32.680967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:30:32.681438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:30:32.702766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:32.706039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:32.707689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:32.708845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:32.711314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:32.712187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:32.765385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Getting quotas for project 4873c6872c514a02a2a2a0f2ac0d98d8. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:30:32.777912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Getting quotas for user f6bd3486b7f242f8849563d8ca63a0cf and project 4873c6872c514a02a2a2a0f2ac0d98d8. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:30:32.809528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:30:32.819683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:30:32.938055 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ada8c97a-f2e5-4c5d-a9d4-cd2de7858ed1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.389118 Oct 03 10:30:32.941170 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 18/57] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:30:32.950162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:32.955189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:32.970563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:32.973157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:32.974320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:32.975996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:32.976847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:32.979848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:33.130831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b026bab6-a500-4128-ae8c-64eb3a10b3d0 tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-246930690", "id": 844376708, "os-flavor-access:is_public": "True"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:33.203927 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b026bab6-a500-4128-ae8c-64eb3a10b3d0 tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.577106 Oct 03 10:30:33.217893 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 40/58] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:30:32 2022] POST /compute/v2.1/flavors => generated 467 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:30:33.238763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1561ecdf-b27c-40b1-b3da-3438fd2ce8a1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:33.241333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1561ecdf-b27c-40b1-b3da-3438fd2ce8a1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:33.555701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1561ecdf-b27c-40b1-b3da-3438fd2ce8a1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:33.565321 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1561ecdf-b27c-40b1-b3da-3438fd2ce8a1 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1243 microversion: 2.1 time: 0.338078 Oct 03 10:30:33.567539 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 41/59] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:33 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1243 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:33.621035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:33.644179 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ce77e8a-8b4d-46a3-9557-fd40cfbe6d70 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1300 microversion: 2.1 time: 0.699276 Oct 03 10:30:33.646630 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 19/60] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:32 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1300 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:33.655856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ff7f524-5e4f-4044-b539-24d3fbdbd6de tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:34.131973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f074fed9280>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.136678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.140813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.143276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.145446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.146101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.148186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.200580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=11,nova_api:DELETE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:34.236496 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ff7f524-5e4f-4044-b539-24d3fbdbd6de tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/844376708/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.587226 Oct 03 10:30:34.239195 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 20/61] 10.222.0.27 () {62 vars in 1262 bytes} [Mon Oct 3 10:30:33 2022] POST /compute/v2.1/flavors/844376708/os-extra_specs => generated 62 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:34.259152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.261997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:34.280164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb50657d-7216-423d-b3f1-d070eba7f7a3 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.709170 Oct 03 10:30:34.284099 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 42/62] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 3 10:30:33 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:34.296192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.297365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.299147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.300036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.301253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.303282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.306935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad2babb4-e6d6-4670-9b11-cf20eab92439 tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.354243 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad2babb4-e6d6-4670-9b11-cf20eab92439 tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/844376708" status: 202 len: 0 microversion: 2.86 time: 0.059353 Oct 03 10:30:34.360425 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 43/63] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 3 10:30:34 2022] DELETE /compute/v2.1/flavors/844376708 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:30:34.376560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f074fd198b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.408982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.411433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.412428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.414693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.416129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.418216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.475600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a64874d3-24b7-4251-a9c7-8cad7adc9e2d tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.113513 Oct 03 10:30:34.485662 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 44/64] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Oct 3 10:30:34 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:34.493496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7a213a3-1818-4980-8c5d-08428f378528 tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.528423 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7a213a3-1818-4980-8c5d-08428f378528 tempest-FlavorMetadataValidation-330393589 tempest-FlavorMetadataValidation-330393589-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.039280 Oct 03 10:30:34.530539 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 45/65] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:30:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:30:34.538879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f074fd19f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.543382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.544109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.544762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.546264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.547171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.548290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.661059 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43252add-3d33-4b6f-a908-f60fb733919e tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.128778 Oct 03 10:30:34.673642 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 46/66] 10.222.0.27 () {58 vars in 1145 bytes} [Mon Oct 3 10:30:34 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:30:34.681157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.685496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:34.695632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.697450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.700204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.700204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.700204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.700204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.844088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:34.856021 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65e1bb8c-0d47-48cf-980c-447bcc7e4968 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1243 microversion: 2.1 time: 0.183400 Oct 03 10:30:34.859837 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 47/67] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:34 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1243 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:34.865044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:34.868977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:34.881820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.884439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.888901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:34.890503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:34.891130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:34.891720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:35.078443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:35.089273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ae6c0ec-593e-4cde-a746-96f7f4b824ef tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1300 microversion: 2.1 time: 0.226754 Oct 03 10:30:35.090250 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 48/68] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:34 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1300 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:35.268579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:35.292426 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-216ff607-8b0e-4ea5-b3ee-014b7a0a145d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 1.042118 Oct 03 10:30:35.294458 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 21/69] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:34 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:35.485711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-12ce93a6-c58e-4b64-9b3d-857ce98785ce req-4361df10-c548-4d5c-aa55-bff7ce80f0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bbb36a-4dcd-4fed-9653-d59c6c5547ed", "tag": "dd9eef2f-dc12-4dba-8db5-192a883f67e4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:35.524309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-12ce93a6-c58e-4b64-9b3d-857ce98785ce req-4361df10-c548-4d5c-aa55-bff7ce80f0b5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:35.524819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-12ce93a6-c58e-4b64-9b3d-857ce98785ce req-4361df10-c548-4d5c-aa55-bff7ce80f0b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:35.525463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-12ce93a6-c58e-4b64-9b3d-857ce98785ce req-4361df10-c548-4d5c-aa55-bff7ce80f0b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:35.575306 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-12ce93a6-c58e-4b64-9b3d-857ce98785ce req-4361df10-c548-4d5c-aa55-bff7ce80f0b5 service nova] Creating event network-changed:dd9eef2f-dc12-4dba-8db5-192a883f67e4 for instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed on n-h2-858383-3 Oct 03 10:30:35.579592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-12ce93a6-c58e-4b64-9b3d-857ce98785ce req-4361df10-c548-4d5c-aa55-bff7ce80f0b5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:30:35.581458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-12ce93a6-c58e-4b64-9b3d-857ce98785ce req-4361df10-c548-4d5c-aa55-bff7ce80f0b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:30:35.582596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:35.583185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:35.591491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:35.593019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:35.593516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:35.593956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:35.630383 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.compute.rpcapi [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 10:30:35.636262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] Releasing lock "compute-rpcapi-router" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:30:35.676822 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-efbc7511-e070-4acf-9482-ca999fcf23df None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.357158 Oct 03 10:30:35.678466 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 49/70] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:35.890772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:35.891645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:35.905128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:35.908074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:35.908761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:35.913831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:35.914333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:35.914786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:36.078902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:36.092050 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c8b8c388-7d84-43ec-be0e-486b12f0297f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1291 microversion: 2.1 time: 0.207237 Oct 03 10:30:36.092939 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 22/71] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:35 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1291 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:36.116412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:36.117455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:36.131442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:36.131854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:36.132295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:36.133118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:36.136416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:36.136922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:36.321589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:36.322114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:36.333747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:36.345140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:36.345140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:36.345140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:36.345140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:36.345548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:36.785980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:36.794355 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-433d6b18-2945-4153-9025-be13e13faa30 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.477385 Oct 03 10:30:36.801562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 23/72] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:36 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:37.132596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:37.134771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:37.163677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:37.166179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:37.171532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:37.174884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:37.180622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:37.185003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:37.503095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:37.514510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-962659c8-1589-4095-9bf6-39193aa57184 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 1.402114 Oct 03 10:30:37.515099 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 50/73] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:36 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:37.594145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:37.606047 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2be4c7ff-195d-46e6-8c8f-5107d1c54346 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1291 microversion: 2.1 time: 0.489795 Oct 03 10:30:37.613808 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 24/74] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:37 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1291 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:37.825324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:37.827087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:37.842708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:37.849659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:37.851864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:37.855102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:37.859431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:37.860864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:38.538872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:38.539555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:38.551810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:38.553729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:38.555107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:38.557920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:38.558601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:38.561060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:39.208093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:39.220413 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef21de4d-bd6c-4538-8cfd-5ab07150e3b2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 1.398950 Oct 03 10:30:39.221861 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 51/75] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:37 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:39.240974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:39.242305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:39.250241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=11,nova_api:INSERT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:39.272669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:39.273646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:39.275290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:39.280365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:39.281118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:39.283798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:39.480641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:39.502862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d5b3b73-178b-4b1d-af16-c9beb2333c28 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.968290 Oct 03 10:30:39.535079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 25/76] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:38 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:40.158309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:40.167175 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3dc8eddf-b9b2-4d64-b4cf-d8cf1580e99b tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1297 microversion: 2.1 time: 0.942061 Oct 03 10:30:40.175184 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 52/77] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:39 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1297 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:40.252316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:40.255243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:40.302885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:40.303983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:40.306019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:40.308162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:40.309217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:40.313199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:40.551383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:40.558923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:40.589113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:40.590702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:40.591404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:40.595012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:40.595765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:40.596667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:42.171385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:42.199704 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75bd30ec-248d-4d66-8498-145072f2756f tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 1.658825 Oct 03 10:30:42.201533 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 53/78] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:40 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:42.742357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:42.800138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:42.875795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7c10e87-538a-4f1b-9e42-7aade3a34e66 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:42.882134 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-d7c10e87-538a-4f1b-9e42-7aade3a34e66 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7c10e87-538a-4f1b-9e42-7aade3a34e66 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770-project-admin] Request method failure captured: Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrnQu7YVjCofCOd9vKxE1UevYuT3P3KIz44qTU9R2a1tAOhXLPIE6UZayTdCQXw6FBQ75hHTF-prneaC_lUoVnjNCAv0d1PJo10RAKrOPViHsPgOIxfW4nUP_SbwJnqPM380IC_a1YYzj2QtDN8ovrhZmDm2Pz9rdGRsLNTtmtiqXY8 Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 695e639ba1b84cf484c76e56d4d15de6 Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:30:42.888888 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/695e639ba1b84cf484c76e56d4d15de6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_695e639ba1b84cf484c76e56d4d15de6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/695e639ba1b84cf484c76e56d4d15de6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/695e639ba1b84cf484c76e56d4d15de6"}]}] Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 695e639ba1b84cf484c76e56d4d15de6 Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770-project-admin Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 62fc6624c5694d46a7cad45d875fc6b9 Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770-project-admin Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:30:42.890744 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid timestamp for date invalid_time Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'invalid_time'} Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:42.891368 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 03 10:30:42.892438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:30:42.895332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7c10e87-538a-4f1b-9e42-7aade3a34e66 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:42.896475 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d7c10e87-538a-4f1b-9e42-7aade3a34e66 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770 tempest-InstanceUsageAuditLogNegativeTestJSON-1520789770-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.693379 Oct 03 10:30:42.902752 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 54/79] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Oct 3 10:30:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 699 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:30:42.908385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:42.909495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:42.955941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:42.956986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:42.960553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:42.961948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:42.962641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:42.963304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:43.254264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:43.271926 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-36e91b75-cae6-46b1-a3b1-c127a501cf0d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 3.023381 Oct 03 10:30:43.299083 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 26/80] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:40 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 3050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:43.559974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:43.846510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-84c09c48-5576-403a-85b3-de2204020ec6 req-d901bbbc-d38b-4638-80d5-0dbc2f0e1ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a25a9df-3efc-470c-aba2-a14a510a4f3b", "tag": "b176d203-d654-46de-bb7f-a3e7277c8834"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:43.891906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-84c09c48-5576-403a-85b3-de2204020ec6 req-d901bbbc-d38b-4638-80d5-0dbc2f0e1ade service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:43.893330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-84c09c48-5576-403a-85b3-de2204020ec6 req-d901bbbc-d38b-4638-80d5-0dbc2f0e1ade service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:43.897355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-84c09c48-5576-403a-85b3-de2204020ec6 req-d901bbbc-d38b-4638-80d5-0dbc2f0e1ade service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:43.946596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-84c09c48-5576-403a-85b3-de2204020ec6 req-d901bbbc-d38b-4638-80d5-0dbc2f0e1ade service nova] Creating event network-changed:b176d203-d654-46de-bb7f-a3e7277c8834 for instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b on n-h2-858383-3 Oct 03 10:30:43.955433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-84c09c48-5576-403a-85b3-de2204020ec6 req-d901bbbc-d38b-4638-80d5-0dbc2f0e1ade service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:30:43.956167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-84c09c48-5576-403a-85b3-de2204020ec6 req-d901bbbc-d38b-4638-80d5-0dbc2f0e1ade service nova] Acquired lock "compute-rpcapi-router" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:30:43.966459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:43.967197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:43.967800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:43.968982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:43.969601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:43.970180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:43.993088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.rpcapi [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 10:30:43.996673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] Releasing lock "compute-rpcapi-router" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:30:44.034485 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-98e85479-ed65-4b90-bc25-9ad24f9c4ca2 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.729255 Oct 03 10:30:44.035524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 27/81] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:44.087876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:44.098741 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1928e030-449d-4d4b-a253-fa99661aa8b8 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 1.194596 Oct 03 10:30:44.101930 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 55/82] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:42 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:44.144626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:44.148282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:44.167978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:44.171951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:44.172623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:44.173556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:44.174641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:44.175083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:44.544817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:44.569028 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-198b9990-7f7a-43ef-9c85-7b74f335a25d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.463309 Oct 03 10:30:44.581082 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 56/83] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:44 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:44.587748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:44.589236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:44.605540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:44.606043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:44.607203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:44.612146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:44.612960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:44.614477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:44.679379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:44.712063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62387f1f-11d7-4526-a4dc-d989ea971e39 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:44.716698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62387f1f-11d7-4526-a4dc-d989ea971e39 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5b2a796d7f784d62b25ebd5168fcbdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607684aadbaa4eaf97ccb2ec7345f354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62387f1f-11d7-4526-a4dc-d989ea971e39 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Request method failure captured: Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnO4F-JfujHm98fw5KgKE1Hy7tEHrVxKU-_S4CGV1Mbq_JHGTnoiffjNLiSkmSS-ATdUDJ3XFzfkE7hvMtIpzSkrVr81DruqCQDHF1-m7tPlN-srK7T2RJp_UwBYRENTYBWeG33zcn7aFJexF4lVEfXit04zB-pfAAsEnbdxPS00PU Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 607684aadbaa4eaf97ccb2ec7345f354 Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:30:44.722916 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/607684aadbaa4eaf97ccb2ec7345f354"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_607684aadbaa4eaf97ccb2ec7345f354"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/607684aadbaa4eaf97ccb2ec7345f354"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/607684aadbaa4eaf97ccb2ec7345f354"}]}] Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 607684aadbaa4eaf97ccb2ec7345f354 Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5b2a796d7f784d62b25ebd5168fcbdf7 Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project Oct 03 10:30:44.724174 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: action_args: {} Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:44.724727 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 03 10:30:44.725872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:44.726745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62387f1f-11d7-4526-a4dc-d989ea971e39 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:44.726745 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62387f1f-11d7-4526-a4dc-d989ea971e39 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.687482 Oct 03 10:30:44.726745 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 28/84] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 3 10:30:44 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 689 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:44.744955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bec34e0b-b705-4beb-9fe6-6fed5e7aac56 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:44.746748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bec34e0b-b705-4beb-9fe6-6fed5e7aac56 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5b2a796d7f784d62b25ebd5168fcbdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607684aadbaa4eaf97ccb2ec7345f354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bec34e0b-b705-4beb-9fe6-6fed5e7aac56 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Request method failure captured: Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03%2010:30:44 HTTP/1.1 Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnO4F-JfujHm98fw5KgKE1Hy7tEHrVxKU-_S4CGV1Mbq_JHGTnoiffjNLiSkmSS-ATdUDJ3XFzfkE7hvMtIpzSkrVr81DruqCQDHF1-m7tPlN-srK7T2RJp_UwBYRENTYBWeG33zcn7aFJexF4lVEfXit04zB-pfAAsEnbdxPS00PU Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 607684aadbaa4eaf97ccb2ec7345f354 Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:30:44.756270 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/607684aadbaa4eaf97ccb2ec7345f354"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_607684aadbaa4eaf97ccb2ec7345f354"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/607684aadbaa4eaf97ccb2ec7345f354"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/607684aadbaa4eaf97ccb2ec7345f354"}]}] Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 607684aadbaa4eaf97ccb2ec7345f354 Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5b2a796d7f784d62b25ebd5168fcbdf7 Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project Oct 03 10:30:44.757547 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '2022-10-03 10:30:44'} Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:30:44.758075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 03 10:30:44.759058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:30:44.759921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bec34e0b-b705-4beb-9fe6-6fed5e7aac56 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:30:44.762490 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bec34e0b-b705-4beb-9fe6-6fed5e7aac56 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062 tempest-InstanceUsageAuditLogNegativeTestJSON-878533062-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03 10:30:44" status: 403 len: 128 microversion: 2.1 time: 0.026694 Oct 03 10:30:44.763257 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 29/85] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:30:44 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03%2010%3A30%3A44 => generated 128 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:30:45.193320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:45.204065 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f8675a5-adae-41f7-94a3-11cfb90e6d1d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.630443 Oct 03 10:30:45.205517 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 57/86] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:44 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:45.210797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:45.211613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:45.221302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:45.221947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:45.222560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:45.223461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:45.224067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:45.224862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:45.478770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:45.492665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c6858673-6cec-49ff-95d7-eaa8acf93514 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.285747 Oct 03 10:30:45.493970 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 58/87] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:45 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:45.502549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-532ac927-ca00-464d-8e71-6209d670e594 tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1969776066", "id": 765134777, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:45.565638 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-532ac927-ca00-464d-8e71-6209d670e594 tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.567194 Oct 03 10:30:45.582660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a43f12f8-f333-4096-a8c5-7fc6174f9236 req-7ae70b83-cc08-42b9-ac4b-e8c72694fb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af222604-5009-4007-92ab-921c98a70b1f", "tag": "2d2b00b0-2743-4843-a0e6-c2eefbad5755"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:45.588644 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 30/88] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:30:44 2022] POST /compute/v2.1/flavors => generated 446 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:30:45.596238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a43f12f8-f333-4096-a8c5-7fc6174f9236 req-7ae70b83-cc08-42b9-ac4b-e8c72694fb1d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:45.596882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a43f12f8-f333-4096-a8c5-7fc6174f9236 req-7ae70b83-cc08-42b9-ac4b-e8c72694fb1d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:45.601590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:45.602850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:45.603514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a43f12f8-f333-4096-a8c5-7fc6174f9236 req-7ae70b83-cc08-42b9-ac4b-e8c72694fb1d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:45.615307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:45.621023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a43f12f8-f333-4096-a8c5-7fc6174f9236 req-7ae70b83-cc08-42b9-ac4b-e8c72694fb1d service nova] Creating event network-changed:2d2b00b0-2743-4843-a0e6-c2eefbad5755 for instance af222604-5009-4007-92ab-921c98a70b1f on n-h2-858383-3 Oct 03 10:30:45.623944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:45.624078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:45.624439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:45.625915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:45.627999 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a43f12f8-f333-4096-a8c5-7fc6174f9236 req-7ae70b83-cc08-42b9-ac4b-e8c72694fb1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060724 Oct 03 10:30:45.629148 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 59/89] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:30:45.633833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:45.634547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:45.920212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-60b1a7b1-5467-4cca-ad0a-c5645b5d6e70 tempest-FlavorsV255TestJSON-1024398286 tempest-FlavorsV255TestJSON-1024398286-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:45.933223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:45.936491 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-60b1a7b1-5467-4cca-ad0a-c5645b5d6e70 tempest-FlavorsV255TestJSON-1024398286 tempest-FlavorsV255TestJSON-1024398286-project] 10.222.0.27 "GET /compute/v2.1/flavors/765134777" status: 200 len: 446 microversion: 2.55 time: 0.304620 Oct 03 10:30:45.948181 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 60/90] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Oct 3 10:30:45 2022] GET /compute/v2.1/flavors/765134777 => generated 446 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:30:45.956274 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce2e8ed0-3aa7-4575-b95b-122bb047fa26 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.361012 Oct 03 10:30:45.957461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 31/91] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:45 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:45.967400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7172ae34-65f3-482c-a699-18594f3a0093 tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] Action: 'update', calling method: .version_select at 0x7f0755065b80>, body: {"flavor": {"description": "new"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:46.064018 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7172ae34-65f3-482c-a699-18594f3a0093 tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/765134777" status: 200 len: 447 microversion: 2.55 time: 0.107912 Oct 03 10:30:46.074582 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 61/92] 10.222.0.27 () {62 vars in 1216 bytes} [Mon Oct 3 10:30:45 2022] PUT /compute/v2.1/flavors/765134777 => generated 447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:30:46.081641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f6e8fcd-d465-4cc5-b1a4-9ec184438609 tempest-FlavorsV255TestJSON-1024398286 tempest-FlavorsV255TestJSON-1024398286-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:46.150190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1f6e8fcd-d465-4cc5-b1a4-9ec184438609 tempest-FlavorsV255TestJSON-1024398286 tempest-FlavorsV255TestJSON-1024398286-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.075982 Oct 03 10:30:46.151077 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 32/93] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:30:46 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:30:46.179948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f113bbf5-61fb-42a8-b263-191415663caf tempest-FlavorsV255TestJSON-1024398286 tempest-FlavorsV255TestJSON-1024398286-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:46.228210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:46.228938 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f113bbf5-61fb-42a8-b263-191415663caf tempest-FlavorsV255TestJSON-1024398286 tempest-FlavorsV255TestJSON-1024398286-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.054842 Oct 03 10:30:46.229156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:46.229846 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 62/94] 10.222.0.27 () {60 vars in 1166 bytes} [Mon Oct 3 10:30:46 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:30:46.240255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:46.241456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:46.241456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:46.249808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:46.254666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32b40a91-0545-4556-9b35-c4c18ec00e49 tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:46.255537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:46.257160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:46.281516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-32b40a91-0545-4556-9b35-c4c18ec00e49 tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/765134777" status: 202 len: 0 microversion: 2.55 time: 0.034399 Oct 03 10:30:46.284888 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 63/95] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 3 10:30:46 2022] DELETE /compute/v2.1/flavors/765134777 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:30:46.298438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a394cce0-f909-4306-a494-acd650574f7c tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:46.339591 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a394cce0-f909-4306-a494-acd650574f7c tempest-FlavorsV255TestJSON-1209268322 tempest-FlavorsV255TestJSON-1209268322-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.050002 Oct 03 10:30:46.346452 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 64/96] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:30:46 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:30:46.519658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:46.521700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:46.538051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:46.538564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:46.539011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:46.539731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:46.540195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:46.540643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:46.617065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:46.645273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d014807-ccda-4ddb-bf61-e40b0c589ed7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.421345 Oct 03 10:30:46.652268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 33/97] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:46 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:30:46.853886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:46.865559 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40199bf2-77e2-4702-80c4-c40db9c63b88 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.349661 Oct 03 10:30:46.870347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 65/98] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:46 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:46.982189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:46.983058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:46.991778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:46.992271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:46.992761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:47.009719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:47.014974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:47.017029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:47.681158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:47.682302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:47.709944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:47.717600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:47.718130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:47.719147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:47.719639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:47.720054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:47.830720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:47.843087 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c97546fa-82d3-4a69-8b86-f3d67fcad316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.864960 Oct 03 10:30:47.856262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 34/99] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:46 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:47.895100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:47.896114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:47.909206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:47.917028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:47.919348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:47.922410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:47.923637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:47.924867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:48.354897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:48.366999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:48.376926 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f61a16bc-3c0a-429a-a748-a9e7ccb3d26f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.488944 Oct 03 10:30:48.378883 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 35/100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:47 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:48.600636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:48.614679 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b201746d-d119-4373-a1d1-8cc52645045d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.938138 Oct 03 10:30:48.628803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 66/101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:47 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:48.867439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:48.868606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:48.883550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:48.886535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:48.887174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:48.890600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:48.891246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:48.892372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:49.327588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:49.343849 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b25d6ab6-bc93-4fd4-9b53-fa4c20a0ce36 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.477435 Oct 03 10:30:49.345388 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 36/102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:48 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:49.410474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:49.411099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:49.443935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:49.454277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:49.454720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:49.456661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:49.458433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:49.460694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:49.642711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:49.649719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:49.670385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:49.672493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:49.674552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:49.674552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:49.679684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:49.681038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:49.918316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:49.928450 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e65410c4-d0af-4688-b423-851b14c8b086 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.292711 Oct 03 10:30:49.929050 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 37/103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:49 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:30:50.218163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:50.234212 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9455b9e8-e231-432c-bf50-85abdfc63487 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.835515 Oct 03 10:30:50.235542 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 67/104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:49 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:50.366881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:50.368340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:50.382719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:50.383217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:50.383643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:50.386060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:50.387649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:50.390046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:50.815999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:50.830664 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f2bbf3c-04b0-43e4-a992-0c92d6addcbb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.466374 Oct 03 10:30:50.832619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 38/105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:50 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:50.958464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:50.958975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:50.975461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:50.976571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:50.977387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:50.978547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:50.988631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:50.990486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:51.328626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-543f1f35-2c90-41d2-a8af-5be391f08eab req-4d00c235-be5b-44ca-bcca-10e169bf19d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a25a9df-3efc-470c-aba2-a14a510a4f3b", "name": "network-vif-plugged", "status": "completed", "tag": "b176d203-d654-46de-bb7f-a3e7277c8834"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:51.343562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-543f1f35-2c90-41d2-a8af-5be391f08eab req-4d00c235-be5b-44ca-bcca-10e169bf19d4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:51.344688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-543f1f35-2c90-41d2-a8af-5be391f08eab req-4d00c235-be5b-44ca-bcca-10e169bf19d4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:51.345669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-543f1f35-2c90-41d2-a8af-5be391f08eab req-4d00c235-be5b-44ca-bcca-10e169bf19d4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:51.360356 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-543f1f35-2c90-41d2-a8af-5be391f08eab req-4d00c235-be5b-44ca-bcca-10e169bf19d4 service nova] Creating event network-vif-plugged:b176d203-d654-46de-bb7f-a3e7277c8834 for instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b on n-h2-858383-3 Oct 03 10:30:51.391272 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-543f1f35-2c90-41d2-a8af-5be391f08eab req-4d00c235-be5b-44ca-bcca-10e169bf19d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173878 Oct 03 10:30:51.392459 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 39/106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:30:51.404064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:51.405032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:51.416472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:51.417939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:51.419376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:51.422790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:51.424348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:51.424761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:51.467095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:51.475542 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-08724b5e-4d3f-4e73-88f4-dfea0d3c358a tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.527703 Oct 03 10:30:51.476129 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 68/107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:50 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:51.630750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:51.645654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8b81ea6-13aa-4514-925c-a98e11eea645 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.251477 Oct 03 10:30:51.646989 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 40/108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:51 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:51.855352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:51.856214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:51.867377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:51.867377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:51.867377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:51.867841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:51.871094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:51.871693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:52.422860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:52.430715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db0babfb-56c4-4808-9596-038e328e99b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.579080 Oct 03 10:30:52.433445 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 69/109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:51 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:52.499904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:52.501372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:52.512335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:52.512335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:52.512335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:52.512335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:52.512667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:52.512667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:52.669931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:52.671185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:52.678358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:52.679139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:52.680618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:52.681515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:52.682115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:52.682961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:52.843516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:52.855574 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e37aa4c5-d7fa-4d8f-8339-8679726b2d0f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.360462 Oct 03 10:30:52.856599 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 41/110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:52 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:52.938153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:52.949720 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-acb0e38c-bcb3-4f6d-9a1d-6ed4f9f33181 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.283428 Oct 03 10:30:52.950999 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 70/111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:52 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:53.340644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62907e3d-8bb5-4907-bf7f-02432a8660eb tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-276033894", "id": 995635299, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:53.372037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62907e3d-8bb5-4907-bf7f-02432a8660eb tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.312544 Oct 03 10:30:53.373193 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 42/112] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:30:53 2022] POST /compute/v2.1/flavors => generated 464 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:30:53.464242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:53.465501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:53.482394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:53.485728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:53.486762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:53.489114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:53.490186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:53.492227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:53.618526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00d2c1b7-0bb5-4f2d-b7d2-4db9a195bf67 tempest-FlavorsV261TestJSON-1644926250 tempest-FlavorsV261TestJSON-1644926250-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:53.643489 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00d2c1b7-0bb5-4f2d-b7d2-4db9a195bf67 tempest-FlavorsV261TestJSON-1644926250 tempest-FlavorsV261TestJSON-1644926250-project] 10.222.0.27 "GET /compute/v2.1/flavors/995635299" status: 200 len: 464 microversion: 2.61 time: 0.259468 Oct 03 10:30:53.643926 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 71/113] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Oct 3 10:30:53 2022] GET /compute/v2.1/flavors/995635299 => generated 464 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:30:53.661473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a598fa6-69ce-48e0-958c-e263b763cb71 tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:53.726674 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a598fa6-69ce-48e0-958c-e263b763cb71 tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/995635299" status: 200 len: 465 microversion: 2.61 time: 0.072685 Oct 03 10:30:53.734121 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 72/114] 10.222.0.27 () {62 vars in 1216 bytes} [Mon Oct 3 10:30:53 2022] PUT /compute/v2.1/flavors/995635299 => generated 465 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:30:53.746648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad984af4-7401-431f-b68f-fb5774f5fb15 tempest-FlavorsV261TestJSON-1644926250 tempest-FlavorsV261TestJSON-1644926250-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:53.783782 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad984af4-7401-431f-b68f-fb5774f5fb15 tempest-FlavorsV261TestJSON-1644926250 tempest-FlavorsV261TestJSON-1644926250-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.046741 Oct 03 10:30:53.784969 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 73/115] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:30:53 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:30:53.808321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-052a07c1-5cc1-44be-89c8-d29cc74683cf tempest-FlavorsV261TestJSON-1644926250 tempest-FlavorsV261TestJSON-1644926250-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:53.831240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-052a07c1-5cc1-44be-89c8-d29cc74683cf tempest-FlavorsV261TestJSON-1644926250 tempest-FlavorsV261TestJSON-1644926250-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.026869 Oct 03 10:30:53.844469 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 74/116] 10.222.0.27 () {60 vars in 1166 bytes} [Mon Oct 3 10:30:53 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:30:53.850269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42d13f61-4bb3-45e4-bea8-5a1bb82e5067 tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:53.875499 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42d13f61-4bb3-45e4-bea8-5a1bb82e5067 tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/995635299" status: 202 len: 0 microversion: 2.61 time: 0.028311 Oct 03 10:30:53.880608 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 75/117] 10.222.0.27 () {60 vars in 1199 bytes} [Mon Oct 3 10:30:53 2022] DELETE /compute/v2.1/flavors/995635299 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:30:53.892900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:53.893742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:53.909698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:53.910587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:53.913344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:53.914342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:53.915453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:53.917449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:53.993909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:54.144198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:54.157239 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfba5189-eb4d-402c-aec7-9d44bafba00e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1342 microversion: 2.1 time: 0.700579 Oct 03 10:30:54.161507 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 43/118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:53 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1342 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:30:54.180277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfd791a4-bee4-4b10-ad32-ab3458bfc966 tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:54.261340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:54.289743 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-39113eb5-c6d4-4d89-898f-3565c1dc34c5 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.407723 Oct 03 10:30:54.290980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 76/119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:53 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:54.298013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:54.300534 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfd791a4-bee4-4b10-ad32-ab3458bfc966 tempest-FlavorsV261TestJSON-193106660 tempest-FlavorsV261TestJSON-193106660-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.136354 Oct 03 10:30:54.302143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:54.303181 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 44/120] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:30:54 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:30:54.311467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:54.312181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:54.312970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:54.313818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:54.314395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:54.314948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:55.132810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:55.150178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8518a50e-41ad-4559-8259-f0f7462c04da tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.854177 Oct 03 10:30:55.151380 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 77/121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:54 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:55.183858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:55.184660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:55.197039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:55.202737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:55.204498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:55.209106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:55.213010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:55.213905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:55.253517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-578c8d0a-e199-403c-ad84-a7567fc9875c req-82dda82c-aa48-4184-af2e-675d4dbe7783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bbb36a-4dcd-4fed-9653-d59c6c5547ed", "name": "network-vif-plugged", "status": "completed", "tag": "dd9eef2f-dc12-4dba-8db5-192a883f67e4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:55.293245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-578c8d0a-e199-403c-ad84-a7567fc9875c req-82dda82c-aa48-4184-af2e-675d4dbe7783 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:55.298884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-578c8d0a-e199-403c-ad84-a7567fc9875c req-82dda82c-aa48-4184-af2e-675d4dbe7783 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:55.299521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-578c8d0a-e199-403c-ad84-a7567fc9875c req-82dda82c-aa48-4184-af2e-675d4dbe7783 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:55.333092 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-578c8d0a-e199-403c-ad84-a7567fc9875c req-82dda82c-aa48-4184-af2e-675d4dbe7783 service nova] Creating event network-vif-plugged:dd9eef2f-dc12-4dba-8db5-192a883f67e4 for instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed on n-h2-858383-3 Oct 03 10:30:55.356945 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-578c8d0a-e199-403c-ad84-a7567fc9875c req-82dda82c-aa48-4184-af2e-675d4dbe7783 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110618 Oct 03 10:30:55.360600 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 78/122] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:55.388475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:55.397553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:55.415853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:55.422659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:55.423346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:55.424327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:55.425066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:55.425727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:55.553287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:55.563319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0bcc223-daab-4880-a341-c734978e5718 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1491 microversion: 2.1 time: 0.382482 Oct 03 10:30:55.565064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 45/123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:55 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1491 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:55.992953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:55.993439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:56.008436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:56.008921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:56.009335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:56.012676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:56.013176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:56.013606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:56.100910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:56.135481 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-25f65d3c-3c0d-44d3-8630-aeb16c636cac tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.772518 Oct 03 10:30:56.148059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:30:56.150626 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 79/124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:55 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:56.177580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:56.178600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:56.186141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:56.186920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:56.187498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:56.188349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:56.189524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:56.190095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:56.395168 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd0f434b-2828-424b-8ac2-60afd30ff760 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 204 len: 0 microversion: 2.1 time: 0.809882 Oct 03 10:30:56.397121 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 46/125] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:30:55 2022] DELETE /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:30:56.410879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:56.411766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:56.422528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:56.424064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:56.424711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:56.425719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:56.426329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:56.427253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:56.648251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:56.662493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48acd2b5-5ff7-4d3b-a2c4-b998520cc2ff tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.488623 Oct 03 10:30:56.663486 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 80/126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:56 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:56.944834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:56.955326 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9b1a077-f3ab-4f74-80b2-ebb733e5d971 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1497 microversion: 2.1 time: 0.553476 Oct 03 10:30:56.958357 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 47/127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:56 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1497 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:30:57.169878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:57.171072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:57.183041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:57.183041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:57.185383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:57.185735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:57.186782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:57.187308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:57.471696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8a26674e-96ad-4729-9079-e0ae68361181 req-eb90190a-8b63-4d31-a960-0f29a995b9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af222604-5009-4007-92ab-921c98a70b1f", "name": "network-vif-plugged", "status": "completed", "tag": "2d2b00b0-2743-4843-a0e6-c2eefbad5755"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:57.483618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8a26674e-96ad-4729-9079-e0ae68361181 req-eb90190a-8b63-4d31-a960-0f29a995b9be service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:57.489702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8a26674e-96ad-4729-9079-e0ae68361181 req-eb90190a-8b63-4d31-a960-0f29a995b9be service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:57.490330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8a26674e-96ad-4729-9079-e0ae68361181 req-eb90190a-8b63-4d31-a960-0f29a995b9be service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:57.517647 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8a26674e-96ad-4729-9079-e0ae68361181 req-eb90190a-8b63-4d31-a960-0f29a995b9be service nova] Creating event network-vif-plugged:2d2b00b0-2743-4843-a0e6-c2eefbad5755 for instance af222604-5009-4007-92ab-921c98a70b1f on n-h2-858383-3 Oct 03 10:30:57.528568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8a26674e-96ad-4729-9079-e0ae68361181 req-eb90190a-8b63-4d31-a960-0f29a995b9be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060363 Oct 03 10:30:57.530347 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 48/128] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:30:57.581620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:57.596513 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d8ae319-60ea-4615-ad24-2c37227c3238 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1341 microversion: 2.1 time: 0.436222 Oct 03 10:30:57.600777 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 81/129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:57 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1341 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:57.692204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:57.693235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:57.701269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:57.702440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:57.703183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:57.704075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:57.705001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:57.705571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:57.986883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:57.987489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:58.001209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:58.017615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:58.027552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:58.031924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:58.033150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:58.033740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:58.034649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:58.065619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e5fec83-675e-462d-81b1-9ef0e841bc16 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.361855 Oct 03 10:30:58.067213 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 49/130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:57 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:58.629380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:58.630281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:58.650095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:58.650801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:58.651431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:58.652756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:58.665837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:58.666479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:58.745247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:INSERT=3,nova_api:RELEASE=1,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:58.833295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:58.877258 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4cd54ef-b249-4efa-95aa-f989fcce8043 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1497 microversion: 2.1 time: 0.893410 Oct 03 10:30:58.881041 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 82/131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:57 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1497 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:30:59.090969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:59.091659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:59.094604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:30:59.098809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:59.099487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:59.100093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:59.100979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:59.101572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:59.102134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:59.113085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:59.120811 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-daf31faa-49c7-465a-b9d7-bd42bb4a8101 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1491 microversion: 2.1 time: 0.497310 Oct 03 10:30:59.125464 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 50/132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:58 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1491 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:30:59.382025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:30:59.391546 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ac84828-dba0-445b-8ccb-40129577fa34 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1339 microversion: 2.1 time: 0.304184 Oct 03 10:30:59.392716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 83/133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:30:59 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1339 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:30:59.559258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-782755268", "block_migration": true, "disk_over_commit": false}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:59.563276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:30:59.585057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:59.585873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:59.590660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:59.593488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:30:59.594334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:30:59.596382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:30:59.877210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca77e847-8308-442a-93df-f739c9d055f6 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:30:59.895841 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca77e847-8308-442a-93df-f739c9d055f6 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.388912 Oct 03 10:30:59.923683 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 84/134] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:30:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:30:59.928603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8ebf41be-55f3-4577-acd1-88c899bc607d req-55b6b2ba-311c-4bea-ba75-b3859e41d130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a25a9df-3efc-470c-aba2-a14a510a4f3b", "name": "network-vif-deleted", "tag": "b176d203-d654-46de-bb7f-a3e7277c8834"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:30:59.992373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8ebf41be-55f3-4577-acd1-88c899bc607d req-55b6b2ba-311c-4bea-ba75-b3859e41d130 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:00.002873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8ebf41be-55f3-4577-acd1-88c899bc607d req-55b6b2ba-311c-4bea-ba75-b3859e41d130 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:00.003552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8ebf41be-55f3-4577-acd1-88c899bc607d req-55b6b2ba-311c-4bea-ba75-b3859e41d130 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:00.096667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8ebf41be-55f3-4577-acd1-88c899bc607d req-55b6b2ba-311c-4bea-ba75-b3859e41d130 service nova] Creating event network-vif-deleted:b176d203-d654-46de-bb7f-a3e7277c8834 for instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b on n-h2-858383-3 Oct 03 10:31:00.121264 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8ebf41be-55f3-4577-acd1-88c899bc607d req-55b6b2ba-311c-4bea-ba75-b3859e41d130 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195681 Oct 03 10:31:00.122233 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 85/135] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:00.128175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:00.129376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:00.143173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:00.144444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:00.147377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:00.149960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:00.150697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:00.151368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:00.337725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lazy-loading 'flavor' on Instance uuid 80bbb36a-4dcd-4fed-9653-d59c6c5547ed {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:00.341439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:00.360792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2902a5f3-0bc7-424b-b555-87bfb9eb0ca2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 200 len: 1327 microversion: 2.1 time: 0.237301 Oct 03 10:31:00.361860 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 86/136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:00 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 1327 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:00.509412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Going to try to live migrate instance to tempest-host-782755268 {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:31:00.529071 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] HTTP exception thrown: Compute host tempest-host-782755268 could not be found. Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Request method failure captured: Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed/action HTTP/1.1 Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 106 Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm-IQ3pMOv7z02sq0N7qUIC8G4ghX2aydleTmyzSeOvqI_bLLaOwh0au0o01N7fs6QdJ32lME04iUpQnExif4eVpkp_PzW2Zcb5fAeHpTXmHJZgDpSn6EYf2lRwsjcGPNkQPy9pAai22WR8Y3_EusV5uiJnuAiD9qkPY1HOPoSAynE Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ef2425d027164ecc9bbbb5757da08ed5 Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-LiveMigrationNegativeTest-1005003494 Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:31:00.544919 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef2425d027164ecc9bbbb5757da08ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef2425d027164ecc9bbbb5757da08ed5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef2425d027164ecc9bbbb5757da08ed5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef2425d027164ecc9bbbb5757da08ed5"}]}] Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-LiveMigrationNegativeTest-1005003494 Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ef2425d027164ecc9bbbb5757da08ed5 Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1005003494 Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-LiveMigrationNegativeTest-1005003494-project-admin Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 44fc9b203d2840ab84551830ff684478 Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-LiveMigrationNegativeTest-1005003494-project-admin Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: {"os-migrateLive": {"host": "tempest-host-782755268", "block_migration": true, "disk_over_commit": false}} Oct 03 10:31:00.546434 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: exception: Compute host tempest-host-782755268 could not be found. Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '80bbb36a-4dcd-4fed-9653-d59c6c5547ed', 'body': {'os-migrateLive': {'host': 'tempest-host-782755268', 'block_migration': True, 'disk_over_commit': False}}} Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:31:00.547132 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-782755268 could not be found. Oct 03 10:31:00.548236 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-782755268 could not be found. Oct 03 10:31:00.549280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-782755268 could not be found. Oct 03 10:31:00.550310 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:00.555407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Returning 400 to user: Compute host tempest-host-782755268 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:00.556717 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d14a6ce-c290-4394-b0f8-a6431db3fc46 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed/action" status: 400 len: 99 microversion: 2.1 time: 1.408515 Oct 03 10:31:00.557806 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 51/137] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 3 10:30:59 2022] POST /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed/action => generated 99 bytes in 1410 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 03 10:31:00.571610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:00.574010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:00.591679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:00.593578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:00.594182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:00.596140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:00.598100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:00.599093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:00.890152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:00.898020 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2e271979-4f0f-4c41-b7bc-cc4a471e800e tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1488 microversion: 2.1 time: 0.338514 Oct 03 10:31:00.898760 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 52/138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:00 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1488 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:00.910304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:00.911246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:00.923861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:00.927116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:00.927989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:00.931673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:00.932337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:00.937395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:00.947697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-59012993-bfaf-431c-95c2-1448d12a1a4c tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-918525829", "id": 633867173, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:01.020004 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-59012993-bfaf-431c-95c2-1448d12a1a4c tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.630429 Oct 03 10:31:01.021818 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 87/139] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:00 2022] POST /compute/v2.1/flavors => generated 421 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:01.039906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:01.048450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:01.058177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:01.059142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:01.059827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:01.060750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:01.063337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:01.064933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:01.120678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:01.285718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:01.292933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:01.304535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-435e04b3-901e-4b2f-9ffc-2e51a4fa44b3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1491 microversion: 2.1 time: 0.399879 Oct 03 10:31:01.307086 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 53/140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:00 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1491 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:01.327332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-abd489f5-59a2-4f5e-a9fb-29f1121d9627 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:01.357163 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-abd489f5-59a2-4f5e-a9fb-29f1121d9627 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048666 Oct 03 10:31:01.360460 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 54/141] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 3 10:31:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:31:01.372407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-50a1c824-0743-41a3-a2e3-772fdd84a356 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-971458369", "id": 121050391, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:01.756995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eda6ac0a-60cb-46e2-8881-2cb44a2d3199 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1639 microversion: 2.1 time: 0.733421 Oct 03 10:31:01.763475 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 88/142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:01 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1639 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:01.769341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:01.771917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:01.788643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:01.789959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:01.791756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:01.794925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:01.797379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:01.798240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:01.832416 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-50a1c824-0743-41a3-a2e3-772fdd84a356 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.468519 Oct 03 10:31:01.833358 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 55/143] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:01 2022] POST /compute/v2.1/flavors => generated 421 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:01.834361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] HTTP exception thrown: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Request method failure captured: Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b HTTP/1.1 Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm92LLNG4eiyLMj9I62Ptm2aMWV-IPAtY7nzDRSjdTRyyB69R4gevGomyGFS_9VJdtIOhljIbs3YuPSjDdy--QA8brk5-uKt4B47Lz2ui5Gi9ra3NpBT8t-vhfjBCIWw_Ki2-SMSLitQ_v_DmSPXhvBL_PUUD-cV_vgFf5erU6s6bw Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:01.837198 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577957f991214f90b168e2854037028d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577957f991214f90b168e2854037028d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}] Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f86ff2883585463e8a3994e14ec3d5c5 Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:01.838349 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '0a25a9df-3efc-470c-aba2-a14a510a4f3b'} Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:01.839021 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:01.840111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:01.841186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-360043582", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:01.847144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Returning 404 to user: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:01.849345 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5084b452-9b16-4b5b-9639-b9ceae40a110 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 404 len: 111 microversion: 2.1 time: 0.083943 Oct 03 10:31:01.863726 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 89/144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:01 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:01.873101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:01.877002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:01.896973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:01.898877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:01.899508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:01.901992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:01.903097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:01.906872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:01.932999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:31:01.986302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:31:02.246755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bd63a2c0-d1b1-40b5-8d8d-e8abe6bc4a46 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 204 len: 0 microversion: 2.1 time: 0.381296 Oct 03 10:31:02.253068 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 90/145] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:01 2022] DELETE /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:31:02.262470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b60247d-662f-4949-a6af-cf7aeb7448a3 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:02.285097 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b60247d-662f-4949-a6af-cf7aeb7448a3 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030608 Oct 03 10:31:02.311337 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 91/146] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 3 10:31:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:31:02.327030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-120527239", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:02.447989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:31:02.489486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:31:02.490040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:31:02.490613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:31:02.491178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:31:02.491731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:31:02.518609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:02.521127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:02.522565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:02.524991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:02.526163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:02.528570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:02.562069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Getting quotas for project beb07b94d361455dad13c0e485e909c7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:02.567338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Getting quotas for user d19314a1cae1478eb870e7f7da5d0760 and project beb07b94d361455dad13c0e485e909c7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:02.583828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:31:02.587200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:31:02.667832 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80cdf2bc-981c-4705-92f8-cc7c45916e8e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833353 Oct 03 10:31:02.669036 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 56/147] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:31:02.674136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:02.679643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:02.687625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:02.693424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:02.696148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:02.697870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:02.699267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:02.700322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.034087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:31:03.034632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:31:03.035022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:31:03.035429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:31:03.035947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:31:03.036432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:03.052606 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2aeec423-354a-4637-990c-83e257ba1557 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1494 microversion: 2.1 time: 0.378857 Oct 03 10:31:03.054422 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 57/148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:02 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1494 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:03.072290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.072825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.073270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.073999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.078369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0bee8c9-697a-4902-8b55-0cbab0738cf5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Action: 'create', calling method: .version_select at 0x7f074ffa3ee0>, body: {"keypair": {"name": "tempest-keypair-1192700604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLp3vH3pe6uZjfN+4/vQvHkB7Q6rM4FjAa/9ZkMKFVa3t/l+ZSS8Lxm5yHn3RNBbn1oZa0SlSGhYOBWqlgVblgOd0PeMrOjekQ8vDZ2EVoXdGurciJVs+tyrRcjsZcg/Q=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:03.084195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.084808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.153625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a0bee8c9-697a-4902-8b55-0cbab0738cf5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Getting quotas for project f15708e4a6464c968bb7f6c73b73c019. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:03.157144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Getting quotas for project 577957f991214f90b168e2854037028d. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:03.161079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a0bee8c9-697a-4902-8b55-0cbab0738cf5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Getting quotas for user 4f65f9939dc241f0bffc3cd45efd857a and project f15708e4a6464c968bb7f6c73b73c019. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:03.168153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Getting quotas for user f86ff2883585463e8a3994e14ec3d5c5 and project 577957f991214f90b168e2854037028d. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:03.192343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0bee8c9-697a-4902-8b55-0cbab0738cf5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132413 Oct 03 10:31:03.193806 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 58/149] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:31:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:03.201158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7537e045-c7aa-4b2e-ae37-a573c42e994b tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:03.202137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7537e045-c7aa-4b2e-ae37-a573c42e994b tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:03.216959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:31:03.219420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:31:03.329764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7537e045-c7aa-4b2e-ae37-a573c42e994b tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:03.347522 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7537e045-c7aa-4b2e-ae37-a573c42e994b tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1218 microversion: 2.1 time: 0.148945 Oct 03 10:31:03.371462 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 59/150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:03 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:03.399282 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86411a05-4537-462d-9ddb-842bd44a900c tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085315 Oct 03 10:31:03.399862 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 92/151] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:31:03.430513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b3493e84-d761-4a73-822c-a8df33280aea tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:03.437995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b3493e84-d761-4a73-822c-a8df33280aea tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:03.681491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b3493e84-d761-4a73-822c-a8df33280aea tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:03.691713 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b3493e84-d761-4a73-822c-a8df33280aea tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1219 microversion: 2.1 time: 0.280674 Oct 03 10:31:03.692669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 93/152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:03 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1219 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:03.813055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074ff21700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:03.814899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.815390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.816019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.865885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.866651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.867339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.879084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.879973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.880922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.888207 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-63f0e7fb-6de8-450a-adb6-6cbcd5af42e3 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.515733 Oct 03 10:31:03.889780 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 60/153] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:03.902465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fba3940>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:03.910947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=122270) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 03 10:31:03.912710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.914139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.915295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.939074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.939938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.940595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.956288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.957241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.958181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:03.969180 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b12e47f2-ccda-4e9d-9e73-764a6a5ad6cf tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.070585 Oct 03 10:31:03.970315 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 94/154] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 3 10:31:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:03.990697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fdcdb80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:03.994035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:03.994528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:03.995278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.015830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.017304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.018044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.040517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.041463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.042130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.066517 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f86df090-8f57-4ee9-895e-ce521114a271 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079994 Oct 03 10:31:04.082549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fc88b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:04.087325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.088192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.088838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.090369 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 61/155] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:04.110109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:04.110758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:04.135377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.140065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.141691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.144654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.145176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.152028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.156450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.159448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.163311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.187460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8af2089c-9d00-4d6b-b55a-c8bb02afd96d tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.107818 Oct 03 10:31:04.205781 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 95/156] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:04.218388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-725a0559-4544-4f90-b13a-634fe5832016 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fcbb9d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:04.220239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-725a0559-4544-4f90-b13a-634fe5832016 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.228084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-725a0559-4544-4f90-b13a-634fe5832016 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.228692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-725a0559-4544-4f90-b13a-634fe5832016 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.296957 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-725a0559-4544-4f90-b13a-634fe5832016 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.089867 Oct 03 10:31:04.297727 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 96/157] 10.222.0.27 () {58 vars in 1179 bytes} [Mon Oct 3 10:31:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:04.325067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fd2c1f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:04.333038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.333631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.334077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.366992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.367476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.367893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.396813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.397078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.397311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.405631 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c2376d0-bb34-4e62-9ad3-2953d540a8b4 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085898 Oct 03 10:31:04.406643 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 97/158] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:04.418325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:04.419045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:04.426538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.427156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.427663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:04.430354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:04.432388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:04.432873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.022116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:05.036195 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fad430ae-8e99-42d6-a293-c07c2a5ffb85 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1270 microversion: 2.1 time: 0.628242 Oct 03 10:31:05.045821 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 98/159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:04 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1270 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:05.059625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fad0ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:05.062147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.063149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.063795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.067982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:05.075721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e6f60f0-8800-4dda-99f9-817bd759adc0 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1494 microversion: 2.1 time: 0.982303 Oct 03 10:31:05.082325 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 62/160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:04 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1494 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:05.087953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:05.088539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:05.094308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.095393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.096622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.105424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.105944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.106383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.107307 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-03b918db-50ab-4c0d-9377-aa05d39d0e3a tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.055910 Oct 03 10:31:05.108750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 99/161] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:05.109239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.110642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.111243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.129116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fc22f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:05.132863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.133665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.134379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.157329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.158138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.158934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.166869 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba17276e-504d-442c-a4c0-5c544cbc08e1 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.044519 Oct 03 10:31:05.167995 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 100/162] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:05 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:05.192228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Calling method '.version_select at 0x7f074fd06d30>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:05.200319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.200891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.202150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.234325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.235094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.236171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.265303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:05.268344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:05.269036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:05.288835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:05.301319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a0f54ce-36cd-431d-b35f-26b8b4ba1024 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1271 microversion: 2.1 time: 0.214801 Oct 03 10:31:05.302731 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 63/163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:05 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:05.337767 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7e6efbf-2508-478a-a19b-266557771f11 tempest-HypervisorAdminTestJSON-1563235664 tempest-HypervisorAdminTestJSON-1563235664-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.157003 Oct 03 10:31:05.347701 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 101/164] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 3 10:31:05 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:06.066157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:06.066793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:06.090647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:06.091892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:06.093090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:06.093968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:06.094573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:06.095157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:06.113267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:06.114123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:06.133994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:06.134521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:06.147586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:06.149977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:06.150850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:06.155705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:06.333307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:06.354725 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b35b8220-f38b-45d4-aa29-70ae27a9ce7f tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1276 microversion: 2.1 time: 0.295916 Oct 03 10:31:06.377489 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 64/165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:06 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:06.384087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-660541c7-15c3-4524-9335-93372a61550d req-687751e5-e0ed-475e-bf64-7ccd65c61884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af222604-5009-4007-92ab-921c98a70b1f", "name": "network-vif-deleted", "tag": "2d2b00b0-2743-4843-a0e6-c2eefbad5755"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:06.396697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6bd3486b7f242f8849563d8ca63a0cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4873c6872c514a02a2a2a0f2ac0d98d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:06.399407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-660541c7-15c3-4524-9335-93372a61550d req-687751e5-e0ed-475e-bf64-7ccd65c61884 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:06.401125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-660541c7-15c3-4524-9335-93372a61550d req-687751e5-e0ed-475e-bf64-7ccd65c61884 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:06.401793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-660541c7-15c3-4524-9335-93372a61550d req-687751e5-e0ed-475e-bf64-7ccd65c61884 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:06.419329 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7133e00-7618-432e-b845-1fb0dfcd2e4f tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 200 len: 1452 microversion: 2.1 time: 0.317087 Oct 03 10:31:06.423741 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 102/166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:06 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 1452 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:06.427064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-660541c7-15c3-4524-9335-93372a61550d req-687751e5-e0ed-475e-bf64-7ccd65c61884 service nova] Creating event network-vif-deleted:2d2b00b0-2743-4843-a0e6-c2eefbad5755 for instance af222604-5009-4007-92ab-921c98a70b1f on n-h2-858383-3 Oct 03 10:31:06.436919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:06.436919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:06.439823 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-660541c7-15c3-4524-9335-93372a61550d req-687751e5-e0ed-475e-bf64-7ccd65c61884 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060775 Oct 03 10:31:06.444848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 65/167] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:06.449416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:06.450160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:06.450784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:06.452352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:06.453336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:06.454197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:06.605440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:06.627508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d8f125a-ec8d-4ee9-8a3f-f92959c97101 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1271 microversion: 2.1 time: 0.198760 Oct 03 10:31:06.644378 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 103/168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:06 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:07.124735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1384754527", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "121050391", "adminPass": "***", "networks": [{"uuid": "2a441fda-2f9e-4b00-a376-c543d291306d"}], "security_groups": [{"name": "tempest-securitygroup--455722137"}], "key_name": "tempest-keypair-1192700604", "user_data": "}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:07.389307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:07.389931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:07.398664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:07.399174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:07.399641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:07.400358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:07.400873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:07.401286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:07.640110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:07.650274 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-068f4ea4-94be-4595-a2e5-081382a1529d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1276 microversion: 2.1 time: 0.265289 Oct 03 10:31:07.653570 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 104/169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:07 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:07.672453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:07.681113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:07.694717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:07.695313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:07.695838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:07.702285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:07.704532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:07.705351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:07.711591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] validate_networks() for [('2a441fda-2f9e-4b00-a376-c543d291306d', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:31:07.737077 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] HTTP exception thrown: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Request method failure captured: Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f HTTP/1.1 Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm9K7lYcAMc5aq-Fl3-pndCf1Qvopk6UOV05dM0wLnnbWlcoWG-BTu6FllMQ-DYKtQPmtwOstQ4BV1EYCKFOjx_Bt4MrkOM3oubJqEbcq_WF1sElj7VCD_cy1pk7wRRQTLdoPdVy81MdlpYgH7udV-e6Xy8Em0MyhJC8XUvrwRYllg Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4873c6872c514a02a2a2a0f2ac0d98d8 Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:07.738867 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4873c6872c514a02a2a2a0f2ac0d98d8"}]}] Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4873c6872c514a02a2a2a0f2ac0d98d8 Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminTestJSON-829916290-project Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f6bd3486b7f242f8849563d8ca63a0cf Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminTestJSON-829916290-project Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:07.740122 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'af222604-5009-4007-92ab-921c98a70b1f'} Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:07.741203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:07.742261 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:07.743174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Returning 404 to user: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:07.743174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-550bc361-129a-4ef6-a03a-f5ae4b0178f6 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 404 len: 111 microversion: 2.1 time: 0.079372 Oct 03 10:31:07.745527 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 105/170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:07 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:07.756921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:07.760166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:07.778348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:07.781032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:07.781769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:07.783563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:07.785725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:07.786536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:07.963354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:07.990451 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7363b98-9ae2-4a54-9ae5-86447a20ffe0 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1271 microversion: 2.1 time: 0.243505 Oct 03 10:31:07.991200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 106/171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:07 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:08.008441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5861c6c-c30a-44f4-8113-38a650a3d2a5 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:08.032614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5861c6c-c30a-44f4-8113-38a650a3d2a5 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:08.035690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5861c6c-c30a-44f4-8113-38a650a3d2a5 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:08.036202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5861c6c-c30a-44f4-8113-38a650a3d2a5 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:08.290665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e5861c6c-c30a-44f4-8113-38a650a3d2a5 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.298052 Oct 03 10:31:08.291884 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 107/172] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:31:07 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:08.307893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c219c088-dfc8-49b7-b149-dc7cae526083 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:08.401847 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c219c088-dfc8-49b7-b149-dc7cae526083 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.101698 Oct 03 10:31:08.406340 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 108/173] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:08 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:08.424037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de11f7cb-2811-4436-94a3-58f164e4ea7f tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1953734701"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:08.428593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-de11f7cb-2811-4436-94a3-58f164e4ea7f tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid da23649c-beb2-4324-8fdf-b9f40e99e5e0 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:08.482559 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de11f7cb-2811-4436-94a3-58f164e4ea7f tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064621 Oct 03 10:31:08.489411 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 109/174] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:08.503034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3a9da83-6021-4a9d-8203-47033045d1de tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:08.549867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a9da83-6021-4a9d-8203-47033045d1de tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:08.551894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a9da83-6021-4a9d-8203-47033045d1de tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:08.552822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a9da83-6021-4a9d-8203-47033045d1de tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:08.572964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:08.752451 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3a9da83-6021-4a9d-8203-47033045d1de tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.256624 Oct 03 10:31:08.754372 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 110/175] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:31:08 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:08.765337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:08.769230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:08.798682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:08.799446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:08.800216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:08.802024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:08.802690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:08.803277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:08.844023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:08.922127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:08.932026 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ffb45b76-4a0b-486d-89f3-247510f91625 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1276 microversion: 2.1 time: 0.176819 Oct 03 10:31:08.940945 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 111/176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:08 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:08.949024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-311577a7-235d-4563-b2f5-1a9187cc296e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:08.964110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-311577a7-235d-4563-b2f5-1a9187cc296e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.020450 Oct 03 10:31:08.966760 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 112/177] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:31:08 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:08.980014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d517050-9481-4e5c-9dff-23447f59e010 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:08.998957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d517050-9481-4e5c-9dff-23447f59e010 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.001672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d517050-9481-4e5c-9dff-23447f59e010 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.002270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d517050-9481-4e5c-9dff-23447f59e010 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:09.291607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d517050-9481-4e5c-9dff-23447f59e010 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.315993 Oct 03 10:31:09.292613 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 113/178] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:31:08 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:09.323807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:31:09.324294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:31:09.324696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:31:09.325131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:31:09.325545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:31:09.334243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:09.350022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:09.357236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.358103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.358547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:09.359291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.359751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.363870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:09.368386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.369263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.369718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:09.370452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.379100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.380507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:09.393217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Getting quotas for project f15708e4a6464c968bb7f6c73b73c019. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:09.399083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Getting quotas for user 4f65f9939dc241f0bffc3cd45efd857a and project f15708e4a6464c968bb7f6c73b73c019. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:09.442926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:31:09.445436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:31:09.493393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:09.505645 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab897387-a0d5-45b2-946d-870b773134ae tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1271 microversion: 2.1 time: 0.211907 Oct 03 10:31:09.506450 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 114/179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:09 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:09.514033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c81f3ee6-edcd-472d-8aa8-14361df4f1fb tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:09.562514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c81f3ee6-edcd-472d-8aa8-14361df4f1fb tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.054928 Oct 03 10:31:09.563676 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 115/180] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:09 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:09.584451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f77825ec-b3c9-4dd4-9841-0a6bf24cc5d3 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1783614247"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:09.588750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-f77825ec-b3c9-4dd4-9841-0a6bf24cc5d3 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid 125f6d30-d55c-4016-90eb-cfd1ef8e5f37 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:09.615796 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0afe26ef-1157-45dc-bd03-2ac8f0698850 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.499762 Oct 03 10:31:09.619490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 66/181] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:31:09.636665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7ad2db21-0b1b-4073-b3bf-6656ae596da1 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:09.637618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7ad2db21-0b1b-4073-b3bf-6656ae596da1 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:09.661332 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f77825ec-b3c9-4dd4-9841-0a6bf24cc5d3 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087998 Oct 03 10:31:09.665006 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 116/182] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:09.680606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d02e21c1-a32d-44e3-aead-3e5eb1f031e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:09.693765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d02e21c1-a32d-44e3-aead-3e5eb1f031e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.694524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d02e21c1-a32d-44e3-aead-3e5eb1f031e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.695117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d02e21c1-a32d-44e3-aead-3e5eb1f031e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:09.757514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7ad2db21-0b1b-4073-b3bf-6656ae596da1 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:09.767826 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7ad2db21-0b1b-4073-b3bf-6656ae596da1 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1263 microversion: 2.1 time: 0.136644 Oct 03 10:31:09.773426 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 67/183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:09 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1263 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:09.927355 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d02e21c1-a32d-44e3-aead-3e5eb1f031e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.255746 Oct 03 10:31:09.934287 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 117/184] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:31:09 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:09.939971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-282d9ed5-f4dd-440b-8eab-a4d30680abb2 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:09.950418 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-282d9ed5-f4dd-440b-8eab-a4d30680abb2 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013303 Oct 03 10:31:09.950418 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 68/185] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:31:09 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:09.960776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:09.961402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:09.984968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.985471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.988305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e276de3-cf42-4220-8a7a-003b79cedf08 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:09.990277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:09.991043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:09.997764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:09.998279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.034322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e276de3-cf42-4220-8a7a-003b79cedf08 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:10.034322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e276de3-cf42-4220-8a7a-003b79cedf08 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:10.034322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e276de3-cf42-4220-8a7a-003b79cedf08 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.245931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:10.262197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1db1158-1e73-41a4-815d-c12fde4688eb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1276 microversion: 2.1 time: 0.307330 Oct 03 10:31:10.272895 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 118/186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:09 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:10.338896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e276de3-cf42-4220-8a7a-003b79cedf08 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.371541 Oct 03 10:31:10.340249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 69/187] 10.222.0.27 () {60 vars in 1191 bytes} [Mon Oct 3 10:31:09 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:10.353021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13957476-87e4-4bb1-ba46-dbed778f0cfd tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:10.384294 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13957476-87e4-4bb1-ba46-dbed778f0cfd tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.035172 Oct 03 10:31:10.391116 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 119/188] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:10 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:10.397687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7546750a-870b-4f94-b2b1-eab41ff1bc90 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-667872346"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:10.404495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-7546750a-870b-4f94-b2b1-eab41ff1bc90 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid c5dcbf5e-9d78-418d-ba34-0982b23d5470 for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:10.454344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:10.473276 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7546750a-870b-4f94-b2b1-eab41ff1bc90 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079440 Oct 03 10:31:10.474026 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 70/189] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:10.486436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f9218a4f-668f-4bcb-af13-29e3cc3144f7 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:10.499077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9218a4f-668f-4bcb-af13-29e3cc3144f7 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:10.499674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9218a4f-668f-4bcb-af13-29e3cc3144f7 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:10.500102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9218a4f-668f-4bcb-af13-29e3cc3144f7 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.535399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:10.544517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:10.562712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:10.563217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:10.563666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.573040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:10.573040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:10.573040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.712807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:10.724449 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f9218a4f-668f-4bcb-af13-29e3cc3144f7 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.242424 Oct 03 10:31:10.725246 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 120/190] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 10:31:10 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:10.731853 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b3cea91-07ba-4195-9c35-619a76310a6a tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1271 microversion: 2.1 time: 0.195368 Oct 03 10:31:10.732524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 71/191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:10 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:10.745407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b429791-abc1-4a11-8dee-0e2bab514695 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:10.759127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b429791-abc1-4a11-8dee-0e2bab514695 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:10.759620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b429791-abc1-4a11-8dee-0e2bab514695 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:10.765342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b429791-abc1-4a11-8dee-0e2bab514695 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.801994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:10.802858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:10.811650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:10.812615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:10.814067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.815052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:10.815769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:10.816708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:10.941165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:10.950593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8d41f4a9-bc01-4b70-9314-7f563b46c95a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1267 microversion: 2.1 time: 0.153508 Oct 03 10:31:10.952464 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 72/192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:10 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:11.126460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b429791-abc1-4a11-8dee-0e2bab514695 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.393519 Oct 03 10:31:11.127073 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 121/193] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 10:31:10 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:11.146502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31383291-398c-47d6-a2e6-5dc3bfbc20aa tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.191281 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-31383291-398c-47d6-a2e6-5dc3bfbc20aa tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.055596 Oct 03 10:31:11.192437 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 73/194] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:11 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 10:31:11.204085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a0db45c-7aea-4140-9453-3f073d88996e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-107823517"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:11.207625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-1a0db45c-7aea-4140-9453-3f073d88996e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid 60a80aee-c8ed-4ddb-8bf0-3ea8e8fe0de6 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:11.215262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f0755198280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.221203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.223195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.223929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.225191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.225977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.226656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.233632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a0db45c-7aea-4140-9453-3f073d88996e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034956 Oct 03 10:31:11.234375 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 122/195] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:11.250293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3eca6a4f-cce6-47a5-ba49-36895219a55c tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.288854 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3eca6a4f-cce6-47a5-ba49-36895219a55c tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.045773 Oct 03 10:31:11.289070 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f878882e-288d-4654-a344-0ce7fb8a60be tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.078791 Oct 03 10:31:11.290158 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 123/196] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:11 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:11.297785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.298751 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 74/197] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:11.299028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:11.312438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ba526a6-533c-4acf-bd5f-7cc9aed13f5e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.312999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.313839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.314484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.315970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.316698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.318048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.330577 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-3ba526a6-533c-4acf-bd5f-7cc9aed13f5e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ba526a6-533c-4acf-bd5f-7cc9aed13f5e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Request method failure captured: Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm_dNuUazhdI10sRC8q0Wt3ngf9Kzwe5yqoHsi4nB_ciYi761__sWu5LXc1P7MNXdmyh6ysRBZmKOC16mpEdMQQGEcZdIQOH9MCXy8mdQpfObVLLh7_K15wgCUfdm--VVZvOXV6MOlLCLRn7lpqIdkppBxXUgp6y3XhxtFbPeU5J3U Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:31:11.337338 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}] Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 19b6c6dd3cfb47febbb71aa13f4903b5 Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: exception: Aggregate 11 could not be found. Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '11'} Oct 03 10:31:11.338806 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:11.340144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 03 10:31:11.341784 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.344993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ba526a6-533c-4acf-bd5f-7cc9aed13f5e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:11.346306 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ba526a6-533c-4acf-bd5f-7cc9aed13f5e tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.046443 Oct 03 10:31:11.347390 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 75/198] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:11.352375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f074fbda940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.361050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.361900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.362576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.365653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.369256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.372897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.412748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:11.428527 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de930ccb-4352-46ea-8fe8-ed5d0e3b8a36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1276 microversion: 2.1 time: 0.135730 Oct 03 10:31:11.431304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 124/199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:11.437437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23b2f3c1-f640-45f8-9647-5921e413473b tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.452581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-db5a88fc-eb14-42aa-87db-a4baa5c80cb0 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.103925 Oct 03 10:31:11.455442 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 76/200] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:11.468124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f074fbf2f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.471660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.472362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.473140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.474072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.474755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.475650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.476116 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-23b2f3c1-f640-45f8-9647-5921e413473b tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23b2f3c1-f640-45f8-9647-5921e413473b tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Request method failure captured: Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_dNuUazhdI10sRC8q0Wt3ngf9Kzwe5yqoHsi4nB_ciYi761__sWu5LXc1P7MNXdmyh6ysRBZmKOC16mpEdMQQGEcZdIQOH9MCXy8mdQpfObVLLh7_K15wgCUfdm--VVZvOXV6MOlLCLRn7lpqIdkppBxXUgp6y3XhxtFbPeU5J3U Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:11.481508 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}] Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 19b6c6dd3cfb47febbb71aa13f4903b5 Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: exception: Aggregate 11 could not be found. Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '11'} Oct 03 10:31:11.483256 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:11.483963 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:11.485625 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:11.486703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:11.486703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:11.486703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:11.486703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 03 10:31:11.486703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:11.486703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23b2f3c1-f640-45f8-9647-5921e413473b tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:11.487949 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-23b2f3c1-f640-45f8-9647-5921e413473b tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.056201 Oct 03 10:31:11.488526 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 125/201] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:11 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:11.515502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80d2afe9-331d-40f1-97d9-6c23a9aceb9f tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.051955 Oct 03 10:31:11.521648 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 77/202] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:11.529295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0dbc0aba-b4d7-4372-9c18-a0e7df78796f tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-754227510"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:11.540955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-0dbc0aba-b4d7-4372-9c18-a0e7df78796f tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid 16f1cade-21b0-4954-b5b9-7e0565765d6f for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:11.601720 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0dbc0aba-b4d7-4372-9c18-a0e7df78796f tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077974 Oct 03 10:31:11.602427 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 78/203] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:11.627509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4baf2461-e500-4f6f-9083-ce76cddca15a tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-562896440", "name": "tempest-test_aggregate-1010979486"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:11.679532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-4baf2461-e500-4f6f-9083-ce76cddca15a tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid 0e623de6-4507-4088-a39d-e3ce139fa141 for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:11.745394 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4baf2461-e500-4f6f-9083-ce76cddca15a tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.138859 Oct 03 10:31:11.745394 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 79/204] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 3 10:31:11 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:11.761029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Calling method '.version_select at 0x7f074fad0b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.763446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.764808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.765366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.776589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f074fdee1f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.794947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.795491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.795936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.800676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.801291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.801732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.827413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.828176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.828781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.829441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.829577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.830064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.846196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cab5f59-226f-4601-9ce4-ff00803b6766 tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.356264 Oct 03 10:31:11.847071 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 126/205] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:11.857624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dec494b4-31d3-493c-8626-e9d0bf91ac50 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:11.876039 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44ec34b0-45c3-47a8-8c64-ed00a09e4276 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-858383-3" status: 200 len: 598 microversion: 2.1 time: 0.129406 Oct 03 10:31:11.877705 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 80/206] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/os-hosts/n-h2-858383-3 => generated 598 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:11.882468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:11.883161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:11.884299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec494b4-31d3-493c-8626-e9d0bf91ac50 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.887641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec494b4-31d3-493c-8626-e9d0bf91ac50 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.888633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec494b4-31d3-493c-8626-e9d0bf91ac50 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.890944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.891508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.892074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:11.892880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:11.893818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:11.893942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.046891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:12.063175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9f8079d-cc8b-4e2a-894c-c91393273810 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1271 microversion: 2.1 time: 0.184253 Oct 03 10:31:12.064164 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 81/207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:11 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:12.081577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bed33637-8d15-4dab-acf6-2e633eae958f tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.091190 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dec494b4-31d3-493c-8626-e9d0bf91ac50 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.242066 Oct 03 10:31:12.093444 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 127/208] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 10:31:11 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.102863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Calling method '.version_select at 0x7f074fad0040>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.105314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.105917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.106725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.124967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bed33637-8d15-4dab-acf6-2e633eae958f tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.059583 Oct 03 10:31:12.125856 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 82/209] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:12 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:12.132196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Calling method '.version_select at 0x7f074fbf6d30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.138219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.138934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.139781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.150604 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8dc7472f-f1ce-42e8-b539-b65f996f7fdc tempest-HypervisorAdminV228Test-1730456403 tempest-HypervisorAdminV228Test-1730456403-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.055846 Oct 03 10:31:12.155223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 128/210] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 3 10:31:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:12.160540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.161549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:12.166808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.167628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.168278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.183931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.184802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.185503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.189435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.189979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.190475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.193894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.194561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.196267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.242002 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06e707fc-b0e7-4dd7-ab51-90eabf381975 tempest-HostsAdminTestJSON-1109792570 tempest-HostsAdminTestJSON-1109792570-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-858383-3" status: 200 len: 598 microversion: 2.1 time: 0.115029 Oct 03 10:31:12.243632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 83/211] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 3 10:31:12 2022] GET /compute/v2.1/os-hosts/n-h1-858383-3 => generated 598 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.255387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9f62830-2c76-4f0d-a46f-ac99fb0f56e6 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:12.271019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9f62830-2c76-4f0d-a46f-ac99fb0f56e6 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'de4ad4b38a3f4e3aa1b2ce4502066431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3084ef7da12432e80c8bc7b8b7349c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9f62830-2c76-4f0d-a46f-ac99fb0f56e6 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Request method failure captured: Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 42 Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm8zb64UcMHs8Oo-LWC_uvJCYBWMLRXH0fHCasy2UY8iV_smlafC7Ux-rvGxhTg6sdNv3H_N6Ch-LsD64BE5fw1Dr09un1cLgO0847arGW5OS9ukGBhEmoj-bO8iV2P_uMR-EiwgxqE3i9ouU2uYaFXzjTOSZKVEXWinKyBwLZ-t3A Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:12.274876 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3084ef7da12432e80c8bc7b8b7349c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3084ef7da12432e80c8bc7b8b7349c4"}]}] Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a3084ef7da12432e80c8bc7b8b7349c4 Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888 Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: de4ad4b38a3f4e3aa1b2ce4502066431 Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1132819888-project Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: {"remove_host": {"host": "n-h2-858383-3"}} Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:31:12.276093 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-858383-3'}}} Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:12.276928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 03 10:31:12.278515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.281435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9f62830-2c76-4f0d-a46f-ac99fb0f56e6 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:12.281435 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9f62830-2c76-4f0d-a46f-ac99fb0f56e6 tempest-AggregatesAdminNegativeTestJSON-1132819888 tempest-AggregatesAdminNegativeTestJSON-1132819888-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.036359 Oct 03 10:31:12.282335 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 84/212] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 10:31:12 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:12.292860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7d7eb6c-0f3f-4c54-b8b3-d6b49e7848e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.307468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-a7d7eb6c-0f3f-4c54-b8b3-d6b49e7848e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7d7eb6c-0f3f-4c54-b8b3-d6b49e7848e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Request method failure captured: Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm_dNuUazhdI10sRC8q0Wt3ngf9Kzwe5yqoHsi4nB_ciYi761__sWu5LXc1P7MNXdmyh6ysRBZmKOC16mpEdMQQGEcZdIQOH9MCXy8mdQpfObVLLh7_K15wgCUfdm--VVZvOXV6MOlLCLRn7lpqIdkppBxXUgp6y3XhxtFbPeU5J3U Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:31:12.313553 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}] Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 19b6c6dd3cfb47febbb71aa13f4903b5 Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: exception: Aggregate 13 could not be found. Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '13'} Oct 03 10:31:12.314918 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.315649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 03 10:31:12.316674 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.317689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7d7eb6c-0f3f-4c54-b8b3-d6b49e7848e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:12.317689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7d7eb6c-0f3f-4c54-b8b3-d6b49e7848e8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.033196 Oct 03 10:31:12.337617 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 85/213] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:12 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:12.352115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b628236-ff9a-4136-845c-2e4446f3b801 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:12.380172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b628236-ff9a-4136-845c-2e4446f3b801 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.383974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:12.384862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b628236-ff9a-4136-845c-2e4446f3b801 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.385451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b628236-ff9a-4136-845c-2e4446f3b801 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.402441 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-570fbed6-2b87-45ce-9257-be0077b7f69c tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1321 microversion: 2.1 time: 0.245425 Oct 03 10:31:12.418524 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 129/214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:12 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:12.418524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c5d75e7-1ef3-4e44-82fa-e7ce22e7a530 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.479047 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9c5d75e7-1ef3-4e44-82fa-e7ce22e7a530 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c5d75e7-1ef3-4e44-82fa-e7ce22e7a530 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Request method failure captured: Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_dNuUazhdI10sRC8q0Wt3ngf9Kzwe5yqoHsi4nB_ciYi761__sWu5LXc1P7MNXdmyh6ysRBZmKOC16mpEdMQQGEcZdIQOH9MCXy8mdQpfObVLLh7_K15wgCUfdm--VVZvOXV6MOlLCLRn7lpqIdkppBxXUgp6y3XhxtFbPeU5J3U Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:12.480913 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f99bc8560a564c88b0e7461d71b8f18a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f99bc8560a564c88b0e7461d71b8f18a"}]}] Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: f99bc8560a564c88b0e7461d71b8f18a Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1479845902 Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 19b6c6dd3cfb47febbb71aa13f4903b5 Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminTestJSON-1479845902-project-admin Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: exception: Aggregate 13 could not be found. Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '13'} Oct 03 10:31:12.482039 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:12.482770 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:12.483759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c5d75e7-1ef3-4e44-82fa-e7ce22e7a530 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9c5d75e7-1ef3-4e44-82fa-e7ce22e7a530 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.074684 Oct 03 10:31:12.486784 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 130/215] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:12 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:12.492394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.495814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:12.542033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.546156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.546627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.551228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.551228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.551615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:12.714570 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b628236-ff9a-4136-845c-2e4446f3b801 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.375767 Oct 03 10:31:12.716011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 86/216] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 10:31:12 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.736480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75f01eec-0783-4556-a848-0ac06c7bfc4a tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1787101833"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:12.738529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:12.744055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-75f01eec-0783-4556-a848-0ac06c7bfc4a tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid e1594799-95a2-4cce-a312-e2038fadb9ad for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:12.752625 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63fc27f7-756c-4d3d-a3f2-d1a48d8838dd tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1276 microversion: 2.1 time: 0.260099 Oct 03 10:31:12.754542 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 131/217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:12 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:12.766947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83649558-af21-4ba9-9738-58839a3ee493 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.791938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75f01eec-0783-4556-a848-0ac06c7bfc4a tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074605 Oct 03 10:31:12.798731 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 87/218] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.813322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d4beb39-fad0-4c49-acbd-a5720fccd5de tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.824054 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83649558-af21-4ba9-9738-58839a3ee493 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.067092 Oct 03 10:31:12.827432 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 132/219] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:12 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:12.839679 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d4beb39-fad0-4c49-acbd-a5720fccd5de tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.035395 Oct 03 10:31:12.840986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-18ef858e-3a25-4d0d-be3c-2ba17560b562 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-462382305"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:12.842110 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 88/220] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:12 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.847898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-18ef858e-3a25-4d0d-be3c-2ba17560b562 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Generated uuid 0db10a2d-2f40-462b-aa65-0cea2068a032 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:12.857252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6710c16d-60d6-4845-b587-5d3e559edee5 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:12.899971 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-18ef858e-3a25-4d0d-be3c-2ba17560b562 tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065797 Oct 03 10:31:12.903452 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 133/221] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.925563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:12.941907 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6710c16d-60d6-4845-b587-5d3e559edee5 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.090334 Oct 03 10:31:12.956371 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 89/222] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 10:31:12 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.961038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:12.961889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cfcdd67e-f2a5-4196-bc38-572ff91a2075 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:12.978159 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cfcdd67e-f2a5-4196-bc38-572ff91a2075 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.020133 Oct 03 10:31:12.979152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 90/223] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:12 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:12.986571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:12.988856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:12.989766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.010901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b0b3375-13e0-4a5c-b5dd-1a3d93c41b99 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.037005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.037590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.038048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.063712 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b0b3375-13e0-4a5c-b5dd-1a3d93c41b99 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.073744 Oct 03 10:31:13.066629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.compute.aggregates [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 03 10:31:13.069593 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 91/224] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:12 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:13.072382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Request method failure captured: Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 42 Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm_P9XN42t6p_EQdnHdYuje-Deg3UtDBYxjgt7M6hyO5PEA2_zpKKfMk8P9ZOVyjURD1YcO94n9BIN3OZxc2KKOClT4SWJ28Qx4XaWbSjtTtzLywtydXLVR0JMovsX2DZeCk5UOlNtSn9_kZN8e1Sm0HZNWKk4wWF5YqwsO-4CAf3k Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:13.074501 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a0ed00dd58e4a75857d10371b36881e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a0ed00dd58e4a75857d10371b36881e"}]}] Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a0ed00dd58e4a75857d10371b36881e Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748 Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60d208e04092487780a2c3ac27d26e4f Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: {"remove_host": {"host": "nonexist_host"}} Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:13.075694 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6015, in _get_service_in_cell_by_host Oct 03 10:31:13.076991 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6693, in remove_host_from_aggregate Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 03 10:31:13.078141 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _get_service_in_cell_by_host Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.079223 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:13.080345 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:13.080345 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:13.080345 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:13.080345 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:13.080345 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 03 10:31:13.080345 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:13.080682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-953ab1eb-d7fe-4567-afb8-15d28d4abe69 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-335606332", "availability_zone": "tempest-test_az-912719273"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:13.081806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:13.081806 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12b8a2c0-ceed-4794-a749-7e8d37b73b4b tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.168683 Oct 03 10:31:13.083676 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 134/225] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 10:31:12 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:13.084019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-953ab1eb-d7fe-4567-afb8-15d28d4abe69 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid 295b7636-d582-47e0-b9bf-46b1b04dd2e7 for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:13.098111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.098690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:13.108927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.109883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.110548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.112902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.113678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.114331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.137109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-953ab1eb-d7fe-4567-afb8-15d28d4abe69 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.066308 Oct 03 10:31:13.151959 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 92/226] 10.222.0.27 () {60 vars in 1165 bytes} [Mon Oct 3 10:31:13 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:13.172650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-abfe6677-0cf4-4ae4-9080-789ff9dda97f tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.209244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-abfe6677-0cf4-4ae4-9080-789ff9dda97f tempest-AggregatesAdminNegativeTestJSON-2043005748 tempest-AggregatesAdminNegativeTestJSON-2043005748-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.055635 Oct 03 10:31:13.210250 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 93/227] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:13.217948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f34c6be-f95c-46fe-85f4-b06c51560ee6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-335606332_new", "availability_zone": "tempest-test_az-912719273_new"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:13.366455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=9,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:13.371674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f34c6be-f95c-46fe-85f4-b06c51560ee6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.372399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f34c6be-f95c-46fe-85f4-b06c51560ee6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.373161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f34c6be-f95c-46fe-85f4-b06c51560ee6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.466356 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f34c6be-f95c-46fe-85f4-b06c51560ee6 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 334 microversion: 2.1 time: 0.254426 Oct 03 10:31:13.467305 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 94/228] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 3 10:31:13 2022] PUT /compute/v2.1/os-aggregates/16 => generated 334 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:13.476515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.477386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:13.489150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:13.501598 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9426f13f-c7f4-4305-8efa-f9213f7f9d0d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1289 microversion: 2.1 time: 0.416215 Oct 03 10:31:13.501835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.502634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.504072 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 135/229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:13 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1289 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:13.504595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.507140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.508466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.510158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.515229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7379ff6-0a8c-4444-8eeb-89d33c73e4f1 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.550630 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7379ff6-0a8c-4444-8eeb-89d33c73e4f1 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.043081 Oct 03 10:31:13.552789 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 136/230] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:31:13 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:13.569387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3464a5f-9f83-4a89-85a2-3d23a40effed tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.617898 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3464a5f-9f83-4a89-85a2-3d23a40effed tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.058098 Oct 03 10:31:13.619372 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 137/231] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:13 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:13.629728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eef4ee6d-0783-4d2e-b4d1-07b71d0d8eb8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-399110066"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:13.644206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-eef4ee6d-0783-4d2e-b4d1-07b71d0d8eb8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Generated uuid 282b2d7b-8c09-4dc7-ad2f-5f16e68c703d for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:13.686961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:13.691667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eef4ee6d-0783-4d2e-b4d1-07b71d0d8eb8 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067969 Oct 03 10:31:13.693013 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 138/232] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 10:31:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:13.706995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2602a7f3-cd40-4d43-9780-383fb8a82afd tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.718771 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2602a7f3-cd40-4d43-9780-383fb8a82afd tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.018606 Oct 03 10:31:13.719990 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 139/233] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:31:13 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:13.732887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-937de84a-dcc0-44bf-bc5c-fcc099aa3d08 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.771217 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-937de84a-dcc0-44bf-bc5c-fcc099aa3d08 tempest-AggregatesAdminTestJSON-1479845902 tempest-AggregatesAdminTestJSON-1479845902-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.043213 Oct 03 10:31:13.772960 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 140/234] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:13 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:31:13.785385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:13.786671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:13.794346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.796231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.797280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:13.799414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:13.800152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:13.800957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:14.019991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:14.029197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f14ba700-3f99-4c1a-9eb2-b45d6bae40cb tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1276 microversion: 2.1 time: 0.250032 Oct 03 10:31:14.037596 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 141/235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:13 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:14.042425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:14.042927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:14.056882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:14.057391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:14.057938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:14.058694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:14.059263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:14.059584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:14.087693 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] HTTP exception thrown: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Request method failure captured: Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f HTTP/1.1 Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm9K7lYcAMc5aq-Fl3-pndCf1Qvopk6UOV05dM0wLnnbWlcoWG-BTu6FllMQ-DYKtQPmtwOstQ4BV1EYCKFOjx_Bt4MrkOM3oubJqEbcq_WF1sElj7VCD_cy1pk7wRRQTLdoPdVy81MdlpYgH7udV-e6Xy8Em0MyhJC8XUvrwRYllg Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4873c6872c514a02a2a2a0f2ac0d98d8 Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:14.092758 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4873c6872c514a02a2a2a0f2ac0d98d8"}]}] Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4873c6872c514a02a2a2a0f2ac0d98d8 Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminTestJSON-829916290-project Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f6bd3486b7f242f8849563d8ca63a0cf Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminTestJSON-829916290-project Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.093985 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'af222604-5009-4007-92ab-921c98a70b1f'} Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:14.094633 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.096663 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.099213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Returning 404 to user: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:14.099213 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e9d8f49-6342-4700-bd3e-b89163cc3b66 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 404 len: 111 microversion: 2.1 time: 0.055758 Oct 03 10:31:14.099213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 142/236] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:14 2022] DELETE /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:14.102764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:14.103443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] [instance: af222604-5009-4007-92ab-921c98a70b1f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:14.113826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:14.114587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:14.115271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:14.115896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:14.116340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:14.116794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:14.138663 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] HTTP exception thrown: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Request method failure captured: Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f HTTP/1.1 Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm9K7lYcAMc5aq-Fl3-pndCf1Qvopk6UOV05dM0wLnnbWlcoWG-BTu6FllMQ-DYKtQPmtwOstQ4BV1EYCKFOjx_Bt4MrkOM3oubJqEbcq_WF1sElj7VCD_cy1pk7wRRQTLdoPdVy81MdlpYgH7udV-e6Xy8Em0MyhJC8XUvrwRYllg Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4873c6872c514a02a2a2a0f2ac0d98d8 Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:14.141265 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4873c6872c514a02a2a2a0f2ac0d98d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4873c6872c514a02a2a2a0f2ac0d98d8"}]}] Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4873c6872c514a02a2a2a0f2ac0d98d8 Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-829916290 Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AggregatesAdminTestJSON-829916290-project Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f6bd3486b7f242f8849563d8ca63a0cf Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AggregatesAdminTestJSON-829916290-project Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.142692 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'af222604-5009-4007-92ab-921c98a70b1f'} Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:14.143438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. Oct 03 10:31:14.144473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:14.146737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] Returning 404 to user: Instance af222604-5009-4007-92ab-921c98a70b1f could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:14.147808 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-052a5100-ffeb-4097-aa11-b3bfe5581d36 tempest-AggregatesAdminTestJSON-829916290 tempest-AggregatesAdminTestJSON-829916290-project] 10.222.0.27 "GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f" status: 404 len: 111 microversion: 2.1 time: 0.048761 Oct 03 10:31:14.149280 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 143/237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:14 2022] GET /compute/v2.1/servers/af222604-5009-4007-92ab-921c98a70b1f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:31:14.294455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:14.307785 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ffa677e-9215-4f8b-8dd1-17d25e6e4606 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1388 microversion: 2.1 time: 0.837306 Oct 03 10:31:14.309374 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 95/238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:13 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1388 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:14.526772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:14.527311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:14.535672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:14.546134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:14.546593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:14.547349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:14.547808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:14.548238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:15.046984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:15.055606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:15.056354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:15.063567 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e07810e-5726-4a62-a821-313eedacd33d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1277 microversion: 2.1 time: 0.540629 Oct 03 10:31:15.064578 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 144/239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:14 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1277 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:15.082458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:15.083351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:15.083982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:15.084918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:15.085578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:15.086194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:15.335195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:15.336130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:15.344043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:15.344668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:15.345312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:15.352490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:15.353284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:15.353830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:15.581525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:15.585268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:15.593105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce136f5a-801d-48d2-94de-702413eb976d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.541303 Oct 03 10:31:15.600584 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 96/240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:15 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:15.710567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-696b830e-e806-45c1-a608-9a5a5d2766e5 req-2609c036-434b-4db3-aa0d-68fa5ba03ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03170cc0-d8a1-4021-8aac-b4019e329987", "tag": "77628770-1ed9-42bc-9dc2-87f9f8955595"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:15.733670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-696b830e-e806-45c1-a608-9a5a5d2766e5 req-2609c036-434b-4db3-aa0d-68fa5ba03ffe service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:15.734394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-696b830e-e806-45c1-a608-9a5a5d2766e5 req-2609c036-434b-4db3-aa0d-68fa5ba03ffe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:15.734990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-696b830e-e806-45c1-a608-9a5a5d2766e5 req-2609c036-434b-4db3-aa0d-68fa5ba03ffe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:15.774162 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-696b830e-e806-45c1-a608-9a5a5d2766e5 req-2609c036-434b-4db3-aa0d-68fa5ba03ffe service nova] Creating event network-changed:77628770-1ed9-42bc-9dc2-87f9f8955595 for instance 03170cc0-d8a1-4021-8aac-b4019e329987 on n-h2-858383-3 Oct 03 10:31:15.785424 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-696b830e-e806-45c1-a608-9a5a5d2766e5 req-2609c036-434b-4db3-aa0d-68fa5ba03ffe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078305 Oct 03 10:31:15.786356 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 97/241] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:15.962157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:15.972466 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-56d07cda-f5cb-4dc3-9ea2-499096b0014a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1388 microversion: 2.1 time: 0.640957 Oct 03 10:31:15.981879 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 145/242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:15 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1388 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:16.091932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:16.092839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:16.099928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:16.100945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:16.101584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:16.102509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:16.103143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:16.103766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:16.288098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:16.301502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5bf7260-83bb-42ff-a03f-3e694b897636 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1277 microversion: 2.1 time: 0.214225 Oct 03 10:31:16.318218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 98/243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:16 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:16.617139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:16.618748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:16.630088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:16.632607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:16.633269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:16.635805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:16.637312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:16.639729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:17.009293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:17.009916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:17.023070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:17.023571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:17.025324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:17.028327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:17.029224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:17.029754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:17.292501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:17.309833 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78112cd3-5fc8-4353-a188-e82fdd14fbca tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.692717 Oct 03 10:31:17.310517 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 146/244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:16 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:17.335395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:17.336009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:17.347534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:17.348013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:17.348452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:17.349197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:17.350151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:17.350581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:17.356945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:17.678546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:17.692126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61e11dfb-0f29-44bb-a625-cd07899040c2 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1388 microversion: 2.1 time: 0.691661 Oct 03 10:31:17.693292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 99/245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:16 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1388 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:17.727579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:17.738313 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8801179d-f479-489f-91bf-65f3325e7fac tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.407762 Oct 03 10:31:17.743152 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 147/246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:17 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:18.339842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:18.340713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:18.359215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:18.359966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:18.362223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:18.362868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:18.365541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:18.366516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:18.729679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:18.730958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:18.746707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:18.747215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:18.747659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:18.748376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:18.748865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:18.749297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:18.820010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:18.836708 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ecbcfa5a-a3d3-48ec-8403-b0f3e98316c2 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.502321 Oct 03 10:31:18.837852 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 100/247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:18 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:18.853991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:18.855042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:18.870545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:18.872416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:18.876191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:18.877160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:18.881329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:18.882042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:19.212323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:19.224984 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a89a9a0c-b4e5-4bb7-b5d8-2e343f154136 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1388 microversion: 2.1 time: 0.502239 Oct 03 10:31:19.242123 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 148/248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:18 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1388 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:19.425490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:19.435353 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-055cf3a6-7097-4c4c-83d1-9dfe35c08ec1 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.596318 Oct 03 10:31:19.441148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 101/249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:18 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:19.480384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e9d641b0-af8a-4d6a-8e61-657e9a1a345b req-f9e2f9a1-4737-42a8-bf79-c34c3740e015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dd1072-c4cb-442b-a7de-8d39f43d11cb", "tag": "eadfdaa3-3dfc-4402-8aef-cc76c6e45455"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:19.512761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e9d641b0-af8a-4d6a-8e61-657e9a1a345b req-f9e2f9a1-4737-42a8-bf79-c34c3740e015 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:19.513288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e9d641b0-af8a-4d6a-8e61-657e9a1a345b req-f9e2f9a1-4737-42a8-bf79-c34c3740e015 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:19.518187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e9d641b0-af8a-4d6a-8e61-657e9a1a345b req-f9e2f9a1-4737-42a8-bf79-c34c3740e015 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:19.548440 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e9d641b0-af8a-4d6a-8e61-657e9a1a345b req-f9e2f9a1-4737-42a8-bf79-c34c3740e015 service nova] Creating event network-changed:eadfdaa3-3dfc-4402-8aef-cc76c6e45455 for instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb on n-h1-858383-3 Oct 03 10:31:19.559811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e9d641b0-af8a-4d6a-8e61-657e9a1a345b req-f9e2f9a1-4737-42a8-bf79-c34c3740e015 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084802 Oct 03 10:31:19.563838 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 149/250] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:19.866936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:19.867864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:19.880658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=20 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:19.895868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:19.898901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:19.899753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:19.905152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:19.917646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:19.918945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:20.268601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:20.270014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:20.293103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:20.294789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:20.296568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:20.297526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:20.297984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:20.298485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:20.442476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:20.456179 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f09c4517-124f-4c5b-8982-e996f81c42b4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.590131 Oct 03 10:31:20.458490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 102/251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:19 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:20.477843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:20.482337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:20.497910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:20.498768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:20.502145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:20.506253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:20.509751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:20.511212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:20.907432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:20.915637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-410725a1-f386-4529-8e0e-22cf842707dc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1388 microversion: 2.1 time: 0.658861 Oct 03 10:31:20.931841 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 150/252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:20 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1388 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:21.150466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:21.165452 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-572fbd4c-3814-42f4-ade0-8633087dca3e tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.705446 Oct 03 10:31:21.166107 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 103/253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:20 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:21.409261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Calling method '.version_select at 0x7f074fd2c700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:21.411261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.412099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.412732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.447218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.447730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.449313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.476364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.483658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:21.484265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:21.487340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.489766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.501278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:21.503229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.505655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.506342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.507229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.511402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.512143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.513233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-afe1006d-e0e4-4439-bb42-8c284d0e9b9b tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.580060 Oct 03 10:31:21.520279 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 151/254] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:21.533495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Calling method '.version_select at 0x7f074fc22ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:21.535490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.536229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.536854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.568059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.569305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.569884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.689226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.692479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.693094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.712405 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0d8e021-fe53-45a3-8f95-a8812cc3cbd9 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-858383-3/servers" status: 200 len: 275 microversion: 2.1 time: 0.181576 Oct 03 10:31:21.717565 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 152/255] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 3 10:31:21 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-3/servers => generated 275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:21.729378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a1401ca8-64fc-4f7c-9efb-e36059b0c365 req-ce60fd10-5740-4aec-b05a-182a8083d580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1975aa-22f5-4838-91b3-6d9f13b5fe98", "tag": "de42700a-43d0-400f-a7d7-610b9e7c94b8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:21.756891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a1401ca8-64fc-4f7c-9efb-e36059b0c365 req-ce60fd10-5740-4aec-b05a-182a8083d580 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.758030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a1401ca8-64fc-4f7c-9efb-e36059b0c365 req-ce60fd10-5740-4aec-b05a-182a8083d580 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.759272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a1401ca8-64fc-4f7c-9efb-e36059b0c365 req-ce60fd10-5740-4aec-b05a-182a8083d580 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.796698 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a1401ca8-64fc-4f7c-9efb-e36059b0c365 req-ce60fd10-5740-4aec-b05a-182a8083d580 service nova] Creating event network-changed:de42700a-43d0-400f-a7d7-610b9e7c94b8 for instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 on n-h1-858383-3 Oct 03 10:31:21.809624 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a1401ca8-64fc-4f7c-9efb-e36059b0c365 req-ce60fd10-5740-4aec-b05a-182a8083d580 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088515 Oct 03 10:31:21.811716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 153/256] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:21.825725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Calling method '.version_select at 0x7f074fab8700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:21.828815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.832421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.834262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.848486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:21.861440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1857771d-dbbc-4204-ae0a-e12d0e0a9a10 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.381564 Oct 03 10:31:21.863233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 104/257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:21 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:21.870178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.870677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.871116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.892461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.893326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.893922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.901687 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c0617b9-fcb5-4c5a-a950-b4a89da1c14c tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088621 Oct 03 10:31:21.902477 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 154/258] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:21.913495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Calling method '.version_select at 0x7f074fbf6e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:21.915331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.916053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.916573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.939089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:21.939622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.939881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:21.940390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.940969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.947725 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4302f6f8-1f11-4bb2-aa0c-78d6408dbff6 tempest-HypervisorAdminUnderV252Test-1646245021 tempest-HypervisorAdminUnderV252Test-1646245021-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-858383-3/search" status: 200 len: 104 microversion: 2.1 time: 0.037719 Oct 03 10:31:21.948825 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 105/259] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 3 10:31:21 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-3/search => generated 104 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:21.953545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.954042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.954486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:21.955608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:21.955720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:21.956104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:22.168384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:22.185047 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d729f96-2685-4bfd-9c95-2cd6c68ab122 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1388 microversion: 2.1 time: 0.250187 Oct 03 10:31:22.201599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:22.201599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:22.203185 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 155/260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:21 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1388 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:22.205714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:22.206200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:22.206630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:22.207382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:22.207833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:22.208251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:22.463969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:22.479036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b633029-7f06-48e3-9f84-4e2538f4abec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.288700 Oct 03 10:31:22.493716 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 106/261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:22 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:22.557170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a196707d-6be3-424d-a50f-bb1f564f8d1d req-54ae87d1-fad4-424a-90be-016143be8fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03170cc0-d8a1-4021-8aac-b4019e329987", "name": "network-vif-plugged", "status": "completed", "tag": "77628770-1ed9-42bc-9dc2-87f9f8955595"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:22.573910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a196707d-6be3-424d-a50f-bb1f564f8d1d req-54ae87d1-fad4-424a-90be-016143be8fa2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:22.574517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a196707d-6be3-424d-a50f-bb1f564f8d1d req-54ae87d1-fad4-424a-90be-016143be8fa2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:22.581637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a196707d-6be3-424d-a50f-bb1f564f8d1d req-54ae87d1-fad4-424a-90be-016143be8fa2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:22.615803 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a196707d-6be3-424d-a50f-bb1f564f8d1d req-54ae87d1-fad4-424a-90be-016143be8fa2 service nova] Creating event network-vif-plugged:77628770-1ed9-42bc-9dc2-87f9f8955595 for instance 03170cc0-d8a1-4021-8aac-b4019e329987 on n-h2-858383-3 Oct 03 10:31:22.634028 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a196707d-6be3-424d-a50f-bb1f564f8d1d req-54ae87d1-fad4-424a-90be-016143be8fa2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079996 Oct 03 10:31:22.639638 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 156/262] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:22.889958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:22.890884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:22.899353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:22.900401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:22.900875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:22.901582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:22.903483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:22.903918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:23.021705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:23.190014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a84bdf8e-ac67-4ffe-a42e-a60b52fb5b3e tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-913320544", "id": 1522274877, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:23.195617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:23.211374 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e1c92a9-1df3-4e9a-b2ba-79c8b90570f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.328502 Oct 03 10:31:23.213447 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 157/263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:22 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:23.221967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:23.224341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:23.238125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:23.241132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:23.241745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:23.244237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:23.244891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:23.245945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:23.251072 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a84bdf8e-ac67-4ffe-a42e-a60b52fb5b3e tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.541136 Oct 03 10:31:23.255120 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 107/264] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:22 2022] POST /compute/v2.1/flavors => generated 429 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:23.266150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72a15069-9aef-48f5-858d-01b0868631c2 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:23.331713 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72a15069-9aef-48f5-858d-01b0868631c2 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1522274877" status: 202 len: 0 microversion: 2.1 time: 0.069269 Oct 03 10:31:23.335985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 108/265] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:31:23 2022] DELETE /compute/v2.1/flavors/1522274877 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:31:23.346943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c04b31e2-3022-4b74-85b3-52979c3ea7de tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:23.407422 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c04b31e2-3022-4b74-85b3-52979c3ea7de tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.070071 Oct 03 10:31:23.410693 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 109/266] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:23 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:23.433246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e06bb0f8-761a-4f3b-a198-6a5286b843ae tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2109420555", "id": 510248452, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:23.472417 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e06bb0f8-761a-4f3b-a198-6a5286b843ae tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.042948 Oct 03 10:31:23.473065 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 110/267] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:23 2022] POST /compute/v2.1/flavors => generated 414 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:23.488575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-188ee642-be60-4df6-a1d2-a0e04928a663 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:23.534958 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-188ee642-be60-4df6-a1d2-a0e04928a663 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.051708 Oct 03 10:31:23.541905 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 111/268] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:23 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:23.548720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:23.550896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:23.594388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:23.594904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:23.595353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:23.599928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:23.601998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:23.602491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:23.858344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:23.869741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f200338b-e33c-4698-85f0-7aa0fad0a43d tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.326506 Oct 03 10:31:23.870333 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 112/269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:23 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:24.029246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:24.054187 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-74956ea9-bb15-4021-885b-381dc5d96742 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1388 microversion: 2.1 time: 0.838050 Oct 03 10:31:24.071952 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 158/270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:23 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1388 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:24.072965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1eeada31-ad03-4b2c-9057-a4f314336e10 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.106906 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1eeada31-ad03-4b2c-9057-a4f314336e10 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/510248452" status: 202 len: 0 microversion: 2.1 time: 0.038325 Oct 03 10:31:24.108215 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 159/271] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:24 2022] DELETE /compute/v2.1/flavors/510248452 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:24.209985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Calling method '.version_select at 0x7f074fdee8b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.214235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.214901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.215663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.239800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.240481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.241312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.258471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-14c74c71-901f-4dea-b051-9577f4731d95 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Calling method '.version_select at 0x7f074fad0ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.260249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-14c74c71-901f-4dea-b051-9577f4731d95 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '127eed97f2c443a9a5beab74b3fc8ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a091e9f6b354855a5e3265c792a1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-14c74c71-901f-4dea-b051-9577f4731d95 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Request method failure captured: Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrn6znOrrwzuphgxgumLK59-Ic8Cobki2ict8domOsj8_SKZDiFTQkWKTjLEFgJc2L9MTIN75E19b_AQNWn11eQFwLR3sQJRlcf96NOGZTHGaKD92kMFo_j8vDP1O9DH5G0VwvpvzCSaj09QubH2PgWIeJW7YRWV-Qul3H8wMLKzptw Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:24.267262 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}] Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 127eed97f2c443a9a5beab74b3fc8ab9 Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:31:24.268792 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:24.269620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 03 10:31:24.270621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.275020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-14c74c71-901f-4dea-b051-9577f4731d95 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:24.276072 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-14c74c71-901f-4dea-b051-9577f4731d95 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.165602 Oct 03 10:31:24.277206 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 160/272] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:24.282690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f2c0c52-58f6-47e2-ae00-d25978ce4b1c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.283862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.284550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.285450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.293898 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-429b7ef3-d5e1-4806-a6e2-075811cfb059 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.417610 Oct 03 10:31:24.297769 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 113/273] 10.222.0.27 () {60 vars in 1208 bytes} [Mon Oct 3 10:31:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:31:24.309344 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f2c0c52-58f6-47e2-ae00-d25978ce4b1c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.030427 Oct 03 10:31:24.310403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.310534 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 161/274] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:24.312068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:24.316587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f791338-5963-4c07-b948-9a7da1d7f76a tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Calling method '.version_select at 0x7f074fad6430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.318730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f791338-5963-4c07-b948-9a7da1d7f76a tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '127eed97f2c443a9a5beab74b3fc8ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a091e9f6b354855a5e3265c792a1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:24.319795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f791338-5963-4c07-b948-9a7da1d7f76a tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Request method failure captured: Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrn6znOrrwzuphgxgumLK59-Ic8Cobki2ict8domOsj8_SKZDiFTQkWKTjLEFgJc2L9MTIN75E19b_AQNWn11eQFwLR3sQJRlcf96NOGZTHGaKD92kMFo_j8vDP1O9DH5G0VwvpvzCSaj09QubH2PgWIeJW7YRWV-Qul3H8wMLKzptw Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:24.320289 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}] Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 127eed97f2c443a9a5beab74b3fc8ab9 Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:31:24.325024 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:24.325750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 03 10:31:24.326815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.328354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f791338-5963-4c07-b948-9a7da1d7f76a tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:24.328354 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f791338-5963-4c07-b948-9a7da1d7f76a tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009533 Oct 03 10:31:24.328492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.328568 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 162/275] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:24.328636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.328715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-354ba84a-0367-4758-85d7-b8c468afaae8 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-534698594"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:24.329663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.330409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.331066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.331395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.aggregate [None req-354ba84a-0367-4758-85d7-b8c468afaae8 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Generated uuid 80e988cd-2629-42bd-b531-8cec1a8fa724 for aggregate {{(pid=122270) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 10:31:24.364454 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-354ba84a-0367-4758-85d7-b8c468afaae8 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.041019 Oct 03 10:31:24.366882 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 163/276] 10.222.0.27 () {62 vars in 1205 bytes} [Mon Oct 3 10:31:24 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:24.374360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b05292e-9cce-43ac-ad69-70e2570df1af tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Calling method '.version_select at 0x7f074fad0ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.377472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0b05292e-9cce-43ac-ad69-70e2570df1af tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '127eed97f2c443a9a5beab74b3fc8ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a091e9f6b354855a5e3265c792a1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b05292e-9cce-43ac-ad69-70e2570df1af tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Request method failure captured: Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrn6znOrrwzuphgxgumLK59-Ic8Cobki2ict8domOsj8_SKZDiFTQkWKTjLEFgJc2L9MTIN75E19b_AQNWn11eQFwLR3sQJRlcf96NOGZTHGaKD92kMFo_j8vDP1O9DH5G0VwvpvzCSaj09QubH2PgWIeJW7YRWV-Qul3H8wMLKzptw Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:24.381517 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}] Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 127eed97f2c443a9a5beab74b3fc8ab9 Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:31:24.384079 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:24.385758 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 03 10:31:24.388644 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:24.393526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b05292e-9cce-43ac-ad69-70e2570df1af tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:24.396107 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0b05292e-9cce-43ac-ad69-70e2570df1af tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027101 Oct 03 10:31:24.397683 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 164/277] 10.222.0.27 () {58 vars in 1179 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:24.416366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ff70ad8-4eb4-40d2-b958-b96af7906fb1 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-168259535", "id": 2115883516, "os-flavor-access:is_public": "True"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:24.481548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ff70ad8-4eb4-40d2-b958-b96af7906fb1 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.078162 Oct 03 10:31:24.482245 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 165/278] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:24 2022] POST /compute/v2.1/flavors => generated 428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:24.497179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41688289-c761-46c2-9db1-a54d8e596a46 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1508549374"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:24.640654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:24.649996 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ccec13f-9cc4-4bd0-b68a-872dba8b911c tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.351003 Oct 03 10:31:24.650746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 114/279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:24.696961 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41688289-c761-46c2-9db1-a54d8e596a46 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.203395 Oct 03 10:31:24.704097 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 166/280] 10.222.0.27 () {62 vars in 1213 bytes} [Mon Oct 3 10:31:24 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:24.708453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d38410a2-f7bd-42c7-97ac-5b61613eba83 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.729262 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d38410a2-f7bd-42c7-97ac-5b61613eba83 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2115883516" status: 202 len: 0 microversion: 2.1 time: 0.030588 Oct 03 10:31:24.729844 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 167/281] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:31:24 2022] DELETE /compute/v2.1/flavors/2115883516 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:24.741364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3eef891-f008-4faa-9f0a-67d76f850a3f tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.753467 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3eef891-f008-4faa-9f0a-67d76f850a3f tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.017946 Oct 03 10:31:24.754705 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 168/282] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:24.764414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b77dfa97-f4d7-4b77-a1ed-b8b9134a8943 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.791985 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b77dfa97-f4d7-4b77-a1ed-b8b9134a8943 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.036059 Oct 03 10:31:24.793089 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 169/283] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:24.801021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-38dd824f-5086-47f4-9fc9-3a2eeeb74322 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:24.813008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:24.814521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38dd824f-5086-47f4-9fc9-3a2eeeb74322 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.815060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38dd824f-5086-47f4-9fc9-3a2eeeb74322 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.815494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38dd824f-5086-47f4-9fc9-3a2eeeb74322 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.948614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Calling method '.version_select at 0x7f074fb77040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:24.950712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.951950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.952593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.971964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.973346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.973891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:24.974300 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-38dd824f-5086-47f4-9fc9-3a2eeeb74322 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.180062 Oct 03 10:31:24.974881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 170/284] 10.222.0.27 () {62 vars in 1235 bytes} [Mon Oct 3 10:31:24 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:24.979755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8aceb550-f176-498f-9c13-214369f8803c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-962793714", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:24.995813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:24.996929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:24.997659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.005948 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8aceb550-f176-498f-9c13-214369f8803c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029921 Oct 03 10:31:25.007650 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b35ba9b3-5fc7-4be3-ad86-089824b64ed3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.355619 Oct 03 10:31:25.007799 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 171/285] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:24 2022] POST /compute/v2.1/flavors => generated 506 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:25.008857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 115/286] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:25.013504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad08926b-62d5-46a5-8df6-e6e76fe51abb tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:25.017974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.023312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:25.025763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad08926b-62d5-46a5-8df6-e6e76fe51abb tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.026488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad08926b-62d5-46a5-8df6-e6e76fe51abb tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.027119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad08926b-62d5-46a5-8df6-e6e76fe51abb tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.036217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.038145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.038943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.039660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.040123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.040548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.173191 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad08926b-62d5-46a5-8df6-e6e76fe51abb tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.162843 Oct 03 10:31:25.174164 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 116/287] 10.222.0.27 () {62 vars in 1235 bytes} [Mon Oct 3 10:31:25 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:25.179798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecc0b724-bb72-472b-babe-622e2327e161 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Calling method '.version_select at 0x7f074fb330d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.183155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecc0b724-bb72-472b-babe-622e2327e161 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '127eed97f2c443a9a5beab74b3fc8ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a091e9f6b354855a5e3265c792a1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecc0b724-bb72-472b-babe-622e2327e161 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Request method failure captured: Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrn6znOrrwzuphgxgumLK59-Ic8Cobki2ict8domOsj8_SKZDiFTQkWKTjLEFgJc2L9MTIN75E19b_AQNWn11eQFwLR3sQJRlcf96NOGZTHGaKD92kMFo_j8vDP1O9DH5G0VwvpvzCSaj09QubH2PgWIeJW7YRWV-Qul3H8wMLKzptw Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:25.188044 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}] Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 127eed97f2c443a9a5beab74b3fc8ab9 Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1'} Oct 03 10:31:25.189475 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:25.191210 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 03 10:31:25.192701 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.193818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecc0b724-bb72-472b-babe-622e2327e161 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:25.193818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ecc0b724-bb72-472b-babe-622e2327e161 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.013704 Oct 03 10:31:25.193818 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 117/288] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:25.197361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a584ac72-1c5b-4669-9080-23d3686ec430 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.216273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a584ac72-1c5b-4669-9080-23d3686ec430 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/4693ae88-ec08-481b-b742-cf9185cd1d26" status: 202 len: 0 microversion: 2.1 time: 0.024825 Oct 03 10:31:25.217913 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 118/289] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:25 2022] DELETE /compute/v2.1/flavors/4693ae88-ec08-481b-b742-cf9185cd1d26 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:25.223645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.224570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:25.230759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.231322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.231761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.232654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.233343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.233771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.313622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:25.321107 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8525f9c0-8f26-4151-bcb8-827d0fefbdb5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.312068 Oct 03 10:31:25.322184 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 172/290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:25.337156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c141e12b-a6a2-4ee7-b162-a6d72c2b7c43 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.359936 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c141e12b-a6a2-4ee7-b162-a6d72c2b7c43 tempest-AggregatesAdminTestV241-116520541 tempest-AggregatesAdminTestV241-116520541-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.036445 Oct 03 10:31:25.360997 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 173/291] 10.222.0.27 () {60 vars in 1196 bytes} [Mon Oct 3 10:31:25 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:25.367953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4b49dee-dd7f-45e5-b5ab-50fee6c98c12 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Calling method '.version_select at 0x7f074fd2c550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.370051 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-d4b49dee-dd7f-45e5-b5ab-50fee6c98c12 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] HTTP exception thrown: Hypervisor with ID '0a06b455-f284-477b-9710-7a33bdcf335e' could not be found. Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4b49dee-dd7f-45e5-b5ab-50fee6c98c12 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Request method failure captured: Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hypervisors/0a06b455-f284-477b-9710-7a33bdcf335e/uptime HTTP/1.1 Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrn7dIO8Qu3qxYsC5HYAul9at3S-cnl-c8seuL0M4mexj12kd4ojgLSjcwfYzs9dzdPF_C0-VCZylX4zn7kIRzusRy40djaEg2GYW6NnY9RhdJk1DVw-dI3Z-yTKB85qRTPBCznCUhdDbt9nJ5d4L6tiUbwfbwtLzS8cZBd79csskps Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d97e7d6124864a48a5cfb4bce4659794 Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-984250561 Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:25.382674 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d97e7d6124864a48a5cfb4bce4659794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d97e7d6124864a48a5cfb4bce4659794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d97e7d6124864a48a5cfb4bce4659794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d97e7d6124864a48a5cfb4bce4659794"}]}] Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-984250561 Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d97e7d6124864a48a5cfb4bce4659794 Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-984250561 Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 964632bff0fd4d6c9ddb172d9766a640 Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: exception: Hypervisor with ID '0a06b455-f284-477b-9710-7a33bdcf335e' could not be found. Oct 03 10:31:25.384144 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '0a06b455-f284-477b-9710-7a33bdcf335e'} Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0a06b455-f284-477b-9710-7a33bdcf335e' Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 03 10:31:25.385154 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0a06b455-f284-477b-9710-7a33bdcf335e' could not be found. Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.386547 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.387706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.387706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.387706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.387706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:25.387706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:25.387706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0a06b455-f284-477b-9710-7a33bdcf335e' could not be found. Oct 03 10:31:25.387706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.394217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4b49dee-dd7f-45e5-b5ab-50fee6c98c12 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Returning 404 to user: Hypervisor with ID '0a06b455-f284-477b-9710-7a33bdcf335e' could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:25.395305 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d4b49dee-dd7f-45e5-b5ab-50fee6c98c12 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/0a06b455-f284-477b-9710-7a33bdcf335e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.033229 Oct 03 10:31:25.395994 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 174/292] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/os-hypervisors/0a06b455-f284-477b-9710-7a33bdcf335e/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:25.407241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29816e19-b58d-4114-9c2a-14e27deccdf9 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.416353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:25.430338 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0b30fb5-c495-4c01-92b1-a05d5f41a7c9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1587 microversion: 2.1 time: 0.208591 Oct 03 10:31:25.430338 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 119/293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1587 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:25.435564 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29816e19-b58d-4114-9c2a-14e27deccdf9 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.037949 Oct 03 10:31:25.436477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Calling method '.version_select at 0x7f074fbabb80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.444293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.444805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.445244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.448842 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 175/294] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:25.461528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.464454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:25.476469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.478911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.479266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.480029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.480812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.481404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.481634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.481934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.482089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.509588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.510087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.510528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.526372 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e600cee6-dd3d-4ace-a555-e6156f1b559d tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.096652 Oct 03 10:31:25.526997 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 120/295] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:25.537924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3dfb30fa-0f28-4b0f-9fd5-a1e8a91446eb tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-560045821", "id": "732ebdec-366b-4fd1-a1ac-7df579e491f7", "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:25.563535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3dfb30fa-0f28-4b0f-9fd5-a1e8a91446eb tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.035415 Oct 03 10:31:25.564720 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 121/296] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:25 2022] POST /compute/v2.1/flavors => generated 506 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:25.570980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e308c992-9c50-43a5-a024-1deccc9c27b9 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Calling method '.version_select at 0x7f074fb18040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.573113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e308c992-9c50-43a5-a024-1deccc9c27b9 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '127eed97f2c443a9a5beab74b3fc8ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a091e9f6b354855a5e3265c792a1487', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e308c992-9c50-43a5-a024-1deccc9c27b9 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Request method failure captured: Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrn6znOrrwzuphgxgumLK59-Ic8Cobki2ict8domOsj8_SKZDiFTQkWKTjLEFgJc2L9MTIN75E19b_AQNWn11eQFwLR3sQJRlcf96NOGZTHGaKD92kMFo_j8vDP1O9DH5G0VwvpvzCSaj09QubH2PgWIeJW7YRWV-Qul3H8wMLKzptw Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:25.575240 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a091e9f6b354855a5e3265c792a1487"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a091e9f6b354855a5e3265c792a1487"}]}] Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 6a091e9f6b354855a5e3265c792a1487 Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-568426405 Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 127eed97f2c443a9a5beab74b3fc8ab9 Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-568426405-project Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1'} Oct 03 10:31:25.577365 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:25.578118 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 03 10:31:25.579246 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.582160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e308c992-9c50-43a5-a024-1deccc9c27b9 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:25.587551 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e308c992-9c50-43a5-a024-1deccc9c27b9 tempest-HypervisorAdminNegativeTestJSON-568426405 tempest-HypervisorAdminNegativeTestJSON-568426405-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016808 Oct 03 10:31:25.588296 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 122/297] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:25.599705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3fded10e-6e90-4f7a-a9d3-109a453619a2 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.628186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3fded10e-6e90-4f7a-a9d3-109a453619a2 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/732ebdec-366b-4fd1-a1ac-7df579e491f7" status: 202 len: 0 microversion: 2.1 time: 0.032557 Oct 03 10:31:25.632611 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 123/298] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:25 2022] DELETE /compute/v2.1/flavors/732ebdec-366b-4fd1-a1ac-7df579e491f7 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:25.637391 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06fa3455-f66f-481c-861e-84a5e70534d5 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187240 Oct 03 10:31:25.638140 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 176/299] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:25.639358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-112b5f78-1d3e-4926-a73b-a6ad0eba30c3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Calling method '.version_select at 0x7f074fb18160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.642000 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-112b5f78-1d3e-4926-a73b-a6ad0eba30c3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] HTTP exception thrown: Hypervisor with ID '1a7fd6b4-eede-424d-beb5-3fb1e01f7b42' could not be found. Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-112b5f78-1d3e-4926-a73b-a6ad0eba30c3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Request method failure captured: Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hypervisors/1a7fd6b4-eede-424d-beb5-3fb1e01f7b42 HTTP/1.1 Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrn7dIO8Qu3qxYsC5HYAul9at3S-cnl-c8seuL0M4mexj12kd4ojgLSjcwfYzs9dzdPF_C0-VCZylX4zn7kIRzusRy40djaEg2GYW6NnY9RhdJk1DVw-dI3Z-yTKB85qRTPBCznCUhdDbt9nJ5d4L6tiUbwfbwtLzS8cZBd79csskps Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d97e7d6124864a48a5cfb4bce4659794 Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-984250561 Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:31:25.647290 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d97e7d6124864a48a5cfb4bce4659794"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d97e7d6124864a48a5cfb4bce4659794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d97e7d6124864a48a5cfb4bce4659794"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d97e7d6124864a48a5cfb4bce4659794"}]}] Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-984250561 Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d97e7d6124864a48a5cfb4bce4659794 Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-984250561 Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 964632bff0fd4d6c9ddb172d9766a640 Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: exception: Hypervisor with ID '1a7fd6b4-eede-424d-beb5-3fb1e01f7b42' could not be found. Oct 03 10:31:25.648813 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1a7fd6b4-eede-424d-beb5-3fb1e01f7b42'} Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1a7fd6b4-eede-424d-beb5-3fb1e01f7b42' Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 03 10:31:25.649962 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:31:25.651180 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1a7fd6b4-eede-424d-beb5-3fb1e01f7b42' could not be found. Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1a7fd6b4-eede-424d-beb5-3fb1e01f7b42' could not be found. Oct 03 10:31:25.652643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:25.654800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-930fea05-967a-4f12-a42b-baebd43ad829 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.655897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-112b5f78-1d3e-4926-a73b-a6ad0eba30c3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] Returning 404 to user: Hypervisor with ID '1a7fd6b4-eede-424d-beb5-3fb1e01f7b42' could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:25.657810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-112b5f78-1d3e-4926-a73b-a6ad0eba30c3 tempest-HypervisorAdminNegativeTestJSON-984250561 tempest-HypervisorAdminNegativeTestJSON-984250561-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1a7fd6b4-eede-424d-beb5-3fb1e01f7b42" status: 404 len: 123 microversion: 2.1 time: 0.023531 Oct 03 10:31:25.664870 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 124/300] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/os-hypervisors/1a7fd6b4-eede-424d-beb5-3fb1e01f7b42 => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:25.676185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.677096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:25.687432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.688195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.688908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.690109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:25.690759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:25.691372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:25.707534 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-930fea05-967a-4f12-a42b-baebd43ad829 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.063655 Oct 03 10:31:25.708470 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 177/301] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:25.732056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e8f4f608-844e-4903-bb54-4e5a6319f4ef tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1698400537", "id": 276702669, "os-flavor-access:is_public": "True"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:25.774042 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e8f4f608-844e-4903-bb54-4e5a6319f4ef tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.047465 Oct 03 10:31:25.774649 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 178/302] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:25 2022] POST /compute/v2.1/flavors => generated 411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:25.790053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f5e32d70-240d-49ac-8a4f-12cbbaacf2c7 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:25.804291 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f5e32d70-240d-49ac-8a4f-12cbbaacf2c7 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/276702669" status: 200 len: 411 microversion: 2.1 time: 0.019887 Oct 03 10:31:25.815668 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 179/303] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/flavors/276702669 => generated 411 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:26.143586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:26.150395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:26.161802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-16a7cf28-b22e-4875-b0ce-80bf42fdf5da tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.491108 Oct 03 10:31:26.162779 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 125/304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:26.346993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.347832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:26.350400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5db9f18f-3a7f-460d-8525-0e5063a597b3 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.362429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:26.364731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:26.365316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:26.366046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:26.366515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:26.369453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:26.428037 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5db9f18f-3a7f-460d-8525-0e5063a597b3 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6214 microversion: 2.1 time: 0.610032 Oct 03 10:31:26.446004 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 180/305] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:25 2022] GET /compute/v2.1/flavors/detail => generated 6214 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:26.460271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bf93d075-58e2-42c1-8726-af38da8675a6 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.505005 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bf93d075-58e2-42c1-8726-af38da8675a6 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/276702669" status: 202 len: 0 microversion: 2.1 time: 0.047755 Oct 03 10:31:26.506070 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 181/306] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:26 2022] DELETE /compute/v2.1/flavors/276702669 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:26.515402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c31ddb93-c571-48cb-a548-758eac6e3aa3 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.571980 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c31ddb93-c571-48cb-a548-758eac6e3aa3 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.058602 Oct 03 10:31:26.572993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 182/307] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:26 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:26.612799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7aa757d6-9f1b-47fc-bd0c-6c412e166c98 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2017381282", "id": 814022009, "os-flavor-access:is_public": "False"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:26.636196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7aa757d6-9f1b-47fc-bd0c-6c412e166c98 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.045493 Oct 03 10:31:26.637319 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 183/308] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:26 2022] POST /compute/v2.1/flavors => generated 427 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:26.654199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0c3953a3-398f-4446-bc49-1db886ebacd0 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "814022009"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:26.668930 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-0c3953a3-398f-4446-bc49-1db886ebacd0 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] HTTP exception thrown: Flavor 814022009 could not be found. Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0c3953a3-398f-4446-bc49-1db886ebacd0 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] Request method failure captured: Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 106 Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrn4aaoEjOfEwxpwxv9U95P-jeyMug14srG9r-DEI6OJ2U1PExPN5aj5fEi6OZmeSJzNxeXsohL2mu6anncYbVBeT5dy-G_Vp_ZCV9cHBM01r39dwfWGDUdx8jn7aJxbCuED3amTTEhxa6vTRl5CyLOyPyIzvcqy2m2-SIfPXBpKMkY Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 9a225b39a04349e9a7b430bbf941b8a5 Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsAdminTestJSON-811265034 Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:26.672512 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a225b39a04349e9a7b430bbf941b8a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a225b39a04349e9a7b430bbf941b8a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a225b39a04349e9a7b430bbf941b8a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a225b39a04349e9a7b430bbf941b8a5"}]}] Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsAdminTestJSON-811265034 Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 9a225b39a04349e9a7b430bbf941b8a5 Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-811265034 Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsAdminTestJSON-811265034-project Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 7581273b807e467981444c557d478896 Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsAdminTestJSON-811265034-project Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "test", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "814022009"}} Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:26.674149 n-d-858383-3 devstack@n-api.service[122270]: exception: Flavor 814022009 could not be found. Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '814022009'}}} Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 814022009 could not be found. Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:26.675063 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 814022009 could not be found. Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:26.676385 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:26.677752 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:26.677752 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:26.677752 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:26.677752 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 814022009 could not be found. Oct 03 10:31:26.677752 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:26.679401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0c3953a3-398f-4446-bc49-1db886ebacd0 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] Returning 400 to user: Flavor 814022009 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:26.681232 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0c3953a3-398f-4446-bc49-1db886ebacd0 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.034873 Oct 03 10:31:26.683346 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 184/309] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:26 2022] POST /compute/v2.1/servers => generated 80 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:31:26.697110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7a00fb5-1176-44f8-87a3-34bf4dde3215 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.720257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7a00fb5-1176-44f8-87a3-34bf4dde3215 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/814022009" status: 202 len: 0 microversion: 2.1 time: 0.031211 Oct 03 10:31:26.721770 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 185/310] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:26 2022] DELETE /compute/v2.1/flavors/814022009 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:26.730872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-549ae0da-d6e2-4f94-ab6f-9d965c41c8c4 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.768223 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-549ae0da-d6e2-4f94-ab6f-9d965c41c8c4 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.041703 Oct 03 10:31:26.769206 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 186/311] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:26 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:26.793999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c412e45-e65d-4f30-804f-7fe0d4e0bbfe tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1257093137", "id": 420780029, "os-flavor-access:is_public": "False"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:26.824243 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c412e45-e65d-4f30-804f-7fe0d4e0bbfe tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.034522 Oct 03 10:31:26.824858 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 187/312] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:26 2022] POST /compute/v2.1/flavors => generated 412 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:26.837871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f703b031-257e-4b49-91fc-4c12359440b8 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2067008320", "id": 1699715374, "os-flavor-access:is_public": "True"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:26.864355 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f703b031-257e-4b49-91fc-4c12359440b8 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029679 Oct 03 10:31:26.872699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 188/313] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:26 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:26.878714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c5d3d30-b234-41af-adce-7421bbcb863c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.906771 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5c5d3d30-b234-41af-adce-7421bbcb863c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.032357 Oct 03 10:31:26.916852 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 189/314] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 3 10:31:26 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:26.923323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d611d1cb-0d1d-4346-bd0f-2a5177d68f42 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.938822 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d611d1cb-0d1d-4346-bd0f-2a5177d68f42 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.020234 Oct 03 10:31:26.950003 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 190/315] 10.222.0.27 () {58 vars in 1177 bytes} [Mon Oct 3 10:31:26 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:26.957679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cdc2dd26-c461-4ba1-8ccc-59c4e2c3f5de tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:26.972575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cdc2dd26-c461-4ba1-8ccc-59c4e2c3f5de tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.021027 Oct 03 10:31:26.973422 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 191/316] 10.222.0.27 () {58 vars in 1171 bytes} [Mon Oct 3 10:31:26 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:26.989346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a00f166b-658f-4148-b7c5-9facea7db1dd tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.001755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a00f166b-658f-4148-b7c5-9facea7db1dd tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.016927 Oct 03 10:31:27.002493 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 192/317] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 3 10:31:26 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:27.017090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bbec3ce-f70f-445c-8a99-25dadf3b8085 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.049583 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1bbec3ce-f70f-445c-8a99-25dadf3b8085 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.036739 Oct 03 10:31:27.050457 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 193/318] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:27.069655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d1c22128-ef14-480a-b747-ff70a7b07ac8 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.110455 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d1c22128-ef14-480a-b747-ff70a7b07ac8 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.044276 Oct 03 10:31:27.119929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:27.121117 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 194/319] 10.222.0.27 () {58 vars in 1175 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:27.134172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e3ae807-e155-42f9-a838-eff39e5819fc tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.140967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51fcafb3-6a5d-4784-b4cb-81eba35a8de5 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.799864 Oct 03 10:31:27.153495 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 126/320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:26 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:27.173471 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e3ae807-e155-42f9-a838-eff39e5819fc tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.043018 Oct 03 10:31:27.173990 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 195/321] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:27.185698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.186724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:27.193605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ee59c58-ac2e-40f8-a70a-1899216e1817 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.196166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:27.198614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:27.199073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:27.199818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:27.203480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:27.203955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:27.235972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ee59c58-ac2e-40f8-a70a-1899216e1817 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.046286 Oct 03 10:31:27.236571 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 196/322] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:27.257371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-70d27f14-3970-4eb6-a84e-f8e1a7acd2c9 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.282556 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-70d27f14-3970-4eb6-a84e-f8e1a7acd2c9 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1699715374" status: 202 len: 0 microversion: 2.1 time: 0.029726 Oct 03 10:31:27.283284 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 197/323] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:31:27 2022] DELETE /compute/v2.1/flavors/1699715374 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:27.296374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ce5661a-8652-4506-8c9c-efbac71556e1 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.337746 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ce5661a-8652-4506-8c9c-efbac71556e1 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.049932 Oct 03 10:31:27.353319 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 198/324] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:27.358525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dda33160-8a70-498e-8fe2-090f4cf34624 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.394543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dda33160-8a70-498e-8fe2-090f4cf34624 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/420780029" status: 202 len: 0 microversion: 2.1 time: 0.039671 Oct 03 10:31:27.401803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 199/325] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:27 2022] DELETE /compute/v2.1/flavors/420780029 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:27.410875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7040a0b0-a074-4034-9c31-7e95da5a8ac6 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.466358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7040a0b0-a074-4034-9c31-7e95da5a8ac6 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.061590 Oct 03 10:31:27.466692 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 200/326] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:27.489914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-675da6ff-aba4-4e43-8cce-b3e1184d5434 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-862114461", "id": 890117931, "os-flavor-access:is_public": "False"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:27.522020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:27.532055 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-675da6ff-aba4-4e43-8cce-b3e1184d5434 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.047183 Oct 03 10:31:27.536818 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 201/327] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:27 2022] POST /compute/v2.1/flavors => generated 411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:27.551566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0eda6378-cc86-4e59-bae7-54e1be8fff44 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.609623 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0eda6378-cc86-4e59-bae7-54e1be8fff44 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.062954 Oct 03 10:31:27.626916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:27.628800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 202/328] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:27.633971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3765b0b5-1a4a-420e-ad24-0e618c1964cd tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.638609 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24f62b24-7fc8-497f-aa56-6e4e200bbf88 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.456870 Oct 03 10:31:27.642156 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 127/329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:27.672060 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3765b0b5-1a4a-420e-ad24-0e618c1964cd tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.042181 Oct 03 10:31:27.672658 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 203/330] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:27.692823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4e6788f-3e35-48e1-bba8-1b286165f43c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.727203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:27.746835 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4e6788f-3e35-48e1-bba8-1b286165f43c tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/890117931" status: 202 len: 0 microversion: 2.1 time: 0.058323 Oct 03 10:31:27.748062 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 128/331] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:27 2022] DELETE /compute/v2.1/flavors/890117931 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:27.756239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-103ecbe6-2ef1-4912-a534-6329a3bfd328 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.778445 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-103ecbe6-2ef1-4912-a534-6329a3bfd328 tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.026036 Oct 03 10:31:27.794114 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 204/332] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:27.803809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5259915-588c-4197-a4da-d0846178cdcc tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-362767479", "id": 909644506, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:27.828801 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5259915-588c-4197-a4da-d0846178cdcc tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.027462 Oct 03 10:31:27.830028 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 129/333] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:27 2022] POST /compute/v2.1/flavors => generated 410 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:27.848617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83483a3c-ed84-4aad-bb10-01e63a02fcd6 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.901090 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83483a3c-ed84-4aad-bb10-01e63a02fcd6 tempest-FlavorsAdminTestJSON-811265034 tempest-FlavorsAdminTestJSON-811265034-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6213 microversion: 2.1 time: 0.060885 Oct 03 10:31:27.902581 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 205/334] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail => generated 6213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:27.924703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f5ea2814-fd43-4c9a-a21c-1a2140a4146d tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:27.963252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f5ea2814-fd43-4c9a-a21c-1a2140a4146d tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/909644506" status: 202 len: 0 microversion: 2.1 time: 0.041325 Oct 03 10:31:27.966737 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 130/335] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:27 2022] DELETE /compute/v2.1/flavors/909644506 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:27.973857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-494e99bd-aeaf-462b-8c3d-8d9b9c960edf tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:28.049620 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-494e99bd-aeaf-462b-8c3d-8d9b9c960edf tempest-FlavorsAdminTestJSON-1112930073 tempest-FlavorsAdminTestJSON-1112930073-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.080034 Oct 03 10:31:28.050620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 206/336] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:28.179473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:28.180094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:28.188807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:28.189309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:28.189748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:28.190454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:28.190910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:28.204834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:28.580041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:28.593505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1359b6c8-35c2-4372-b18b-4457da21bd48 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.417801 Oct 03 10:31:28.614482 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 131/337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:28 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:28.647680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:28.648491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:28.664732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:28.668220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:28.672739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:28.673801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:28.677184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:28.677846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:29.120120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f54a5bf7-311c-49a0-a6ba-e5b0474f55a9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Action: 'create', calling method: .version_select at 0x7f074fa95d30>, body: {"keypair": {"name": "tempest-keypair-385604850", "type": "ssh", "user_id": "d000d827323a40f8ab8edfb8ad0ea60d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7abc3RJzCLDDzlSlZnYO/RrYPapwDPJdt+L3eq9BCAU6aoM/Igv1ZPTweKYVy66A3CPZNFLJPVzJq17HjApCqVwI6UfPH9TDYkZueCmVZTij9CIjSlXP49VO/4HFRZDA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:29.212674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f54a5bf7-311c-49a0-a6ba-e5b0474f55a9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Getting quotas for project 7ef9073504324d789b79bb22732daabc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:29.237874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:29.243613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f54a5bf7-311c-49a0-a6ba-e5b0474f55a9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Getting quotas for user 07129ba70c204d00a229d204d7aee27b and project 7ef9073504324d789b79bb22732daabc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:29.249711 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e33b620-3fb2-4a62-bc23-63b91627ecba tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 200 len: 1587 microversion: 2.1 time: 0.611837 Oct 03 10:31:29.255274 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 132/338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:28 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 1587 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:29.266688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-da89f182-ecbe-4602-8c84-110c61f4da4d req-40b6f49b-8e2a-46b9-8a1b-df651893a004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03170cc0-d8a1-4021-8aac-b4019e329987", "tag": "77628770-1ed9-42bc-9dc2-87f9f8955595"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:29.317176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-da89f182-ecbe-4602-8c84-110c61f4da4d req-40b6f49b-8e2a-46b9-8a1b-df651893a004 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:29.320494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-da89f182-ecbe-4602-8c84-110c61f4da4d req-40b6f49b-8e2a-46b9-8a1b-df651893a004 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:29.321540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-da89f182-ecbe-4602-8c84-110c61f4da4d req-40b6f49b-8e2a-46b9-8a1b-df651893a004 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:29.336745 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f54a5bf7-311c-49a0-a6ba-e5b0474f55a9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.805788 Oct 03 10:31:29.337521 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 207/339] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:31:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 808 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:31:29.349913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:29.350657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:29.362010 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-da89f182-ecbe-4602-8c84-110c61f4da4d req-40b6f49b-8e2a-46b9-8a1b-df651893a004 service nova] Creating event network-changed:77628770-1ed9-42bc-9dc2-87f9f8955595 for instance 03170cc0-d8a1-4021-8aac-b4019e329987 on n-h2-858383-3 Oct 03 10:31:29.367019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:29.367628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:29.368318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:29.369174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:29.369947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:29.370471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:29.380299 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-da89f182-ecbe-4602-8c84-110c61f4da4d req-40b6f49b-8e2a-46b9-8a1b-df651893a004 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113522 Oct 03 10:31:29.380996 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 133/340] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:29.417156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5a0e6057-5dbf-45af-83e1-3e085c785d65 req-aab10816-d079-4622-ab85-3589ba77f05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06dd1072-c4cb-442b-a7de-8d39f43d11cb", "name": "network-vif-plugged", "status": "completed", "tag": "eadfdaa3-3dfc-4402-8aef-cc76c6e45455"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:29.440694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5a0e6057-5dbf-45af-83e1-3e085c785d65 req-aab10816-d079-4622-ab85-3589ba77f05c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:29.441481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5a0e6057-5dbf-45af-83e1-3e085c785d65 req-aab10816-d079-4622-ab85-3589ba77f05c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:29.441981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5a0e6057-5dbf-45af-83e1-3e085c785d65 req-aab10816-d079-4622-ab85-3589ba77f05c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:29.459095 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5a0e6057-5dbf-45af-83e1-3e085c785d65 req-aab10816-d079-4622-ab85-3589ba77f05c service nova] Creating event network-vif-plugged:eadfdaa3-3dfc-4402-8aef-cc76c6e45455 for instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb on n-h1-858383-3 Oct 03 10:31:29.468928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5a0e6057-5dbf-45af-83e1-3e085c785d65 req-aab10816-d079-4622-ab85-3589ba77f05c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086045 Oct 03 10:31:29.469809 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 134/341] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:29.477553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08ad24a8-c85c-4e9b-bc36-50beb5ad55f2 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Action: 'create', calling method: .version_select at 0x7f074fb33ca0>, body: {"keypair": {"name": "tempest-keypair-2114705287", "type": "ssh", "user_id": "d000d827323a40f8ab8edfb8ad0ea60d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIbE+r/vAIKU4JzNxpq/rAHd4oO2PGJRvrvdRuUZ3ZpJskJsc32ZkA37HBTkansaBFECnuATnJElg6XQ+Semo/tqGBPWulAvA/KV08mBazoIcnmHMK/y9GGWZuYqbjsjA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:29.504530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-08ad24a8-c85c-4e9b-bc36-50beb5ad55f2 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Getting quotas for project 7ef9073504324d789b79bb22732daabc. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:29.513151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-08ad24a8-c85c-4e9b-bc36-50beb5ad55f2 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Getting quotas for user 07129ba70c204d00a229d204d7aee27b and project 7ef9073504324d789b79bb22732daabc. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:29.552890 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08ad24a8-c85c-4e9b-bc36-50beb5ad55f2 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.081401 Oct 03 10:31:29.555055 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 135/342] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:31:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:31:29.573229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12ae071a-78f1-4b78-99f7-1dd31f6dbbfc tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Calling method '.version_select at 0x7f074fbf2ee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:29.611894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12ae071a-78f1-4b78-99f7-1dd31f6dbbfc tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-385604850?user_id=d000d827323a40f8ab8edfb8ad0ea60d" status: 200 len: 511 microversion: 2.10 time: 0.048194 Oct 03 10:31:29.612655 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 136/343] 10.222.0.27 () {60 vars in 1337 bytes} [Mon Oct 3 10:31:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-385604850?user_id=d000d827323a40f8ab8edfb8ad0ea60d => generated 511 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:31:29.632307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:29.633106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:29.651798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:29.652321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:29.652736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:29.657931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:29.658555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:29.660310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:30.009548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:30.030237 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0726f0f3-2665-4ac2-bebc-a3cacb37c6a6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.690564 Oct 03 10:31:30.031301 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 208/344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:29 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:30.036663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb5eb60d-0625-4de9-930f-cbdbc8af2df9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Action: 'create', calling method: .version_select at 0x7f074fa1e160>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-462488860", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDcCzqj4oV/I3Nz+83uEgH5a/CPJZfbRbzZqRUMLKPJGj+OZ2G/7hGfMl+cZpOX+NAcN0BpeqLfzSp37/oVU90vscIHLgCuqt2gUlBqXHFDedSD4npUTdaT8gMqqwESvA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:30.078420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cb5eb60d-0625-4de9-930f-cbdbc8af2df9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Getting quotas for project 7ef9073504324d789b79bb22732daabc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:30.084539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cb5eb60d-0625-4de9-930f-cbdbc8af2df9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Getting quotas for user 07129ba70c204d00a229d204d7aee27b and project 7ef9073504324d789b79bb22732daabc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:30.125976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb5eb60d-0625-4de9-930f-cbdbc8af2df9 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.093393 Oct 03 10:31:30.127941 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 209/345] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:31:30 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:31:30.144663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0b61236-b482-47c8-ab0a-768b295e214f tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Calling method '.version_select at 0x7f074f9d6550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:30.154940 n-d-858383-3 devstack@n-api.service[122270]: WARNING oslo_db.sqlalchemy.utils [None req-a0b61236-b482-47c8-ab0a-768b295e214f tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 10:31:30.164870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0b61236-b482-47c8-ab0a-768b295e214f tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=d000d827323a40f8ab8edfb8ad0ea60d" status: 200 len: 725 microversion: 2.10 time: 0.024185 Oct 03 10:31:30.166862 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 210/346] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 3 10:31:30 2022] GET /compute/v2.1/os-keypairs?user_id=d000d827323a40f8ab8edfb8ad0ea60d => generated 725 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:31:30.179133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb000ee1-9bbb-41aa-9690-2d2cbcce3591 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Calling method '.version_select at 0x7f074f9e0b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:30.211935 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb000ee1-9bbb-41aa-9690-2d2cbcce3591 tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-462488860" status: 204 len: 0 microversion: 2.10 time: 0.037123 Oct 03 10:31:30.212628 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 211/347] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Oct 3 10:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-462488860 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 10:31:30.221181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a6e69be-a6a0-4e37-b111-40f9074d344c tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Calling method '.version_select at 0x7f074f9d6f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:30.249346 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a6e69be-a6a0-4e37-b111-40f9074d344c tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114705287?user_id=d000d827323a40f8ab8edfb8ad0ea60d" status: 204 len: 0 microversion: 2.10 time: 0.031266 Oct 03 10:31:30.253974 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 212/348] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114705287?user_id=d000d827323a40f8ab8edfb8ad0ea60d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:31:30.260391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d985913-386f-40f6-a7aa-ed5258f10a8d tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] Calling method '.version_select at 0x7f074fab8790>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:30.285815 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0d985913-386f-40f6-a7aa-ed5258f10a8d tempest-KeyPairsV210TestJSON-1040295567 tempest-KeyPairsV210TestJSON-1040295567-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385604850?user_id=d000d827323a40f8ab8edfb8ad0ea60d" status: 204 len: 0 microversion: 2.10 time: 0.030220 Oct 03 10:31:30.286348 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 213/349] 10.222.0.27 () {60 vars in 1340 bytes} [Mon Oct 3 10:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385604850?user_id=d000d827323a40f8ab8edfb8ad0ea60d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:31:30.309165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:30.325876 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9523341-1a48-4aa4-9733-2fad80db0255 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.707561 Oct 03 10:31:30.328265 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 137/350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:29 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:31.054041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:31.054609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:31.063997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:31.064818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:31.069649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:31.071017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:31.073039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:31.075723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:31.350884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:31.351497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:31.363268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:31.367754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:31.368208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:31.368971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:31.370621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:31.375784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:31.386375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee4f8772-5873-487a-8547-7da1f23e51ae tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1318 microversion: 2.1 time: 0.337217 Oct 03 10:31:31.386687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:31.387637 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 214/351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:31 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:31.500189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-83a6b8e3-aba7-4029-8a56-b338e781e002 req-383dc1bf-aace-4623-830f-8c9458715b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1975aa-22f5-4838-91b3-6d9f13b5fe98", "name": "network-vif-plugged", "status": "completed", "tag": "de42700a-43d0-400f-a7d7-610b9e7c94b8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:31.532597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-83a6b8e3-aba7-4029-8a56-b338e781e002 req-383dc1bf-aace-4623-830f-8c9458715b08 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:31.533231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-83a6b8e3-aba7-4029-8a56-b338e781e002 req-383dc1bf-aace-4623-830f-8c9458715b08 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:31.533682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-83a6b8e3-aba7-4029-8a56-b338e781e002 req-383dc1bf-aace-4623-830f-8c9458715b08 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:31.565149 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-83a6b8e3-aba7-4029-8a56-b338e781e002 req-383dc1bf-aace-4623-830f-8c9458715b08 service nova] Creating event network-vif-plugged:de42700a-43d0-400f-a7d7-610b9e7c94b8 for instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 on n-h1-858383-3 Oct 03 10:31:31.598530 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-83a6b8e3-aba7-4029-8a56-b338e781e002 req-383dc1bf-aace-4623-830f-8c9458715b08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100292 Oct 03 10:31:31.599174 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 215/352] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:31.737197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:31.749194 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8d8fcd5-5db0-4492-9801-50ec90a03c46 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.399114 Oct 03 10:31:31.749817 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 138/353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:31 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:32.413687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:32.415114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:32.424694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.426138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.427089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.428668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.430090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.438350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.652528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:32.661974 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81fd11c5-630b-489d-bb53-ae0eb4d640f3 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1468 microversion: 2.1 time: 0.253370 Oct 03 10:31:32.662621 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 216/354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:32 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1468 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:32.684722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:32.685307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:32.693966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.694616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.695224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.696034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.696567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.697166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.729158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lazy-loading 'flavor' on Instance uuid 06dd1072-c4cb-442b-a7de-8d39f43d11cb {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:32.772384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:32.773364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:32.786088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.787323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.788223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.789184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.790311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.790937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.849078 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fdf15352-0ff1-4d81-aaf7-2d6e3522ef13 tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb/action" status: 202 len: 0 microversion: 2.1 time: 0.167805 Oct 03 10:31:32.849787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 139/355] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:31:32 2022] POST /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:32.860599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:32.861586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:32.870832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.871767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.872458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.874090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:32.874740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:32.876812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:32.969808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:32.973800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:32.979638 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a30f0e79-f31e-4784-a899-b7d8a9bf0c03 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.211667 Oct 03 10:31:32.980324 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 217/356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:32 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:33.125160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:33.135406 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-098d2e1a-7582-409e-9dcd-c6c54764f082 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1476 microversion: 2.1 time: 0.279326 Oct 03 10:31:33.136267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 140/357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:32 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:34.004799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:34.005534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:34.013473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:34.013945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:34.015124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:34.015821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:34.016273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:34.016695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:34.160222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:34.161617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:34.172145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:34.172746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:34.173493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:34.174322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:34.174892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:34.175508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:34.182946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:34.192665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cba07490-ed84-4e16-bb6f-0784ea2029d2 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1319 microversion: 2.1 time: 0.192024 Oct 03 10:31:34.193661 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 218/358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:33 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:34.369395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:34.390925 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e7173b0e-5566-4d16-9d54-2c89ee505f03 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1476 microversion: 2.1 time: 0.234469 Oct 03 10:31:34.393743 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 141/359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:34 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:35.318294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b1098fd6-892e-4d88-87ce-f6b0b96a42fc tempest-NetworksTest-707914612 tempest-NetworksTest-707914612-project-admin] Calling method '.version_select at 0x7f074fa1e790>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:35.371708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:35.374539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.375029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.375472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.376204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.376661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.377117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.405211 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c95e6216-e23e-432c-9064-42aff1b75835 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.369024 Oct 03 10:31:35.405801 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 142/360] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 3 10:31:35 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:31:35.410610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:35.413033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:35.419216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.420034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.421199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.422053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.422827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.423407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.547080 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b1098fd6-892e-4d88-87ce-f6b0b96a42fc tempest-NetworksTest-707914612 tempest-NetworksTest-707914612-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.594033 Oct 03 10:31:35.551254 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 219/361] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:31:34 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:35.554031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:35.554632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:35.563610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.564313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.564881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.565684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.566203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.566634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.614988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:35.623254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d35d82cc-1bf0-46da-9d8e-1cb6d8952375 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1468 microversion: 2.1 time: 0.216330 Oct 03 10:31:35.624824 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 143/362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:35 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1468 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:35.629169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:35.630879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.631561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.632000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.632729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.633210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.633632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.657636 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62358591-5212-40a0-afd5-0c0235dfdaa0 tempest-AZAdminV2TestJSON-2054479780 tempest-AZAdminV2TestJSON-2054479780-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.031770 Oct 03 10:31:35.658523 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 144/363] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 3 10:31:35 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:35.663073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5859005b-103b-4992-b062-f7aadc1e1f18 tempest-NetworksTest-707914612 tempest-NetworksTest-707914612-project-admin] Calling method '.version_select at 0x7f074faa8af0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:35.773836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:35.787129 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b83a9b1-3fd5-4479-b7f4-e7a74a1109e7 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1459 microversion: 2.1 time: 0.237047 Oct 03 10:31:35.788712 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 220/364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:35 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1459 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:35.794661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:35.798409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:35.807442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.808565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.809032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.809853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.810311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.810738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.817565 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5859005b-103b-4992-b062-f7aadc1e1f18 tempest-NetworksTest-707914612 tempest-NetworksTest-707914612-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/1a762c72-6509-4b1b-94ef-14d89b24dd91" status: 200 len: 652 microversion: 2.1 time: 0.157290 Oct 03 10:31:35.819064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 145/365] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:31:35 2022] GET /compute/v2.1/os-networks/1a762c72-6509-4b1b-94ef-14d89b24dd91 => generated 652 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:35.827089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:35.827936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:35.837802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.838365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.839215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.839988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:35.840515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:35.841087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:35.961831 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7411a606-2aaa-454f-82c8-4089a6f3f9e6 tempest-DeleteServersAdminTestJSON-395875951 tempest-DeleteServersAdminTestJSON-395875951-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98/action" status: 202 len: 0 microversion: 2.1 time: 0.171361 Oct 03 10:31:35.966639 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 221/366] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:31:35 2022] POST /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:35.976037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8593b3c6-999d-4b4b-8eaa-0f05a09926cf tempest-NetworksTest-707914612 tempest-NetworksTest-707914612-project-admin] Calling method '.version_select at 0x7f074fab80d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:36.135038 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3ac2b84-b9f9-4ef0-9c1b-11ca15a46b8d tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1610 microversion: 2.1 time: 0.314575 Oct 03 10:31:36.149248 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 146/367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:35 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1610 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:36.149248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:36.149248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:36.159830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.159830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.159830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.159830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.160339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.160339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.194182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.194826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.195365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.195941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lazy-loading 'fault' on Instance uuid 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:36.301474 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8593b3c6-999d-4b4b-8eaa-0f05a09926cf tempest-NetworksTest-707914612 tempest-NetworksTest-707914612-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.331888 Oct 03 10:31:36.302319 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 222/368] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:31:35 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:36.312511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:36.319198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.320137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.320927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.321951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.322550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.323071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.390231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:36.402535 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d42b4bb-7f46-495d-a39d-603ed2e47cec tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094610 Oct 03 10:31:36.411634 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 223/369] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:31:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:36.417547 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a765d1b-bfef-402a-a03a-b5a83513a1e6 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1451 microversion: 2.1 time: 0.275864 Oct 03 10:31:36.418174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 147/370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:36 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1451 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:36.429516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:36.434892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:36.451315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:36.452539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.453019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:36.453997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.454557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.456257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.457256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.457800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.462183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.462677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.463270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.464270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:36.464736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:36.465178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:36.517684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:31:36.575214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:36.785697 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4824944b-4e76-467a-ad7c-f1a94bd4b1b3 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 204 len: 0 microversion: 2.1 time: 0.338742 Oct 03 10:31:36.787221 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 148/371] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:36 2022] DELETE /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:31:37.069746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48f82742-b921-417f-8100-6f87310ec99d tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-148487002", "id": 739031544, "os-flavor-access:is_public": "False"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:37.098917 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48f82742-b921-417f-8100-6f87310ec99d tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.301433 Oct 03 10:31:37.099936 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 149/372] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:36 2022] POST /compute/v2.1/flavors => generated 427 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:37.104661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:37.105559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:37.114298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:37.114810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:37.115424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:37.116438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:37.116973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:37.117360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:37.143248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Lazy-loading 'flavor' on Instance uuid 06dd1072-c4cb-442b-a7de-8d39f43d11cb {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:37.197448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:37.198173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:37.199336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:37.199984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lazy-loading 'fault' on Instance uuid 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:37.220078 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb while it is in vm_state suspended Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Request method failure captured: Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb/action HTTP/1.1 Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 97 Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm-IQ3pMOv7z02sq0N7qUIC8G4ghX2aydleTmyzSeOvqI_bLLaOwh0au0o01N7fs6QdJ32lME04iUpQnExif4eVpkp_PzW2Zcb5fAeHpTXmHJZgDpSn6EYf2lRwsjcGPNkQPy9pAai22WR8Y3_EusV5uiJnuAiD9qkPY1HOPoSAynE Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ef2425d027164ecc9bbbb5757da08ed5 Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-LiveMigrationNegativeTest-1005003494 Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:37.223645 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef2425d027164ecc9bbbb5757da08ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef2425d027164ecc9bbbb5757da08ed5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef2425d027164ecc9bbbb5757da08ed5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef2425d027164ecc9bbbb5757da08ed5"}]}] Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-LiveMigrationNegativeTest-1005003494 Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ef2425d027164ecc9bbbb5757da08ed5 Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1005003494 Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-LiveMigrationNegativeTest-1005003494-project-admin Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 44fc9b203d2840ab84551830ff684478 Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-LiveMigrationNegativeTest-1005003494-project-admin Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: {"os-migrateLive": {"host": "n-h2-858383-3", "block_migration": true, "disk_over_commit": false}} Oct 03 10:31:37.225576 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'os-migrateLive' instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb while it is in vm_state suspended Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '06dd1072-c4cb-442b-a7de-8d39f43d11cb', 'body': {'os-migrateLive': {'host': 'n-h2-858383-3', 'block_migration': True, 'disk_over_commit': False}}} Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 03 10:31:37.226401 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:37.227668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb while it is in vm_state suspended Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb while it is in vm_state suspended Oct 03 10:31:37.229061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:37.230205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb while it is in vm_state suspended {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:37.231292 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72801184-2be8-43bf-b735-cd67428adafe tempest-LiveMigrationNegativeTest-1005003494 tempest-LiveMigrationNegativeTest-1005003494-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb/action" status: 409 len: 155 microversion: 2.1 time: 0.817245 Oct 03 10:31:37.231963 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 224/373] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:31:36 2022] POST /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb/action => generated 155 bytes in 819 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:37.237913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b283d687-4751-48df-89dd-46056efe957b tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b41225c959594da599a98e029c3bdc79"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:37.462264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:37.477755 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b378fc2-4ec6-442c-858e-fa377fe137cb tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1457 microversion: 2.1 time: 0.373719 Oct 03 10:31:37.478806 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 150/374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:37 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1457 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:37.486935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:37.488683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:37.501061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:37.505080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:37.512323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:37.512323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:37.512323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:37.512323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:37.552271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:31:37.678530 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-022a7165-7bbb-4dbb-830f-380fd3c4a04d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "DELETE /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 204 len: 0 microversion: 2.1 time: 0.197072 Oct 03 10:31:37.680539 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 151/375] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:37 2022] DELETE /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:31:37.692259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:37.693522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:37.703671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:37.704257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:37.704939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:37.706067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:37.706228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:37.707174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:37.776922 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b283d687-4751-48df-89dd-46056efe957b tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/739031544/action" status: 200 len: 96 microversion: 2.1 time: 0.542248 Oct 03 10:31:37.777608 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 225/376] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 3 10:31:37 2022] POST /compute/v2.1/flavors/739031544/action => generated 96 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:31:37.997720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:38.010673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f09ea22-13d8-4d45-a544-af37337deba4 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1465 microversion: 2.1 time: 0.321672 Oct 03 10:31:38.011279 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 152/377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:37 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1465 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:38.174125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b2f1a459-5a47-41ae-afcc-08036bcd4a53 tempest-FlavorsAccessTestJSON-82956261 tempest-FlavorsAccessTestJSON-82956261-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:38.204684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b2f1a459-5a47-41ae-afcc-08036bcd4a53 tempest-FlavorsAccessTestJSON-82956261 tempest-FlavorsAccessTestJSON-82956261-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.419866 Oct 03 10:31:38.205631 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 226/378] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:37 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:38.225338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae527f8c-1dea-4138-beeb-a240539dcb9e tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b41225c959594da599a98e029c3bdc79"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:38.507681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1025749010", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:38.619689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:31:38.962772 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae527f8c-1dea-4138-beeb-a240539dcb9e tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/739031544/action" status: 200 len: 21 microversion: 2.1 time: 0.741627 Oct 03 10:31:38.970052 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 227/379] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 3 10:31:38 2022] POST /compute/v2.1/flavors/739031544/action => generated 21 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:31:38.981205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:38.981979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:38.998503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:38.999317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:39.000079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:39.001127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:39.001877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:39.002515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:39.075255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:39.076443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:39.076955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:39.077409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lazy-loading 'fault' on Instance uuid 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:39.116042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:31:39.117712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:31:39.118904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:31:39.119480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:31:39.120048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:31:39.134784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:39.137397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:39.141975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:39.143987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:39.146675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:39.147739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:39.179486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:39.184582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for user fa6ea468370b4bacb98dd5457b0e6aea and project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:39.199407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:31:39.203578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:31:39.220024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:39.282612 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0989e109-c0de-438b-8f8a-7995c599d414 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270111 Oct 03 10:31:39.283446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 153/380] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:31:39.291868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:39.305146 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-98c7af56-7d82-4fc1-ac64-454d1606b274 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1457 microversion: 2.1 time: 0.333369 Oct 03 10:31:39.306603 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 228/381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:38 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1457 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:39.312217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:39.312994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:39.320072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:39.321480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:39.322244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:39.329084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27de666b-346f-434a-9f0d-fac42f57142c tempest-FlavorsAccessTestJSON-82956261 tempest-FlavorsAccessTestJSON-82956261-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:39.336868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:39.338704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:39.339331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:39.380985 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27de666b-346f-434a-9f0d-fac42f57142c tempest-FlavorsAccessTestJSON-82956261 tempest-FlavorsAccessTestJSON-82956261-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.088729 Oct 03 10:31:39.396104 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 154/382] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:39 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:39.400818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b804b848-d84a-4f2a-b985-8ea0d067c02a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:39.401422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b804b848-d84a-4f2a-b985-8ea0d067c02a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:39.823724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b804b848-d84a-4f2a-b985-8ea0d067c02a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:39.832111 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b804b848-d84a-4f2a-b985-8ea0d067c02a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1213 microversion: 2.1 time: 0.439357 Oct 03 10:31:39.836497 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 155/383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:39 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1213 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:39.841949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d3165e2-4d94-491c-97c7-b19660936bae tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:39.904741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d3165e2-4d94-491c-97c7-b19660936bae tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/739031544" status: 202 len: 0 microversion: 2.1 time: 0.067084 Oct 03 10:31:39.905465 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 156/384] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:39 2022] DELETE /compute/v2.1/flavors/739031544 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:39.913676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bd3331e-57d4-4185-ac6c-b9f67e1090ad tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:39.985800 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bd3331e-57d4-4185-ac6c-b9f67e1090ad tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.075700 Oct 03 10:31:39.989151 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 157/385] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:39 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:40.012054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e937700-66c6-48e3-aea5-0bfa69b1e3d5 tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1573436948", "id": 190537210, "os-flavor-access:is_public": "False"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:40.058396 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e937700-66c6-48e3-aea5-0bfa69b1e3d5 tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.050900 Oct 03 10:31:40.062852 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 158/386] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:40 2022] POST /compute/v2.1/flavors => generated 428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:40.074628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b302992-71c1-4385-90fd-fbc6de5a7f07 tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:40.094352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:40.101356 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b302992-71c1-4385-90fd-fbc6de5a7f07 tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/190537210/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.030330 Oct 03 10:31:40.105634 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 159/387] 10.222.0.27 () {58 vars in 1206 bytes} [Mon Oct 3 10:31:40 2022] GET /compute/v2.1/flavors/190537210/os-flavor-access => generated 21 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:31:40.116546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8522a44c-dede-487d-80f4-648dbc160c3e tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:40.176585 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8522a44c-dede-487d-80f4-648dbc160c3e tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/190537210" status: 202 len: 0 microversion: 2.1 time: 0.063119 Oct 03 10:31:40.180385 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 160/388] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:31:40 2022] DELETE /compute/v2.1/flavors/190537210 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:31:40.186634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5aab662c-583c-4a5d-92b0-d8f71beb5f23 tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:40.233519 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5aab662c-583c-4a5d-92b0-d8f71beb5f23 tempest-FlavorsAccessTestJSON-357737050 tempest-FlavorsAccessTestJSON-357737050-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.051305 Oct 03 10:31:40.238760 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 161/389] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:40 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:40.333338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:40.333947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:40.346232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:40.346758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:40.347199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:40.347915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:40.348364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:40.348798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:40.429412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:40.431853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:40.437671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:40.438407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lazy-loading 'fault' on Instance uuid 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:40.557260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:40.572840 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b1a0b0c8-9fa4-4b44-8b92-fb19e833d50d tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1465 microversion: 2.1 time: 1.259401 Oct 03 10:31:40.575098 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 229/390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:39 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1465 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:40.723952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:40.734596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7fdd5139-8b95-4dc3-89d2-f56b6705d98b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1457 microversion: 2.1 time: 0.406315 Oct 03 10:31:40.741539 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 162/391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:40 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1457 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:31:40.861741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:40.862666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:40.873060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:40.873592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:40.874033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:40.874841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:40.880755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:40.881821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:41.061658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:41.073259 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16e3c084-8f07-4f1f-b5db-9d1d33071d90 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1265 microversion: 2.1 time: 0.212580 Oct 03 10:31:41.099282 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 230/392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:40 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:41.602263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:41.602921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:41.618076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:41.618571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:41.623123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:41.629922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:41.630491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:41.632420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:41.762222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:41.763379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:41.782583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:41.786165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:41.787337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:41.794591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:41.796360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:41.799054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:41.903053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:41.904252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:41.905667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:41.907908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lazy-loading 'fault' on Instance uuid 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:42.261867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:42.274407 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b58c3079-4df1-41fe-ac69-2c5d9de71509 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1465 microversion: 2.1 time: 0.676836 Oct 03 10:31:42.276313 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 163/393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:41 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1465 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:42.293838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:42.296164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:42.312409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:42.312947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:42.313393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:42.317139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:42.317712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:42.318179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:42.415831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:42.433503 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79e47732-6e48-435f-9378-2c4f14751747 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1271 microversion: 2.1 time: 0.154652 Oct 03 10:31:42.434486 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 164/394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:42 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:42.757444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:42.766150 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-465b61cc-e941-4480-b514-93f891d5eff9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1457 microversion: 2.1 time: 1.009949 Oct 03 10:31:42.770666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 231/395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:41 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1457 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:42.860527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Calling method '.version_select at 0x7f074fb33f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:42.863656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:42.864149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:42.864586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:42.914699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:42.915750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:42.919946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:42.954792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:42.955294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:42.957379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:42.971464 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59f1d13c-2e8d-48ca-b0a6-cc6b3cd6ec17 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.534722 Oct 03 10:31:42.986173 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 165/396] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:43.300500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.301339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:43.317013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.323575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.325213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.326166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.329468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.335009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.584495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:43.594250 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1073195a-112b-4a36-9d0d-9ba9a8e90f6e tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 200 len: 1423 microversion: 2.1 time: 0.297711 Oct 03 10:31:43.616541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 166/397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:43 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 1423 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:43.623876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.624817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:43.631330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.632092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.632674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.633634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.634235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.634803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.657011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01bd5152-3ade-479c-bf53-629b2e753e8e tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Calling method '.version_select at 0x7f074f85b430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.659465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01bd5152-3ade-479c-bf53-629b2e753e8e tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd994a75d16164bcf9ac8488e988635c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e08a82fd144303b8be02d0ff946a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01bd5152-3ade-479c-bf53-629b2e753e8e tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Request method failure captured: Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hypervisors/n-h2-858383-3/search HTTP/1.1 Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroM_nCyVVDXyAxAa1hBjBLAnTDpdyAHMSPRxyIkGkjjKC6ueDUIZMiQZDZpg7_Ix6fe6s8d7u6H2BO77GHaS7-AO2oZGlHNwHDal7uNU9aCitLF3wohGruCnAuUgrzC0SF2WnsgdoyfO4oc37YzQ653cx97u6p_GZYQwnCpsAkzCfI Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 75e08a82fd144303b8be02d0ff946a35 Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1745955701 Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:43.661881 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75e08a82fd144303b8be02d0ff946a35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75e08a82fd144303b8be02d0ff946a35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75e08a82fd144303b8be02d0ff946a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75e08a82fd144303b8be02d0ff946a35"}]}] Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1745955701 Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 75e08a82fd144303b8be02d0ff946a35 Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1745955701 Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d994a75d16164bcf9ac8488e988635c2 Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 03 10:31:43.663235 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'n-h2-858383-3'} Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:43.663956 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 03 10:31:43.665088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.669103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01bd5152-3ade-479c-bf53-629b2e753e8e tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:43.670229 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01bd5152-3ade-479c-bf53-629b2e753e8e tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-858383-3/search" status: 403 len: 117 microversion: 2.1 time: 0.690729 Oct 03 10:31:43.672994 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 232/398] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 3 10:31:42 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-3/search => generated 117 bytes in 694 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:31:43.695135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5837157f-428d-47bb-bfbd-39ad0324b27b req-3f31a07f-0528-4e0c-bcc0-cb6faa7ded88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06dd1072-c4cb-442b-a7de-8d39f43d11cb", "name": "network-vif-deleted", "tag": "eadfdaa3-3dfc-4402-8aef-cc76c6e45455"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:43.727594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5837157f-428d-47bb-bfbd-39ad0324b27b req-3f31a07f-0528-4e0c-bcc0-cb6faa7ded88 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.729461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5837157f-428d-47bb-bfbd-39ad0324b27b req-3f31a07f-0528-4e0c-bcc0-cb6faa7ded88 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.730353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5837157f-428d-47bb-bfbd-39ad0324b27b req-3f31a07f-0528-4e0c-bcc0-cb6faa7ded88 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.745361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5837157f-428d-47bb-bfbd-39ad0324b27b req-3f31a07f-0528-4e0c-bcc0-cb6faa7ded88 service nova] Creating event network-vif-deleted:eadfdaa3-3dfc-4402-8aef-cc76c6e45455 for instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb on n-h1-858383-3 Oct 03 10:31:43.751511 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5837157f-428d-47bb-bfbd-39ad0324b27b req-3f31a07f-0528-4e0c-bcc0-cb6faa7ded88 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068321 Oct 03 10:31:43.752829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 233/399] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:43.760027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Calling method '.version_select at 0x7f074f85b670>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.765510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.766238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.766842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.773681 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Request method failure captured: Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroOpOnRSgBcdB1F8MTr01vpgc0VtLcq7LnMaqV0KQ2YqLgO4-bPxkaOw2_1SWapLMUzhhdrVdE7rtyFI33knDi0Q722WY-5m9ZNrjNecx6MYAeEopukdljRNho0HlNOe-0OZKdJPs_oCtcd1SsSuXiCDBIYTG-XvNBNGuCT7O8dJN8 Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 73024b8698944e96a3e08db73104d5e3 Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-230311047 Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:43.775793 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73024b8698944e96a3e08db73104d5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_73024b8698944e96a3e08db73104d5e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/73024b8698944e96a3e08db73104d5e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73024b8698944e96a3e08db73104d5e3"}]}] Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-230311047 Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 73024b8698944e96a3e08db73104d5e3 Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-230311047 Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a0268578d1e84485842999b47edd45ae Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 10:31:43.777320 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:43.778184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:43.781214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:43.781214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:43.781214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:43.781214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 10:31:43.781214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.782335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:43.783337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:43.784918 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29120305-5dc6-4f34-8600-f025edade4c5 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.029814 Oct 03 10:31:43.785662 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 234/400] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:31:43 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:43.804353 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4acb1f2b-7103-47df-8997-c6f3f22c8d7d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1271 microversion: 2.1 time: 0.185905 Oct 03 10:31:43.807945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 167/401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:43 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:43.809664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.812047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:43.824965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:43.831085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Calling method '.version_select at 0x7f074fbda040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.834859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.837309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.839322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.840239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.841778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.844124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.844743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.846337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.847281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.891708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.893146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.895035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.930112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.931548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.932422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.933607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lazy-loading 'fault' on Instance uuid 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:43.937112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.937673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.939350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:43.946789 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0e6f8cf-88bc-4448-a241-5586a5fc67f7 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.124926 Oct 03 10:31:43.947602 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 168/402] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:43.964709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eba401b3-8930-4a5e-ad0d-33921645f3a2 tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Calling method '.version_select at 0x7f074faa83a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.966676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eba401b3-8930-4a5e-ad0d-33921645f3a2 tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd994a75d16164bcf9ac8488e988635c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e08a82fd144303b8be02d0ff946a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eba401b3-8930-4a5e-ad0d-33921645f3a2 tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Request method failure captured: Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroM_nCyVVDXyAxAa1hBjBLAnTDpdyAHMSPRxyIkGkjjKC6ueDUIZMiQZDZpg7_Ix6fe6s8d7u6H2BO77GHaS7-AO2oZGlHNwHDal7uNU9aCitLF3wohGruCnAuUgrzC0SF2WnsgdoyfO4oc37YzQ653cx97u6p_GZYQwnCpsAkzCfI Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 75e08a82fd144303b8be02d0ff946a35 Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1745955701 Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:43.969169 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75e08a82fd144303b8be02d0ff946a35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75e08a82fd144303b8be02d0ff946a35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75e08a82fd144303b8be02d0ff946a35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75e08a82fd144303b8be02d0ff946a35"}]}] Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1745955701 Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 75e08a82fd144303b8be02d0ff946a35 Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1745955701 Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d994a75d16164bcf9ac8488e988635c2 Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 03 10:31:43.970552 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1'} Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:43.971305 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 03 10:31:43.972352 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:43.974520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eba401b3-8930-4a5e-ad0d-33921645f3a2 tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:43.974520 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eba401b3-8930-4a5e-ad0d-33921645f3a2 tempest-HypervisorAdminNegativeUnderV252Test-1745955701 tempest-HypervisorAdminNegativeUnderV252Test-1745955701-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015043 Oct 03 10:31:43.974520 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 169/403] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:31:43 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:43.986656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Calling method '.version_select at 0x7f074fa81dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:43.988683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:43.990903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:43.991468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.000109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] HTTP exception thrown: No hypervisor matching '88f60d26-979b-4659-8bad-6ef6e543b3cd' could be found. Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Request method failure captured: Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hypervisors/88f60d26-979b-4659-8bad-6ef6e543b3cd/servers HTTP/1.1 Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroOpOnRSgBcdB1F8MTr01vpgc0VtLcq7LnMaqV0KQ2YqLgO4-bPxkaOw2_1SWapLMUzhhdrVdE7rtyFI33knDi0Q722WY-5m9ZNrjNecx6MYAeEopukdljRNho0HlNOe-0OZKdJPs_oCtcd1SsSuXiCDBIYTG-XvNBNGuCT7O8dJN8 Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 73024b8698944e96a3e08db73104d5e3 Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-230311047 Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:31:44.008459 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73024b8698944e96a3e08db73104d5e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_73024b8698944e96a3e08db73104d5e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/73024b8698944e96a3e08db73104d5e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73024b8698944e96a3e08db73104d5e3"}]}] Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-230311047 Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 73024b8698944e96a3e08db73104d5e3 Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-230311047 Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a0268578d1e84485842999b47edd45ae Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: exception: No hypervisor matching '88f60d26-979b-4659-8bad-6ef6e543b3cd' could be found. Oct 03 10:31:44.009961 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '88f60d26-979b-4659-8bad-6ef6e543b3cd'} Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '88f60d26-979b-4659-8bad-6ef6e543b3cd' could be found. Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.010766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:44.012582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:44.012582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:44.012582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:44.012582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:44.012582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '88f60d26-979b-4659-8bad-6ef6e543b3cd' could be found. Oct 03 10:31:44.012582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.016144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] Returning 404 to user: No hypervisor matching '88f60d26-979b-4659-8bad-6ef6e543b3cd' could be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:44.017224 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d34f473-b47d-4d92-a34d-f965c25da213 tempest-HypervisorAdminNegativeUnderV252Test-230311047 tempest-HypervisorAdminNegativeUnderV252Test-230311047-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/88f60d26-979b-4659-8bad-6ef6e543b3cd/servers" status: 404 len: 123 microversion: 2.1 time: 0.036159 Oct 03 10:31:44.018460 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 170/404] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 3 10:31:43 2022] GET /compute/v2.1/os-hypervisors/88f60d26-979b-4659-8bad-6ef6e543b3cd/servers => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:44.194498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86ff2883585463e8a3994e14ec3d5c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '577957f991214f90b168e2854037028d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:44.204621 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b782cd3-9ddb-403d-9bea-9d48ba41fcec tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 200 len: 1309 microversion: 2.1 time: 0.405942 Oct 03 10:31:44.205240 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 235/405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:43 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:44.362342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-752090be-d6b2-4e49-bae0-54fe75a05b8b tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Calling method '.version_select at 0x7f074fa51f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:44.623194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:44.624368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 06dd1072-c4cb-442b-a7de-8d39f43d11cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:44.634208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.634698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.635761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.637005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.637704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.639053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.656099 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] HTTP exception thrown: Instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb could not be found. Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Request method failure captured: Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb HTTP/1.1 Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm7JCKIb256zq60mHsbOmr5yMfeez0b4nJY-NgfQQYQAjKy5pAZqCkestzqCf9IBOV0FkYv7mC-w3vP9-U4lxeDkDr70d_TjN5smw9G71_k81hCt47AU5OOQOJE505PC5_Hyf-mG5MAtQT5L8HOrfA32W3j8SV5F44LSBCJLBOclWw Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: beb07b94d361455dad13c0e485e909c7 Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-LiveMigrationNegativeTest-1246567075 Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:44.657654 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb07b94d361455dad13c0e485e909c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_beb07b94d361455dad13c0e485e909c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/beb07b94d361455dad13c0e485e909c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb07b94d361455dad13c0e485e909c7"}]}] Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-LiveMigrationNegativeTest-1246567075 Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: beb07b94d361455dad13c0e485e909c7 Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1246567075 Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-LiveMigrationNegativeTest-1246567075-project Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d19314a1cae1478eb870e7f7da5d0760 Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-LiveMigrationNegativeTest-1246567075-project Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb could not be found. Oct 03 10:31:44.658905 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '06dd1072-c4cb-442b-a7de-8d39f43d11cb'} Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb could not be found. Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:44.659587 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb could not be found. Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb could not be found. Oct 03 10:31:44.660672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:44.661705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Returning 404 to user: Instance 06dd1072-c4cb-442b-a7de-8d39f43d11cb could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:44.662495 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-15851573-8785-44db-9bd5-4155117d0367 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb" status: 404 len: 111 microversion: 2.1 time: 0.043327 Oct 03 10:31:44.665878 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 236/406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:44 2022] GET /compute/v2.1/servers/06dd1072-c4cb-442b-a7de-8d39f43d11cb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:31:44.676722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:44.678743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:44.686644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.687301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.687872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.689170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.689788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.690369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.724586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:31:44.765942 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-752090be-d6b2-4e49-bae0-54fe75a05b8b tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5" status: 200 len: 371 microversion: 2.1 time: 0.608822 Oct 03 10:31:44.774468 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 171/407] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 10:31:44 2022] GET /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5 => generated 371 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:44.782229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Action: 'update', calling method: .version_select at 0x7f074fbdae50>, body: {"quota_set": {"ram": "5120"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:44.887336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.888738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.890153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.891146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.892218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.893279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.953999 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eabeea60-ddf6-4a08-b282-9dd6105d88e6 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 204 len: 0 microversion: 2.1 time: 0.283516 Oct 03 10:31:44.955726 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 237/408] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:44 2022] DELETE /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:31:44.973486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:44.974413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:44.985538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.986860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.988672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:44.989577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:44.990980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:44.992201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.006127 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ab07aec-0671-4608-b8d4-7361bd5c0517 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5" status: 200 len: 328 microversion: 2.1 time: 0.229326 Oct 03 10:31:45.006975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 172/409] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:31:44 2022] PUT /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5 => generated 328 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:45.012626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.013908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:45.030555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.040594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.043060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.043834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.047074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.048432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.197676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:45.256930 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3179812-dbf7-49e6-b10a-996e009dbd91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1271 microversion: 2.1 time: 0.289528 Oct 03 10:31:45.257584 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 238/410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:44 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:45.285576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-219aa81e-9e48-44d8-b4e7-53a13bdc7601 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.331353 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-219aa81e-9e48-44d8-b4e7-53a13bdc7601 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5" status: 202 len: 0 microversion: 2.1 time: 0.052658 Oct 03 10:31:45.332736 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 239/411] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:31:45 2022] DELETE /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:45.349013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.350337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:45.350987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:45.367132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.367757 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e89be46-bd78-46c4-b9d9-18d02eafba36 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1475 microversion: 2.1 time: 0.358569 Oct 03 10:31:45.369461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 173/412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:45 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1475 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:45.377184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.379810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.380892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.381583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.384050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.388269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-927eba70-5801-47b2-b731-b294cde9aea3 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Calling method '.version_select at 0x7f074fa81a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.408679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:45.426160 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] HTTP exception thrown: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Request method failure captured: Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 HTTP/1.1 Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm92LLNG4eiyLMj9I62Ptm2aMWV-IPAtY7nzDRSjdTRyyB69R4gevGomyGFS_9VJdtIOhljIbs3YuPSjDdy--QA8brk5-uKt4B47Lz2ui5Gi9ra3NpBT8t-vhfjBCIWw_Ki2-SMSLitQ_v_DmSPXhvBL_PUUD-cV_vgFf5erU6s6bw Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:45.429200 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577957f991214f90b168e2854037028d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577957f991214f90b168e2854037028d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}] Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f86ff2883585463e8a3994e14ec3d5c5 Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.430423 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3c1975aa-22f5-4838-91b3-6d9f13b5fe98'} Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:45.431110 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.432329 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.436636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Returning 404 to user: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:45.437780 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e813781-a573-40ab-942a-05f0f5a554b9 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 404 len: 111 microversion: 2.1 time: 0.103912 Oct 03 10:31:45.438811 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 240/413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:45 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:45.465256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.466353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:45.480256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.480748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.481699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.484362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.487753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.488209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.534417 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] HTTP exception thrown: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Request method failure captured: Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 HTTP/1.1 Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm92LLNG4eiyLMj9I62Ptm2aMWV-IPAtY7nzDRSjdTRyyB69R4gevGomyGFS_9VJdtIOhljIbs3YuPSjDdy--QA8brk5-uKt4B47Lz2ui5Gi9ra3NpBT8t-vhfjBCIWw_Ki2-SMSLitQ_v_DmSPXhvBL_PUUD-cV_vgFf5erU6s6bw Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:45.543903 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577957f991214f90b168e2854037028d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577957f991214f90b168e2854037028d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}] Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f86ff2883585463e8a3994e14ec3d5c5 Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.545173 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3c1975aa-22f5-4838-91b3-6d9f13b5fe98'} Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:45.545982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.547263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.548375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Returning 404 to user: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:45.548375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e17a7674-0689-4ebf-b391-4adecbbfd38b tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 404 len: 111 microversion: 2.1 time: 0.088187 Oct 03 10:31:45.548375 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 241/414] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:45 2022] DELETE /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:45.564211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.567270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 3c1975aa-22f5-4838-91b3-6d9f13b5fe98] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:45.596386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.596904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.597674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.598681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.599331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.600058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.624459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] HTTP exception thrown: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Request method failure captured: Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 HTTP/1.1 Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm92LLNG4eiyLMj9I62Ptm2aMWV-IPAtY7nzDRSjdTRyyB69R4gevGomyGFS_9VJdtIOhljIbs3YuPSjDdy--QA8brk5-uKt4B47Lz2ui5Gi9ra3NpBT8t-vhfjBCIWw_Ki2-SMSLitQ_v_DmSPXhvBL_PUUD-cV_vgFf5erU6s6bw Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:45.632854 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577957f991214f90b168e2854037028d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577957f991214f90b168e2854037028d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}] Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f86ff2883585463e8a3994e14ec3d5c5 Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.634212 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3c1975aa-22f5-4838-91b3-6d9f13b5fe98'} Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:45.634889 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. Oct 03 10:31:45.639938 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.643715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Returning 404 to user: Instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:45.644871 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a8f46fb9-b4d0-483e-b537-79f754acf813 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98" status: 404 len: 111 microversion: 2.1 time: 0.092741 Oct 03 10:31:45.645943 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 242/415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:45 2022] GET /compute/v2.1/servers/3c1975aa-22f5-4838-91b3-6d9f13b5fe98 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:45.661630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.662342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:45.677691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.680014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.680583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.681463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.683601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.685865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.741255 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] HTTP exception thrown: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Request method failure captured: Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b HTTP/1.1 Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm92LLNG4eiyLMj9I62Ptm2aMWV-IPAtY7nzDRSjdTRyyB69R4gevGomyGFS_9VJdtIOhljIbs3YuPSjDdy--QA8brk5-uKt4B47Lz2ui5Gi9ra3NpBT8t-vhfjBCIWw_Ki2-SMSLitQ_v_DmSPXhvBL_PUUD-cV_vgFf5erU6s6bw Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:45.743068 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577957f991214f90b168e2854037028d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577957f991214f90b168e2854037028d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}] Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f86ff2883585463e8a3994e14ec3d5c5 Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.744406 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '0a25a9df-3efc-470c-aba2-a14a510a4f3b'} Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:45.745251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.746570 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.749258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Returning 404 to user: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:45.750209 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-92e9a072-eba1-425c-9eb4-2c1dcb4b2a44 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 404 len: 111 microversion: 2.1 time: 0.100182 Oct 03 10:31:45.752074 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 243/416] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:31:45 2022] DELETE /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:45.762253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:45.763344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] [instance: 0a25a9df-3efc-470c-aba2-a14a510a4f3b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:45.781188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.782142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.782739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.783913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.784527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.785244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.808515 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] HTTP exception thrown: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Request method failure captured: Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b HTTP/1.1 Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrm92LLNG4eiyLMj9I62Ptm2aMWV-IPAtY7nzDRSjdTRyyB69R4gevGomyGFS_9VJdtIOhljIbs3YuPSjDdy--QA8brk5-uKt4B47Lz2ui5Gi9ra3NpBT8t-vhfjBCIWw_Ki2-SMSLitQ_v_DmSPXhvBL_PUUD-cV_vgFf5erU6s6bw Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:45.812072 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_577957f991214f90b168e2854037028d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/577957f991214f90b168e2854037028d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/577957f991214f90b168e2854037028d"}]}] Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 577957f991214f90b168e2854037028d Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428399357 Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f86ff2883585463e8a3994e14ec3d5c5 Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersAdminTestJSON-428399357-project Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.813573 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '0a25a9df-3efc-470c-aba2-a14a510a4f3b'} Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:45.814386 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. Oct 03 10:31:45.815668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:45.819674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] Returning 404 to user: Instance 0a25a9df-3efc-470c-aba2-a14a510a4f3b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:45.821169 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d7dbb1ab-656d-4dff-a090-c485a9966316 tempest-DeleteServersAdminTestJSON-428399357 tempest-DeleteServersAdminTestJSON-428399357-project] 10.222.0.27 "GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b" status: 404 len: 111 microversion: 2.1 time: 0.063410 Oct 03 10:31:45.822460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 244/417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:45 2022] GET /compute/v2.1/servers/0a25a9df-3efc-470c-aba2-a14a510a4f3b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:45.839050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3bc9cbc6-3e91-4def-a712-051fae14de53 req-f15f9b46-f915-4a4e-8ede-719878e37d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1975aa-22f5-4838-91b3-6d9f13b5fe98", "name": "network-vif-deleted", "tag": "de42700a-43d0-400f-a7d7-610b9e7c94b8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:45.851340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3bc9cbc6-3e91-4def-a712-051fae14de53 req-f15f9b46-f915-4a4e-8ede-719878e37d09 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:45.852087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3bc9cbc6-3e91-4def-a712-051fae14de53 req-f15f9b46-f915-4a4e-8ede-719878e37d09 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:45.852679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3bc9cbc6-3e91-4def-a712-051fae14de53 req-f15f9b46-f915-4a4e-8ede-719878e37d09 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:45.866000 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3bc9cbc6-3e91-4def-a712-051fae14de53 req-f15f9b46-f915-4a4e-8ede-719878e37d09 service nova] Creating event network-vif-deleted:de42700a-43d0-400f-a7d7-610b9e7c94b8 for instance 3c1975aa-22f5-4838-91b3-6d9f13b5fe98 on n-h1-858383-3 Oct 03 10:31:45.871941 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3bc9cbc6-3e91-4def-a712-051fae14de53 req-f15f9b46-f915-4a4e-8ede-719878e37d09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047704 Oct 03 10:31:45.873349 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 245/418] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:45.993759 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-927eba70-5801-47b2-b731-b294cde9aea3 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5" status: 200 len: 371 microversion: 2.1 time: 0.622177 Oct 03 10:31:45.995019 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 174/419] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 10:31:45 2022] GET /compute/v2.1/os-quota-sets/f8229103e05e4102ab0d3a5c517bf8b5 => generated 371 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:46.287254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:46.289023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:46.299253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:46.299736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:46.300237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:46.300967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:46.301582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:46.302714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:46.352590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:46.392490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:46.393290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:46.400486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:46.413642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:46.415681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:46.417132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:46.419061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:46.420683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:46.662563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:46.674672 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7dc19fec-ee83-4f1a-bd7d-d8f235bc47d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1313 microversion: 2.1 time: 0.393074 Oct 03 10:31:46.678753 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 246/420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:46 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:46.696460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d60c4d84-509d-47dc-899b-31450a739aea tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Calling method '.version_select at 0x7f074f8a7550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:46.993180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:46.997177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:47.004289 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4a1a3d8-b21c-4c4e-bf95-aaa6232ac091 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1475 microversion: 2.1 time: 0.616319 Oct 03 10:31:47.010015 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 175/421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:46 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1475 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:47.538711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d60c4d84-509d-47dc-899b-31450a739aea tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.858556 Oct 03 10:31:47.549823 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 247/422] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:31:46 2022] GET /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b/defaults => generated 371 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:47.709237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:47.709844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:47.718395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:47.723216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:47.725455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:47.726665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:47.728322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:47.728996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:47.803616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-40dc5f10-3edf-4622-b1e2-053347f91edf req-b114f121-c114-42a5-a62b-30d03dfbe7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bbb36a-4dcd-4fed-9653-d59c6c5547ed", "name": "network-vif-deleted", "tag": "dd9eef2f-dc12-4dba-8db5-192a883f67e4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:47.876841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-40dc5f10-3edf-4622-b1e2-053347f91edf req-b114f121-c114-42a5-a62b-30d03dfbe7b8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:47.883813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-40dc5f10-3edf-4622-b1e2-053347f91edf req-b114f121-c114-42a5-a62b-30d03dfbe7b8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:47.885334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-40dc5f10-3edf-4622-b1e2-053347f91edf req-b114f121-c114-42a5-a62b-30d03dfbe7b8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:47.928644 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-40dc5f10-3edf-4622-b1e2-053347f91edf req-b114f121-c114-42a5-a62b-30d03dfbe7b8 service nova] Creating event network-vif-deleted:dd9eef2f-dc12-4dba-8db5-192a883f67e4 for instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed on n-h2-858383-3 Oct 03 10:31:47.949758 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-40dc5f10-3edf-4622-b1e2-053347f91edf req-b114f121-c114-42a5-a62b-30d03dfbe7b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153403 Oct 03 10:31:47.953916 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 248/423] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:47.987324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:47.999965 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4585d20d-1cee-4140-bf6d-2d7b05458de4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1313 microversion: 2.1 time: 0.294506 Oct 03 10:31:48.001753 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 176/424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:47 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:48.036885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:48.037962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:48.060074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:48.065005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:48.065618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:48.066275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:48.066737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:48.067232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:48.094025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-439a6d38-11c1-4406-b723-531f366a10f3 req-31610693-5bbb-498a-9716-eb35b4131292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd0ee96-4df2-4007-a07c-bf659b2b569f", "tag": "8b97993e-7063-4fa2-9c8e-a65af6ae95d8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:48.114671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-439a6d38-11c1-4406-b723-531f366a10f3 req-31610693-5bbb-498a-9716-eb35b4131292 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:48.114996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-439a6d38-11c1-4406-b723-531f366a10f3 req-31610693-5bbb-498a-9716-eb35b4131292 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:48.115441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-439a6d38-11c1-4406-b723-531f366a10f3 req-31610693-5bbb-498a-9716-eb35b4131292 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:48.139705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:48.140427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:48.141067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:48.145381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lazy-loading 'fault' on Instance uuid 80bbb36a-4dcd-4fed-9653-d59c6c5547ed {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:31:48.146118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-439a6d38-11c1-4406-b723-531f366a10f3 req-31610693-5bbb-498a-9716-eb35b4131292 service nova] Creating event network-changed:8b97993e-7063-4fa2-9c8e-a65af6ae95d8 for instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f on n-h2-858383-3 Oct 03 10:31:48.156659 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-439a6d38-11c1-4406-b723-531f366a10f3 req-31610693-5bbb-498a-9716-eb35b4131292 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069533 Oct 03 10:31:48.161381 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 177/425] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:48.244946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19314a1cae1478eb870e7f7da5d0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb07b94d361455dad13c0e485e909c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:48.254838 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-003525c4-5abb-4bcb-9515-440e1dc744a1 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 200 len: 1309 microversion: 2.1 time: 0.223733 Oct 03 10:31:48.255424 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 249/426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:48 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:49.024813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:49.027290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:49.050914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:49.051166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:49.051621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:49.053809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:49.054303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:49.056142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:49.077178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Action: 'update', calling method: .version_select at 0x7f074f98edc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:49.379488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:49.392853 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1fd05466-8ae3-4fd3-a913-f7065f952b77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1313 microversion: 2.1 time: 0.372784 Oct 03 10:31:49.412693 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 178/427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:49 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:49.422347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:49.424580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] [instance: 80bbb36a-4dcd-4fed-9653-d59c6c5547ed] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:49.459453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:49.459958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:49.460421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:49.463500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:49.463967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:49.464406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:49.516264 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] HTTP exception thrown: Instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed could not be found. Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Request method failure captured: Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed HTTP/1.1 Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrm7JCKIb256zq60mHsbOmr5yMfeez0b4nJY-NgfQQYQAjKy5pAZqCkestzqCf9IBOV0FkYv7mC-w3vP9-U4lxeDkDr70d_TjN5smw9G71_k81hCt47AU5OOQOJE505PC5_Hyf-mG5MAtQT5L8HOrfA32W3j8SV5F44LSBCJLBOclWw Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: beb07b94d361455dad13c0e485e909c7 Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-LiveMigrationNegativeTest-1246567075 Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:49.519346 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb07b94d361455dad13c0e485e909c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_beb07b94d361455dad13c0e485e909c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/beb07b94d361455dad13c0e485e909c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/beb07b94d361455dad13c0e485e909c7"}]}] Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-LiveMigrationNegativeTest-1246567075 Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: beb07b94d361455dad13c0e485e909c7 Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1246567075 Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-LiveMigrationNegativeTest-1246567075-project Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d19314a1cae1478eb870e7f7da5d0760 Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-LiveMigrationNegativeTest-1246567075-project Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed could not be found. Oct 03 10:31:49.520972 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '80bbb36a-4dcd-4fed-9653-d59c6c5547ed'} Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed could not be found. Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:49.521771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed could not be found. Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed could not be found. Oct 03 10:31:49.523078 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:49.525502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] Returning 404 to user: Instance 80bbb36a-4dcd-4fed-9653-d59c6c5547ed could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:49.526596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-306407d0-2be0-4650-826b-17bc2d821842 tempest-LiveMigrationNegativeTest-1246567075 tempest-LiveMigrationNegativeTest-1246567075-project] 10.222.0.27 "GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed" status: 404 len: 111 microversion: 2.1 time: 0.112666 Oct 03 10:31:49.527915 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 179/428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:49 2022] GET /compute/v2.1/servers/80bbb36a-4dcd-4fed-9653-d59c6c5547ed => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:49.919094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:49.921395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:49.923558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:49.924615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:49.928745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:49.930465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:50.063503 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe717393-0c06-46f4-a48e-76f09c360cb1 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f" status: 200 len: 328 microversion: 2.1 time: 0.991243 Oct 03 10:31:50.072803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 250/429] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:31:49 2022] PUT /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f => generated 328 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:50.079664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Calling method '.version_select at 0x7f074fac9e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:50.423095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:50.423699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:50.441731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:50.446991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:50.448157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:50.450444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:50.451156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:50.454613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:51.063118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=25 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:51.070725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:51.071207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:51.079877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:51.081408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:51.088700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:51.094312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:51.145309 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ddd5c11-3d26-49ec-aac8-efbbf0dd01ee tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f/detail" status: 200 len: 916 microversion: 2.1 time: 1.070281 Oct 03 10:31:51.146229 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 180/430] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:31:50 2022] GET /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f/detail => generated 916 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:51.275927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:51.301448 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0e128d8-c073-442f-b3cb-4de6d471a792 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1313 microversion: 2.1 time: 0.870039 Oct 03 10:31:51.301680 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 251/431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:50 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:52.326892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:52.327497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:52.335698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:52.336692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:52.337295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:52.338118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:52.338704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:52.339581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Action: 'update', calling method: .version_select at 0x7f074f86f310>, body: {"quota_set": {"ram": "2048"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:52.340043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:52.746072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:52.762841 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b1ab630-5e43-4d0e-ae80-cebef0dace4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1313 microversion: 2.1 time: 0.439696 Oct 03 10:31:52.763531 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 181/432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:52 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:53.052170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:53.052819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:53.053374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:53.054198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:53.054757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:53.055271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:53.117054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:53.117908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:53.118545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:53.119734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:53.120387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:53.121309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:53.230201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9356834c-f407-4341-9152-838815588359 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f?user_id=68d3c4c95d874f92b851e5b9e532b18d" status: 200 len: 328 microversion: 2.1 time: 0.894311 Oct 03 10:31:53.231317 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 252/433] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:31:52 2022] PUT /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f?user_id=68d3c4c95d874f92b851e5b9e532b18d => generated 328 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:53.246273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc927ab5-9ddf-498e-a780-2d7a2750db13 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Calling method '.version_select at 0x7f074f86fb80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:53.371052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-277c48a2-3e20-45ef-86d2-5a43825695fa tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-80743853", "id": 1858064778, "os-flavor-access:is_public": "False"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:53.410681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=88,nova_api:DELETE=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:53.415628 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-277c48a2-3e20-45ef-86d2-5a43825695fa tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.648364 Oct 03 10:31:53.425962 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 182/434] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:52 2022] POST /compute/v2.1/flavors => generated 437 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:53.439275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58b6a25a-2760-4b3c-ade9-0d9347b098f2 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:54.098286 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58b6a25a-2760-4b3c-ade9-0d9347b098f2 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1858064778/action" status: 200 len: 97 microversion: 2.1 time: 0.669675 Oct 03 10:31:54.098914 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 183/435] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 3 10:31:53 2022] POST /compute/v2.1/flavors/1858064778/action => generated 97 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:31:54.112259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:54.126268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:54.143521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:54.144018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:54.147339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:54.149401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:54.153513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:54.156501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:54.257172 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc927ab5-9ddf-498e-a780-2d7a2750db13 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f?user_id=68d3c4c95d874f92b851e5b9e532b18d" status: 200 len: 370 microversion: 2.1 time: 1.017915 Oct 03 10:31:54.266338 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 253/436] 10.222.0.27 () {58 vars in 1323 bytes} [Mon Oct 3 10:31:53 2022] GET /compute/v2.1/os-quota-sets/991e939eaf9f4611a90bfe94601a702f?user_id=68d3c4c95d874f92b851e5b9e532b18d => generated 370 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:54.271531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef89c0ac-12da-4652-98e2-1915dd59ad11 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:54.390704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:54.400286 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8de21d49-abca-44dd-9330-68f3820a12d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1313 microversion: 2.1 time: 0.292390 Oct 03 10:31:54.417419 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 184/437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:54 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:54.729179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-81a9d58b-7785-436a-8cba-3d39006d947f tempest-InstanceUsageAuditLogTestJSON-1874673353 tempest-InstanceUsageAuditLogTestJSON-1874673353-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:54.789001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81a9d58b-7785-436a-8cba-3d39006d947f tempest-InstanceUsageAuditLogTestJSON-1874673353 tempest-InstanceUsageAuditLogTestJSON-1874673353-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03 10:31:54" status: 200 len: 318 microversion: 2.1 time: 0.260467 Oct 03 10:31:54.789620 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 185/438] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:31:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03%2010%3A31%3A54 => generated 318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:31:54.806686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3cd3b20a-764b-45c8-8cc0-69ce647e752d req-4bcec4a3-b36d-4b74-be2d-543977b8dee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd0ee96-4df2-4007-a07c-bf659b2b569f", "name": "network-vif-plugged", "status": "completed", "tag": "8b97993e-7063-4fa2-9c8e-a65af6ae95d8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:54.832203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3cd3b20a-764b-45c8-8cc0-69ce647e752d req-4bcec4a3-b36d-4b74-be2d-543977b8dee6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:54.834124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3cd3b20a-764b-45c8-8cc0-69ce647e752d req-4bcec4a3-b36d-4b74-be2d-543977b8dee6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:54.835542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3cd3b20a-764b-45c8-8cc0-69ce647e752d req-4bcec4a3-b36d-4b74-be2d-543977b8dee6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:54.856168 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3cd3b20a-764b-45c8-8cc0-69ce647e752d req-4bcec4a3-b36d-4b74-be2d-543977b8dee6 service nova] Creating event network-vif-plugged:8b97993e-7063-4fa2-9c8e-a65af6ae95d8 for instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f on n-h2-858383-3 Oct 03 10:31:54.865549 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3cd3b20a-764b-45c8-8cc0-69ce647e752d req-4bcec4a3-b36d-4b74-be2d-543977b8dee6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071273 Oct 03 10:31:54.867323 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 186/439] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:54.873131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-11780e32-9b36-4c57-aea9-fef86b30c9cd tempest-InstanceUsageAuditLogTestJSON-1874673353 tempest-InstanceUsageAuditLogTestJSON-1874673353-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:54.953229 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-11780e32-9b36-4c57-aea9-fef86b30c9cd tempest-InstanceUsageAuditLogTestJSON-1874673353 tempest-InstanceUsageAuditLogTestJSON-1874673353-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.084169 Oct 03 10:31:54.954725 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 187/440] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 3 10:31:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:55.212235 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-ef89c0ac-12da-4652-98e2-1915dd59ad11 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 24f673827f584063b1f4c98453e50784 combination. Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef89c0ac-12da-4652-98e2-1915dd59ad11 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Request method failure captured: Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/flavors/1858064778/action HTTP/1.1 Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 67 Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroW_lp4zEN2iN360_4jtnwn0B_w2WEz6wfLLWhK0DFYO-IAHz7QwTcEkxD_gNr1mB9ulV3nzqjSgJtYZuRTCGpygn200D2I85zQd9bKUgs5wLNH9ABlOwwZCodBgbp3uIWiphGTOoIB3kbIXQNceJ0xPlALs9f_6C3VXjzx1xC-z80 Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4a9d8ba946294be7999183aee15e1e1d Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:55.215611 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a9d8ba946294be7999183aee15e1e1d"}]}] Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4a9d8ba946294be7999183aee15e1e1d Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: af243c9d14bd44cda4fe4dc2686fb9db Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: {"addTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} Oct 03 10:31:55.217129 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: exception: Flavor access already exists for flavor 34 and project 24f673827f584063b1f4c98453e50784 combination. Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '1858064778', 'body': {'addTenantAccess': {'tenant': '24f673827f584063b1f4c98453e50784'}}} Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result.read() Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 10:31:55.217982 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-24f673827f584063b1f4c98453e50784' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi session.flush() Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 10:31:55.219144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 10:31:55.220373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 10:31:55.221486 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result.read() Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-24f673827f584063b1f4c98453e50784' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 3, 10, 31, 55, 201759), 'updated_at': None, 'flavor_id': 34, 'project_id': '24f673827f584063b1f4c98453e50784'}] Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:55.222584 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 24f673827f584063b1f4c98453e50784 combination. Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:55.223659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 24f673827f584063b1f4c98453e50784 combination. Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:55.225605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:55.228038 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 24f673827f584063b1f4c98453e50784 combination. Oct 03 10:31:55.228038 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:55.228038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef89c0ac-12da-4652-98e2-1915dd59ad11 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 24f673827f584063b1f4c98453e50784 combination. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:55.228038 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef89c0ac-12da-4652-98e2-1915dd59ad11 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1858064778/action" status: 409 len: 152 microversion: 2.1 time: 0.949520 Oct 03 10:31:55.228038 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 254/441] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 3 10:31:54 2022] POST /compute/v2.1/flavors/1858064778/action => generated 152 bytes in 957 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:55.229354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4ef8a618-54b9-4ec1-805b-b06b32cb26ab tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:55.427061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:55.427694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:55.438105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:55.441154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:55.441609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:55.443444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:55.443931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:55.444372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:55.776252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:55.788911 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52b37b9e-a61d-46cb-92f3-e136d61475a2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1313 microversion: 2.1 time: 0.367121 Oct 03 10:31:55.789489 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 255/442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:55 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:55.805698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-adef94b8-76d3-4cd4-884c-7eed76badbe7 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Calling method '.version_select at 0x7f074f9e1ee0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:56.262782 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4ef8a618-54b9-4ec1-805b-b06b32cb26ab tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1858064778/action" status: 200 len: 21 microversion: 2.1 time: 1.040490 Oct 03 10:31:56.268126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 188/443] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 3 10:31:55 2022] POST /compute/v2.1/flavors/1858064778/action => generated 21 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:31:56.284903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44575fda-e49a-4c54-83d8-842dbc5abbe5 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:56.332878 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44575fda-e49a-4c54-83d8-842dbc5abbe5 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1858064778" status: 202 len: 0 microversion: 2.1 time: 0.059947 Oct 03 10:31:56.333842 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 189/444] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:31:56 2022] DELETE /compute/v2.1/flavors/1858064778 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:56.346625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf7b05f5-e6fc-40bc-8263-c3a98e5e4434 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:56.409101 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf7b05f5-e6fc-40bc-8263-c3a98e5e4434 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.068040 Oct 03 10:31:56.412460 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 190/445] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:56 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:56.436797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c1f12ce-a5d5-44f9-83e7-f52836ed103d tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1402502745", "id": 1999581522, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:56.476550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c1f12ce-a5d5-44f9-83e7-f52836ed103d tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.044520 Oct 03 10:31:56.477948 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 191/446] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:56.542561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-adef94b8-76d3-4cd4-884c-7eed76badbe7 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.744447 Oct 03 10:31:56.543222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 256/447] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:31:55 2022] GET /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b/defaults => generated 371 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:56.548735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-03c48700-7b10-4c50-a784-cdf797870e45 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:56.558756 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-03c48700-7b10-4c50-a784-cdf797870e45 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-03c48700-7b10-4c50-a784-cdf797870e45 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Request method failure captured: Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/flavors/1999581522/os-flavor-access HTTP/1.1 Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroW_lp4zEN2iN360_4jtnwn0B_w2WEz6wfLLWhK0DFYO-IAHz7QwTcEkxD_gNr1mB9ulV3nzqjSgJtYZuRTCGpygn200D2I85zQd9bKUgs5wLNH9ABlOwwZCodBgbp3uIWiphGTOoIB3kbIXQNceJ0xPlALs9f_6C3VXjzx1xC-z80 Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4a9d8ba946294be7999183aee15e1e1d Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:56.561574 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a9d8ba946294be7999183aee15e1e1d"}]}] Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4a9d8ba946294be7999183aee15e1e1d Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: af243c9d14bd44cda4fe4dc2686fb9db Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: exception: Access list not available for public flavors. Oct 03 10:31:56.563243 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'flavor_id': '1999581522'} Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 03 10:31:56.564323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:56.567196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-03c48700-7b10-4c50-a784-cdf797870e45 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:56.568375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-03c48700-7b10-4c50-a784-cdf797870e45 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1999581522/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.023961 Oct 03 10:31:56.569092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 257/448] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 3 10:31:56 2022] GET /compute/v2.1/flavors/1999581522/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:56.579750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Action: 'update', calling method: .version_select at 0x7f074f86f790>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:56.645783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Calling method '.version_select at 0x7f074fbda040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:56.650079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:56.650639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:56.651150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:56.652040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:56.652568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:56.653092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:56.691775 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65376143-7131-4f0c-bea9-e98f26f646af tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.212479 Oct 03 10:31:56.692552 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 192/449] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 3 10:31:56 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:56.697946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a307b928-f1b5-414c-ab0a-f4c9853876ff tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:56.722819 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a307b928-f1b5-414c-ab0a-f4c9853876ff tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1999581522" status: 202 len: 0 microversion: 2.1 time: 0.028723 Oct 03 10:31:56.723424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 193/450] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:31:56 2022] DELETE /compute/v2.1/flavors/1999581522 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:56.965843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:56.966652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:56.967153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:56.968671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:56.969394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:56.969901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:56.987721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:57.021162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f957a6c1-6dec-4e14-903e-28c20e72d890 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Calling method '.version_select at 0x7f074fa81dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:57.026605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f957a6c1-6dec-4e14-903e-28c20e72d890 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'dd3311de83f540a9905ef3f7a0cd7b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec3b4bf8f428c95ad7cc96665b04b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f957a6c1-6dec-4e14-903e-28c20e72d890 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Request method failure captured: Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroZbpo6_lnP1fKN52Kn7QJYuHBlQ5TtqOdLjRQmgaQNltanbflDgOkjGoSfbgCZstnLOu3LF5pZ5vI0m7HLZIkN8CUpbbXUmP0FKZ2n5uANv6hjx_Lx5Q89nLb2oH8Hkbz890i9eTZxy23pU0lODyMEB8P0OQFHuIrHds_tzdiTuM8 Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:57.030233 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}] Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: dd3311de83f540a9905ef3f7a0cd7b4c Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: action_args: {} Oct 03 10:31:57.031533 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:57.032315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 03 10:31:57.033407 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:57.034531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f957a6c1-6dec-4e14-903e-28c20e72d890 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:57.034531 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f957a6c1-6dec-4e14-903e-28c20e72d890 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.307112 Oct 03 10:31:57.034531 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 194/451] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 3 10:31:56 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 309 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:57.041961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e919b07a-ae36-4c1f-9b57-02eb1fdae1c6 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:57.067282 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e919b07a-ae36-4c1f-9b57-02eb1fdae1c6 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.032851 Oct 03 10:31:57.068446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 195/452] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:57 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:57.073092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:57.074021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:57.082816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:57.083575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:57.084186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:57.085157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:57.085772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:57.086397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:57.266558 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91504698-88cd-42a4-96d2-5980b207f2da tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b" status: 200 len: 329 microversion: 2.1 time: 0.692112 Oct 03 10:31:57.267907 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 258/453] 10.222.0.27 () {60 vars in 1263 bytes} [Mon Oct 3 10:31:56 2022] PUT /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b => generated 329 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:57.289390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:57.299907 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa0beea5-9acb-4f52-9d01-9d7ba9b37513 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1463 microversion: 2.1 time: 0.230289 Oct 03 10:31:57.300925 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 196/454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:57 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1463 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:57.306637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7069ce9-8903-4826-a074-ac30d93e5e1a tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Calling method '.version_select at 0x7f074f99a550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:57.310942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7069ce9-8903-4826-a074-ac30d93e5e1a tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'dd3311de83f540a9905ef3f7a0cd7b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec3b4bf8f428c95ad7cc96665b04b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7069ce9-8903-4826-a074-ac30d93e5e1a tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Request method failure captured: Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hosts/n-d-858383-3/reboot HTTP/1.1 Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroZbpo6_lnP1fKN52Kn7QJYuHBlQ5TtqOdLjRQmgaQNltanbflDgOkjGoSfbgCZstnLOu3LF5pZ5vI0m7HLZIkN8CUpbbXUmP0FKZ2n5uANv6hjx_Lx5Q89nLb2oH8Hkbz890i9eTZxy23pU0lODyMEB8P0OQFHuIrHds_tzdiTuM8 Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:57.313372 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}] Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: dd3311de83f540a9905ef3f7a0cd7b4c Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'n-d-858383-3'} Oct 03 10:31:57.315590 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:57.316554 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 03 10:31:57.317713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:57.318780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7069ce9-8903-4826-a074-ac30d93e5e1a tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:57.321703 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7069ce9-8903-4826-a074-ac30d93e5e1a tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019432 Oct 03 10:31:57.322796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 197/455] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 3 10:31:57 2022] GET /compute/v2.1/os-hosts/n-d-858383-3/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:57.329315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7891a94-32aa-41a7-aaff-85ac773f5128 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-8234855", "id": 2056567907, "os-flavor-access:is_public": "False"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:57.364809 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7891a94-32aa-41a7-aaff-85ac773f5128 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.038117 Oct 03 10:31:57.366698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 198/456] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:57 2022] POST /compute/v2.1/flavors => generated 436 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:57.379372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Action: 'update', calling method: .version_select at 0x7f074fbda430>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:57.618183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-897402985", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "f3f01fec-6192-4230-9d75-0f9c0fe4d3e8"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:57.707263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:57.707993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:57.708652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:57.709482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:57.710076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:57.710572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:57.742291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] validate_networks() for [('f3f01fec-6192-4230-9d75-0f9c0fe4d3e8', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:31:58.116550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=14,nova_api:DELETE=7,nova_api:UPDATE=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:31:58.256885 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ddf1f029-a4ab-4698-97eb-a2a729cf2594 tempest-QuotasAdminTestJSON-1299898814 tempest-QuotasAdminTestJSON-1299898814-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b" status: 200 len: 329 microversion: 2.1 time: 0.887210 Oct 03 10:31:58.258466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 199/457] 10.222.0.27 () {60 vars in 1263 bytes} [Mon Oct 3 10:31:57 2022] PUT /compute/v2.1/os-quota-sets/090e7f9adc934861a2205061e6ba2f2b => generated 329 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:58.491665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:31:58.492232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:31:58.492972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:31:58.493483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:31:58.494001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:31:58.506493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:58.507113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:58.507645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:58.508478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:58.509071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:58.509592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:58.532697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:31:58.543580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:58.544724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:58.546173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for user 6f0eda1654514026b803bcf2a1b8f4f4 and project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:31:58.551309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:58.552053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:58.552728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:58.553665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:58.554329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:58.555066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:58.594455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:31:58.599451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:31:58.733445 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-02b100f6-2df6-4806-97b9-5dac1c83c4c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463984 Oct 03 10:31:58.738989 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 259/458] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:31:58.748013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0213c97-f74b-4f36-a729-ae70c22203c7 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Calling method '.version_select at 0x7f074f8b7ee0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:58.765576 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b0213c97-f74b-4f36-a729-ae70c22203c7 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0213c97-f74b-4f36-a729-ae70c22203c7 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:58.768024 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'nonexistent_hostname'} Oct 03 10:31:58.769358 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:58.770149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 03 10:31:58.771227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:58.772364 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.776012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0213c97-f74b-4f36-a729-ae70c22203c7 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:58.777980 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b0213c97-f74b-4f36-a729-ae70c22203c7 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.037337 Oct 03 10:31:58.781342 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 260/459] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 3 10:31:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:58.853601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-743cd02a-fa83-4982-8281-72a7509c0bd5 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1614 microversion: 2.1 time: 0.593728 Oct 03 10:31:58.854299 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 200/460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:58 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1614 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:58.866403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b34876f-6fc9-4630-a2d7-28c119405e65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:58.870027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b34876f-6fc9-4630-a2d7-28c119405e65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:58.937003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b34876f-6fc9-4630-a2d7-28c119405e65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:58.946355 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b34876f-6fc9-4630-a2d7-28c119405e65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1210 microversion: 2.1 time: 0.091248 Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 201/461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:58 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c715c686-222d-4464-a710-f3c72d76392d tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Calling method '.version_select at 0x7f074f94f1f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c715c686-222d-4464-a710-f3c72d76392d tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'dd3311de83f540a9905ef3f7a0cd7b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec3b4bf8f428c95ad7cc96665b04b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c715c686-222d-4464-a710-f3c72d76392d tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Request method failure captured: Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hosts/n-d-858383-3 HTTP/1.1 Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:58.960791 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroZbpo6_lnP1fKN52Kn7QJYuHBlQ5TtqOdLjRQmgaQNltanbflDgOkjGoSfbgCZstnLOu3LF5pZ5vI0m7HLZIkN8CUpbbXUmP0FKZ2n5uANv6hjx_Lx5Q89nLb2oH8Hkbz890i9eTZxy23pU0lODyMEB8P0OQFHuIrHds_tzdiTuM8 Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}] Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:58.962207 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: dd3311de83f540a9905ef3f7a0cd7b4c Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'n-d-858383-3'} Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:58.963187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:58.969707 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 03 10:31:58.971420 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:58.971420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c715c686-222d-4464-a710-f3c72d76392d tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:58.971420 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c715c686-222d-4464-a710-f3c72d76392d tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-3" status: 403 len: 109 microversion: 2.1 time: 0.010917 Oct 03 10:31:58.971420 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 202/462] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 3 10:31:58 2022] GET /compute/v2.1/os-hosts/n-d-858383-3 => generated 109 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:58.971420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:58.971420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:58.978354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:58.978643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:58.979092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:58.979830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:58.980272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:58.980725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:59.081864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ae3e33471e434e02a003b7dddf2756e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69efc7f0eb42358bb06f5356d2cb9b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:59.082863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] flavor_id is None. Assuming migration. {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 10:31:59.083461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 10:31:59.230340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a63fbd87-5014-4cd5-8dc0-5fa0a726468d tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:59.237448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a63fbd87-5014-4cd5-8dc0-5fa0a726468d tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '3011affe004f4188b0cf6600b47b440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f673827f584063b1f4c98453e50784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a63fbd87-5014-4cd5-8dc0-5fa0a726468d tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Request method failure captured: Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/flavors/2056567907/action HTTP/1.1 Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 67 Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroTbqqar4kMvnf5-SKu2-46hnG9ZK-_P4y3V6_n3YNF8Vp7aSNjHZdHAJSS3WzlVti6mzgV6JeAtTS5p2H5DITyFtaS0nPsPL-UYAZNrvQdgtB2FGVHwYwVwVV8QWQsfoHuhnhjOg9CEU6AwcIviW-yElOt6P2tDnViNjyc14EKskU Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 24f673827f584063b1f4c98453e50784 Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-415986342 Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:59.240828 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24f673827f584063b1f4c98453e50784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24f673827f584063b1f4c98453e50784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24f673827f584063b1f4c98453e50784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24f673827f584063b1f4c98453e50784"}]}] Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-415986342 Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 24f673827f584063b1f4c98453e50784 Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-415986342 Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FlavorsAccessNegativeTestJSON-415986342-project Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3011affe004f4188b0cf6600b47b440f Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-415986342-project Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: {"addTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} Oct 03 10:31:59.242595 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '2056567907', 'body': {'addTenantAccess': {'tenant': '24f673827f584063b1f4c98453e50784'}}} Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:59.243381 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 03 10:31:59.244705 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.246755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a63fbd87-5014-4cd5-8dc0-5fa0a726468d tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:59.246755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a63fbd87-5014-4cd5-8dc0-5fa0a726468d tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] 10.222.0.27 "POST /compute/v2.1/flavors/2056567907/action" status: 403 len: 130 microversion: 2.1 time: 0.454137 Oct 03 10:31:59.248242 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 261/463] 10.222.0.27 () {60 vars in 1200 bytes} [Mon Oct 3 10:31:58 2022] POST /compute/v2.1/flavors/2056567907/action => generated 130 bytes in 460 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:59.256450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba54e4d5-65ef-49f9-b709-9aae4c8fa346 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Calling method '.version_select at 0x7f074f86f8b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.275511 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-ba54e4d5-65ef-49f9-b709-9aae4c8fa346 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba54e4d5-65ef-49f9-b709-9aae4c8fa346 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:59.277083 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'nonexistent_hostname'} Oct 03 10:31:59.278318 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.279047 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.280419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.281454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba54e4d5-65ef-49f9-b709-9aae4c8fa346 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:59.285417 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba54e4d5-65ef-49f9-b709-9aae4c8fa346 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028690 Oct 03 10:31:59.287345 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 262/464] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 3 10:31:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:59.298050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-66f32608-88e9-416b-827e-77e48e8977e9 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.377382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-66f32608-88e9-416b-827e-77e48e8977e9 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2056567907" status: 202 len: 0 microversion: 2.1 time: 0.088928 Oct 03 10:31:59.382377 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 263/465] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:31:59 2022] DELETE /compute/v2.1/flavors/2056567907 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:59.387857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22ce4bfa-235a-4518-b6fc-7ae972b05906 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Calling method '.version_select at 0x7f074f81b3a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.390162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22ce4bfa-235a-4518-b6fc-7ae972b05906 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'dd3311de83f540a9905ef3f7a0cd7b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec3b4bf8f428c95ad7cc96665b04b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22ce4bfa-235a-4518-b6fc-7ae972b05906 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Request method failure captured: Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hosts/n-d-858383-3/shutdown HTTP/1.1 Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroZbpo6_lnP1fKN52Kn7QJYuHBlQ5TtqOdLjRQmgaQNltanbflDgOkjGoSfbgCZstnLOu3LF5pZ5vI0m7HLZIkN8CUpbbXUmP0FKZ2n5uANv6hjx_Lx5Q89nLb2oH8Hkbz890i9eTZxy23pU0lODyMEB8P0OQFHuIrHds_tzdiTuM8 Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:31:59.392248 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}] Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: dd3311de83f540a9905ef3f7a0cd7b4c Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'n-d-858383-3'} Oct 03 10:31:59.393710 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:59.394478 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 03 10:31:59.396157 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.407423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22ce4bfa-235a-4518-b6fc-7ae972b05906 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:59.410402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22ce4bfa-235a-4518-b6fc-7ae972b05906 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.029974 Oct 03 10:31:59.413309 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 264/466] 10.222.0.27 () {58 vars in 1194 bytes} [Mon Oct 3 10:31:59 2022] GET /compute/v2.1/os-hosts/n-d-858383-3/shutdown => generated 113 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:59.428131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-991fec5f-ade3-4a89-ab1b-8d8d11236583 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.459511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9347d910-a2a6-484d-9523-46bb57828e1a tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f/action" status: 202 len: 0 microversion: 2.1 time: 0.492956 Oct 03 10:31:59.460052 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 203/467] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:31:58 2022] POST /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:31:59.472382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d60a79a6-04c3-4e7a-adf8-9cf72a3ef4a6 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Calling method '.version_select at 0x7f074f94fdc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.478408 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-991fec5f-ade3-4a89-ab1b-8d8d11236583 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.061332 Oct 03 10:31:59.479007 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 265/468] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:31:59 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:59.488088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.494137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:31:59.506933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:59.507324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:59.507761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:59.508666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:31:59.509166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:31:59.509729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:31:59.516556 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d60a79a6-04c3-4e7a-adf8-9cf72a3ef4a6 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d60a79a6-04c3-4e7a-adf8-9cf72a3ef4a6 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:31:59.527762 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'nonexistent_hostname'} Oct 03 10:31:59.529447 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:59.530363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 03 10:31:59.531399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.532454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d60a79a6-04c3-4e7a-adf8-9cf72a3ef4a6 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:59.543932 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d60a79a6-04c3-4e7a-adf8-9cf72a3ef4a6 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.068674 Oct 03 10:31:59.546504 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 204/469] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:31:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:59.564041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-84d83d6f-9e1f-460c-b463-2fc7cb4bf4dd tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1754559764", "id": 107597912, "os-flavor-access:is_public": "False"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:59.636659 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-84d83d6f-9e1f-460c-b463-2fc7cb4bf4dd tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.089031 Oct 03 10:31:59.639794 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 205/470] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:31:59 2022] POST /compute/v2.1/flavors => generated 436 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:31:59.651512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91a781a5-1b66-4362-8327-90f5e8307730 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Calling method '.version_select at 0x7f074f9cbca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.672554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-91a781a5-1b66-4362-8327-90f5e8307730 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'dd3311de83f540a9905ef3f7a0cd7b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec3b4bf8f428c95ad7cc96665b04b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91a781a5-1b66-4362-8327-90f5e8307730 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Request method failure captured: Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-hosts/n-d-858383-3/startup HTTP/1.1 Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroZbpo6_lnP1fKN52Kn7QJYuHBlQ5TtqOdLjRQmgaQNltanbflDgOkjGoSfbgCZstnLOu3LF5pZ5vI0m7HLZIkN8CUpbbXUmP0FKZ2n5uANv6hjx_Lx5Q89nLb2oH8Hkbz890i9eTZxy23pU0lODyMEB8P0OQFHuIrHds_tzdiTuM8 Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:31:59.680311 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}] Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: dd3311de83f540a9905ef3f7a0cd7b4c Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'n-d-858383-3'} Oct 03 10:31:59.682011 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:59.682791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 03 10:31:59.683838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.689953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91a781a5-1b66-4362-8327-90f5e8307730 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:59.691016 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91a781a5-1b66-4362-8327-90f5e8307730 tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-858383-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.049931 Oct 03 10:31:59.706055 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 206/471] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 3 10:31:59 2022] GET /compute/v2.1/os-hosts/n-d-858383-3/startup => generated 110 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:31:59.718980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3406519-b662-4be5-9a71-11272e836ddd tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:59.873192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:31:59.884856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aeec12f0-b4b5-418a-a459-ac2cabb6a5f0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1472 microversion: 2.1 time: 0.400474 Oct 03 10:31:59.886540 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 266/472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:31:59 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:31:59.917662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3dc70716-1252-40f7-a858-057593eb60c2 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Calling method '.version_select at 0x7f074f81bdc0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:31:59.949522 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-3dc70716-1252-40f7-a858-057593eb60c2 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3dc70716-1252-40f7-a858-057593eb60c2 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:59.951252 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'nonexistent_hostname'} Oct 03 10:31:59.952545 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:31:59.953327 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 03 10:31:59.954392 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:31:59.955512 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.958323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3dc70716-1252-40f7-a858-057593eb60c2 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:31:59.959230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3dc70716-1252-40f7-a858-057593eb60c2 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.071597 Oct 03 10:31:59.964460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 267/473] 10.222.0.27 () {58 vars in 1215 bytes} [Mon Oct 3 10:31:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:31:59.980007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bac14219-29da-4ffd-8f5c-d7a554f4253f tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Action: 'update', calling method: .version_select at 0x7f074f81b430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bac14219-29da-4ffd-8f5c-d7a554f4253f tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/os-hosts/n-d-858383-3 HTTP/1.1 Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 51 Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:31:59.996338 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: {"status": "enable", "maintenance_mode": "invalid"} Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:31:59.997871 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'n-d-858383-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'disable', Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'Enable', Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'Disable', Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance: Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:31:59.998738 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.000111 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.001284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.001284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:32:00.001284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:32:00.001284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:32:00.001284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.004992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bac14219-29da-4ffd-8f5c-d7a554f4253f tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:32:00.008688 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bac14219-29da-4ffd-8f5c-d7a554f4253f tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-3" status: 400 len: 199 microversion: 2.1 time: 0.038171 Oct 03 10:32:00.010492 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 268/474] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:31:59 2022] PUT /compute/v2.1/os-hosts/n-d-858383-3 => generated 199 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:32:00.026861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:00.027986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:00.046176 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3406519-b662-4be5-9a71-11272e836ddd tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/107597912/action" status: 200 len: 96 microversion: 2.1 time: 0.338315 Oct 03 10:32:00.048066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:00.049454 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 207/475] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 3 10:31:59 2022] POST /compute/v2.1/flavors/107597912/action => generated 96 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:00.050447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:00.050906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:00.051682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:00.058809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:00.059264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:00.064573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f71b9ce1-e6f4-4ee8-9aae-098d3b3789e1 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Action: 'update', calling method: .version_select at 0x7f074f94f430>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f71b9ce1-e6f4-4ee8-9aae-098d3b3789e1 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/os-hosts/n-d-858383-3 HTTP/1.1 Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 51 Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:32:00.070159 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: {"status": "invalid", "maintenance_mode": "enable"} Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:32:00.071496 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'n-d-858383-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'disable', Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'Enable', Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'Disable', Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance: Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.072268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.073703 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.074812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.074812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:32:00.074812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:32:00.074812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 10:32:00.074812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.094094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f71b9ce1-e6f4-4ee8-9aae-098d3b3789e1 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:32:00.098833 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f71b9ce1-e6f4-4ee8-9aae-098d3b3789e1 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-3" status: 400 len: 189 microversion: 2.1 time: 0.045868 Oct 03 10:32:00.099906 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 208/476] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:32:00 2022] PUT /compute/v2.1/os-hosts/n-d-858383-3 => generated 189 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:32:00.116016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb1b84e1-833d-4577-a017-00503f49e3ef tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:00.133707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb1b84e1-833d-4577-a017-00503f49e3ef tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '3011affe004f4188b0cf6600b47b440f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f673827f584063b1f4c98453e50784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb1b84e1-833d-4577-a017-00503f49e3ef tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Request method failure captured: Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/flavors/107597912/action HTTP/1.1 Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 70 Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroTbqqar4kMvnf5-SKu2-46hnG9ZK-_P4y3V6_n3YNF8Vp7aSNjHZdHAJSS3WzlVti6mzgV6JeAtTS5p2H5DITyFtaS0nPsPL-UYAZNrvQdgtB2FGVHwYwVwVV8QWQsfoHuhnhjOg9CEU6AwcIviW-yElOt6P2tDnViNjyc14EKskU Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 24f673827f584063b1f4c98453e50784 Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-415986342 Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:32:00.142326 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24f673827f584063b1f4c98453e50784"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24f673827f584063b1f4c98453e50784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24f673827f584063b1f4c98453e50784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24f673827f584063b1f4c98453e50784"}]}] Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-415986342 Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 24f673827f584063b1f4c98453e50784 Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-415986342 Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FlavorsAccessNegativeTestJSON-415986342-project Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3011affe004f4188b0cf6600b47b440f Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-415986342-project Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: {"removeTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} Oct 03 10:32:00.144028 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '107597912', 'body': {'removeTenantAccess': {'tenant': '24f673827f584063b1f4c98453e50784'}}} Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can( Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:32:00.144705 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 03 10:32:00.147421 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.154812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb1b84e1-833d-4577-a017-00503f49e3ef tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:32:00.160191 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb1b84e1-833d-4577-a017-00503f49e3ef tempest-FlavorsAccessNegativeTestJSON-415986342 tempest-FlavorsAccessNegativeTestJSON-415986342-project] 10.222.0.27 "POST /compute/v2.1/flavors/107597912/action" status: 403 len: 133 microversion: 2.1 time: 0.058456 Oct 03 10:32:00.162751 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 209/477] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 3 10:32:00 2022] POST /compute/v2.1/flavors/107597912/action => generated 133 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:32:00.185115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b697b86a-b8c0-4e45-99aa-57438403414b tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Action: 'update', calling method: .version_select at 0x7f074f9313a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:00.197667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b697b86a-b8c0-4e45-99aa-57438403414b tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'dd3311de83f540a9905ef3f7a0cd7b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec3b4bf8f428c95ad7cc96665b04b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b697b86a-b8c0-4e45-99aa-57438403414b tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Request method failure captured: Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/os-hosts/n-d-858383-3 HTTP/1.1 Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 50 Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroZbpo6_lnP1fKN52Kn7QJYuHBlQ5TtqOdLjRQmgaQNltanbflDgOkjGoSfbgCZstnLOu3LF5pZ5vI0m7HLZIkN8CUpbbXUmP0FKZ2n5uANv6hjx_Lx5Q89nLb2oH8Hkbz890i9eTZxy23pU0lODyMEB8P0OQFHuIrHds_tzdiTuM8 Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:32:00.204671 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c7dec3b4bf8f428c95ad7cc96665b04b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c7dec3b4bf8f428c95ad7cc96665b04b"}]}] Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: c7dec3b4bf8f428c95ad7cc96665b04b Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-843918603 Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: dd3311de83f540a9905ef3f7a0cd7b4c Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-HostsAdminNegativeTestJSON-843918603-project Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: {"status": "enable", "maintenance_mode": "enable"} Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 03 10:32:00.206247 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'n-d-858383-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:32:00.207294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 03 10:32:00.208664 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.227637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b697b86a-b8c0-4e45-99aa-57438403414b tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:32:00.232258 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b697b86a-b8c0-4e45-99aa-57438403414b tempest-HostsAdminNegativeTestJSON-843918603 tempest-HostsAdminNegativeTestJSON-843918603-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-3" status: 403 len: 111 microversion: 2.1 time: 0.066975 Oct 03 10:32:00.235098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 210/478] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:32:00 2022] PUT /compute/v2.1/os-hosts/n-d-858383-3 => generated 111 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:32:00.245415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb28b2e4-09e5-49de-8b7e-3ef3c56b29cf tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "24f673827f584063b1f4c98453e50784"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:00.263924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:00.278942 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ab9429a-23ea-419a-a4d9-2dc8e41bf193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1262 microversion: 2.1 time: 0.264802 Oct 03 10:32:00.281007 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 269/479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:00 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1262 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:00.287963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96d8e22b-2890-413f-bb02-a343ada63be4 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Action: 'update', calling method: .version_select at 0x7f074f81b310>, body: {"status": null, "maintenance_mode": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96d8e22b-2890-413f-bb02-a343ada63be4 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/os-hosts/n-d-858383-3 HTTP/1.1 Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 42 Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:32:00.293356 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: {"status": null, "maintenance_mode": null} Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 03 10:32:00.294594 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'n-d-858383-3', 'body': {'status': None, 'maintenance_mode': None}} Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'disable', Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'Enable', Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'Disable', Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance: Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi None Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.295498 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.296875 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.303452 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:32:00.303452 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:32:00.303452 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 03 10:32:00.303452 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.303452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96d8e22b-2890-413f-bb02-a343ada63be4 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:32:00.303452 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96d8e22b-2890-413f-bb02-a343ada63be4 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-858383-3" status: 400 len: 127 microversion: 2.1 time: 0.017198 Oct 03 10:32:00.304302 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 270/480] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 10:32:00 2022] PUT /compute/v2.1/os-hosts/n-d-858383-3 => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:32:00.309342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a65c931-4310-464a-b890-e779be789af0 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Action: 'update', calling method: .version_select at 0x7f074f830040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:00.314011 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.hosts [None req-1a65c931-4310-464a-b890-e779be789af0 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Enabling host nonexistent_hostname. Oct 03 10:32:00.323082 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1a65c931-4310-464a-b890-e779be789af0 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a65c931-4310-464a-b890-e779be789af0 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Request method failure captured: Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 50 Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrocmdpIs7kwcU7z7jiRyHv0u7Uo4AFUq76czPz1o2VkMqMNC55VSjbRQ-8DwRyUvMNMb8N1_aUlsBaO8871ZYOvm9IZzUStecZ_7H5aPT75B1MiZfXhtCp0UWAVTxrREZ7WTwusFe01aGQ0pRsIH1JQAvflREGAHa228291tL4oOgw Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:32:00.325801 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1874523323194774abd9fb453f6cda7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1874523323194774abd9fb453f6cda7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1874523323194774abd9fb453f6cda7c"}]}] Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 1874523323194774abd9fb453f6cda7c Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1898500461 Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0092e1451f0d403fb8288c86e8e1de83 Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1898500461-project-admin Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: {"status": "enable", "maintenance_mode": "enable"} Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:32:00.328726 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 10:32:00.329629 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:32:00.330608 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:32:00.331719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a65c931-4310-464a-b890-e779be789af0 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:32:00.332572 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a65c931-4310-464a-b890-e779be789af0 tempest-HostsAdminNegativeTestJSON-1898500461 tempest-HostsAdminNegativeTestJSON-1898500461-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022461 Oct 03 10:32:00.332739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 271/481] 10.222.0.27 () {60 vars in 1211 bytes} [Mon Oct 3 10:32:00 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:32:00.912607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:00.914177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:00.927877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:00.928794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:00.929526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:00.933579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:00.934258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:00.934977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:01.784358 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb28b2e4-09e5-49de-8b7e-3ef3c56b29cf tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/107597912/action" status: 200 len: 21 microversion: 2.1 time: 1.547927 Oct 03 10:32:01.791855 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 211/482] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 3 10:32:00 2022] POST /compute/v2.1/flavors/107597912/action => generated 21 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:01.828395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:01.834190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:01.855362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:01.856425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:01.858760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:01.862600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:01.863093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:01.863537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:01.979051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:01.995841 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c530e2b-4e25-4232-bb35-5972705d1879 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1472 microversion: 2.1 time: 1.088399 Oct 03 10:32:01.999120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 272/483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:00 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1472 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:02.009788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a95158a-f98f-4192-9aee-935c86cec531 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:02.054384 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a95158a-f98f-4192-9aee-935c86cec531 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/107597912" status: 202 len: 0 microversion: 2.1 time: 0.053006 Oct 03 10:32:02.057553 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 273/484] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:32:01 2022] DELETE /compute/v2.1/flavors/107597912 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:32:02.069801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0c912d4-ad4b-47b0-9563-ad587aa2639c tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:02.134962 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0c912d4-ad4b-47b0-9563-ad587aa2639c tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.074837 Oct 03 10:32:02.149378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:02.159217 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 274/485] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:32:02 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:02.164699 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66958c51-f491-47af-a1a0-c0aa34c2e5e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1268 microversion: 2.1 time: 0.370285 Oct 03 10:32:02.166278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c621f0e-f752-45af-af75-35ccd7964c83 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-259678917", "id": 600364512, "os-flavor-access:is_public": "False"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:02.168185 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 212/486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:01 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1268 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:02.238642 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c621f0e-f752-45af-af75-35ccd7964c83 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.078092 Oct 03 10:32:02.250511 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 275/487] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:32:02 2022] POST /compute/v2.1/flavors => generated 435 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:02.255073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa1af4b4-a651-4383-bca1-7342051cce47 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2e8dae301f4343d997142c661dfb3914"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:02.893126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-aa1af4b4-a651-4383-bca1-7342051cce47 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] HTTP exception thrown: Flavor access not found for 38 / 2e8dae301f4343d997142c661dfb3914 combination. Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa1af4b4-a651-4383-bca1-7342051cce47 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Request method failure captured: Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/flavors/600364512/action HTTP/1.1 Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 70 Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroW_lp4zEN2iN360_4jtnwn0B_w2WEz6wfLLWhK0DFYO-IAHz7QwTcEkxD_gNr1mB9ulV3nzqjSgJtYZuRTCGpygn200D2I85zQd9bKUgs5wLNH9ABlOwwZCodBgbp3uIWiphGTOoIB3kbIXQNceJ0xPlALs9f_6C3VXjzx1xC-z80 Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 4a9d8ba946294be7999183aee15e1e1d Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:32:02.899257 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a9d8ba946294be7999183aee15e1e1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a9d8ba946294be7999183aee15e1e1d"}]}] Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 4a9d8ba946294be7999183aee15e1e1d Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-829244670 Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: af243c9d14bd44cda4fe4dc2686fb9db Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: {"removeTenantAccess": {"tenant": "2e8dae301f4343d997142c661dfb3914"}} Oct 03 10:32:02.900878 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: exception: Flavor access not found for 38 / 2e8dae301f4343d997142c661dfb3914 combination. Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '600364512', 'body': {'removeTenantAccess': {'tenant': '2e8dae301f4343d997142c661dfb3914'}}} Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 03 10:32:02.901761 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / 2e8dae301f4343d997142c661dfb3914 combination. Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / 2e8dae301f4343d997142c661dfb3914 combination. Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:02.903160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:32:02.905325 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:32:02.905325 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:32:02.905325 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:32:02.905325 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:32:02.905325 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / 2e8dae301f4343d997142c661dfb3914 combination. Oct 03 10:32:02.905325 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:32:02.910945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa1af4b4-a651-4383-bca1-7342051cce47 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Returning 404 to user: Flavor access not found for 38 / 2e8dae301f4343d997142c661dfb3914 combination. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:32:02.912267 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa1af4b4-a651-4383-bca1-7342051cce47 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/600364512/action" status: 404 len: 124 microversion: 2.1 time: 0.664310 Oct 03 10:32:02.913292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 213/488] 10.222.0.27 () {60 vars in 1197 bytes} [Mon Oct 3 10:32:02 2022] POST /compute/v2.1/flavors/600364512/action => generated 124 bytes in 666 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:32:02.922841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f9abaaf-c998-45ca-902d-b4009d541c0d tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:02.958321 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f9abaaf-c998-45ca-902d-b4009d541c0d tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/600364512" status: 202 len: 0 microversion: 2.1 time: 0.040015 Oct 03 10:32:02.959290 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 276/489] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:32:02 2022] DELETE /compute/v2.1/flavors/600364512 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:32:02.968120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e341738-009b-4481-ae5f-4a7fd79397e4 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:03.031280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e341738-009b-4481-ae5f-4a7fd79397e4 tempest-FlavorsAccessNegativeTestJSON-829244670 tempest-FlavorsAccessNegativeTestJSON-829244670-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.066012 Oct 03 10:32:03.031588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:03.035812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:03.036218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 214/490] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:32:02 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:03.069609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:03.074641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:03.075479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:03.077334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:03.079210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:03.079728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:03.195885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:03.196535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:03.205646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:03.207041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:03.207583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:03.208448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:03.209031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:03.209704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:03.445639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:03.450261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:03.458366 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f12bfb54-bd60-4f3a-b0aa-a773d2c6a7a6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1472 microversion: 2.1 time: 0.440287 Oct 03 10:32:03.461594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d0e9862-4a18-4540-8494-64d42b270378 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1268 microversion: 2.1 time: 0.269192 Oct 03 10:32:03.466032 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 215/491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:03 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:03.481262 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 277/492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:03 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:04.488266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:04.488994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:04.489353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:04.489509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:04.497706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:04.500567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:04.501213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:04.501421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:04.502198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:04.502532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:04.503091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:04.503292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:04.503857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:04.512051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:04.512678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:04.513388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:04.770786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:04.794487 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f6046e72-f7e1-4290-98af-d76686529ef9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1472 microversion: 2.1 time: 0.311512 Oct 03 10:32:04.795274 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 216/493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:04 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:05.161796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:05.181829 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e91c5a8-2034-4528-8341-27d69bf2995d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.697509 Oct 03 10:32:05.183032 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 278/494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:04 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:05.754347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:05.755013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:05.766288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:05.767638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:05.771518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:05.772631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:05.773278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:05.773867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:05.822220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:05.822755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:05.843539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:05.844059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:05.847287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:05.848073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:05.854201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:32:05.855624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:05.858786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:06.043210 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40774426-9a63-4d28-b407-b81881b5a7fb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 204 len: 0 microversion: 2.1 time: 0.293859 Oct 03 10:32:06.058041 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 217/495] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:32:05 2022] DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:32:06.472231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:06.485079 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-38cc056b-eeb7-4fb7-8735-5026b0c1fecf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1472 microversion: 2.1 time: 0.667107 Oct 03 10:32:06.492725 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 279/496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:05 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1472 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:06.498034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:06.500138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:06.506844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=18,nova_api:DELETE=9 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:06.509251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:06.510522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:06.511374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:06.512414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:06.513995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:06.514730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:06.765109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1475156517", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": "none"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:06.905451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:06.906011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:06.906489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:06.907075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:06.907644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:06.924197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:06.924903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:06.925624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:06.926658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:06.927121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:06.927552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:06.935489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=15 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:06.936363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:06.950105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Getting quotas for project edde72f6116d47819b3903bafb1a0254. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:06.956523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Getting quotas for user 3995cd3a0f904339ae0482b0a2c83339 and project edde72f6116d47819b3903bafb1a0254. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:06.972152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:06.980975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d5ba261-2d77-4ea2-bc91-0d4644bf20eb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.486725 Oct 03 10:32:07.000389 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 280/497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:06 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:07.001375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:07.010128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:07.015068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1779502917", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "633867173", "adminPass": "***", "networks": [{"uuid": "2a441fda-2f9e-4b00-a376-c543d291306d"}], "security_groups": [{"name": "tempest-securitygroup--455722137"}], "key_name": "tempest-keypair-1192700604", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:07.088886 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-866e30c9-7eb8-4903-a8c2-e6a0ccf5389b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.905590 Oct 03 10:32:07.099061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 218/498] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:32:07.104914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f791a15b-f781-40c4-b0f5-4890740028c3 req-c56de5c5-41eb-4364-b15a-1bc29bf2a5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc538f05-7fa3-41ff-9515-21cf2614682b", "tag": "32c5aa00-acd7-4398-9018-8100679e6eb0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:07.134664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f791a15b-f781-40c4-b0f5-4890740028c3 req-c56de5c5-41eb-4364-b15a-1bc29bf2a5be service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:07.135612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f791a15b-f781-40c4-b0f5-4890740028c3 req-c56de5c5-41eb-4364-b15a-1bc29bf2a5be service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:07.136220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f791a15b-f781-40c4-b0f5-4890740028c3 req-c56de5c5-41eb-4364-b15a-1bc29bf2a5be service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:07.149897 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f791a15b-f781-40c4-b0f5-4890740028c3 req-c56de5c5-41eb-4364-b15a-1bc29bf2a5be service nova] Creating event network-changed:32c5aa00-acd7-4398-9018-8100679e6eb0 for instance bc538f05-7fa3-41ff-9515-21cf2614682b on n-h1-858383-3 Oct 03 10:32:07.156826 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f791a15b-f781-40c4-b0f5-4890740028c3 req-c56de5c5-41eb-4364-b15a-1bc29bf2a5be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056241 Oct 03 10:32:07.158046 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 219/499] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:07.164756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-292eb278-aa5a-4ca1-89e9-08d8b13cb523 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:07.165917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-292eb278-aa5a-4ca1-89e9-08d8b13cb523 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:07.297251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-292eb278-aa5a-4ca1-89e9-08d8b13cb523 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:07.309865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-292eb278-aa5a-4ca1-89e9-08d8b13cb523 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:07.314539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-292eb278-aa5a-4ca1-89e9-08d8b13cb523 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:07.341918 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-292eb278-aa5a-4ca1-89e9-08d8b13cb523 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1454 microversion: 2.91 time: 0.180047 Oct 03 10:32:07.341918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 220/500] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:07 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:07.726783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] validate_networks() for [('2a441fda-2f9e-4b00-a376-c543d291306d', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:32:07.777338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-796151307", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": "none"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:07.891821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:07.892243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:07.892976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:07.893616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:07.894183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:07.917426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:07.918144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:07.919748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:07.927086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:07.930344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:07.931030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:07.992231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Getting quotas for project 184473c6010b43ceb894770b7a45161d. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:08.003927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Getting quotas for user 79fde9028a7d43b4b8e5e603f8a1f2fd and project 184473c6010b43ceb894770b7a45161d. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:08.023739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:08.028969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:08.036043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:08.153243 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ab73e91b-9646-416c-881d-3d997f4840af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.793062 Oct 03 10:32:08.164372 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 221/501] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:32:08.175475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:08.176305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:08.210287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:08.210287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:08.210287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:08.210287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:08.210648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:08.210648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:08.522915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=11 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:08.560685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=64 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:08.569759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:08.579425 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0991bafe-3aa7-4cdc-a7bb-c2e3a9a9a0c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.413608 Oct 03 10:32:08.593554 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 222/502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:08 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:08.604816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:08.605752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:08.613064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:08.614134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:08.614849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:08.615878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:08.617226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:08.617902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:08.937738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:08.948809 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a977f6cb-653b-4be4-87bc-84da535e4a6e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.353985 Oct 03 10:32:08.966953 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 223/503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:08 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:08.976961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37e5f4f1-10dc-4faf-9350-9d52609cebdd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:08.981106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37e5f4f1-10dc-4faf-9350-9d52609cebdd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:09.128097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-37e5f4f1-10dc-4faf-9350-9d52609cebdd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.146395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-37e5f4f1-10dc-4faf-9350-9d52609cebdd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.148437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-37e5f4f1-10dc-4faf-9350-9d52609cebdd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.157203 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37e5f4f1-10dc-4faf-9350-9d52609cebdd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "PUT /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1358 microversion: 2.75 time: 0.185722 Oct 03 10:32:09.170498 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 224/504] 10.222.0.27 () {62 vars in 1297 bytes} [Mon Oct 3 10:32:08 2022] PUT /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:09.181345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:09.181345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:09.195147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.195549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.196292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.200802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.203409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.203887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.290421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:09.290872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:09.291396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:09.291827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:09.292549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:09.327497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.329073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.331029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.332734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.336890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.337380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.384543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Getting quotas for project f15708e4a6464c968bb7f6c73b73c019. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:09.390397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Getting quotas for user 4f65f9939dc241f0bffc3cd45efd857a and project f15708e4a6464c968bb7f6c73b73c019. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:09.403532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:09.408121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:09.477483 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b3eaa10-1607-49a2-8935-6dce2b633af9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.475757 Oct 03 10:32:09.484410 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 281/505] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:32:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:32:09.484635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:09.488564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:09.493049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.493759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.494203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.495083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.495550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.495977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.531516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.543268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.562798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.584105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bae91ec7-86be-4d5d-af73-9e706dcc6b96 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1506 microversion: 2.91 time: 0.412245 Oct 03 10:32:09.585820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 225/506] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:09 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:09.610491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99fa11a9-8c41-45e2-b34d-5f64a1056125 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:09.611476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99fa11a9-8c41-45e2-b34d-5f64a1056125 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:09.786861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-99fa11a9-8c41-45e2-b34d-5f64a1056125 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.795848 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99fa11a9-8c41-45e2-b34d-5f64a1056125 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1263 microversion: 2.1 time: 0.205148 Oct 03 10:32:09.808936 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 226/507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:09 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1263 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:09.814986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.821390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:09.821534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:09.822369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:09.831814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.832688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.833266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.833500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:09.834367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.835289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:09.835963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:09.836609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:09.874155 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dfe178e-ce55-4668-8d52-33025617920c tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1362 microversion: 2.75 time: 0.389005 Oct 03 10:32:09.890202 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 282/508] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:09 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:10.226991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dd1c970-9fa5-4100-8948-0f4c9dd1c3f5 tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] Calling method '.version_select at 0x7f074f7d4160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:10.232930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:10.244696 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df63aa08-dd83-4beb-a3bc-c787c9cbe372 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.434197 Oct 03 10:32:10.247688 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 227/509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:09 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:10.263890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:10.267425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dd1c970-9fa5-4100-8948-0f4c9dd1c3f5 tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.369871 Oct 03 10:32:10.268464 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 283/510] 10.222.0.27 () {60 vars in 1226 bytes} [Mon Oct 3 10:32:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:10.275010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:10.280208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a1a056a-740b-47c3-b0a0-70e967a2be24 tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] Action: 'update', calling method: .version_select at 0x7f074f7d4550>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:10.293892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:10.294826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:10.295712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:10.296913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:10.297551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:10.298144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:10.652892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:10.662905 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4dc693c6-8cc8-4dbb-9302-5eb9cacdf740 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.409089 Oct 03 10:32:10.670011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 228/511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:10 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:10.708672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9a8ea5c9-2445-43d3-beba-352fac1aad95 req-b946b2aa-52e4-4d23-b625-16c69594c701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03170cc0-d8a1-4021-8aac-b4019e329987", "name": "network-vif-deleted", "tag": "77628770-1ed9-42bc-9dc2-87f9f8955595"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:10.745432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9a8ea5c9-2445-43d3-beba-352fac1aad95 req-b946b2aa-52e4-4d23-b625-16c69594c701 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:10.749449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9a8ea5c9-2445-43d3-beba-352fac1aad95 req-b946b2aa-52e4-4d23-b625-16c69594c701 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:10.749897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9a8ea5c9-2445-43d3-beba-352fac1aad95 req-b946b2aa-52e4-4d23-b625-16c69594c701 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:10.767524 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a1a056a-740b-47c3-b0a0-70e967a2be24 tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.492144 Oct 03 10:32:10.772313 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 284/512] 10.222.0.27 () {62 vars in 1247 bytes} [Mon Oct 3 10:32:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:10.784474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:10.785389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:10.794210 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9a8ea5c9-2445-43d3-beba-352fac1aad95 req-b946b2aa-52e4-4d23-b625-16c69594c701 service nova] Creating event network-vif-deleted:77628770-1ed9-42bc-9dc2-87f9f8955595 for instance 03170cc0-d8a1-4021-8aac-b4019e329987 on n-h2-858383-3 Oct 03 10:32:10.807739 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9a8ea5c9-2445-43d3-beba-352fac1aad95 req-b946b2aa-52e4-4d23-b625-16c69594c701 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130722 Oct 03 10:32:10.808052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:10.808990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:10.809641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:10.810561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:10.810863 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 229/513] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:10.812257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:10.813217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:10.823959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d8d2a93-a9e0-4237-b35f-b5f628827c8c tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] Calling method '.version_select at 0x7f074f82f8b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:10.859952 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d8d2a93-a9e0-4237-b35f-b5f628827c8c tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.046915 Oct 03 10:32:10.860641 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 230/514] 10.222.0.27 () {60 vars in 1226 bytes} [Mon Oct 3 10:32:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:10.872682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:10.875416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:10.888209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:10.888725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:10.889193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:10.895350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:10.900835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:10.901548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:11.007380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.011052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.019593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95615131-d617-418f-a3b1-10ec81477986 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1259 microversion: 2.1 time: 0.157804 Oct 03 10:32:11.020878 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 231/515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:10 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:11.024004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.026748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a4bf5d2b-4921-40e0-893c-de1bc0a5cef8 tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] Action: 'update', calling method: .version_select at 0x7f074f95dc10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:11.027605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.040741 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a8dd952-08de-44f2-95b2-791a8d7955e8 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1506 microversion: 2.91 time: 0.258735 Oct 03 10:32:11.063587 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 285/516] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:10 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:11.076495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:11.077527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:11.095447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:11.098576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:11.099908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:11.102072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:11.103766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:11.109603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:11.169672 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a4bf5d2b-4921-40e0-893c-de1bc0a5cef8 tempest-QuotaClassesAdmin257Test-1780087729 tempest-QuotaClassesAdmin257Test-1780087729-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.147417 Oct 03 10:32:11.171177 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 232/517] 10.222.0.27 () {62 vars in 1247 bytes} [Mon Oct 3 10:32:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:11.272591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:11.278487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.290404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:11.305789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:11.307384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:11.308038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:11.309116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:11.309828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:11.310688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:11.322348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.327544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.346631 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9695d9a0-c9ad-4b2b-944d-e21e2e8f9dbd tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1362 microversion: 2.75 time: 0.279730 Oct 03 10:32:11.348679 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 286/518] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:11 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:11.614326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:11.625088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd750f54-2248-4b52-8629-a3fab453f316 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.357537 Oct 03 10:32:11.638800 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 233/519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:11 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:11.688336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:11.689351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:11.705493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:11.706164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:11.707074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:11.708653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:11.710994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:11.712571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.210566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e3c6f24-5f33-489a-b108-770fd264de72 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1893443905", "ram": 512, "vcpus": 1, "disk": 10, "id": 1984442801, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:12.236462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.247485 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a8adaec-7b21-4cfc-9117-c7e7c3b19cef tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.563646 Oct 03 10:32:12.250132 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 287/520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:11 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:12.256144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:12.257804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:12.262481 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e3c6f24-5f33-489a-b108-770fd264de72 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.402703 Oct 03 10:32:12.265473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.266223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.266931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.268091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.269424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.270175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.277554 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 234/521] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:32:11 2022] POST /compute/v2.1/flavors => generated 416 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:32:12.293074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:12.293855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:12.303691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.305593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.306070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.314027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.314649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.315095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.446924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.457691 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3abc57b2-81c6-4a8c-94dd-d2d251b6d6df tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1315 microversion: 2.1 time: 0.206379 Oct 03 10:32:12.489066 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 288/522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:12 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:12.501151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7bcb298-2818-4ee7-b409-4b83a738accc tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:12.591091 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7bcb298-2818-4ee7-b409-4b83a738accc tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1984442801/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.098559 Oct 03 10:32:12.595803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 289/523] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 3 10:32:12 2022] POST /compute/v2.1/flavors/1984442801/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:12.606686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.611616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:12.613489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:12.616382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.624445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.628690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.638617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.639888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.645024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.648330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.650201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.654977 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1336eba-b06b-4ead-9aae-74c33b9f2fcc tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1512 microversion: 2.91 time: 0.375880 Oct 03 10:32:12.655765 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 235/524] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:12 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:12.881534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.897652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-020d821a-c6ca-4dcf-9707-c62e6324cc17 tempest-FlavorsExtraSpecsTestJSON-22746947 tempest-FlavorsExtraSpecsTestJSON-22746947-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:12.908392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.912346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:12.917549 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-020d821a-c6ca-4dcf-9707-c62e6324cc17 tempest-FlavorsExtraSpecsTestJSON-22746947 tempest-FlavorsExtraSpecsTestJSON-22746947-project] 10.222.0.27 "GET /compute/v2.1/flavors/1984442801/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.251075 Oct 03 10:32:12.921678 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 236/525] 10.222.0.27 () {58 vars in 1203 bytes} [Mon Oct 3 10:32:12 2022] GET /compute/v2.1/flavors/1984442801/os-extra_specs => generated 66 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:12.933210 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7725d5b0-d6a6-4a09-9510-04525940288a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1410 microversion: 2.75 time: 0.335286 Oct 03 10:32:12.938223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 290/526] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:12 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1410 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:12.946566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:12.949688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:12.954100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ae783da-5891-420b-bc95-065d19321d28 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:12.962584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.964635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.970062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:12.971384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:12.972267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:12.974350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.012825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=12,nova_api:UPDATE=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:13.029339 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ae783da-5891-420b-bc95-065d19321d28 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1984442801/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083917 Oct 03 10:32:13.038804 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 291/527] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 3 10:32:12 2022] POST /compute/v2.1/flavors/1984442801/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:13.044660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-132b8d61-e4f1-4991-a6f2-72856ee69482 tempest-FlavorsExtraSpecsTestJSON-22746947 tempest-FlavorsExtraSpecsTestJSON-22746947-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.070812 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-132b8d61-e4f1-4991-a6f2-72856ee69482 tempest-FlavorsExtraSpecsTestJSON-22746947 tempest-FlavorsExtraSpecsTestJSON-22746947-project] 10.222.0.27 "GET /compute/v2.1/flavors/1984442801/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030417 Oct 03 10:32:13.076937 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 292/528] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/flavors/1984442801/os-extra_specs/hw:numa_nodes => generated 22 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:13.083307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed7c3312-60f7-493a-9617-fa676265e0cd tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:13.142844 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed7c3312-60f7-493a-9617-fa676265e0cd tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1984442801/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063396 Oct 03 10:32:13.144115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 293/529] 10.222.0.27 () {60 vars in 1224 bytes} [Mon Oct 3 10:32:13 2022] POST /compute/v2.1/flavors/1984442801/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:13.153436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d10ca6d0-4d1b-4373-8e0c-0688df280325 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.164144 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d10ca6d0-4d1b-4373-8e0c-0688df280325 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1984442801/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014405 Oct 03 10:32:13.165647 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 294/530] 10.222.0.27 () {58 vars in 1203 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/flavors/1984442801/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:13.181221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb873270-cbf1-4476-bfb7-c15b22f71e78 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:13.225439 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb873270-cbf1-4476-bfb7-c15b22f71e78 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1984442801/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.050382 Oct 03 10:32:13.227092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 295/531] 10.222.0.27 () {60 vars in 1265 bytes} [Mon Oct 3 10:32:13 2022] PUT /compute/v2.1/flavors/1984442801/os-extra_specs/hw:numa_nodes => generated 22 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:13.240944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78a99a3a-96a8-4ca9-a12d-1c6dfe10a093 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.257512 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78a99a3a-96a8-4ca9-a12d-1c6dfe10a093 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1984442801/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025006 Oct 03 10:32:13.258093 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 296/532] 10.222.0.27 () {58 vars in 1203 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/flavors/1984442801/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:13.273551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-232a0b27-58d7-4341-ab39-1def331700ef tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.325191 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-232a0b27-58d7-4341-ab39-1def331700ef tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1984442801/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.056247 Oct 03 10:32:13.330230 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 297/533] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:32:13 2022] DELETE /compute/v2.1/flavors/1984442801/os-extra_specs/hw:numa_nodes => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:32:13.338923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.340733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:13.355409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.360973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.361550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.362758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.363541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.364365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.387673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:13.401037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-226fa146-5748-4289-9eb3-0db652c30e32 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.471298 Oct 03 10:32:13.406421 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 237/534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:12 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:13.414139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7af6f927-9bd3-4809-8d24-d3c6de40db3f tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.487382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7af6f927-9bd3-4809-8d24-d3c6de40db3f tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1984442801/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.079797 Oct 03 10:32:13.487961 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 238/535] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:32:13 2022] DELETE /compute/v2.1/flavors/1984442801/os-extra_specs/hw:cpu_policy => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 10:32:13.495048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.495661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:13.508933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.515281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.515995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.516981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.517601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.518672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.619060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:13.627909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2fda5f52-d077-43e1-9747-aa4f2d49f7de tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1321 microversion: 2.1 time: 0.138716 Oct 03 10:32:13.629394 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 239/536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1321 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:13.633953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8272f08-2827-4308-b59b-717e4c1ac764 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.648680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8272f08-2827-4308-b59b-717e4c1ac764 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1984442801/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018116 Oct 03 10:32:13.649294 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 240/537] 10.222.0.27 () {58 vars in 1203 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/flavors/1984442801/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:32:13.664420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a18a056d-8f3c-41eb-a927-442ed0fd709b tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.707008 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a18a056d-8f3c-41eb-a927-442ed0fd709b tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1984442801" status: 202 len: 0 microversion: 2.1 time: 0.048623 Oct 03 10:32:13.707599 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 241/538] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:32:13 2022] DELETE /compute/v2.1/flavors/1984442801 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:32:13.713113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.713727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:13.722451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.723268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.723956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.724920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.725570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.726202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.799552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:13.814431 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e09cd20a-23e4-4452-ae85-da280d007888 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.479790 Oct 03 10:32:13.817074 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 298/539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:13.831898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:13.835949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43d053d3-a8ca-4aa6-bfe2-678f91379d10 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.850108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:13.851555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:13.863497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3a6b743-6674-451e-a640-42dcb5247efd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1512 microversion: 2.91 time: 0.154610 Oct 03 10:32:13.866093 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 242/540] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:13.866755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43d053d3-a8ca-4aa6-bfe2-678f91379d10 tempest-FlavorsExtraSpecsTestJSON-1720627856 tempest-FlavorsExtraSpecsTestJSON-1720627856-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.047728 Oct 03 10:32:13.867802 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 299/541] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:13.966135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:13.966747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:13.976569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.978565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.979189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:13.980063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:13.981672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:13.982570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:14.160620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:14.174580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:14.179237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:14.189111 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08f41b62-34b6-457d-920f-a90ec49b6bf2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1418 microversion: 2.75 time: 0.227497 Oct 03 10:32:14.205744 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 243/542] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:13 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1418 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:32:14.427476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:14.427960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:14.440871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:14.441358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:14.441796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:14.442509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:14.442975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:14.443397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:14.655232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:14.656596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:14.665250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:14.673348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:14.674207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:14.675638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:14.676373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:14.677012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:14.872096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:14.893030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-450cf875-cbe0-493c-810a-fb3b06d8f538 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.466475 Oct 03 10:32:14.899016 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 300/543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:14 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:14.911129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:14.915616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:14.933184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:14.933434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:14.934205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:14.937463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:14.939036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:14.940175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:15.107310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.121086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea596462-5023-4385-aa90-c76e03f37b78 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1388 microversion: 2.1 time: 0.470536 Oct 03 10:32:15.124953 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 244/544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:14 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1388 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:15.134178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:15.141139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:15.153896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:15.155079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:15.155761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:15.156685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:15.161812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:15.162429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:15.217104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.226701 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-69e695ed-9ec9-4788-a5f1-af81696772c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.325660 Oct 03 10:32:15.230794 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 301/545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:14 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:15.242661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:15.242997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:15.255140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:15.255646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:15.256091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:15.256821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:15.257271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:15.261132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:15.365323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.381616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.383071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.389092 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a8917d1-87e2-4835-a9d3-ec36f784e5c9 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1512 microversion: 2.91 time: 0.260242 Oct 03 10:32:15.393139 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 245/546] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:15 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:15.441074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.449479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.457146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:15.467754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f0ecf34-a6e0-4400-a4dc-3f6367892bd9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1416 microversion: 2.75 time: 0.235648 Oct 03 10:32:15.468627 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 302/547] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:15 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1416 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:15.923521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:15.924132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:15.927893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=7,nova_api:DELETE=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:15.943885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:15.945659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:15.949695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:15.950672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:15.952799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:15.953457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.150582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:16.151184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:16.160904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.162470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.166201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.168873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.170668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.171452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.324858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.336657 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6b2b2bd-7105-48d1-a5b2-1d571dbaecf3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.416910 Oct 03 10:32:16.347076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 246/548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:15 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:16.363081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:16.366986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:16.378664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.384468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.385098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.386022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.386772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.388424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.428368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:16.485984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.498362 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4deba2e-7bd4-46a3-b93c-71417f13bfe0 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1388 microversion: 2.1 time: 0.351289 Oct 03 10:32:16.500329 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 303/549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:16 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1388 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:16.506268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:16.507059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:16.513667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.514947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.515892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.516836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.517536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.518363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.650839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.664107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.666306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.672153 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3dac9d72-66bf-4401-a54e-a66a01ebd648 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1512 microversion: 2.91 time: 0.170449 Oct 03 10:32:16.673355 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 304/550] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:16 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:16.689464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:16.690356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:16.702458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.703875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.704505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.705415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.706021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.706676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.805682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.822654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.828946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:16.838497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-760b6138-951a-403a-905c-ebcce2c9b1b2 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1416 microversion: 2.75 time: 0.163833 Oct 03 10:32:16.852939 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 305/551] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:16 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1416 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:16.871122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f4168709-0aac-4a27-8842-95ad11de4f7a req-35b235ae-c405-4af9-8db9-887c8d132c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d2d109-a77c-4ebe-9aa8-80187fb3f240", "tag": "043e2572-78c2-48b4-94c7-336d1e0ebd85"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:16.899060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4168709-0aac-4a27-8842-95ad11de4f7a req-35b235ae-c405-4af9-8db9-887c8d132c22 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:16.899548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4168709-0aac-4a27-8842-95ad11de4f7a req-35b235ae-c405-4af9-8db9-887c8d132c22 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:16.900175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4168709-0aac-4a27-8842-95ad11de4f7a req-35b235ae-c405-4af9-8db9-887c8d132c22 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:16.918302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f4168709-0aac-4a27-8842-95ad11de4f7a req-35b235ae-c405-4af9-8db9-887c8d132c22 service nova] Creating event network-changed:043e2572-78c2-48b4-94c7-336d1e0ebd85 for instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 on n-h2-858383-3 Oct 03 10:32:16.924416 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f4168709-0aac-4a27-8842-95ad11de4f7a req-35b235ae-c405-4af9-8db9-887c8d132c22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068418 Oct 03 10:32:16.924952 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 306/552] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:17.050120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:17.063004 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7ce3496b-ad75-45b1-841a-3b42cef0bdd4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.711517 Oct 03 10:32:17.064131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 247/553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:16 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:17.112602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4326b4da-ff68-4b62-9af1-dcb2eeb333d5 req-1aae466b-ec41-4fdd-8ddc-ab8413f9b4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc538f05-7fa3-41ff-9515-21cf2614682b", "name": "network-vif-plugged", "status": "completed", "tag": "32c5aa00-acd7-4398-9018-8100679e6eb0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:17.135409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4326b4da-ff68-4b62-9af1-dcb2eeb333d5 req-1aae466b-ec41-4fdd-8ddc-ab8413f9b4d7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:17.135887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4326b4da-ff68-4b62-9af1-dcb2eeb333d5 req-1aae466b-ec41-4fdd-8ddc-ab8413f9b4d7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:17.136300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4326b4da-ff68-4b62-9af1-dcb2eeb333d5 req-1aae466b-ec41-4fdd-8ddc-ab8413f9b4d7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:17.162008 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4326b4da-ff68-4b62-9af1-dcb2eeb333d5 req-1aae466b-ec41-4fdd-8ddc-ab8413f9b4d7 service nova] Creating event network-vif-plugged:32c5aa00-acd7-4398-9018-8100679e6eb0 for instance bc538f05-7fa3-41ff-9515-21cf2614682b on n-h1-858383-3 Oct 03 10:32:17.173797 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4326b4da-ff68-4b62-9af1-dcb2eeb333d5 req-1aae466b-ec41-4fdd-8ddc-ab8413f9b4d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065862 Oct 03 10:32:17.174624 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 307/554] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:17.376184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:17.377537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:17.394673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:17.399159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:17.403018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:17.404074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:17.408956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:17.409704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:17.525318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:17.526016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:17.538669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:17.539154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:17.549513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:17.550277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:17.550753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:17.551180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:17.697024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:17.708115 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-94b617d6-cb58-4f66-997e-3fa1efca21d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.340640 Oct 03 10:32:17.710248 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 248/555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:17 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:17.934199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:17.954462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:17.981044 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b55ce2d5-a508-44a3-84c7-0f6a392f175f tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1388 microversion: 2.1 time: 0.460663 Oct 03 10:32:17.994649 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 308/556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:17 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1388 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:18.006038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:18.006945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:18.015790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.016793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.017992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.019202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.019868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.020922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.141448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:18.161039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:18.163019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:18.176408 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b50e0631-e889-4afd-89ce-607e3bdaee1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1533 microversion: 2.91 time: 0.171869 Oct 03 10:32:18.178043 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 309/557] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:17 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1533 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:18.191547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:18.192812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:18.208325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.211354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.223112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.224360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.225137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.225780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.231454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Action: 'update', calling method: .version_select at 0x7f074f7e09d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:18.393952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:18.410012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:18.412701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:18.427400 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53a808d9-01da-4f6b-b649-02ef278408f9 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1416 microversion: 2.75 time: 0.243120 Oct 03 10:32:18.428460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 310/558] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:18 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1416 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:18.442871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:18.444708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:18.468455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.469304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.469731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.471285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.472259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.472908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.705340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:18.709766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:18.719742 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-747f2c4c-96a3-4331-b1a0-0df221303959 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.287797 Oct 03 10:32:18.720466 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 311/559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:18 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:18.773194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.774111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.774653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.775512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.776084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.776634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.908496 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b14b17fc-cdb4-49d8-81d1-d6e701ed9fa5 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b" status: 200 len: 240 microversion: 2.36 time: 1.196796 Oct 03 10:32:18.916150 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 249/560] 10.222.0.27 () {62 vars in 1303 bytes} [Mon Oct 3 10:32:17 2022] PUT /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b => generated 240 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:18.930108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:18.930732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:18.954918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.955414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.955838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:18.963787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:18.964274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:18.964713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:19.294223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:19.295432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:19.304475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:19.305012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:19.305543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:19.306255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:19.306702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:19.307121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:19.397308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:19.460146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:19.470619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a7ef518-2bd1-4be2-9ab0-a4cdc94050ac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.553190 Oct 03 10:32:19.471520 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 250/561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:18 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:19.484728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Calling method '.version_select at 0x7f074f8aa5e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:19.529714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lazy-loading 'services' on Instance uuid bd7aa640-cc81-4558-8a95-020b29cfebd9 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:32:19.645249 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48531196-206c-4039-b6a5-6eb2207d1bcb tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1938 microversion: 2.91 time: 0.922165 Oct 03 10:32:19.649745 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 312/562] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:18 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1938 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:19.663097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:19.665961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:19.687026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:19.688070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:19.689472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:19.693371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:19.693966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:19.696311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.074278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.077203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.077925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.078842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.080482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.082557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.129254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f835788-faf1-4eb4-9ae9-d0af5f64f85d tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b/detail" status: 200 len: 672 microversion: 2.36 time: 0.656481 Oct 03 10:32:20.132510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 251/563] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 3 10:32:19 2022] GET /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b/detail => generated 672 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:20.139511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:20.140361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:20.158351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.159129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.159728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.160597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.161251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.162415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.191981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:20.202092 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-70deb220-8d6d-4b00-8596-6de7d8a214b9 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1388 microversion: 2.1 time: 0.551154 Oct 03 10:32:20.215432 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 313/564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:19 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1388 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:20.224827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:20.225421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:20.234898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.235384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.235819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.236516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.236983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.241104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.292685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:20.306890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:20.308587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:20.322811 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5c665369-c6bd-4e7d-8f6f-25890001d584 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1416 microversion: 2.75 time: 0.187813 Oct 03 10:32:20.325328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 252/565] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:20 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1416 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:20.339144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:20.339752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:20.361839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.362596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.366083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.366816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.372651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.373178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.385835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lazy-loading 'services' on Instance uuid bd7aa640-cc81-4558-8a95-020b29cfebd9 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:32:20.423490 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1c466b72-9978-46bd-bdd6-2b3307239a36 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1938 microversion: 2.91 time: 0.206867 Oct 03 10:32:20.424095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 314/566] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:20 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1938 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:20.590070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:20.600611 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0d1a6a8-60d2-4117-8504-570cb1e285c9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1310 microversion: 2.1 time: 0.273284 Oct 03 10:32:20.601353 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 253/567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:20 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:20.621397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Action: 'update', calling method: .version_select at 0x7f074f82f8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:20.671453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Calling method '.version_select at 0x7f074f724940>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:20.678914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.679437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.679889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.698740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.699244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.699688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.722648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.723688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.724334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.725292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.726459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.727072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.772557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.773286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.773885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.774926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.775542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.776128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.787528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:20.804801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.806274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.806932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.836616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.837391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.839560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.900975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.902190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.903686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.913700 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a74388cb-ab42-4480-a503-4cbb124f76b5 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.488531 Oct 03 10:32:20.915959 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 315/568] 10.222.0.27 () {60 vars in 1243 bytes} [Mon Oct 3 10:32:20 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:20.922735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:20.930265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.932491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.933417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.934432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.935100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.936383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.945278 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d36d451-df6d-4562-af6c-71aabc01648a tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b?user_id=25f53c7fa471408e899e433154e72508" status: 200 len: 240 microversion: 2.36 time: 0.342813 Oct 03 10:32:20.952424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 254/569] 10.222.0.27 () {62 vars in 1384 bytes} [Mon Oct 3 10:32:20 2022] PUT /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b?user_id=25f53c7fa471408e899e433154e72508 => generated 240 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:20.968968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:20.969862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:20.981141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.981946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.982097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:20.982783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:20.985195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:20.985643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.004670 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1b47033b-fac3-4877-9fa8-a31b8e26000b tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.087374 Oct 03 10:32:21.012308 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 316/570] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 3 10:32:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:21.017392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Calling method '.version_select at 0x7f074f75ba60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:21.029587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.032330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.032931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.067056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.070594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.071157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.115605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=88,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:21.129626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.131067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.133336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.165818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.166984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.170988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.223451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.224086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.225227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.241947 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e790e18-af68-4ba7-b4b0-ce497a0e9224 tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.233546 Oct 03 10:32:21.242704 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 317/571] 10.222.0.27 () {60 vars in 1222 bytes} [Mon Oct 3 10:32:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:21.262122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e76c1344-d872-40f2-96f0-47a0a615a105 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] Calling method '.version_select at 0x7f074f724430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:21.367491 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e76c1344-d872-40f2-96f0-47a0a615a105 tempest-QuotasAdminTestV236-988834514 tempest-QuotasAdminTestV236-988834514-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b?user_id=25f53c7fa471408e899e433154e72508" status: 200 len: 282 microversion: 2.36 time: 0.116244 Oct 03 10:32:21.378544 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 318/572] 10.222.0.27 () {60 vars in 1364 bytes} [Mon Oct 3 10:32:21 2022] GET /compute/v2.1/os-quota-sets/64a5afcc5107425d8353f107ac14cd0b?user_id=25f53c7fa471408e899e433154e72508 => generated 282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:21.384270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:21.385111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:21.392520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.393305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.394297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.395391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.396318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.396984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.428091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lazy-loading 'flavor' on Instance uuid bd7aa640-cc81-4558-8a95-020b29cfebd9 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:32:21.453709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:21.475282 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1dad70d-b588-4b54-89be-8f0e0eae67c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.528269 Oct 03 10:32:21.475884 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 255/573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:20 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:21.502283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:21.503790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:21.517863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.522441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.523276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.524202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.526062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.526803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:21.941198 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2a8b5544-1dab-4bcb-8435-ebfbf45bac29 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action" status: 202 len: 0 microversion: 2.91 time: 0.560694 Oct 03 10:32:21.949536 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 319/574] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:32:21 2022] POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:32:21.960740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Calling method '.version_select at 0x7f074f6d5550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:21.969704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:21.970211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:21.973351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.017431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.017922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.018361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.038396 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb583e7d-0920-4647-bc63-5370f0d0003f tempest-HypervisorAdminV253TestBase-346894227 tempest-HypervisorAdminV253TestBase-346894227-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/a23de0dd-73e2-46c2-86a3-cb32baaa07dd" status: 200 len: 792 microversion: 2.53 time: 0.087006 Oct 03 10:32:22.041313 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 320/575] 10.222.0.27 () {60 vars in 1298 bytes} [Mon Oct 3 10:32:21 2022] GET /compute/v2.1/os-hypervisors/a23de0dd-73e2-46c2-86a3-cb32baaa07dd => generated 792 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:22.056530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:22.057368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:22.074007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.074777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.075376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.076254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.077578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.078839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.136288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.149355 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27cc7263-3216-443c-bc4e-c2e9f4fd76be tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1388 microversion: 2.1 time: 0.672331 Oct 03 10:32:22.150148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 256/576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:21 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1388 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:22.157085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:22.157840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:22.165582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.166126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.166559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.168116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.168727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.169188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.419998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.432274 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b175eed-2916-41ef-8e4e-d4444a70fbc0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1494 microversion: 2.1 time: 0.280880 Oct 03 10:32:22.450812 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 257/577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:22 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1494 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:22.466005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:22.469122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:22.487749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.487749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.488279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.488996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.489507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.492316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.535038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.547407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.551947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.564191 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72e7f670-8b62-49ca-8637-eee2d2751560 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1437 microversion: 2.75 time: 0.518588 Oct 03 10:32:22.572829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 321/578] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:22 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1437 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:22.617232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.637453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.641330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:22.649641 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5657dd8-a342-43ce-abe6-40a9436e8464 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.197665 Oct 03 10:32:22.650731 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 258/579] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:22 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:22.656180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:22.657162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:22.664112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.664486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.665311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.666367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:22.667063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:22.673918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:22.992456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:23.001812 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad3a2785-6cc7-49ca-9724-8b1276613e80 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.349785 Oct 03 10:32:23.016995 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 259/580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:22 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:23.016995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:23.016995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:23.031419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.032001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.032449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.033450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.034195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.034686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.204356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:23.205094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:23.206469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:23.208653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:23.209498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:23.223333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:23.224206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:23.248790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.253502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.254317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.255216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.255838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.263486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.313878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:23.328462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.329118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.329421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.330142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.333735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.334221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.512273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:23.565521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:23.585204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:23.602573 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ae0f749e-67a6-47f2-a18c-08bb167056ba tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "POST /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b/action" status: 202 len: 1494 microversion: 2.75 time: 0.596360 Oct 03 10:32:23.603706 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 260/581] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:32:23 2022] POST /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b/action => generated 1494 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 03 10:32:23.613235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:23.614267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:23.631723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.633625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.634190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.638699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.639324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.640873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.701017 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df72be66-5571-40dc-8288-f82219414f19 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1645 microversion: 2.1 time: 1.114165 Oct 03 10:32:23.702194 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 322/582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:22 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1645 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:23.717073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:23.717887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:23.729594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.731209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.731494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.732221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.732706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.733744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.892557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:23.923914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:23.941607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:23.970837 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40224da1-01b1-43e7-b635-615f23101f93 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.266244 Oct 03 10:32:23.971763 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 323/583] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:23 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:23.978610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:23.979414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:23.990053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.990746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.991371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:23.992423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:23.995204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:23.995822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.082515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:24.091743 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-49173daf-992b-4d46-a132-1193304c99e3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1388 microversion: 2.1 time: 0.486791 Oct 03 10:32:24.093256 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 261/584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:23 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1388 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:24.118825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-80fc2942-d215-41b7-8855-563d76074ad7 req-403c293c-29ce-4073-8b30-bc074453bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d2d109-a77c-4ebe-9aa8-80187fb3f240", "name": "network-vif-plugged", "status": "completed", "tag": "043e2572-78c2-48b4-94c7-336d1e0ebd85"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:24.135980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-80fc2942-d215-41b7-8855-563d76074ad7 req-403c293c-29ce-4073-8b30-bc074453bf7f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.136464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-80fc2942-d215-41b7-8855-563d76074ad7 req-403c293c-29ce-4073-8b30-bc074453bf7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.136930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-80fc2942-d215-41b7-8855-563d76074ad7 req-403c293c-29ce-4073-8b30-bc074453bf7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.150301 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-80fc2942-d215-41b7-8855-563d76074ad7 req-403c293c-29ce-4073-8b30-bc074453bf7f service nova] Creating event network-vif-plugged:043e2572-78c2-48b4-94c7-336d1e0ebd85 for instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 on n-h2-858383-3 Oct 03 10:32:24.156049 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-80fc2942-d215-41b7-8855-563d76074ad7 req-403c293c-29ce-4073-8b30-bc074453bf7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042823 Oct 03 10:32:24.157043 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 262/585] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:24.173239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:24.174292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:24.181436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.182207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.182806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.183901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.189101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.189837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.350316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:24.363182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:24.371273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:24.380357 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-802c4da7-49a5-4504-ad69-8840b626194b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.405060 Oct 03 10:32:24.403028 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 324/586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:23 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:24.413620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:24.415197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:24.429859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.434314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.436979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.437740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.438180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.440511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.445154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:24.662399 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4211e827-5a75-4c6b-86e1-760b6ad14e6e tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1645 microversion: 2.1 time: 0.504130 Oct 03 10:32:24.664814 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 263/587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:24 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1645 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:24.696581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:24.704394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.710659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.711279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.714216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.716051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.716657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.736476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:24.815414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:24.820269 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81829c36-32c1-4ed2-8892-5a451698d9ff tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.132557 Oct 03 10:32:24.825141 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 264/588] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:32:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:24.833476 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-450d3dea-a5f3-4366-96ea-26f40bf2e9e4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1477 microversion: 2.1 time: 0.429327 Oct 03 10:32:24.834292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:24.834991 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 325/589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:24 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1477 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:24.846012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:24.859228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.859717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.860322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.863741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:24.864686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:24.865295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:24.909602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lazy-loading 'flavor' on Instance uuid bc538f05-7fa3-41ff-9515-21cf2614682b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:32:24.937582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Going to try to live migrate instance to n-h2-858383-3 {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:32:25.001373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:25.002086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:25.038861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:25.039414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:25.041876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:25.042655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:25.044101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:25.046519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:25.203755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:25.237278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:25.241149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:25.262984 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c8cdf89-ee20-48c2-b613-dfd87e651058 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.266476 Oct 03 10:32:25.269073 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 326/590] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:24 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:32:25.316037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:25.316666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:25.336714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:25.338310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:25.339933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:25.340963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:25.344590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:25.347174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:25.583988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:25.601497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f3e902ec-a83e-412d-af7b-03eca8e70372 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1388 microversion: 2.1 time: 0.318701 Oct 03 10:32:25.616982 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 327/591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:25 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:25.934615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2143488742", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "4237c513-9590-4957-9766-25a24a956f31"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:26.009249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] validate_networks() for [('4237c513-9590-4957-9766-25a24a956f31', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:32:26.755652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:26.756081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:26.756577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:26.757008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:26.757625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:26.779378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:26.780419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:26.780887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:26.781627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:26.782090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:26.782517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:26.815274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:26.823777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for user 7b6d14fc83e74c34b2e6d5845f4ed9bf and project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:26.860042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:26.862415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:26.924561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e39d0695-5d01-47a6-8875-84fb90a6901c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.306282 Oct 03 10:32:26.927586 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 328/592] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:32:26.942389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:26.943710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:26.952571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:26.953458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:26.954238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:26.955183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:26.955885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:26.956537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:27.053160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:27.066763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:27.073112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:27.086687 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53179a87-3580-42e2-8a57-5049c7398946 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.151426 Oct 03 10:32:27.100988 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 329/593] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:26 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:27.103860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:27.105520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:27.127009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:27.127892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:27.129853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:27.132536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:27.134935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:27.137473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:27.509178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:27.523014 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6aedfd01-8df7-4180-94d6-02160a1a589d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1476 microversion: 2.1 time: 0.430277 Oct 03 10:32:27.544599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 330/594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:27 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:27.551782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:27.552751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:27.567756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:27.570221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:27.571035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:27.571948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:27.572578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:27.573364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:27.731514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:27.752746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:27.756698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:27.773894 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b1812cca-9fe7-4ad2-9721-de77b9116428 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.227485 Oct 03 10:32:27.793539 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 331/595] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:27 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:27.793539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:27.793539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:27.796377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:27.797248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:27.798113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:27.799185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:27.799840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:27.800531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:28.534495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:28.543426 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53b7684b-43ef-4da0-ad5a-e7b55974dbcc tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1587 microversion: 2.1 time: 0.765884 Oct 03 10:32:28.543979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 332/596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:27 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1587 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:28.553666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:28.561618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:28.593460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:28.594039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:28.596205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:28.605620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:28.607703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:28.610990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:28.653352 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-785e22a9-db36-4597-acea-cfb10a3dfa4d tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b/action" status: 202 len: 0 microversion: 2.1 time: 3.820794 Oct 03 10:32:28.654746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 265/597] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:32:24 2022] POST /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b/action => generated 0 bytes in 3825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:32:28.671497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-aa385c5a-77d1-45ba-ad21-f268d4a9f7da req-7a095ee1-01b3-4db9-bdf6-a227c17715a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd0ee96-4df2-4007-a07c-bf659b2b569f", "name": "network-vif-unplugged", "status": "completed", "tag": "8b97993e-7063-4fa2-9c8e-a65af6ae95d8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:28.706407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa385c5a-77d1-45ba-ad21-f268d4a9f7da req-7a095ee1-01b3-4db9-bdf6-a227c17715a1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:28.709200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa385c5a-77d1-45ba-ad21-f268d4a9f7da req-7a095ee1-01b3-4db9-bdf6-a227c17715a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:28.710002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa385c5a-77d1-45ba-ad21-f268d4a9f7da req-7a095ee1-01b3-4db9-bdf6-a227c17715a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:28.740612 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-aa385c5a-77d1-45ba-ad21-f268d4a9f7da req-7a095ee1-01b3-4db9-bdf6-a227c17715a1 service nova] Creating event network-vif-unplugged:8b97993e-7063-4fa2-9c8e-a65af6ae95d8 for instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f on n-h1-858383-3 Oct 03 10:32:28.772321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-aa385c5a-77d1-45ba-ad21-f268d4a9f7da req-7a095ee1-01b3-4db9-bdf6-a227c17715a1 service nova] Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:32:28.792760 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-aa385c5a-77d1-45ba-ad21-f268d4a9f7da req-7a095ee1-01b3-4db9-bdf6-a227c17715a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135046 Oct 03 10:32:28.794456 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 266/598] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:28.801294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:28.807678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:28.817122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:28.817814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:28.818450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:28.819367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:28.819968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:28.820541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:28.877575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:28.893076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:28.896280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:28.900480 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63092b6b-f2a2-4f44-9452-6d8a4a7ced45 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1314 microversion: 2.25 time: 0.355291 Oct 03 10:32:28.912944 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 333/599] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:28 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:28.933102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:28.934027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:28.945075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:28.946058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:28.946854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:28.948018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:28.949007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:28.950425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:29.034140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:29.046393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:29.053765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:29.069614 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b6b0bccf-d56e-4e0b-a89e-dbceaffdc935 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.272209 Oct 03 10:32:29.070663 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 267/600] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:28 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:29.099022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:29.099777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:29.106589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:29.107886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:29.109184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:29.110061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:29.110672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:29.111247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:29.321654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0754e4c8-a0de-49a5-98d3-46ff5089d9c8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.226447 Oct 03 10:32:29.323694 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 268/601] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:32:29 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:29.334805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:29.336421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:29.347939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:29.348750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:29.349860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:29.350912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:29.351602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:29.352310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:29.605284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:29.618394 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-84afb003-8bf4-440b-b680-2f46a261af33 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1476 microversion: 2.1 time: 0.704019 Oct 03 10:32:29.633991 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 334/602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:28 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1476 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:29.642729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:29.643654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:29.651000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:29.651857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:29.652526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:29.653652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:29.654338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:29.655028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:29.793028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:29.815064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:29.816536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:29.822223 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6dffec3a-62bd-4c5a-ada4-ece131536551 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.186818 Oct 03 10:32:29.825375 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 335/603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:29 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:29.988095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Action: 'update', calling method: .version_select at 0x7f074f5881f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:30.008010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:30.019644 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6fd321eb-e98f-4d97-a386-df5557c91918 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.694630 Oct 03 10:32:30.021291 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 269/604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:29 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:30.027598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:30.028705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:30.036382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:30.038659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.039405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.040160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.041923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.042873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.044092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.059627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.060329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.060884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.062225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.063585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.064391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.123543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6faa8cf8-cec8-4d23-ba94-6158f068a5bd tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d" status: 200 len: 148 microversion: 2.57 time: 0.296365 Oct 03 10:32:30.125069 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 336/605] 10.222.0.27 () {62 vars in 1303 bytes} [Mon Oct 3 10:32:29 2022] PUT /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d => generated 148 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:30.132882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:30.133685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:30.140640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.141159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.141598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.142290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.142759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.143156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.194362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:30.204152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:30.206581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:30.208094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56972e2f-f35a-4515-8517-d3bf4692e652 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1320 microversion: 2.25 time: 0.185491 Oct 03 10:32:30.209275 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 270/606] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:30 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:30.214099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Calling method '.version_select at 0x7f074f721ee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:30.313494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:30.330691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:30.332650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:30.339567 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2eadc4b-58ae-4a8d-88ed-6307848d2555 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.213067 Oct 03 10:32:30.345886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 337/607] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:30 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:30.351081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=90 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:30.362375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.362877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.363320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.368161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.369097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.369727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.428196 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-433721b3-0dc6-4f0c-b3e9-b5bcf4afc87d tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d/detail" status: 200 len: 463 microversion: 2.57 time: 0.216827 Oct 03 10:32:30.428890 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 271/608] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 3 10:32:30 2022] GET /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d/detail => generated 463 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:30.647158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:30.647600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:30.655757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Action: 'update', calling method: .version_select at 0x7f074f77d790>, body: {"quota_set": {"ram": "2048"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:30.656756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.657275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.657711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.658419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.658875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.659300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.760978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.761732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.762513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.764069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.765000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.768499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.827192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.828431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.829561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.830628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.831760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.832736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.909247 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e481b24a-86d9-47ea-99f8-dc7a5afcd970 tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d?user_id=30d321d74e9e4836b10b16c4203a55e0" status: 200 len: 148 microversion: 2.57 time: 0.260884 Oct 03 10:32:30.910947 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 272/609] 10.222.0.27 () {62 vars in 1384 bytes} [Mon Oct 3 10:32:30 2022] PUT /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d?user_id=30d321d74e9e4836b10b16c4203a55e0 => generated 148 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:32:30.921977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:30.922888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:30.931241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.932164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.932801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:30.933675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:30.934484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:30.935130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:31.146623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:31.165114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:31.167928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:31.175863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54bc70cf-495d-4364-84e4-3f74c02fc360 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.263652 Oct 03 10:32:31.176895 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 273/610] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:30 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:31.182102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c461a883-cd28-411a-a564-e2616451c52a tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] Calling method '.version_select at 0x7f074f721af0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:31.288542 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c461a883-cd28-411a-a564-e2616451c52a tempest-QuotasAdminTestV257-758720906 tempest-QuotasAdminTestV257-758720906-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d?user_id=30d321d74e9e4836b10b16c4203a55e0" status: 200 len: 190 microversion: 2.57 time: 0.110276 Oct 03 10:32:31.293898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:31.295496 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 274/611] 10.222.0.27 () {60 vars in 1364 bytes} [Mon Oct 3 10:32:31 2022] GET /compute/v2.1/os-quota-sets/ed4f3901e1214a8ab0d1fff6373a052d?user_id=30d321d74e9e4836b10b16c4203a55e0 => generated 190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:31.303420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-acab2915-e0c1-4da6-ae40-7dd03c34080d req-153a1dc2-1010-4ed2-9068-bdf264274b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd0ee96-4df2-4007-a07c-bf659b2b569f", "tag": "8b97993e-7063-4fa2-9c8e-a65af6ae95d8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:31.305166 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33b761ef-be2b-443e-9a41-b8d2834cf4a7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1474 microversion: 2.1 time: 0.661884 Oct 03 10:32:31.305966 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 338/612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:30 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1474 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:31.320977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:31.321768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:31.335139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:31.335817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:31.336418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:31.337330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:31.337939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:31.339508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:31.352292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-acab2915-e0c1-4da6-ae40-7dd03c34080d req-153a1dc2-1010-4ed2-9068-bdf264274b03 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:31.355460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-acab2915-e0c1-4da6-ae40-7dd03c34080d req-153a1dc2-1010-4ed2-9068-bdf264274b03 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:31.356542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-acab2915-e0c1-4da6-ae40-7dd03c34080d req-153a1dc2-1010-4ed2-9068-bdf264274b03 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:31.379607 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-acab2915-e0c1-4da6-ae40-7dd03c34080d req-153a1dc2-1010-4ed2-9068-bdf264274b03 service nova] Creating event network-changed:8b97993e-7063-4fa2-9c8e-a65af6ae95d8 for instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f on n-h1-858383-3 Oct 03 10:32:31.388712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-acab2915-e0c1-4da6-ae40-7dd03c34080d req-153a1dc2-1010-4ed2-9068-bdf264274b03 service nova] Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:32:31.433608 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-acab2915-e0c1-4da6-ae40-7dd03c34080d req-153a1dc2-1010-4ed2-9068-bdf264274b03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113932 Oct 03 10:32:31.435045 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 275/613] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:31.443802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:31.445052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:31.456723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:31.457407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:31.458068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:31.460035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:31.460580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:31.461208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:31.843311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:31.854421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:31.859608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:31.861001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8012e487-e0c1-41ab-9c9c-602a259e0e0f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.422706 Oct 03 10:32:31.863539 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 276/614] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:31 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:31.879429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:31.880136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:31.894501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:31.903846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:31.904522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:31.905889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:31.906374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:31.906810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.021742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.037442 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cd8cbdfc-8d68-45f9-870f-73a4daced7fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.730251 Oct 03 10:32:32.038231 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 339/615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:31 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:32.054579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.067693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.069562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.088245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-52b8b930-2c76-420f-8438-99a0d8972b92 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.222115 Oct 03 10:32:32.093490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 277/616] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:31 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:32.208036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:32.208827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:32.230801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.231657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.235182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.236105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.241404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.242544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.338789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:32.340047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:32.348396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.349173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.349520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.350352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.351191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.351783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.434732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.444005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.445813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.451745 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c031c90-dcdb-4ae0-a696-fe647bc1852a tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.247867 Oct 03 10:32:32.453774 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 340/617] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:32 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:32.853470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:32.854421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:32.857083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:32.870586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.873619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.881433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:32.890380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.893948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.894905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.896970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.897265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3a393dfc-fca6-4fe8-8298-ba52ec1e110a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1474 microversion: 2.1 time: 0.561538 Oct 03 10:32:32.898585 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 278/618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:32 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1474 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:32.916112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:32.917002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:32.944026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.944740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.946904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:32.947996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:32.951413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:32.952839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:33.511756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:33.528515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:33.531071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:33.537065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ef0dfd97-88d5-4b2c-b87b-e896ffcc15a0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.637220 Oct 03 10:32:33.552340 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 279/619] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:32 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:33.560597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:33.560597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:33.585507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:33.586155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:33.586640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:33.587417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:33.588054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:33.588539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:33.853239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:33.869955 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-80e025bb-8f9c-4d49-ba9a-f2a464315e95 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1587 microversion: 2.1 time: 1.020813 Oct 03 10:32:33.871189 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 341/620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:32 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1587 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:33.877911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:33.878767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:33.894553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:33.896645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:33.899964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:33.901240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:33.901891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:33.902709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.107298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.116301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.118086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.124617 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1c3ae07-d558-4460-bbae-1b861341cf15 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.251490 Oct 03 10:32:34.125536 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 342/621] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:33 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:34.145498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:34.152719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:34.170968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:34.170968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:34.172209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.174247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:34.174806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:34.177470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.187319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:34.351968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.370265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.372530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.402310 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-814401b4-2b6f-4959-9efe-69a51f740caf tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.260542 Oct 03 10:32:34.407367 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 343/622] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:34 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:34.416100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fd8907c9-eee0-449a-b2e0-4242e8995f9a req-65fd878f-3e55-4b7d-b2a6-42ee1edd4dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc538f05-7fa3-41ff-9515-21cf2614682b", "name": "network-vif-unplugged", "status": "completed", "tag": "32c5aa00-acd7-4398-9018-8100679e6eb0"}, {"name": "network-changed", "server_uuid": "89d2d109-a77c-4ebe-9aa8-80187fb3f240", "tag": "043e2572-78c2-48b4-94c7-336d1e0ebd85"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:34.428000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fd8907c9-eee0-449a-b2e0-4242e8995f9a req-65fd878f-3e55-4b7d-b2a6-42ee1edd4dcd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:34.428757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fd8907c9-eee0-449a-b2e0-4242e8995f9a req-65fd878f-3e55-4b7d-b2a6-42ee1edd4dcd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:34.429318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fd8907c9-eee0-449a-b2e0-4242e8995f9a req-65fd878f-3e55-4b7d-b2a6-42ee1edd4dcd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.441992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.443467 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fd8907c9-eee0-449a-b2e0-4242e8995f9a req-65fd878f-3e55-4b7d-b2a6-42ee1edd4dcd service nova] Creating event network-vif-unplugged:32c5aa00-acd7-4398-9018-8100679e6eb0 for instance bc538f05-7fa3-41ff-9515-21cf2614682b on n-h1-858383-3 Oct 03 10:32:34.443970 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fd8907c9-eee0-449a-b2e0-4242e8995f9a req-65fd878f-3e55-4b7d-b2a6-42ee1edd4dcd service nova] Creating event network-changed:043e2572-78c2-48b4-94c7-336d1e0ebd85 for instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 on n-h2-858383-3 Oct 03 10:32:34.454267 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fd8907c9-eee0-449a-b2e0-4242e8995f9a req-65fd878f-3e55-4b7d-b2a6-42ee1edd4dcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.042587 Oct 03 10:32:34.455545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5d33adb-2783-48c3-8c7e-9dc0a513553e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.915969 Oct 03 10:32:34.456209 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 344/623] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:34.461909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:34.462823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:34.469838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:34.470538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:34.471188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.472042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:34.472647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:34.473250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.482249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 280/624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:33 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:34.592987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:34.594333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:34.601952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:34.602909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:34.603584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.604719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:34.605571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:34.606194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:34.950939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:34.965804 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b81d932-e89e-4d6a-9c5e-fdb42eb6fc35 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1471 microversion: 2.1 time: 0.508268 Oct 03 10:32:34.966709 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 345/625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:34 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:34.972828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fc487dc6-8b26-4836-8a5c-78e1c6b06339 req-9c8579b2-6c05-4412-b471-a1e082abcafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c8e57a-87eb-4726-a78c-8846b874f46a", "tag": "6c14f12e-0f43-479d-9a1a-3653984609d0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:35.012432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.032499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fc487dc6-8b26-4836-8a5c-78e1c6b06339 req-9c8579b2-6c05-4412-b471-a1e082abcafa service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.032899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fc487dc6-8b26-4836-8a5c-78e1c6b06339 req-9c8579b2-6c05-4412-b471-a1e082abcafa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.033347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fc487dc6-8b26-4836-8a5c-78e1c6b06339 req-9c8579b2-6c05-4412-b471-a1e082abcafa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.042763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.048337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.051867 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a342ff77-7520-491d-820e-199688e19e42 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.486174 Oct 03 10:32:35.067782 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 281/626] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:34 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:35.080964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:35.081518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:35.085713 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fc487dc6-8b26-4836-8a5c-78e1c6b06339 req-9c8579b2-6c05-4412-b471-a1e082abcafa service nova] Creating event network-changed:6c14f12e-0f43-479d-9a1a-3653984609d0 for instance f4c8e57a-87eb-4726-a78c-8846b874f46a on n-h2-858383-3 Oct 03 10:32:35.091706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.092046 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fc487dc6-8b26-4836-8a5c-78e1c6b06339 req-9c8579b2-6c05-4412-b471-a1e082abcafa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123573 Oct 03 10:32:35.092206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.093130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.093754 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 346/627] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:35.093881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.094369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.094871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.133508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:35.153702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:35.154670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:35.167871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.170390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.172678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.177635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.178362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.179003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.227559 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f94c014f-8c79-4777-9e49-4e6946d14e63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f/action" status: 204 len: 0 microversion: 2.1 time: 0.158333 Oct 03 10:32:35.228224 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 282/628] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:32:35 2022] POST /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f/action => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:32:35.263208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:35.274629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:35.298731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.304996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.305579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.306421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.306996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.307549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.311003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.329729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.369846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.397627 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb4319ad-26c2-408f-9c14-838eb226cd05 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.246333 Oct 03 10:32:35.402617 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 347/629] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:35 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:32:35.451154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:35.451784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:35.482602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.484664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.485619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.489529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.490349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.491076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.676571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.690955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.693860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.703558 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0960ace-2dee-4f4a-8937-c607e247aca8 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.271933 Oct 03 10:32:35.718983 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 348/630] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:35 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:35.736166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:35.737189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:35.745621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.746461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.747147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.748558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:35.750287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:35.750967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:35.903777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:35.937232 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-680ffad2-108e-4c42-b6e4-0e911b24a00e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1471 microversion: 2.1 time: 0.680049 Oct 03 10:32:35.958057 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 283/631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:35 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1471 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:36.086123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:36.086738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:36.096169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.096684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:36.097160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:36.097870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.100499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:36.102739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:36.104709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:36.119604 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e7af802-b9d5-46d5-aa7c-9a040e265151 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.398847 Oct 03 10:32:36.121423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 349/632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:35 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:36.391282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:36.399615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:36.404352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:36.405863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea8d0d78-32ee-4e24-a252-49d7276f626b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.323644 Oct 03 10:32:36.406925 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 284/633] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:36 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:32:36.437203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:36.439679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:36.447316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.448344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:36.449315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:36.450823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.452891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:36.453975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:36.489844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c13af0f7-3d93-4113-ac6a-157f9bc3520f req-94e73528-b33f-46dc-a502-2bc53c3bed8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc538f05-7fa3-41ff-9515-21cf2614682b", "tag": "32c5aa00-acd7-4398-9018-8100679e6eb0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:36.515671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c13af0f7-3d93-4113-ac6a-157f9bc3520f req-94e73528-b33f-46dc-a502-2bc53c3bed8e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.516183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c13af0f7-3d93-4113-ac6a-157f9bc3520f req-94e73528-b33f-46dc-a502-2bc53c3bed8e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:36.516618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c13af0f7-3d93-4113-ac6a-157f9bc3520f req-94e73528-b33f-46dc-a502-2bc53c3bed8e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:36.531655 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c13af0f7-3d93-4113-ac6a-157f9bc3520f req-94e73528-b33f-46dc-a502-2bc53c3bed8e service nova] Creating event network-changed:32c5aa00-acd7-4398-9018-8100679e6eb0 for instance bc538f05-7fa3-41ff-9515-21cf2614682b on n-h1-858383-3 Oct 03 10:32:36.537106 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c13af0f7-3d93-4113-ac6a-157f9bc3520f req-94e73528-b33f-46dc-a502-2bc53c3bed8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051565 Oct 03 10:32:36.537890 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 285/634] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:32:36.551082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:36.561296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:36.563340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:36.569288 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bb553cb-8ff7-4394-92ee-1ac685e7955d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.136623 Oct 03 10:32:36.583460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 350/635] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:36 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:36.741019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:36.741712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:36.753162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.755240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:36.756165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:36.758013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.759133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:36.761097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:36.965721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:36.966981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:36.978377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:36.999884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:37.000397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:37.001216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:37.001676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:37.002101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:37.035193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:37.044898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:37.054229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:37.071313 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77d4f073-655a-4d4b-a7b3-650ced47c8de tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.332754 Oct 03 10:32:37.076134 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 286/636] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:36 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:37.144837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:37.145453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:37.158143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:37.160722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:37.161384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:37.162113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:37.163733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:37.164150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:37.545079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:37.556505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4df29e3c-3247-4b50-a463-56e3d84c23d3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.416066 Oct 03 10:32:37.557117 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 287/637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:37 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:37.562832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:37.570112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:37.589480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:37.589979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:37.590421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:37.591138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:37.591600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:37.592034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:37.961525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:37.974957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:37.976460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:37.977713 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1e7675a-2602-4196-86b7-55d9d3deb98b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.419148 Oct 03 10:32:37.978537 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 288/638] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:37 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:38.010202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5d76e66b-b476-45c5-bae5-99709dd27239 req-5c3f2807-0125-4439-a317-2f0475998a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd0ee96-4df2-4007-a07c-bf659b2b569f", "name": "network-vif-plugged", "status": "completed", "tag": "8b97993e-7063-4fa2-9c8e-a65af6ae95d8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:38.025561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5d76e66b-b476-45c5-bae5-99709dd27239 req-5c3f2807-0125-4439-a317-2f0475998a16 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:38.026514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5d76e66b-b476-45c5-bae5-99709dd27239 req-5c3f2807-0125-4439-a317-2f0475998a16 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:38.027172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5d76e66b-b476-45c5-bae5-99709dd27239 req-5c3f2807-0125-4439-a317-2f0475998a16 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:38.051100 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5d76e66b-b476-45c5-bae5-99709dd27239 req-5c3f2807-0125-4439-a317-2f0475998a16 service nova] Creating event network-vif-plugged:8b97993e-7063-4fa2-9c8e-a65af6ae95d8 for instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f on n-h1-858383-3 Oct 03 10:32:38.063103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-5d76e66b-b476-45c5-bae5-99709dd27239 req-5c3f2807-0125-4439-a317-2f0475998a16 service nova] Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:32:38.075917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:38.080635 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5d76e66b-b476-45c5-bae5-99709dd27239 req-5c3f2807-0125-4439-a317-2f0475998a16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085455 Oct 03 10:32:38.082097 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 289/639] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:38.090776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:38.092099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:38.093742 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1b88168d-ef60-433e-841c-1e0a32ab5f9e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1471 microversion: 2.1 time: 1.132928 Oct 03 10:32:38.094354 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 351/640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:36 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1471 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:38.116265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:38.117816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:38.118226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:38.118807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:38.119330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:38.120189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:38.120909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:38.121588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:38.145788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:38.146309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:38.146762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:38.149842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:38.150369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:38.150813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:38.396227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:38.408674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:38.412601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:38.431533 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1b3f9357-9bed-4094-b9cf-8ca8b82ce640 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.329632 Oct 03 10:32:38.437724 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 352/641] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:38 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:38.584735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:38.585608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:38.596307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:38.596823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:38.597268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:38.597992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:38.598445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:38.603119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:38.691060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:38.701715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:38.703613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:38.721740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3034f8e4-c8a6-472c-bd49-57e4f078a348 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.637965 Oct 03 10:32:38.723284 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 290/642] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:38 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:39.086499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1802264998", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:39.139487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.152842 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc7a8afd-b834-49d0-861d-ff3b7feace23 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.568786 Oct 03 10:32:39.154202 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 353/643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:38 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:39.162917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:32:39.174517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:39.179249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:39.203135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.204020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.204469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.205219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.205678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.212042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.464730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.476476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.478169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.479678 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0457daa-9e85-4a20-add2-7d5b4e17592d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.324221 Oct 03 10:32:39.481289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 354/644] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:39 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:39.491103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:39.491895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:39.508828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.509541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.510515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.511261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.511718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.512139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.570278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:39.570893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:39.571384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:39.571787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:39.572375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:39.590927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.591958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.601041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.602063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.602546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.603280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.642404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Getting quotas for project b4201301e9cb42d3bcdff6d0416140f0. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:39.650207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Getting quotas for user 5be59c07a541438ab3cb0db3a0d0250a and project b4201301e9cb42d3bcdff6d0416140f0. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:39.668203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:39.672209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:39.729765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34fe4ac0-73d5-4be0-9735-0600d42cbb33 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861768 Oct 03 10:32:39.730555 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 291/645] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:32:39.734893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.736861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:39.737743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:39.752597 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-193e786a-9dd9-4da8-9b1b-64b5b8030a46 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1471 microversion: 2.1 time: 0.269945 Oct 03 10:32:39.753538 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 355/646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:39 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:39.765008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.767925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.769995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.770247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.770711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.771139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.772484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:39.773460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:39.784038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.784748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.785894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.788443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:39.789107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:39.789722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:39.884255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.894788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.896529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.904783 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42570607-f7de-437b-a759-6bdc327e24e6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.172614 Oct 03 10:32:39.906505 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 292/647] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:39 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:39.914936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.934522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.939435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:39.960448 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f93ac583-310f-4f02-968c-ac5707dc3280 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.205682 Oct 03 10:32:39.961144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 356/648] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:39 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:39.988574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-127593895", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:39.997919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:40.060406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:32:40.177887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:40.178790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:40.182501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:40.183639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=18 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:40.192229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.192740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.193211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.195507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.196198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.196668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.384269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:40.384878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:40.385601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:40.386201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:40.388506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:40.400461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.400994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.401437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.402172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.402649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.403068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.430451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Getting quotas for project b4201301e9cb42d3bcdff6d0416140f0. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:40.435757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Getting quotas for user 5be59c07a541438ab3cb0db3a0d0250a and project b4201301e9cb42d3bcdff6d0416140f0. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:40.458325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:40.464580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:40.490279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:40.500221 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a108ce7-7ace-45a0-83ef-c4a9c5f10d73 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.327686 Oct 03 10:32:40.513439 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 357/649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:40 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:40.527461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:40.530213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:40.540332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.541050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.544394 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b870947-dd61-4b60-b19a-3af3510c685d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559586 Oct 03 10:32:40.545711 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 293/650] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:32:40.561084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.562711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.563204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.563646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.576174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-955266ae-78fb-4093-980e-35f483605766 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:40.582094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-955266ae-78fb-4093-980e-35f483605766 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:40.682955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-955266ae-78fb-4093-980e-35f483605766 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:40.699029 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-955266ae-78fb-4093-980e-35f483605766 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1213 microversion: 2.1 time: 0.133003 Oct 03 10:32:40.699605 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 294/651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:40 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:40.779900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:40.781054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:40.789589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.789985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.790423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.793198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.793571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:40.793750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.794081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.817189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:40.822241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:40.824017 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dcab0d8a-feac-404c-b318-4d429f475aab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.309419 Oct 03 10:32:40.826725 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 358/652] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:40 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:40.943534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:40.945747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:40.962593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.963161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.964868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:40.966030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:40.980442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:40.982956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.074745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.084710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a1c7458-0b6b-46ae-a215-bc0b8a904c62 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1463 microversion: 2.1 time: 0.308865 Oct 03 10:32:41.086921 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 295/653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:40 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1463 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:41.095392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:41.096207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:41.105547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.107179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.108272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.110533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.111589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.112874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.125417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.138232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.140023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.156600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cd0406e5-4227-4dd7-95ca-79c68a4fb7fc tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.222076 Oct 03 10:32:41.157617 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 359/654] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:40 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:41.166214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:41.168262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:41.185833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.187178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.187826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.189067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.189768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.192993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.252529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.274972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.280924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.293954 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17611f99-41c5-4449-8ec2-a8a39bec53d2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.205286 Oct 03 10:32:41.296687 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 296/655] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:41 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:41.459141 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b3d9c40-0630-4aa9-b06b-e59b85cfec15 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1614 microversion: 2.1 time: 0.299962 Oct 03 10:32:41.477709 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 360/656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:41 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1614 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:41.493497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76dfdfd8-d9c7-4ff3-bce1-4e5a5da9d01d tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '.version_select at 0x7f074f6c20d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:41.500282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76dfdfd8-d9c7-4ff3-bce1-4e5a5da9d01d tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.501063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76dfdfd8-d9c7-4ff3-bce1-4e5a5da9d01d tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.501989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76dfdfd8-d9c7-4ff3-bce1-4e5a5da9d01d tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.516591 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-76dfdfd8-d9c7-4ff3-bce1-4e5a5da9d01d tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.026899 Oct 03 10:32:41.522066 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 297/657] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:32:41 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:41.541705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:41.543418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:41.550627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.551358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.551976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.552875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.553938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.554533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.580295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:41.722464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:41.723324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:41.739418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.739920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.740368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.743500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.746412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.746932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.801862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.819373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f310b716-dbef-41e2-bbd6-d017e1342445 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.285174 Oct 03 10:32:41.820909 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 361/658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:41 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:41.832982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1250528184", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:41.928165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:41.934773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:32:41.945640 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2cedffbe-0563-4104-a475-c4c15f714104 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1209 microversion: 2.1 time: 0.224608 Oct 03 10:32:41.948718 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 298/659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:41 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:41.963740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:41.966960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:41.980118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.982204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.982993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:41.984394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:41.985755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:41.986495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.299037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.308480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.312598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.314490 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b95fc0c-5e83-4354-b109-ea3043089e7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.364065 Oct 03 10:32:42.315954 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 299/660] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:41 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:42.328753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9f0d9204-ef79-4f3b-bf2c-1e8e4986506d req-65c3dff3-125b-4b4e-9159-35ccb6a53af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c8e57a-87eb-4726-a78c-8846b874f46a", "name": "network-vif-plugged", "status": "completed", "tag": "6c14f12e-0f43-479d-9a1a-3653984609d0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:42.348033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9f0d9204-ef79-4f3b-bf2c-1e8e4986506d req-65c3dff3-125b-4b4e-9159-35ccb6a53af2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.351427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9f0d9204-ef79-4f3b-bf2c-1e8e4986506d req-65c3dff3-125b-4b4e-9159-35ccb6a53af2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.351957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9f0d9204-ef79-4f3b-bf2c-1e8e4986506d req-65c3dff3-125b-4b4e-9159-35ccb6a53af2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.377450 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9f0d9204-ef79-4f3b-bf2c-1e8e4986506d req-65c3dff3-125b-4b4e-9159-35ccb6a53af2 service nova] Creating event network-vif-plugged:6c14f12e-0f43-479d-9a1a-3653984609d0 for instance f4c8e57a-87eb-4726-a78c-8846b874f46a on n-h2-858383-3 Oct 03 10:32:42.388349 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9f0d9204-ef79-4f3b-bf2c-1e8e4986506d req-65c3dff3-125b-4b4e-9159-35ccb6a53af2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070971 Oct 03 10:32:42.391638 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 300/661] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:42.398992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:42.419819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:42.431190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.441567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.442442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.444044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.444407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.444882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.584786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.594349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.595740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.601692 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bc061eac-f722-4bfe-af37-5cce69ed2773 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.208611 Oct 03 10:32:42.602479 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 301/662] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:42 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:42.628534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:42.629390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:42.637291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.638026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.638664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.639583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.640199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.640818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.660372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:42.701832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:42.702572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:42.703189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:42.703812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:42.705010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:42.716746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.717417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.718494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.719489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.720072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.721112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.748299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.761880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.764841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:42.785847 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39fb61c1-c10c-4159-91e9-240d0506f096 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.154379 Oct 03 10:32:42.788236 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 302/663] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:42 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:42.795166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:42.818433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for user fa6ea468370b4bacb98dd5457b0e6aea and project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:42.850480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:42.851860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:42.852950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:42.857997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:42.868224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.869034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.883766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.888431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:42.889209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:42.891688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:42.959224 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f452a0a-2dde-49c0-ba86-84f775fd5e47 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133538 Oct 03 10:32:42.961703 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 362/664] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:32:42.976841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cfed16eb-d80d-429b-82c6-373cc918e866 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:42.979003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cfed16eb-d80d-429b-82c6-373cc918e866 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:43.205071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfed16eb-d80d-429b-82c6-373cc918e866 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.215833 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cfed16eb-d80d-429b-82c6-373cc918e866 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1213 microversion: 2.1 time: 0.245518 Oct 03 10:32:43.217084 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 363/665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:42 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1213 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:43.225520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:43.226279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:43.236157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.236707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.237191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.237879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.238937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.239338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.256955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.268597 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8bc6bbd3-6438-4ae2-ac99-d775dd7f0047 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.423931 Oct 03 10:32:43.269596 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 303/666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:42 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:32:43.341521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:43.342223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:43.353024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.356167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.356824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.357731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.359715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.360662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.361094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.378747 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-856e0c13-26ae-4d66-bc41-515f00fe584d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1271 microversion: 2.1 time: 0.157604 Oct 03 10:32:43.379402 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 364/667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:43 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:43.597973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.614237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.616040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.617444 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee9240b5-999a-4702-b20a-7a3bf934ca75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1362 microversion: 2.25 time: 0.280323 Oct 03 10:32:43.617981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 304/668] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:43 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:32:43.639875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:43.640484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:43.649577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.653135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.654098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.655083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.655994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.661690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.789996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.805126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.809097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.816023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:43.816637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:43.828309 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40957186-f121-47e4-9f51-bccd3e9529f6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.193756 Oct 03 10:32:43.830729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.831269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.831722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.833284 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 365/669] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:43 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:43.835850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:43.836341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:43.836808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:43.972297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.990122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:43.992205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:44.001252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0fce24e-a8a2-488e-a70e-5b8a9a154cd1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.190318 Oct 03 10:32:44.014327 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 305/670] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:43 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:32:44.243203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:44.243979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:44.259006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.259606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.260553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:44.265067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.266012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.277904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:44.303298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:44.303912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:44.320374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.320980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.321421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:44.322125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.322593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.323006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:44.694486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:44.702405 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c5636c31-1b3b-4c72-abc0-f466ab57e8a6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.407302 Oct 03 10:32:44.705695 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 306/671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:44 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:44.710670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:44.713463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:44.725921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.726503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.727186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:44.728131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.728918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.729586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:44.870352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:44.882544 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1c451f6e-f08c-4926-a547-693c95b6e5c7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1265 microversion: 2.1 time: 0.643074 Oct 03 10:32:44.885065 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 366/672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:44 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1265 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:44.892416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:44.893428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:44.912044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.915142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.917016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:44.917862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:44.921662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:44.923000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:45.340509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:45.366990 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14a0a35c-79df-4adf-8c58-cc80e7552019 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1271 microversion: 2.1 time: 0.651454 Oct 03 10:32:45.370757 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 307/673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:44 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1271 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:45.377425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:45.378270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:45.393938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:45.394734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:45.395588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:45.396592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:45.397451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:45.407749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:46.206479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.219578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.235162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.238668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb921d0b-c58e-4331-a826-a45ae926c929 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1558 microversion: 2.25 time: 1.352232 Oct 03 10:32:46.253473 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 367/674] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:44 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1558 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:46.266489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:46.270607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:46.280303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:46.281529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:46.282156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:46.283035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:46.283666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:46.284254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:46.512198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.524279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.533288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.544086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c5ed263-c9cc-4e93-a578-c61d7390b608 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 1.172181 Oct 03 10:32:46.548840 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 308/675] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:45 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:46.568664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:46.569350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:46.590440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:46.591228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:46.591852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:46.592811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:46.593900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:46.594505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:46.724506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.741334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.742864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:46.772635 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-642f3c60-1d7d-4de3-8226-9bb37a514fc3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.515580 Oct 03 10:32:46.776121 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 368/676] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:46 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:46.790461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:46.791439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:46.825516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:46.826027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:46.826476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:46.833440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:46.833998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:46.834471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.129480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:47.140276 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b4988d6-6836-4ce8-96bb-37841a3f8470 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1504 microversion: 2.1 time: 0.590049 Oct 03 10:32:47.145261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:47.150967 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 309/677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:46 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:47.159050 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f49f9aa-bfb3-4671-82a5-767c8b8225c0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1271 microversion: 2.1 time: 0.381805 Oct 03 10:32:47.165125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 369/678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:46 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1271 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:47.181554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:47.182593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:47.195707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.196208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.196653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.206136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.206865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.207913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.479417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:47.488514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-03ad19b0-62fa-497f-abc3-0f00f74795f0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1271 microversion: 2.1 time: 0.321959 Oct 03 10:32:47.494065 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 370/679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:47 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:47.589585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:47.590551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:47.602822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.603602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.604210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.605116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.605837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.606420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.643307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:47.644658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:47.664295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.667950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.668614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.669539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.672807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.673581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.913653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:47.925530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:47.933148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:47.948698 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab473c02-b4c5-4bd6-bb28-472466867a67 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.365256 Oct 03 10:32:47.950060 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 371/680] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:47 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:47.968307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:47.969242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:47.972433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:47.979907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.980601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.981241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:47.985651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:47.986322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:47.986945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.051700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid f4c8e57a-87eb-4726-a78c-8846b874f46a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:32:48.174220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-388448a5-e63e-4a61-880c-0426671c509e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 2051 microversion: 2.25 time: 1.021672 Oct 03 10:32:48.175080 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 310/681] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:47 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 2051 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:48.180908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:48.182173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:48.193153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.194274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.204172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.206399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.207122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.207822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.331296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:48.346530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:48.348317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:48.360132 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0fe5088-9db7-4ac9-a05f-a6d93ded0f12 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.408782 Oct 03 10:32:48.363979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 372/682] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:47 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:48.382780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:48.383735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:48.393179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.394046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.397454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.398494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.399167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.399812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.645633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:48.662095 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-208844ea-2471-4a3c-a38b-94cdaa0a2b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1271 microversion: 2.1 time: 0.296829 Oct 03 10:32:48.669034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:48.677213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 373/683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:48 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:48.685397 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caa55dc6-dce4-4f1b-bdd3-6d52297fb218 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1494 microversion: 2.1 time: 0.506130 Oct 03 10:32:48.686349 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 311/684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:48 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1494 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:48.705835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:48.706934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:48.709399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:48.710066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:48.715636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.716416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.717073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.718510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.719129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.719928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.738005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.740530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.741304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:48.743677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:48.745460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:48.750820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.160135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:49.170134 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2cf5872a-03c5-46f7-a64d-86093a895d60 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.482371 Oct 03 10:32:49.188863 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 312/685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:48 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:49.188863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a64a236c-1ed1-4241-9d50-6a20bfa8b525 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '.version_select at 0x7f074f82f700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:49.200547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a64a236c-1ed1-4241-9d50-6a20bfa8b525 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.200547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a64a236c-1ed1-4241-9d50-6a20bfa8b525 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.200547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a64a236c-1ed1-4241-9d50-6a20bfa8b525 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.215220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a64a236c-1ed1-4241-9d50-6a20bfa8b525 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.035926 Oct 03 10:32:49.224166 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 313/686] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:32:49 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:49.224166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:49.224166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:49.239958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.240455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.240932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.241649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.242105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.242532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.508024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:49.526986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:49.528500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:49.554146 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d0f3654-a39d-43cf-8063-cf1c218f0e0e tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.336503 Oct 03 10:32:49.554731 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 314/687] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:49 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:49.573550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:49.574359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:49.595572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.596397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.597049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.601448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.602118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.602748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.711818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid f4c8e57a-87eb-4726-a78c-8846b874f46a {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:32:49.770051 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06e743b4-d3e0-4ff5-a52d-6de4a051aaf7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 2051 microversion: 2.25 time: 1.091642 Oct 03 10:32:49.773699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 374/688] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:48 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 2051 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:49.780489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:49.805151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:49.819015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.819529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.820262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.820709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.825727 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13bc504f-e2bc-43b6-8d7e-189601f86a6a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1645 microversion: 2.1 time: 0.264649 Oct 03 10:32:49.831517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 315/689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:49 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1645 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:49.834201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.835652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.840358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:49.845973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:49.858051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.861404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.862183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:49.870111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:49.871693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:49.872300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:50.128293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:50.160453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:50.162362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:50.186321 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9db328c6-da3b-402c-bcba-00bd6fd69536 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.411296 Oct 03 10:32:50.190590 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 375/690] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:49 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:50.204836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:50.209678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:50.210568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:50.211190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:50.212105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:50.212722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:50.213504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:50.292213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:50.293810 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a72ac5e-49d3-436b-bdea-0ab55726b95c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.101151 Oct 03 10:32:50.307466 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 376/691] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 3 10:32:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:32:50.313991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1133837463", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "f3f01fec-6192-4230-9d75-0f9c0fe4d3e8"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:50.317957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0906326a-e869-4019-9cc3-dc24cb25315e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1271 microversion: 2.1 time: 0.483941 Oct 03 10:32:50.318565 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 316/692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:49 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1271 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:50.339704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:50.339704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:50.344575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:50.345098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:50.346315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:50.346315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:50.346645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:50.347067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:50.404542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] validate_networks() for [('f3f01fec-6192-4230-9d75-0f9c0fe4d3e8', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:32:50.417400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=22 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:50.672017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:50.683397 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba1d66c6-a6ef-4125-b8de-c1f2e97d863b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.350989 Oct 03 10:32:50.685281 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 317/693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:50 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:50.692345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-3", "block_migration": "auto"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:50.702680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:50.708459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=31 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:50.720060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:50.721283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:50.723089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:50.724252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:50.725588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:50.727647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:50.787484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'flavor' on Instance uuid f4c8e57a-87eb-4726-a78c-8846b874f46a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:32:50.814542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Going to try to live migrate instance to n-h1-858383-3 {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:32:50.856156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:52.303232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:32:52.304416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:32:52.305215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:32:52.305787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:32:52.306421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:32:52.337326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:52.340861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:52.344216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:52.349962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:52.356794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:52.357607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:52.432424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:32:52.454133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for user 6f0eda1654514026b803bcf2a1b8f4f4 and project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:32:52.512112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:32:52.517555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:32:52.591851 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61afdaa1-a9bd-4aea-9215-6dfe0939a1f1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282183 Oct 03 10:32:52.596315 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 377/694] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:32:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:32:52.609013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:52.610217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:52.618340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:52.621225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:52.621997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:52.622988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:52.623728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:52.625660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:53.049790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:53.066210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:53.073489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:53.093962 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-babf2cd1-20d2-4a8c-a5d2-4c433a8f6598 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.490439 Oct 03 10:32:53.095852 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 378/695] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:52 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:53.108989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:53.114329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:53.143044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:53.143957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:53.144105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:53.144709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:53.145205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:53.145635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:53.310897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:53.322071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:53.323547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:53.339284 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00b43e7a-dad8-4feb-ae32-9e9a3003dfb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.240258 Oct 03 10:32:53.349785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 379/696] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:53 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:53.349785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:53.349785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:53.366792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:53.367289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:53.367725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:53.368452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:53.370214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:53.370667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:53.419483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:54.289102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:54.303785 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bff29cea-ad64-400d-95d1-0a25b3f81317 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.962322 Oct 03 10:32:54.304659 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 380/697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:53 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:54.310100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-936c1642-8c25-4095-b2b6-1b68a6b9723c req-9676b6e7-f998-478d-a47b-269e78a84c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d64078-3f94-45fb-a864-a10c79b8c92e", "tag": "357dbd63-2219-4a26-ac04-d34854ccbbfd"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:54.359207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-936c1642-8c25-4095-b2b6-1b68a6b9723c req-9676b6e7-f998-478d-a47b-269e78a84c19 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.359207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-936c1642-8c25-4095-b2b6-1b68a6b9723c req-9676b6e7-f998-478d-a47b-269e78a84c19 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.359925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-936c1642-8c25-4095-b2b6-1b68a6b9723c req-9676b6e7-f998-478d-a47b-269e78a84c19 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.421628 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-936c1642-8c25-4095-b2b6-1b68a6b9723c req-9676b6e7-f998-478d-a47b-269e78a84c19 service nova] Creating event network-changed:357dbd63-2219-4a26-ac04-d34854ccbbfd for instance 63d64078-3f94-45fb-a864-a10c79b8c92e on n-h1-858383-3 Oct 03 10:32:54.426774 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-936c1642-8c25-4095-b2b6-1b68a6b9723c req-9676b6e7-f998-478d-a47b-269e78a84c19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120745 Oct 03 10:32:54.436833 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 381/698] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:54.450111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:54.451329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:54.473803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.478273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.478885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.481968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.482931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.485054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.485625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d1c0e29-0f67-4213-8396-f1bcbc6d2a69 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a/action" status: 202 len: 0 microversion: 2.25 time: 3.798511 Oct 03 10:32:54.487250 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 318/699] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:32:50 2022] POST /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a/action => generated 0 bytes in 3801 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:32:54.493051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:54.494115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:54.504592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.505651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.507401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.520440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.521382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.522324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.659772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:54.670898 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c21ec032-4b32-454f-ae4d-81ce619e2a95 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1207 microversion: 2.1 time: 0.182230 Oct 03 10:32:54.674117 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 319/700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:54 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1207 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:54.679126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:54.682847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:54.711571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.711571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.711571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.711571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.712047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.712047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.816123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:54.828673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:54.830728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:54.837789 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-955560b9-6598-49fc-ad3f-7ff321b67076 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.162304 Oct 03 10:32:54.853632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 320/701] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:54 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:54.864404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:54.865002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:54.871685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.872072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.872519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:54.874545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:54.880156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:54.880704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:55.029511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.038851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.040333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.047858 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5018cd68-5a1e-4bf3-9896-65f1f43cc5fa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.193045 Oct 03 10:32:55.060223 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 321/702] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:54 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:55.093700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:55.095948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:55.103523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:55.104037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:55.104554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:55.105276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:55.105954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:55.106382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:55.523928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.535330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.538511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.539051 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-481676c5-8f33-4034-a3b2-9a4397382cc8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.477482 Oct 03 10:32:55.557506 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 322/703] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:55 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:55.575700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:55.576306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:55.588581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:55.588733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:55.590929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:55.591389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:55.591911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:55.592716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:55.717009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.741990 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2eb5b352-99b9-4bce-b81b-8dbc96c3b246 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 1.303710 Oct 03 10:32:55.752803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 382/704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:54 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:55.760526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:55.761527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:55.783140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:55.784028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:55.784693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:55.787524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:55.788188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:55.789272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:55.968829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:55.982510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f900baf-e955-412c-a071-de10c6b4f6cf tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1207 microversion: 2.1 time: 0.234444 Oct 03 10:32:55.991737 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 383/705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:55 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1207 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:56.008489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:56.014829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:56.026536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.027632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.028611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:56.029614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.030834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.031704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:56.071315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:56.079290 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d11f15c9-e700-4d49-ba22-884dc5884186 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.520517 Oct 03 10:32:56.085534 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 323/706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:55 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:56.090970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:56.091775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:56.099981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.100656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.101287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:56.102163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.103105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.103788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:56.164870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:56.173924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:56.175375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:56.191060 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-320b5453-d6ae-4672-99bd-f6c9c442ea46 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.197800 Oct 03 10:32:56.197962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 384/707] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:55 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:56.223794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:56.236225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:56.245126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:56.258903 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7e31cf5-58c9-4ed9-a72b-1f173100993a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.171943 Oct 03 10:32:56.259834 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 324/708] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:56 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:56.599792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:56.601819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:56.614794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.616057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.617544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:56.618474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.619092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.620743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:56.771746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:56.773019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:56.786349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.790067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.790715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:56.791619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:56.792239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:56.803843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.048942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.064891 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9743a568-3240-4bb4-af3a-43816b5b6aee tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.296900 Oct 03 10:32:57.067718 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 325/709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:56 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:57.075294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:57.077211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:57.087491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.088342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.089231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.090800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.091407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.091984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.217382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.230920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b33889e-e2e3-4070-8edb-ab101ea3de33 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1263 microversion: 2.1 time: 0.161536 Oct 03 10:32:57.232046 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 326/710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:57 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:57.238407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:57.239310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:57.270850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:32:57.273996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.274865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.275494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.276369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.277077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.278010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.287196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.298798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.306197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.308550 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48de1ef2-5d3a-4208-9bfb-62ad6a56361e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.721773 Oct 03 10:32:57.317384 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 385/711] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:56 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:57.338385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fd6f6da7-3f10-4771-a5d0-a1847488bd71 req-21be0f7c-8f6b-4241-aa47-586001814de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3601b147-4b29-4547-937c-4b98e467641b", "tag": "eeb63eb4-5236-4ab7-b25a-0e56d9904282"}, {"name": "network-changed", "server_uuid": "f1ec7889-ef50-4158-a548-945a648bbd6f", "tag": "de529bdc-d7ad-4cfd-bf71-a8bca22179f9"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:32:57.371338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fd6f6da7-3f10-4771-a5d0-a1847488bd71 req-21be0f7c-8f6b-4241-aa47-586001814de0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.371875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fd6f6da7-3f10-4771-a5d0-a1847488bd71 req-21be0f7c-8f6b-4241-aa47-586001814de0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.372318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fd6f6da7-3f10-4771-a5d0-a1847488bd71 req-21be0f7c-8f6b-4241-aa47-586001814de0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.414030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fd6f6da7-3f10-4771-a5d0-a1847488bd71 req-21be0f7c-8f6b-4241-aa47-586001814de0 service nova] Creating event network-changed:eeb63eb4-5236-4ab7-b25a-0e56d9904282 for instance 3601b147-4b29-4547-937c-4b98e467641b on n-h1-858383-3 Oct 03 10:32:57.414594 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fd6f6da7-3f10-4771-a5d0-a1847488bd71 req-21be0f7c-8f6b-4241-aa47-586001814de0 service nova] Creating event network-changed:de529bdc-d7ad-4cfd-bf71-a8bca22179f9 for instance f1ec7889-ef50-4158-a548-945a648bbd6f on n-h2-858383-3 Oct 03 10:32:57.424397 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fd6f6da7-3f10-4771-a5d0-a1847488bd71 req-21be0f7c-8f6b-4241-aa47-586001814de0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105600 Oct 03 10:32:57.425339 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 386/712] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:32:57.432714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:57.433680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:57.441913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.442980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.443577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.444449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.445089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.445663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.452490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.460953 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-49d2745f-b820-421e-bf47-281e94e0ccef tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.227115 Oct 03 10:32:57.463940 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 327/713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:57 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:57.479041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:57.480309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:57.494253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.495005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.495622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.500176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:57.500905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:57.501627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:57.605155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.616444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.618168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.629312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.636890 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0ae01fb3-482e-4054-b4c7-5b21fac55d1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.165585 Oct 03 10:32:57.651934 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 328/714] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:57 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:57.652695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.663148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:57.677896 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cefcbd1d-edf4-420f-a082-4c523c8bcf6b tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1446 microversion: 2.75 time: 0.250894 Oct 03 10:32:57.687329 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 387/715] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:57 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1446 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:58.103692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:58.104646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:58.120886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.122403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.123566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.125729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.126784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.128546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.261320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:58.262081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:58.283462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.283958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.284387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.286270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.286730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.287152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.480339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:58.489735 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54f7b726-ae1b-499c-8592-37cb1418e8b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.391466 Oct 03 10:32:58.496795 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 329/716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:58 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:58.496795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:58.499703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:58.515369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.515369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.515369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.515369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.515831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.515831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.615850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:58.631622 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a63ba6d-de22-4a97-b2a2-964af2fdd8f7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1263 microversion: 2.1 time: 0.375551 Oct 03 10:32:58.639272 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 388/717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:58 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1263 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:58.658775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:58.659668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:58.684811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.684811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.684811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.684811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:58.685304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:58.692010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:58.980444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:58.997223 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94b0afb1-b41c-463c-85f7-06dcee90e5b0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.352639 Oct 03 10:32:59.007628 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 389/718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:58 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:59.021497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:59.022620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:59.029004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.029709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.030370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.032457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.033130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.033712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.089705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.100131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.101969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.104293 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89af4bcc-39a2-47b9-a650-737915eaeb88 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.611820 Oct 03 10:32:59.114102 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 330/719] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:58 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:59.144325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:59.145499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:59.158660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.164832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.165534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.166424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.166900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.168063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.181778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.195850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.198387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.211234 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5eeae073-e79c-4ff0-a19d-bd8828563b86 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.202179 Oct 03 10:32:59.214687 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 390/720] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:59 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:59.285665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.299442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.301695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.312209 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5361257c-7d0a-4826-b5c1-d8df5aa8a34f tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1452 microversion: 2.75 time: 0.196126 Oct 03 10:32:59.313695 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 331/721] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:32:59 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:32:59.525879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:59.526840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:59.545085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.546532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.546981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.547710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.548161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.548659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.667952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:32:59.668961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:32:59.690129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.698494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.699330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.702274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:32:59.702900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:32:59.705332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:32:59.819140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.825798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:32:59.830266 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-10cbf898-36d8-461c-bc17-bb9f232e4662 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.310851 Oct 03 10:32:59.831746 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 391/722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:59 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:32:59.869094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-50a8dec9-3259-4667-9a29-f10e339149f3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1271 microversion: 2.1 time: 0.187991 Oct 03 10:32:59.882434 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 332/723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:32:59 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:00.041277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:00.041883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:00.048485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.051848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.052354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.053116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.053756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.054334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.144652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:00.146008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:00.155767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.157487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.159403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.160350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.162112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.162819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.270656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.281691 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-95d5fae5-404f-4e42-9135-cb1a8ac88c64 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.242850 Oct 03 10:33:00.289242 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 392/724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:00 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:00.305935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:00.306914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:00.315128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.316086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.316754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.317722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.318388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.319024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.479145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.485131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.497031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.497372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.498504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.499968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.501515 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb595603-bfe7-4bba-ab46-212b45ce718b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.362342 Oct 03 10:33:00.502638 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 333/725] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:00 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:00.507449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-45b896b6-fe56-4ff4-87e4-b3c0cce667c5 req-483d1b11-daae-4928-88b7-d8271102aaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d64078-3f94-45fb-a864-a10c79b8c92e", "name": "network-vif-plugged", "status": "completed", "tag": "357dbd63-2219-4a26-ac04-d34854ccbbfd"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:00.518993 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5d9d07ce-7704-4e12-8a28-85b66872acb1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.225469 Oct 03 10:33:00.518993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 393/726] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:00 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:00.532588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:00.532588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:00.535081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.535585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.536026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.541837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.541837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.541837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.558932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-45b896b6-fe56-4ff4-87e4-b3c0cce667c5 req-483d1b11-daae-4928-88b7-d8271102aaa6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:00.559856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-45b896b6-fe56-4ff4-87e4-b3c0cce667c5 req-483d1b11-daae-4928-88b7-d8271102aaa6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:00.560545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-45b896b6-fe56-4ff4-87e4-b3c0cce667c5 req-483d1b11-daae-4928-88b7-d8271102aaa6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:00.568316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:00.581711 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-45b896b6-fe56-4ff4-87e4-b3c0cce667c5 req-483d1b11-daae-4928-88b7-d8271102aaa6 service nova] Creating event network-vif-plugged:357dbd63-2219-4a26-ac04-d34854ccbbfd for instance 63d64078-3f94-45fb-a864-a10c79b8c92e on n-h1-858383-3 Oct 03 10:33:00.588672 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-45b896b6-fe56-4ff4-87e4-b3c0cce667c5 req-483d1b11-daae-4928-88b7-d8271102aaa6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084467 Oct 03 10:33:00.590000 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 334/727] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:00.882891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.892165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.893301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:00.901212 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f0a25c22-cb44-4c3f-9433-48ed347a16af tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1452 microversion: 2.75 time: 0.383285 Oct 03 10:33:00.902304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 394/728] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:00 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1452 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:00.948635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:00.949545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:00.978473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:00.984484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:00.999226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:01.004472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:01.007152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:01.009657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:01.010275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:01.012809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:01.012973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:01.014882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:01.015020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:01.025903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:01.037088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:01.038462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:01.601527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:01.610904 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-673f062b-0bf5-4860-b653-80ded1a2d54e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1271 microversion: 2.1 time: 0.695158 Oct 03 10:33:01.621481 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 335/729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:00 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1271 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:01.628662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:01.629306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:01.657782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:01.658171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:01.658612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:01.659323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:01.659775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:01.660193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.131090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.152132 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-631b1350-1073-462e-bac3-6779d9a6325a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.539561 Oct 03 10:33:02.160367 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 336/730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:01 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:02.178717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:02.190323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:02.209141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.220003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.220640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.222187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.222671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.223107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.392594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:02.423895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.434815 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed793527-4ef7-424c-9f0b-85f98bf4608d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 1.491011 Oct 03 10:33:02.438953 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 395/731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:00 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:02.443912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:02.449467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:02.458729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.459233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.459851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.460716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.462414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.462848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.469551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:02.568301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.580835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.587683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.595781 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9d16b1d-0bb8-4a40-a2ae-3b7d63e8a056 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.155568 Oct 03 10:33:02.596462 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 396/732] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:02 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:02.617176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.619366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:02.623073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:02.628906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.629437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.629998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.630676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.631341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.631921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.632417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.635145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.640750 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12674036-18c5-4c67-b842-a7d7ea9b4a75 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.479587 Oct 03 10:33:02.649612 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 337/733] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:02 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:02.693064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:02.698941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:02.706203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.712344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.713322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.714169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:02.714721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:02.715232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:02.758504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.771833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.776714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.786228 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fff86ee8-7495-46fa-b632-f3b0d2652ad3 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1452 microversion: 2.75 time: 0.176323 Oct 03 10:33:02.793290 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 397/734] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:02 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:02.927823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:02.939939 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-578b94a0-89ff-4f8c-b6cd-11d4db8df0ea tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1269 microversion: 2.1 time: 0.289047 Oct 03 10:33:02.942506 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 338/735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:02 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1269 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:03.187990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:03.191856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:03.201253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:03.204304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:03.209014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:03.209858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:03.210351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:03.212912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:03.267463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:03.468061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:03.468969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:03.479529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:03.482443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:03.488140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:03.490194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:03.493354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:03.494003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:03.583818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:03.596284 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c9abf27-6d7c-4d5c-9a38-886612d0ecad tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.415400 Oct 03 10:33:03.598881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 398/736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:03 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:03.645212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8b750239-760a-4c6b-acf2-55bd7299d96b req-17cf7f4b-2859-4be5-95ee-6ca4e5005ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ec7889-ef50-4158-a548-945a648bbd6f", "name": "network-vif-plugged", "status": "completed", "tag": "de529bdc-d7ad-4cfd-bf71-a8bca22179f9"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:03.694193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8b750239-760a-4c6b-acf2-55bd7299d96b req-17cf7f4b-2859-4be5-95ee-6ca4e5005ddf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:03.696277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8b750239-760a-4c6b-acf2-55bd7299d96b req-17cf7f4b-2859-4be5-95ee-6ca4e5005ddf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:03.697851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8b750239-760a-4c6b-acf2-55bd7299d96b req-17cf7f4b-2859-4be5-95ee-6ca4e5005ddf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:03.726750 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8b750239-760a-4c6b-acf2-55bd7299d96b req-17cf7f4b-2859-4be5-95ee-6ca4e5005ddf service nova] Creating event network-vif-plugged:de529bdc-d7ad-4cfd-bf71-a8bca22179f9 for instance f1ec7889-ef50-4158-a548-945a648bbd6f on n-h2-858383-3 Oct 03 10:33:03.741087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8b750239-760a-4c6b-acf2-55bd7299d96b req-17cf7f4b-2859-4be5-95ee-6ca4e5005ddf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120175 Oct 03 10:33:03.748875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 399/737] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:03.791835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:03.794764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:03.825725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:03.830522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:03.831744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:03.837833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:03.838624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:03.843137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.010840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.025753 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e26176c-a959-42e3-b25b-486180401432 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.562045 Oct 03 10:33:04.036817 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 339/738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:03 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:04.045126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:04.046626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:04.054084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.054905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.055928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.057131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.057843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.058481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.125432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.172443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.172443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.174421 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7acc6fec-48d4-491a-82d8-a2af877bc61b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.403044 Oct 03 10:33:04.177443 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 400/739] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:03 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:04.191611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:04.192624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:04.206951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.213333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.213804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.221047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.232930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.232930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.358452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.379602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.381512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.392345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:04.397817 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7651fd9-b623-4e93-8765-031ba31a9327 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1437 microversion: 2.75 time: 0.216398 Oct 03 10:33:04.399111 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 401/740] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:04 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1437 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:04.407778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c650bcbd-5a53-45bd-a9e4-151c1cf1e21b req-4831da54-52f1-410c-9fa9-75135b8e8f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c8e57a-87eb-4726-a78c-8846b874f46a", "name": "network-vif-unplugged", "status": "completed", "tag": "6c14f12e-0f43-479d-9a1a-3653984609d0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:04.422477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c650bcbd-5a53-45bd-a9e4-151c1cf1e21b req-4831da54-52f1-410c-9fa9-75135b8e8f7e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.423336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c650bcbd-5a53-45bd-a9e4-151c1cf1e21b req-4831da54-52f1-410c-9fa9-75135b8e8f7e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.424038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c650bcbd-5a53-45bd-a9e4-151c1cf1e21b req-4831da54-52f1-410c-9fa9-75135b8e8f7e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.442528 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c650bcbd-5a53-45bd-a9e4-151c1cf1e21b req-4831da54-52f1-410c-9fa9-75135b8e8f7e service nova] Creating event network-vif-unplugged:6c14f12e-0f43-479d-9a1a-3653984609d0 for instance f4c8e57a-87eb-4726-a78c-8846b874f46a on n-h2-858383-3 Oct 03 10:33:04.451051 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c650bcbd-5a53-45bd-a9e4-151c1cf1e21b req-4831da54-52f1-410c-9fa9-75135b8e8f7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048443 Oct 03 10:33:04.452537 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 402/741] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:04.460334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:04.461433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:04.472168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.473307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.475781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.477712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.478512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.479169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.624640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.638469 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6870dfca-e62d-46da-be25-7947fc78ad02 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1269 microversion: 2.1 time: 0.184391 Oct 03 10:33:04.658200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 403/742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:04 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:04.807794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.834424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.846880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:04.851989 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09a7dd93-6e50-4aa9-b794-a75ea82574bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.811474 Oct 03 10:33:04.852635 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 340/743] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:04 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:04.883599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:04.889127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:04.920000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.922561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.924702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.925623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:04.930063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.932063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.933807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:04.938137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.949085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.949565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.950008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:04.950724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:04.951176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:04.953491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.184655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:05.200673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aab4090a-0316-4bfc-ab5d-aa253a9b56f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1313 microversion: 2.1 time: 0.340237 Oct 03 10:33:05.220662 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 341/744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:04 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:05.226925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:05.227863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:05.236438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.241127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.241665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.242461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.244243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.244927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.453867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:05.463457 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f9d84ab-05de-4dd8-8303-abdb564c918e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.241011 Oct 03 10:33:05.464050 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 342/745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:05 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:05.476591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:05.477258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:05.490561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.491053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.491488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.492197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.492680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.493128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.565027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:05.586012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:05.588188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:05.595488 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7574119a-8d38-48cc-a9fb-a11ab332e685 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.130143 Oct 03 10:33:05.619420 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 343/746] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:05 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:05.676466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:05.677278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:05.686497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.687725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.688267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.691450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.692473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.693236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.874681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:05.884933 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9a4f08e-be97-4f01-9ca2-7f4fa808c869 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.212337 Oct 03 10:33:05.901598 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 344/747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:05 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:05.901598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:05.901598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:05.902523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.904285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.908671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:05.911757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:05.912648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:05.913394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:06.121254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:06.138814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:06.140835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:06.142093 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf2d35ae-50a4-4c70-b23a-71a1e4165271 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.255133 Oct 03 10:33:06.142918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 345/748] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:05 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:06.227701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:06.228384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:06.235380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:06.235881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:06.236456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:06.237206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:06.237664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:06.238090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:06.572436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:06.587879 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a5a48389-1650-4b9e-8357-0cfce80b8159 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1463 microversion: 2.1 time: 0.360238 Oct 03 10:33:06.597079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 346/749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:06 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1463 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:06.609240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:06.611913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:06.631717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:06.633287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:06.634290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:06.639224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:06.640595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:06.642522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:07.783198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:07.798223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee06588b-1941-4a71-a6cc-4919be1af934 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 1.207428 Oct 03 10:33:07.799996 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 347/750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:06 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:07.805482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-54804793-9f7a-4b37-a41e-c97a3225bee3 req-4c40990c-d124-4c73-b1ac-e09d01a6e58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c8e57a-87eb-4726-a78c-8846b874f46a", "tag": "6c14f12e-0f43-479d-9a1a-3653984609d0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:07.834877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-54804793-9f7a-4b37-a41e-c97a3225bee3 req-4c40990c-d124-4c73-b1ac-e09d01a6e58e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:07.838437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-54804793-9f7a-4b37-a41e-c97a3225bee3 req-4c40990c-d124-4c73-b1ac-e09d01a6e58e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:07.838932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-54804793-9f7a-4b37-a41e-c97a3225bee3 req-4c40990c-d124-4c73-b1ac-e09d01a6e58e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:07.875547 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-54804793-9f7a-4b37-a41e-c97a3225bee3 req-4c40990c-d124-4c73-b1ac-e09d01a6e58e service nova] Creating event network-changed:6c14f12e-0f43-479d-9a1a-3653984609d0 for instance f4c8e57a-87eb-4726-a78c-8846b874f46a on n-h2-858383-3 Oct 03 10:33:07.888677 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-54804793-9f7a-4b37-a41e-c97a3225bee3 req-4c40990c-d124-4c73-b1ac-e09d01a6e58e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087261 Oct 03 10:33:07.890590 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 348/751] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:07.908078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:07.913644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:07.932211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:07.932922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:07.933379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:07.934135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:07.938082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:07.938537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:08.162286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:08.168540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 10:33:08.188145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:33:08.188563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:33:08.189167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:33:08.189586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:33:08.189999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:33:08.441596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-687b6f8d-1ced-459f-9338-2b45b7d97864 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f/action" status: 202 len: 0 microversion: 2.1 time: 0.542240 Oct 03 10:33:08.445179 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 349/752] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:33:07 2022] POST /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:33:08.457263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:08.457892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:08.482192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:08.482712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:08.484925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:08.486866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:08.487377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:08.487826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:08.617096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:08.619680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:08.632794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:08.634352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:08.640469 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6fc70cc9-3ea4-4a40-8a3b-37e1b7cd457a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.195838 Oct 03 10:33:08.649826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 350/753] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:08 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:08.664861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:08.670001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:08.692020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:08.692455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:08.692925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:08.693641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:08.694082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:08.694505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:09.464815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:09.474694 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19de135d-eeb3-4cc8-8f4a-e5890be72e78 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.823256 Oct 03 10:33:09.475689 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 351/754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:08 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:09.485673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:09.486467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:09.493657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:09.494317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:09.494898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:09.495732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:09.496292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:09.496969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:09.785249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:09.795655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:09.799140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:09.800321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ec32017-14ff-432d-b34f-385aa3e78123 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.323547 Oct 03 10:33:09.806146 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 352/755] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:09 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:09.815009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-64d29e96-dd92-47bf-8b58-4aa9aed5bd6b req-b07c7c31-9b21-44fb-8aca-ef40552013a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0654af6f-0bf5-409f-aff3-fedeec38a352", "tag": "fff89d8c-bb3a-4906-8c8b-c7845f09ec8c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:09.831545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-64d29e96-dd92-47bf-8b58-4aa9aed5bd6b req-b07c7c31-9b21-44fb-8aca-ef40552013a5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:09.832222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-64d29e96-dd92-47bf-8b58-4aa9aed5bd6b req-b07c7c31-9b21-44fb-8aca-ef40552013a5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:09.832929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-64d29e96-dd92-47bf-8b58-4aa9aed5bd6b req-b07c7c31-9b21-44fb-8aca-ef40552013a5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:09.848311 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-64d29e96-dd92-47bf-8b58-4aa9aed5bd6b req-b07c7c31-9b21-44fb-8aca-ef40552013a5 service nova] Creating event network-changed:fff89d8c-bb3a-4906-8c8b-c7845f09ec8c for instance 0654af6f-0bf5-409f-aff3-fedeec38a352 on n-h1-858383-3 Oct 03 10:33:09.854656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-64d29e96-dd92-47bf-8b58-4aa9aed5bd6b req-b07c7c31-9b21-44fb-8aca-ef40552013a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046552 Oct 03 10:33:09.855752 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 353/756] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:09.863088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:09.864670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:09.880728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:09.881239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:09.883232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:09.883951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:09.884901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:09.886259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.080109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:10.089412 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0277c9f-acf1-44c8-9cdd-6fa0f63e2a38 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1472 microversion: 2.1 time: 0.231296 Oct 03 10:33:10.090381 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 354/757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:09 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:10.095923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:10.097041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:10.104988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.105882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.106323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.107131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.107611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.108022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.286521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:10.295872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d17bd40c-4edd-4f55-949c-0a4f4e04107e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.204336 Oct 03 10:33:10.311095 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 355/758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:10 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:10.320121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:10.320121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:10.326358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.326800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.327836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.328523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.329023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.329463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.365508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:33:10.500969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8d10abb-a595-41fc-85d5-ec329fac2fc8 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 204 len: 0 microversion: 2.1 time: 0.188231 Oct 03 10:33:10.503041 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 356/759] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:33:10 2022] DELETE /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:33:10.509273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:10.510146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:10.522641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.523133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.523746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.524457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.525070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.525495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.572423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:33:10.576578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:33:10.579232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:33:10.580461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:33:10.581561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:33:10.609077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:10.619503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:10.620930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:10.627149 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f08b3c5e-01d7-43b5-af84-efc9cdb7d7f7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.122722 Oct 03 10:33:10.641001 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 357/760] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:10 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:10.653820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:10.654567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:10.661084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.661577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.662013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.662721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.663179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.663605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.665221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:10.674392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.689318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.690165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.691036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.691695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.692339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.807457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:10.833115 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f2ea3979-15e9-451d-bcdb-21dd4eca513c tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b/action" status: 202 len: 1940 microversion: 2.75 time: 6.173260 Oct 03 10:33:10.834033 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 404/761] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:33:04 2022] POST /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b/action => generated 1940 bytes in 6175 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 03 10:33:10.839802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:10.840651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:10.847669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.848505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.848980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.849684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.850135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.850587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.905562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:10.915295 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9426d63e-9809-4fa1-8b67-4a9c2bde026c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.272992 Oct 03 10:33:10.924803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 358/762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:10 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:10.924803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:10.924803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:10.931535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.931535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.931535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:10.931535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:10.931978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:10.932259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.001883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.012203 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f66d764e-8f4d-4176-a4e8-72573d715307 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1712 microversion: 2.1 time: 0.176880 Oct 03 10:33:11.012811 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 405/763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:10 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1712 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:11.025439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:11.030040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:11.043378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.045023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.046370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.047351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.048085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.048674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.126125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.135287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.136888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.138141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f786227-13ca-44d2-9fd1-973dc45784bf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.220702 Oct 03 10:33:11.139078 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 359/764] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:10 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:11.143799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:11.144413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:11.150519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:11.154340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.154952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.155539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.156595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.157445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.157982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.175019 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b243342-7358-47d7-8054-de73c340a137 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.153103 Oct 03 10:33:11.188794 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 406/765] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:11 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:11.318986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:11.319840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:11.325094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.326891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.327590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.328212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.329106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.329741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.330318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.335909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aedf0858-ad39-408d-87cb-38198ecd639d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1472 microversion: 2.1 time: 0.195354 Oct 03 10:33:11.336540 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 360/766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:11 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:11.487794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.498058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ec624ee5-5732-4456-b61e-9187f57dda86 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.182831 Oct 03 10:33:11.498636 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 407/767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:11 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:11.660283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:11.661029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:11.670470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.671513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.672075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.672858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.673249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.673668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.742285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.753937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.755478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:11.760710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7cb6dd6a-1609-47aa-88db-86f6d8dd4c30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.105177 Oct 03 10:33:11.761376 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 361/768] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:11 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:11.939198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:11.939743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:11.946240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.946927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.947554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:11.948439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:11.949075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:11.949665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.038347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:12.038965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:12.045472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.046007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.046532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.047297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.047755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.048442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.168144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:12.178983 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8515d9fa-ddb5-4685-a1f0-878617dd25e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.243611 Oct 03 10:33:12.182090 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 408/769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:11 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:12.194354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:12.196174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:12.218808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.220334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.222262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.223165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.224458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.226527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.351400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:12.366011 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bd04c18d-0bd8-4555-a7a9-6fdeaed3e9ce tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1712 microversion: 2.1 time: 0.330917 Oct 03 10:33:12.366807 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 362/770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:12 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1712 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:12.371700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:12.373271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:12.380755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.382101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.382704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.384736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.385461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.386821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.557425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:12.579027 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48f616de-5bb4-4f6d-92e2-db8ba0120641 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.211002 Oct 03 10:33:12.597234 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 363/771] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:12 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:12.610747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-197f269c-4239-4313-bc0e-ab963656af04 req-539b13cf-32e6-4f47-a6fd-7f017a04a4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3601b147-4b29-4547-937c-4b98e467641b", "name": "network-vif-plugged", "status": "completed", "tag": "eeb63eb4-5236-4ab7-b25a-0e56d9904282"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:12.621122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-197f269c-4239-4313-bc0e-ab963656af04 req-539b13cf-32e6-4f47-a6fd-7f017a04a4e7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.621603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-197f269c-4239-4313-bc0e-ab963656af04 req-539b13cf-32e6-4f47-a6fd-7f017a04a4e7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.622251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-197f269c-4239-4313-bc0e-ab963656af04 req-539b13cf-32e6-4f47-a6fd-7f017a04a4e7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.637142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-197f269c-4239-4313-bc0e-ab963656af04 req-539b13cf-32e6-4f47-a6fd-7f017a04a4e7 service nova] Creating event network-vif-plugged:eeb63eb4-5236-4ab7-b25a-0e56d9904282 for instance 3601b147-4b29-4547-937c-4b98e467641b on n-h1-858383-3 Oct 03 10:33:12.642606 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-197f269c-4239-4313-bc0e-ab963656af04 req-539b13cf-32e6-4f47-a6fd-7f017a04a4e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044014 Oct 03 10:33:12.643400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 364/772] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:12.648627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:12.649380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:12.652681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:12.657701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.658193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.658629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.659347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.659807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.660232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.710081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:12.719169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:12.723591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:12.725120 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b258d050-3d61-485a-b1fe-374771e506f6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.540900 Oct 03 10:33:12.726170 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 409/773] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:12 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:12.744036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:12.744963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:12.752424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.753301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.753892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.754957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.755592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.756837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.883607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:12.892785 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c13a68d6-d6a9-4690-9aec-c21c651e0d8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1472 microversion: 2.1 time: 0.247982 Oct 03 10:33:12.893594 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 365/774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:12 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:12.900741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:12.901015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:12.908651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.909533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.909794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.910567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:12.911356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:12.911664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:12.987299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:12.989648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:13.000454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:13.002630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:13.012616 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b7d4a496-53b7-49e1-8dae-b888d24a68d1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.116513 Oct 03 10:33:13.013926 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 366/775] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:12 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:13.205764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:13.206646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:13.211515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:13.213214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.214700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.215348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.216064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.216528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.216989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.219808 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3f06e62f-edc1-4eb8-b504-c02f84b42956 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.492480 Oct 03 10:33:13.233151 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 410/776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:12 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:13.394544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:13.395467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:13.401804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.407090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.408110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.408917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.409541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.410136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.465230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:13.474357 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-20170141-5ff1-4038-b340-5b281adaaabe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.272429 Oct 03 10:33:13.475569 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 367/777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:13 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:13.618135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:13.619220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:13.628504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.631218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.631901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.635478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.636188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.640668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.838589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:13.853466 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-504cf336-757d-493b-9723-085df9adb023 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1712 microversion: 2.1 time: 0.461612 Oct 03 10:33:13.854754 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 411/778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:13 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1712 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:13.859999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:13.860881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:13.871393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.874997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.878635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.881515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.882920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.883717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.887256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:13.914246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f24a229-2f78-40fd-bb51-5b186ffb4cfa tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.305494 Oct 03 10:33:13.927236 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 368/779] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:13 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:33:13.941953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:13.942576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:13.950293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.951988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.953031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:13.953757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:13.954214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:13.954645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.286964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.319064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4215f86d-543a-48ed-9ed7-d3ee5a23218a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1472 microversion: 2.1 time: 0.390586 Oct 03 10:33:14.320587 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 369/780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:13 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:14.327327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:14.328706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:14.341388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.342241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.342943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.343832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.344907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.345511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.446774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.456324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.458379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.465109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d14942b-2624-437a-9b09-a91dc88c9d3a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1537 microversion: 2.91 time: 0.143281 Oct 03 10:33:14.488179 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 370/781] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:14 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:14.494374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:14.496457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:14.504482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.505249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.505948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.507636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.508602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.509230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.701511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.710137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.721072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.722551 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-004cee0c-230e-4e28-9cca-1c7acca077cf tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.866469 Oct 03 10:33:14.723290 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 412/782] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:13 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:14.735424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:14.736251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:14.749408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.750150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.750781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.751672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.754340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.754783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.780321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:14.812234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:14.820916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c2312889-cfbd-4426-bcbb-541514c6dcd5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.331412 Oct 03 10:33:14.821526 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 371/783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:14 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:14.879192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:14.879930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:14.909077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.909921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.910911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:14.912031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:14.912654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:14.913137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.081657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:15.094116 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f5d14771-7425-4085-9061-fa623494974a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1645 microversion: 2.1 time: 0.220602 Oct 03 10:33:15.108875 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 372/784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:14 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1645 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:15.108875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:15.108875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:15.109237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:15.109371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.109371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.109371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.109597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.110246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.110777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.117389 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64dd1b9a-2a18-490c-a2ad-2df4eddea3c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.392775 Oct 03 10:33:15.122414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 413/785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:14 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:15.217668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:15.240619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d2cef4c8-8a70-482d-8aed-dafc86fba67e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.144458 Oct 03 10:33:15.259099 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 373/786] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:15 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:15.333536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c9d4f707-148e-494e-8f6c-aff8e3a5f3eb req-0f23abb5-35e5-41b8-9d1e-a20f1ad6936f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d2d109-a77c-4ebe-9aa8-80187fb3f240", "name": "network-vif-deleted", "tag": "043e2572-78c2-48b4-94c7-336d1e0ebd85"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:15.344860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:15.345614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:15.347219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c9d4f707-148e-494e-8f6c-aff8e3a5f3eb req-0f23abb5-35e5-41b8-9d1e-a20f1ad6936f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.347925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c9d4f707-148e-494e-8f6c-aff8e3a5f3eb req-0f23abb5-35e5-41b8-9d1e-a20f1ad6936f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.348688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c9d4f707-148e-494e-8f6c-aff8e3a5f3eb req-0f23abb5-35e5-41b8-9d1e-a20f1ad6936f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.358133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.359781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.360240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.361526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.362024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.362697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.364875 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c9d4f707-148e-494e-8f6c-aff8e3a5f3eb req-0f23abb5-35e5-41b8-9d1e-a20f1ad6936f service nova] Creating event network-vif-deleted:043e2572-78c2-48b4-94c7-336d1e0ebd85 for instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 on n-h2-858383-3 Oct 03 10:33:15.372908 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c9d4f707-148e-494e-8f6c-aff8e3a5f3eb req-0f23abb5-35e5-41b8-9d1e-a20f1ad6936f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043274 Oct 03 10:33:15.374294 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 414/787] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:15.502389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:15.503748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:15.514368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.515826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.516530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.517652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.518369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.519008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.583957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:15.594298 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-546fa2eb-ede1-41d0-8c3c-09776b281ed4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.255165 Oct 03 10:33:15.610864 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 374/788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:15 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:15.641561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:15.649936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:15.651794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:15.665119 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e96288f-faa2-42d6-a122-a645d39bbbaf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1537 microversion: 2.91 time: 0.170424 Oct 03 10:33:15.697463 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 415/789] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:15 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:15.755186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:15.756641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:15.775008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.776084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.776697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.779079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.779717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.782160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.846575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:15.847261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:15.865921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.866405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.866860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:15.867571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:15.868232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:15.877298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.044351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.056135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.057733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.058936 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f53879e5-1b2a-4f1b-934c-c72eff6cf435 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.308414 Oct 03 10:33:16.059868 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 375/790] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:15 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:16.123504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:16.124687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:16.137637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.138407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.138784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.140924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.140924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.144009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.185622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.200485 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-868e53f8-31d0-4f4d-8d68-f1589a511de0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1313 microversion: 2.1 time: 0.355701 Oct 03 10:33:16.201237 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 416/791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:15 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:16.221093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:16.221685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:16.235145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.235629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.236203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.236711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.237193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.237634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lazy-loading 'fault' on Instance uuid 89d2d109-a77c-4ebe-9aa8-80187fb3f240 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:16.239162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.239902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.240366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.240815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.322962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f65f9939dc241f0bffc3cd45efd857a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15708e4a6464c968bb7f6c73b73c019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.348835 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a0c23d0-726b-42d4-a285-373afe2f494a tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 200 len: 1353 microversion: 2.1 time: 0.230011 Oct 03 10:33:16.349651 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 376/792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:16 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 1353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:16.367413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:16.368306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:16.382311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.387640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.388338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.389323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.389987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.390595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.539197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:16.545724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.557912 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-674494da-e8a8-4fab-b4f3-e47ebc369023 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.349555 Oct 03 10:33:16.558790 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 417/793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:16 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:16.574626 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b148a555-196c-4a9b-8c06-2202c9b3510f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.223253 Oct 03 10:33:16.575594 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 377/794] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:16 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:16.590375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4362bf55-c309-4dd6-80c3-b3e142eebd34 req-fa1f0da3-adae-406d-87b0-aed684426615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0654af6f-0bf5-409f-aff3-fedeec38a352", "name": "network-vif-plugged", "status": "completed", "tag": "fff89d8c-bb3a-4906-8c8b-c7845f09ec8c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:16.620713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:16.621298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4362bf55-c309-4dd6-80c3-b3e142eebd34 req-fa1f0da3-adae-406d-87b0-aed684426615 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.622275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:16.622507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4362bf55-c309-4dd6-80c3-b3e142eebd34 req-fa1f0da3-adae-406d-87b0-aed684426615 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.625515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4362bf55-c309-4dd6-80c3-b3e142eebd34 req-fa1f0da3-adae-406d-87b0-aed684426615 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.633777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.634432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.634918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.635705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.636327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.636867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.657301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4362bf55-c309-4dd6-80c3-b3e142eebd34 req-fa1f0da3-adae-406d-87b0-aed684426615 service nova] Creating event network-vif-plugged:fff89d8c-bb3a-4906-8c8b-c7845f09ec8c for instance 0654af6f-0bf5-409f-aff3-fedeec38a352 on n-h1-858383-3 Oct 03 10:33:16.664392 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4362bf55-c309-4dd6-80c3-b3e142eebd34 req-fa1f0da3-adae-406d-87b0-aed684426615 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079188 Oct 03 10:33:16.665536 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 418/795] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:16.697317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:16.698587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:16.710682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.711529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.712131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.715659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:16.716373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:16.717098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:16.853680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.864384 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3febcaa-38d5-471e-937c-46f76fed82e0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.247394 Oct 03 10:33:16.865328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 378/796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:16 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:16.924470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.934943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.936549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:16.942038 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0177c809-1084-42a4-8001-dc87ee7a2fc5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1537 microversion: 2.91 time: 0.248933 Oct 03 10:33:16.958382 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 419/797] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:16 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:33:17.091508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.092287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.104654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.105183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.105630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.110701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.111698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.112157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.226465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.233042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.239959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.240497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.240967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.241726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.242188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.242613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.352570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:17.367794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:17.369679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:17.372230 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc61146a-59a3-4686-bea3-db5cd4ac4fe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.286109 Oct 03 10:33:17.373772 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 379/798] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:33:17.380386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.381601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.390693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.391524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.392325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.393388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.394181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.394897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.414003 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] HTTP exception thrown: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Request method failure captured: Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 HTTP/1.1 Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnVqgM1v0hsCED4qRskEvYoI6idd-62sO1HGFL7eWciDzWTEA0sQ_e5nHvZFwCTy8M_WS5CxzU0Fmq4EMKhfefXzcA074LU9pArQr-q6iWSx9rsDOaFjLnqbQf5gKCYzL_sv3VrvVPwrtZtHWM2xQitcZAdr-PMQk8FtcdcttFm3pg Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:17.416317 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}] Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4f65f9939dc241f0bffc3cd45efd857a Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:17.417781 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '89d2d109-a77c-4ebe-9aa8-80187fb3f240'} Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:17.418559 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:17.419874 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.421193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Returning 404 to user: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:17.421193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-be6ebbaf-5772-486f-9e6b-2fc6685ca8b4 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 404 len: 111 microversion: 2.1 time: 0.041977 Oct 03 10:33:17.422912 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 380/799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:33:17.429620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.430749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.439107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.439592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.440023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.440913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.441431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.441860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.456682 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] HTTP exception thrown: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Request method failure captured: Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 HTTP/1.1 Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnVqgM1v0hsCED4qRskEvYoI6idd-62sO1HGFL7eWciDzWTEA0sQ_e5nHvZFwCTy8M_WS5CxzU0Fmq4EMKhfefXzcA074LU9pArQr-q6iWSx9rsDOaFjLnqbQf5gKCYzL_sv3VrvVPwrtZtHWM2xQitcZAdr-PMQk8FtcdcttFm3pg Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:17.458587 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}] Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4f65f9939dc241f0bffc3cd45efd857a Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.460147 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '03170cc0-d8a1-4021-8aac-b4019e329987'} Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:17.461042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.462235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.463400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Returning 404 to user: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:17.463400 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91b20d2c-1efb-4d77-9029-2a1c369d20eb tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 404 len: 111 microversion: 2.1 time: 0.035724 Oct 03 10:33:17.465400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 381/800] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:33:17 2022] DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:33:17.470284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.470891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.471397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:17.477640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.478122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.478555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.479253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.479704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.480122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.482676 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06fd52db-1394-4dcc-a382-b70a05d7b69c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1462 microversion: 2.1 time: 0.261573 Oct 03 10:33:17.484004 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 420/801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1462 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:17.496131 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] HTTP exception thrown: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Request method failure captured: Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 HTTP/1.1 Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnVqgM1v0hsCED4qRskEvYoI6idd-62sO1HGFL7eWciDzWTEA0sQ_e5nHvZFwCTy8M_WS5CxzU0Fmq4EMKhfefXzcA074LU9pArQr-q6iWSx9rsDOaFjLnqbQf5gKCYzL_sv3VrvVPwrtZtHWM2xQitcZAdr-PMQk8FtcdcttFm3pg Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:17.498441 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}] Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4f65f9939dc241f0bffc3cd45efd857a Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.500293 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '03170cc0-d8a1-4021-8aac-b4019e329987'} Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:17.501011 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:17.502362 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:17.503592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Returning 404 to user: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:17.503907 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7760e0e3-1504-4311-a5bc-f6c49b970323 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 404 len: 111 microversion: 2.1 time: 0.037428 Oct 03 10:33:17.504478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 382/802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:33:17.507345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.507961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.513442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4b48b60-0766-4cad-af21-c40a397bbc33 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '.version_select at 0x7f074f72e4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.519733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.520234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.520678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.521431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.521895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.522326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.542483 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4b48b60-0766-4cad-af21-c40a397bbc33 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192700604" status: 202 len: 0 microversion: 2.1 time: 0.032223 Oct 03 10:33:17.544810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 383/803] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:33:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192700604 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:33:17.594150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.594907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.605778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.606453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.606983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.607888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.608443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.608998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.750758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:17.762443 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d04cc88-9f9a-4b01-b9c4-c25cd32707b8 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1463 microversion: 2.1 time: 0.255474 Oct 03 10:33:17.763939 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 421/804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1463 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:17.772373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.777613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.791304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.791847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:17.792340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.793093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.794039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.798116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.798896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.804170 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-848f6c38-5d28-4be9-937a-82c10e239608 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.213992 Oct 03 10:33:17.818020 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 384/805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:17.887717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:17.888326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:17.896923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.897385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.897808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.899152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:17.899152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:17.899383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:17.926532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:17.936259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:17.976836 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-298a0f07-0e09-4fbb-8522-9adfd9f4181f tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.209950 Oct 03 10:33:17.977977 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 422/806] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:17.988541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-431749546", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "63d64078-3f94-45fb-a864-a10c79b8c92e"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:18.062548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:33:18.116876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.127220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72b666b3-49f4-43a7-8c11-308fc3c32896 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.242491 Oct 03 10:33:18.128073 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 385/807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:17 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:18.134763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:18.135541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:18.144247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.144874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.145397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.146210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.146743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.147255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.224636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.249069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.251770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.258201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-064ea869-0b10-4c4e-972c-af04404f2725 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1540 microversion: 2.91 time: 0.128580 Oct 03 10:33:18.264822 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 386/808] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:18 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1540 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:18.288632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:18.291839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:18.298722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.299147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.299593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.300297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.300752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.301223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.362634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-3". {{(pid=122269) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 10:33:18.440638 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a56f0f71-f594-4aa6-8fa2-cb998c37ba7f tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action" status: 202 len: 0 microversion: 2.91 time: 0.155504 Oct 03 10:33:18.444318 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 387/809] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:33:18 2022] POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:33:18.448612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:18.449243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:18.458232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.458968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.459595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.460466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.461602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.462191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.637869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:33:18.638495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:33:18.639179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:33:18.640353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:33:18.644603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:33:18.677775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.680841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.682144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.688786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.689543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.690131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.705727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.717386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Getting quotas for project b4201301e9cb42d3bcdff6d0416140f0. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:33:18.719395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.724298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Getting quotas for user 5be59c07a541438ab3cb0db3a0d0250a and project b4201301e9cb42d3bcdff6d0416140f0. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:33:18.727656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.729050 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27a3be0e-29cd-4cab-a9e9-2096bafb6f3f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.286422 Oct 03 10:33:18.741538 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 388/810] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:18 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:18.744919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:33:18.748710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:33:18.756632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:18.757299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:18.782513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.783120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.783439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.784157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.784666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.785067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.845306 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1b62523f-4be7-41ea-8e20-da701ed96239 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865282 Oct 03 10:33:18.854765 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 423/811] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:33:18.861238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:18.867339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:18.878641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.880193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.880950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.881665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:18.882154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:18.882604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:18.918446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.950056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.954666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:18.965706 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82d6450d-3796-4c06-a4c9-033384420527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1548 microversion: 2.91 time: 0.222854 Oct 03 10:33:18.974264 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 389/812] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:18 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1548 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:18.982012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-63cbe9ff-d9a1-4cae-adec-da9ce3ba265b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:18.984120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-63cbe9ff-d9a1-4cae-adec-da9ce3ba265b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.117284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-63cbe9ff-d9a1-4cae-adec-da9ce3ba265b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:19.134009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-63cbe9ff-d9a1-4cae-adec-da9ce3ba265b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1213 microversion: 2.1 time: 0.162083 Oct 03 10:33:19.137079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 390/813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:18 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:19.142353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f25f07a5-486e-48e6-9555-40b9a869bedd tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.214093 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f25f07a5-486e-48e6-9555-40b9a869bedd tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/121050391" status: 202 len: 0 microversion: 2.1 time: 0.075887 Oct 03 10:33:19.236668 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 391/814] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:33:19 2022] DELETE /compute/v2.1/flavors/121050391 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:33:19.236858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:19.240684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.241347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.244717 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fac765de-0cef-4da9-a04a-d5654ebe6827 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1311 microversion: 2.1 time: 0.388609 Oct 03 10:33:19.260638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.261039 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 424/815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:18 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1311 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:19.261411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.261858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.262581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.263036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.269100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.272342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.275359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.297181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.306035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.306505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.308151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.308628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.309097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.429539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:19.459979 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eaf30018-2fe2-4eb9-8b5f-5efa24d7f963 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.224870 Oct 03 10:33:19.461259 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 392/816] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:19.466840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a95f93ef-cec6-491b-9b61-c697a0906dd7 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.494445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a95f93ef-cec6-491b-9b61-c697a0906dd7 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.031764 Oct 03 10:33:19.509815 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 393/817] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:19.516189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed11b85f-b000-4e8d-ab55-725297de6997 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.542725 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed11b85f-b000-4e8d-ab55-725297de6997 tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/633867173" status: 202 len: 0 microversion: 2.1 time: 0.029739 Oct 03 10:33:19.547656 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 394/818] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:33:19 2022] DELETE /compute/v2.1/flavors/633867173 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:33:19.554402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2fa8a0ab-5d15-4573-96d6-60dd4e6dfc2b tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.621830 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2fa8a0ab-5d15-4573-96d6-60dd4e6dfc2b tempest-ServersWithSpecificFlavorTestJSON-2127408588 tempest-ServersWithSpecificFlavorTestJSON-2127408588-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072575 Oct 03 10:33:19.623711 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 395/819] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:19.680609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.682357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.692038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.692530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.693018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.694344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.694825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.695264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.713957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] HTTP exception thrown: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Request method failure captured: Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 HTTP/1.1 Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnVqgM1v0hsCED4qRskEvYoI6idd-62sO1HGFL7eWciDzWTEA0sQ_e5nHvZFwCTy8M_WS5CxzU0Fmq4EMKhfefXzcA074LU9pArQr-q6iWSx9rsDOaFjLnqbQf5gKCYzL_sv3VrvVPwrtZtHWM2xQitcZAdr-PMQk8FtcdcttFm3pg Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:19.715466 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}] Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4f65f9939dc241f0bffc3cd45efd857a Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.717092 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '89d2d109-a77c-4ebe-9aa8-80187fb3f240'} Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:19.718661 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.721599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.724333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Returning 404 to user: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:19.724333 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0180c6f-64b3-45a8-9bce-16ca8282ce16 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 404 len: 111 microversion: 2.1 time: 0.065742 Oct 03 10:33:19.724333 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 396/820] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:33:19 2022] DELETE /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:33:19.726463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.727060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 89d2d109-a77c-4ebe-9aa8-80187fb3f240] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.730398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:19.735708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.736239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.736693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.737727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.738186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.741460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.755141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:19.775142 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c578e332-9375-4be1-9499-380706bcafdb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.507732 Oct 03 10:33:19.775760 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 425/821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:19.795418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.796615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.830199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.831003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.831800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.832830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.833277 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] HTTP exception thrown: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.833527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.834060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Request method failure captured: Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 HTTP/1.1 Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnVqgM1v0hsCED4qRskEvYoI6idd-62sO1HGFL7eWciDzWTEA0sQ_e5nHvZFwCTy8M_WS5CxzU0Fmq4EMKhfefXzcA074LU9pArQr-q6iWSx9rsDOaFjLnqbQf5gKCYzL_sv3VrvVPwrtZtHWM2xQitcZAdr-PMQk8FtcdcttFm3pg Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:19.834852 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}] Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4f65f9939dc241f0bffc3cd45efd857a Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.836227 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '89d2d109-a77c-4ebe-9aa8-80187fb3f240'} Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:19.836982 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. Oct 03 10:33:19.838766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.840568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Returning 404 to user: Instance 89d2d109-a77c-4ebe-9aa8-80187fb3f240 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:19.840568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc732faa-a436-46ad-90df-50030af280d3 tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240" status: 404 len: 111 microversion: 2.1 time: 0.113788 Oct 03 10:33:19.840568 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 397/822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/servers/89d2d109-a77c-4ebe-9aa8-80187fb3f240 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:33:19.850220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.850722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.863064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.863569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.864021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.864742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.868517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.869395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.901229 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] HTTP exception thrown: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Request method failure captured: Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 HTTP/1.1 Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnVqgM1v0hsCED4qRskEvYoI6idd-62sO1HGFL7eWciDzWTEA0sQ_e5nHvZFwCTy8M_WS5CxzU0Fmq4EMKhfefXzcA074LU9pArQr-q6iWSx9rsDOaFjLnqbQf5gKCYzL_sv3VrvVPwrtZtHWM2xQitcZAdr-PMQk8FtcdcttFm3pg Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:19.902902 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}] Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4f65f9939dc241f0bffc3cd45efd857a Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.904204 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '03170cc0-d8a1-4021-8aac-b4019e329987'} Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:19.905045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.906909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.908358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Returning 404 to user: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:19.908358 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce8a124b-89ae-4ae2-a29b-9871f01a42ec tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 404 len: 111 microversion: 2.1 time: 0.063409 Oct 03 10:33:19.910949 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 398/823] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:33:19 2022] DELETE /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:33:19.931940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:19.932598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] [instance: 03170cc0-d8a1-4021-8aac-b4019e329987] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:19.942644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.943149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.944363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.945143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:19.945703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:19.946201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:19.963612 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] HTTP exception thrown: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Request method failure captured: Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 HTTP/1.1 Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrnVqgM1v0hsCED4qRskEvYoI6idd-62sO1HGFL7eWciDzWTEA0sQ_e5nHvZFwCTy8M_WS5CxzU0Fmq4EMKhfefXzcA074LU9pArQr-q6iWSx9rsDOaFjLnqbQf5gKCYzL_sv3VrvVPwrtZtHWM2xQitcZAdr-PMQk8FtcdcttFm3pg Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:19.965476 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f15708e4a6464c968bb7f6c73b73c019"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f15708e4a6464c968bb7f6c73b73c019"}]}] Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f15708e4a6464c968bb7f6c73b73c019 Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147 Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4f65f9939dc241f0bffc3cd45efd857a Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1226680147-project Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.966780 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '03170cc0-d8a1-4021-8aac-b4019e329987'} Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:19.967488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. Oct 03 10:33:19.970454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:19.972424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] Returning 404 to user: Instance 03170cc0-d8a1-4021-8aac-b4019e329987 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:19.972424 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4105c3e8-96bd-4a4b-b933-73ea5f7fb48d tempest-ServersWithSpecificFlavorTestJSON-1226680147 tempest-ServersWithSpecificFlavorTestJSON-1226680147-project] 10.222.0.27 "GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987" status: 404 len: 111 microversion: 2.1 time: 0.042635 Oct 03 10:33:19.972424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 399/824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/servers/03170cc0-d8a1-4021-8aac-b4019e329987 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:33:19.999717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:20.000545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:20.010995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.011660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.012380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.014575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.016744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.018487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.186890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.204732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.206232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.218363 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5da3cf95-4192-4589-9877-5f797ff586a2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.221763 Oct 03 10:33:20.220152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 400/825] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:20.226494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:20.227110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:20.246380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.247984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.248945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.249999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.250566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.250907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.313570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.326801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.331596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.332854 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-060f3ecc-0011-4f64-9c12-3877a34f377a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1568 microversion: 2.25 time: 0.554515 Oct 03 10:33:20.335498 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 426/826] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:19 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1568 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:20.346467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:20.349768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:20.363303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.363921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.364554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.365585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.366057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.366482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.413325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.426235 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0ef7a57-cde1-48b3-a4c5-ebd0d0f6ffeb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1209 microversion: 2.1 time: 0.204938 Oct 03 10:33:20.428143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 401/827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:20 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:20.505933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:20.507204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:20.514439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.515698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.516286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.517239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.517846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.518774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.640703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:20.652112 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac20781a-0bd3-4513-904d-425b9db93849 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1494 microversion: 2.1 time: 0.310511 Oct 03 10:33:20.667991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:20.671241 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 427/828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:20 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1494 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:20.680283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:20.685311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:20.704524 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4fae5b80-3020-43f5-b935-696c1f3a90f1 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.206723 Oct 03 10:33:20.708050 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 402/829] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:20 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:20.710358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.710871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.711314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.712041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.712504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.712975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.836300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:20.837346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:20.847643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.849338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.851659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.852586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.854541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.857180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.929934 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b6ba304-a65b-4989-84e6-95fe65d8c261 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1645 microversion: 2.1 time: 0.253032 Oct 03 10:33:20.930579 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 428/830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:20 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1645 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:20.953967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:20.954721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:20.963529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.964425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.965137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:20.966471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:20.967594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:20.968504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.264236 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1148056c-35f2-480c-a72e-94d39aa9f1e8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1645 microversion: 2.1 time: 0.314996 Oct 03 10:33:21.265189 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 429/831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:20 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1645 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:21.269956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:21.270748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:21.285705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.286134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.286582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.287321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.287896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.288618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.371710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.382833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.384296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.390706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7fa406c2-f8b5-4db0-a967-3999c6c5bc82 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.124248 Oct 03 10:33:21.391826 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 430/832] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:21 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:21.396474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:21.400465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.401154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.401775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.402685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.403301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.403896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.437396 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-277a1f1f-e6d4-42a7-975b-bd118b12df04 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044174 Oct 03 10:33:21.438260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 431/833] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:33:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:21.444645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:21.445735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:21.453778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.454351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.455187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.457089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.457769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.458358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.481630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:21.633967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.644490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.646130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.647547 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bdd7e7b0-6407-4dd6-ac84-f12fa98974b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1558 microversion: 2.25 time: 0.207798 Oct 03 10:33:21.648614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 432/834] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:21 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:21.676562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:21.677567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:21.683860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.684632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.685348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.686346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.687033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.687555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.776440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.785433 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6704b529-badc-4793-83ed-e1ab585f7c3c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.977776 Oct 03 10:33:21.786723 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 403/835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:20 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:21.792636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:21.795529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:21.803213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:21.808104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.808606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.809074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.809781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.810506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.810801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.815093 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40eb2224-69ac-4590-b0ad-14d2fe18fa46 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1265 microversion: 2.1 time: 0.164007 Oct 03 10:33:21.815983 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 433/836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:21 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:21.850414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81a0ffb3-d854-4491-91c3-45150be38929 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '.version_select at 0x7f074f8b71f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:21.865885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a0ffb3-d854-4491-91c3-45150be38929 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.870876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a0ffb3-d854-4491-91c3-45150be38929 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.875416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a0ffb3-d854-4491-91c3-45150be38929 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.919420 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81a0ffb3-d854-4491-91c3-45150be38929 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.101971 Oct 03 10:33:21.920075 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 434/837] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 3 10:33:21 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:21.949501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:21.952267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:21.970708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.975281 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4db5b167-e8f1-4991-aaf3-7a1d2517776a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352/action" status: 202 len: 0 microversion: 2.1 time: 0.186660 Oct 03 10:33:21.975662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.976467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.978942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:21.980319 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 404/838] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:33:21 2022] POST /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:33:21.981940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:21.982631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:21.992812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:21.994688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:22.009632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:22.011873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:22.012459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:22.014357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:22.015566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:22.017229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:22.642908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:22.680697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:22.682635 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3cd96a42-34df-44ff-9ff0-39daea36101a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.761489 Oct 03 10:33:22.708384 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 435/839] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:21 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:22.721143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:22.721772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:22.735594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:22.736045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:22.736668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:22.737981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:22.738622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:22.739057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:22.813002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid f4c8e57a-87eb-4726-a78c-8846b874f46a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:22.864447 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10a4e175-8aaa-4321-bca9-3174ff8d1d46 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 2051 microversion: 2.25 time: 0.882026 Oct 03 10:33:22.865961 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 405/840] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:21 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 2051 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:23.001896 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f171e80-4c54-4a7d-a6d6-6e5b83d427d8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1630 microversion: 2.1 time: 0.291448 Oct 03 10:33:23.005606 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 436/841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:22 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1630 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:23.016446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:23.017503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:23.032695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.035815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.039258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.040289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.041034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.041838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.155932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ccbe44d4-a844-4425-89ff-ed953b495ba8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Action: 'create', calling method: .version_select at 0x7f074f7511f0>, body: {"keypair": {"name": "tempest-keypair-727603332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF58q3ocT3I0VdRLzmwqjNRrPBCMUENKvOTA175nF3AlmzfVDoYzSqYRMxa3sYlZUAxrlTfiksIDfJrxHCJtPgzYhjmGQA7WdlHzhHK9wqyBGjTqOL8qoKAvAvc+aN7hQ=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:23.196168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ccbe44d4-a844-4425-89ff-ed953b495ba8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Getting quotas for project b82aa1e4fdc142639048492996994669. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:33:23.197919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:23.201465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ccbe44d4-a844-4425-89ff-ed953b495ba8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Getting quotas for user 8c1a377d004245f7ad16835171cab02e and project b82aa1e4fdc142639048492996994669. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:33:23.213022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:23.217292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:23.242652 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9262fde6-e064-49d3-8641-441277511363 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.235661 Oct 03 10:33:23.243673 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 437/842] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:23 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:23.244574 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ccbe44d4-a844-4425-89ff-ed953b495ba8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.377184 Oct 03 10:33:23.246680 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 406/843] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:33:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:23.250800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:23.252084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:23.260868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.262146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.262833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.263979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.265215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.265878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.267719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:23.267719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:23.299106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.299603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.300034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.300746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.301228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.301659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.316684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:23.428357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:23.444835 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5397c7d8-15bb-46a6-bedd-cca3adf5135f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1283 microversion: 2.1 time: 0.197092 Oct 03 10:33:23.447867 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 407/844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:23 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:23.479131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:23.485829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:23.502081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.502665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.503130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.503890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:23.504360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:23.504830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:23.558440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lazy-loading 'flavor' on Instance uuid 0654af6f-0bf5-409f-aff3-fedeec38a352 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:23.588682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Going to try to live migrate instance to n-h2-858383-3 {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:33:23.629123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:23.643666 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb37fb42-8a81-4b03-bca8-3819e7011c22 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.394815 Oct 03 10:33:23.645815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 438/845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:23 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:23.657624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1489509132", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "4237c513-9590-4957-9766-25a24a956f31"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:23.761338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] validate_networks() for [('4237c513-9590-4957-9766-25a24a956f31', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:33:25.015849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:33:25.016513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:33:25.017038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:33:25.017392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:33:25.018129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:33:25.041042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.041317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.041755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:25.042480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.043141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.043350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:25.120266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:33:25.132614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for user 7b6d14fc83e74c34b2e6d5845f4ed9bf and project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:33:25.165847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:33:25.173505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:33:25.305055 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b51b4369-3dc2-40be-aff4-cc26156ea104 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.654350 Oct 03 10:33:25.314047 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 439/846] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:33:25.343612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:25.345050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:25.356661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.357212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.357669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:25.359013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.359534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.359995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:25.475669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:25.508256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-87881897-39cc-40e1-ba28-1a0376c9ed29 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.192517 Oct 03 10:33:25.537772 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 440/847] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:25 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:25.552341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:25.559113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:25.588913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.595647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.598184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:25.601666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.604241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.608612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:25.816015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:25.831659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:25.838013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:25.861628 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-90c4467d-35bc-4bce-9be8-e6691d8c3b2b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.322446 Oct 03 10:33:25.862592 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 441/848] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:25 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:25.867291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:25.873120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:25.884948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.891055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.891720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:25.892703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:25.893343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:25.893954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:26.104998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:26.120188 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43072333-97e7-4d4a-a23a-d0c8470e949f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1283 microversion: 2.1 time: 0.256483 Oct 03 10:33:26.141149 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 442/849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:25 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1283 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:26.146131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:26.146769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:26.176255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:26.179459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:26.189555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:26.190750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:26.190970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:26.191403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:26.496047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:26.505358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4b181e7-9d45-45b0-a75d-ed29d4c73c8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.362920 Oct 03 10:33:26.517411 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 443/850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:26 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:26.528492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:26.529555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:26.538662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:26.539497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:26.540106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:26.541049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:26.541705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:26.542316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:26.639951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:26.662164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:26.664587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:26.666349 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4da7b1da-0a58-45e4-b527-fa652d5847b3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1266 microversion: 2.25 time: 0.147411 Oct 03 10:33:26.667562 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 444/851] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:26 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:26.675123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:26.676081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:26.692443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:26.693340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:26.695095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:26.696207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:26.698531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:26.710826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:26.990882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:27.027426 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d65399e-39ab-4af5-8598-6781f4d5c6d2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.358173 Oct 03 10:33:27.044814 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 445/852] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:26 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:27.044814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:27.044814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:27.055268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:27.055874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:27.056391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:27.059731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:27.060402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:27.061046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:27.193176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:27.201806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:27.203887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:27.226807 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c39b18b-6706-4d5f-ba5b-f6924355a093 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.193295 Oct 03 10:33:27.227418 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 446/853] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:27 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:27.242580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:27.243202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:27.256565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:27.257750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:27.258356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:27.259500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:27.260121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:27.260712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:27.515440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:27.523998 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e13a8722-eafb-49dd-acbc-742b3f8ced81 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1271 microversion: 2.1 time: 0.295523 Oct 03 10:33:27.527354 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 447/854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:27 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:27.548917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:27.549551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:27.564311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:27.564844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:27.565290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:27.566024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:27.566495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:27.566943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:28.150709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:28.164575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7bf347d-9c0f-4a94-9b37-44040f8d1b24 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.622276 Oct 03 10:33:28.165570 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 448/855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:27 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:28.178968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:28.179897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:28.192818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:28.197781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:28.198314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:28.202217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:28.202930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:28.203398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:28.252616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:28.417581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:28.441512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:28.449900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:28.454069 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29a11c24-434e-49d8-8548-9085d4fafd92 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1320 microversion: 2.25 time: 0.285467 Oct 03 10:33:28.455900 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 449/856] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:28 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:28.472676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1794612638", "imageRef": "eab34222-8d91-49a3-aa72-c021806e949c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fa5da254-78b0-40b5-ae6e-73761cdca747"}], "security_groups": [{"name": "tempest-securitygroup--477842515"}], "key_name": "tempest-keypair-727603332", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:28.784211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] validate_networks() for [('fa5da254-78b0-40b5-ae6e-73761cdca747', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:33:29.239415 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-826cd428-39cf-4e52-87fc-9883863f1199 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352/action" status: 202 len: 0 microversion: 2.1 time: 5.772532 Oct 03 10:33:29.240031 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 408/857] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:33:23 2022] POST /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352/action => generated 0 bytes in 5782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:33:29.247511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:29.248229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:29.275499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:29.275997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:29.276432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:29.280101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:29.280603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:29.283926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:29.416417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:29.470710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43a46fcb-4b6b-4931-acda-5c6f33ce44db tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.228943 Oct 03 10:33:29.471321 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 409/858] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:29 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:29.485750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:29.487890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:29.514374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:29.518082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:29.520452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:29.525118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:29.527157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:29.527790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:29.691849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:29.708826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:29.714205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:29.730248 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e112c641-de97-488d-b3b5-e8d53f723ccd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.256604 Oct 03 10:33:29.730951 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 410/859] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:29 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:29.745682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:29.747110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:29.763059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:29.763558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:29.765804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:29.766846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:29.767470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:29.768354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:30.314469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:33:30.315051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:33:30.315676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:33:30.316238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:33:30.317469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:33:30.363858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:30.367368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:30.370683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:30.372978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:30.376434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:30.378115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:30.435168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Getting quotas for project b82aa1e4fdc142639048492996994669. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:33:30.453484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Getting quotas for user 8c1a377d004245f7ad16835171cab02e and project b82aa1e4fdc142639048492996994669. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:33:30.479151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:33:30.494853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eab34222-8d91-49a3-aa72-c021806e949c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:33:30.543504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:30.561184 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cdf032f9-22dc-4380-969f-4b4739efef85 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.825441 Oct 03 10:33:30.564441 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 411/860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:29 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:30.576459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:30.579252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:30.598939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:30.600052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:30.600681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:30.602650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:30.603661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:30.605202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:30.663412 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-67d54c94-50af-4de0-84a5-8ad4ace18cf2 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.201534 Oct 03 10:33:30.664162 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 450/861] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:33:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:33:30.683743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:30.687294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:30.707954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:30.708498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:30.709061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:30.710181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:30.710825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:30.711809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:31.122907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:31.134619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75d0cb1f-75fe-4820-adef-912d8e0e4ecc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1477 microversion: 2.1 time: 0.567998 Oct 03 10:33:31.138400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 412/862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:30 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1477 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:31.143886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:31.151361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:31.158804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:31.159626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:31.160275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:31.161015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:31.161473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:31.161906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:31.558636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:31.574287 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12efd376-86c6-42e6-8fde-83da6a986d16 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.897057 Oct 03 10:33:31.576581 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 451/863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:30 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:31.589397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:31.619985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:31.622879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:31.629819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:31.635356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:31.638201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0673e22f-e031-4105-8d70-9c43308c3276 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.498551 Oct 03 10:33:31.638802 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 413/864] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:31 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:31.654372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:31.654776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:31.655235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:31.656564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:31.658131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e7268f5-41d3-4ef3-b163-4e4d106731c0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:31.659046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:31.664287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1e7268f5-41d3-4ef3-b163-4e4d106731c0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:31.666278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:31.841823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1e7268f5-41d3-4ef3-b163-4e4d106731c0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:31.852750 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e7268f5-41d3-4ef3-b163-4e4d106731c0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1245 microversion: 2.1 time: 0.207540 Oct 03 10:33:31.868547 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 414/865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:31 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1245 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:31.874852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:31.875820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:31.884069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:31.884931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:31.885565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:31.886463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:31.887082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:31.887656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:31.950148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:31.980468 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c46839c9-30da-4f95-b068-9d068539b1b3 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.399017 Oct 03 10:33:31.997454 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 452/866] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:31 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:31.997586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:31.998248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:32.006804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:32.009507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.010296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.011021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.012166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.013020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.013774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.018794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:32.020319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:32.025721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f707ffd-4822-4606-ac14-9995d8340255 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.155678 Oct 03 10:33:32.026971 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 415/867] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:31 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:32.041125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d5b45ed7-0747-41df-af9a-76677179fdde req-2cf8b46e-c229-4c2a-8938-2a2c676c877a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58627021-c0f0-46b7-b841-a30e90028959", "tag": "780bd99c-62a9-42b2-8345-af7d10aee9c4"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:32.062909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d5b45ed7-0747-41df-af9a-76677179fdde req-2cf8b46e-c229-4c2a-8938-2a2c676c877a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.065501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d5b45ed7-0747-41df-af9a-76677179fdde req-2cf8b46e-c229-4c2a-8938-2a2c676c877a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.066331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d5b45ed7-0747-41df-af9a-76677179fdde req-2cf8b46e-c229-4c2a-8938-2a2c676c877a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.080505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d5b45ed7-0747-41df-af9a-76677179fdde req-2cf8b46e-c229-4c2a-8938-2a2c676c877a service nova] Creating event network-changed:780bd99c-62a9-42b2-8345-af7d10aee9c4 for instance 58627021-c0f0-46b7-b841-a30e90028959 on n-h1-858383-3 Oct 03 10:33:32.085959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d5b45ed7-0747-41df-af9a-76677179fdde req-2cf8b46e-c229-4c2a-8938-2a2c676c877a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057422 Oct 03 10:33:32.086810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 416/868] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:32.169580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:32.172060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:32.202238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.202758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.203208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.203948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.204402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.204874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.401039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:32.413503 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1bacf6ba-9961-47d9-9775-c9f938ab85be tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.417951 Oct 03 10:33:32.415726 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 453/869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:31 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:32.535680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:32.553498 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f7b003a-98d1-48bb-9729-f7f4212ad140 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1476 microversion: 2.1 time: 0.395043 Oct 03 10:33:32.554314 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 417/870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:32 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:32.600420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:32.601263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:32.609641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.610437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.611047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.611927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.612976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.613590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.672606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:32.674731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:32.681782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.683880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.684638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:32.685409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:32.685866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:32.686298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.011665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.022492 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb816f14-c429-4dfa-b1a3-dda4722871c1 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.426713 Oct 03 10:33:33.040801 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 454/871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:32 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:33.040801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:33.040801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:33.052045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.052686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.053268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.054559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.058740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.059554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.085151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.123966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.126245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.127427 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-88333a7d-1c5b-49c3-bed7-ddace638490b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.462172 Oct 03 10:33:33.133988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 418/872] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:32 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:33.147705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:33.148481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:33.159896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.160454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.161249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.162369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.163018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.164140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.243520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.255965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee02d9fe-c7ab-4a35-8f0c-6d40db6b28e3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1305 microversion: 2.1 time: 0.227158 Oct 03 10:33:33.256907 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 455/873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:33 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1305 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:33.272274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:33.273434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:33.284050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.285404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.286409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.287453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.288301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.289169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.315052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:33.361893 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d1c16f0b-8def-4c19-93f7-456406337ea2 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.226124 Oct 03 10:33:33.363408 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 419/874] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:33 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:33.437467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:33.438154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:33.454749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.457562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.460562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.461507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.462246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.462751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.504061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.522111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.529852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:33.542834 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0cc2ca2-2918-45c6-b8c6-77506e6f1a01 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.275899 Oct 03 10:33:33.550246 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 456/875] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:33 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:33.589235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:33.590054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:33.601107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.604643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.606190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:33.608137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:33.610329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:33.611758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.147560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:34.159341 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2a69b384-38c6-4d50-8f7a-0527a5fcdde7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1476 microversion: 2.1 time: 0.576154 Oct 03 10:33:34.178909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:34.180828 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 457/876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:33 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1476 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:34.189082 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b0d3ce5-5e75-4e7e-a4e0-9a42ed7998c2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.756254 Oct 03 10:33:34.190015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:34.201232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:34.201232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.201232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.201232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.201959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.208212 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 420/877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:33 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:34.208584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.209312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.217107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-766f3384-269f-4a11-9f83-797be4a6e0ec req-aac96e44-16ea-439f-95ff-b2d7e9cc018d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4", "tag": "a89a8059-2a12-495e-b540-36d4fb268a64"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:34.239177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-766f3384-269f-4a11-9f83-797be4a6e0ec req-aac96e44-16ea-439f-95ff-b2d7e9cc018d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.239884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-766f3384-269f-4a11-9f83-797be4a6e0ec req-aac96e44-16ea-439f-95ff-b2d7e9cc018d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.240603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-766f3384-269f-4a11-9f83-797be4a6e0ec req-aac96e44-16ea-439f-95ff-b2d7e9cc018d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.257339 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-766f3384-269f-4a11-9f83-797be4a6e0ec req-aac96e44-16ea-439f-95ff-b2d7e9cc018d service nova] Creating event network-changed:a89a8059-2a12-495e-b540-36d4fb268a64 for instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 on n-h2-858383-3 Oct 03 10:33:34.267190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-766f3384-269f-4a11-9f83-797be4a6e0ec req-aac96e44-16ea-439f-95ff-b2d7e9cc018d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057089 Oct 03 10:33:34.270865 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 421/878] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:34.286497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:34.289488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:34.322259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.322763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.323202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.327491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.328269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.332618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.461961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:34.476252 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba803108-6040-486a-9333-4504afb86f2c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.293182 Oct 03 10:33:34.480831 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 458/879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:34 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:34.493558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:34.498070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:34.518628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.519422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.519861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.520603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.522004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.522956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.611815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:34.622756 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-31aadf02-f57b-41ee-ad48-9edf2c2b04da tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1303 microversion: 2.1 time: 0.143402 Oct 03 10:33:34.623993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 459/880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:34 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:34.634082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:34.648053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:34.656843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.657938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.658577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.659541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.660361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.661075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.795247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:34.853225 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-95ab75cf-a5cb-48fe-bb1c-943f25bb9621 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.226755 Oct 03 10:33:34.856440 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 460/881] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:34 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:34.867781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:34.868712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:34.877321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.878079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.881716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:34.891832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:34.893491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.894433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:34.895437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:34.896019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:34.898564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:34.900347 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4be1b0ec-412d-47b4-93a6-a29a08b145db tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.628052 Oct 03 10:33:34.917799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 422/882] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:34 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:35.010830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:35.020782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:35.022256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:35.026723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:35.028609 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-316c2560-5c4b-445d-aa75-7a46d8aaa569 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.170319 Oct 03 10:33:35.029632 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 461/883] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:34 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:35.189276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:35.190275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:35.201093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.201404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.201855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.203107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.207991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.220366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.222427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:35.223055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:35.240308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.241284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.242229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.243164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.243637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.244073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.246237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:35.486457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:35.495040 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2f017179-31e8-4340-9210-b523f9f5aba2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1474 microversion: 2.1 time: 0.309451 Oct 03 10:33:35.495551 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 423/884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:35 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1474 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:35.513636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:35.514435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:35.522076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.522568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.523006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.523707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.524187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.524611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.690410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:35.710797 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbcebde9-2fa8-45e9-93c4-05d45366fb42 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.208900 Oct 03 10:33:35.711406 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 424/885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:35 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:35.716008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:35.716893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:35.723566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.724281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.724884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.725909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.726618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.727591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.805046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:35.815091 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43f30646-535e-46f8-9e41-90c9c32e70c1 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.603350 Oct 03 10:33:35.818142 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 462/886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:35 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:35.890142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:35.891070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:35.898574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.900031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.900629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.901799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.902803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.903192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.923071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:35.934929 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b586f764-cf44-4859-aeec-d9f74b2ada13 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.222141 Oct 03 10:33:35.953573 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 425/887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:35 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:35.958416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:35.959255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:35.966774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.967704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.968406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:35.970923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:35.971561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:35.972039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.024111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:36.066358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1baaa5ab-a351-407d-8c04-661e62cf6ebd tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.179979 Oct 03 10:33:36.077131 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 463/888] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:35 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:36.081998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:36.082650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:36.094177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.094692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.095128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.095845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.096307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.096735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.151473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:36.161668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:36.163316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:36.164787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b9cfc98-3335-41f0-9094-46a56086119f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.209987 Oct 03 10:33:36.165409 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 426/889] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:35 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:36.283251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:36.291664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:36.293316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:36.304883 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d06bee3-19c3-4b3b-9348-33658e6af786 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.226259 Oct 03 10:33:36.307100 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 464/890] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:36 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:36.520330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:36.521125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:36.531068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.531915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.532900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.533881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.534342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.535300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.722743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:36.732919 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ecbd7f5-d9f3-404d-962b-d4f43ca857d7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1474 microversion: 2.1 time: 0.216198 Oct 03 10:33:36.733748 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 427/891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:36 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:36.734943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:36.735565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:36.743348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.743867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.746152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.748568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.749623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.750097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.848547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:36.849472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:36.858342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.859210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.859919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:36.860835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:36.861529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:36.862191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.016636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.021403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:37.028074 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-985af939-667d-4d86-91be-eea529d76fb0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.296774 Oct 03 10:33:37.029035 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 465/892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:36 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:37.034360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:37.035252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:37.041994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.042605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.043265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.044086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.044647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.045196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.118605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.127260 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09f77cb7-4e0d-4687-886e-462facda70d6 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.287422 Oct 03 10:33:37.129407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 428/893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:36 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:37.144557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:37.145196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:37.160342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.160905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.161287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.165331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.166239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.166921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.241375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.254712 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de4b82e3-fc29-43cd-ad06-83f0a44197b3 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.224237 Oct 03 10:33:37.255873 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 466/894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:37 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:37.261689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:37.262442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:37.270464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.271219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.271754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.272530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.273119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.273624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.361829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:37.391560 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4a19ce5a-5b0f-451c-b229-4c903a14518e tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1927 microversion: 2.75 time: 0.255844 Oct 03 10:33:37.405911 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 429/895] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:37 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1927 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:37.420966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:37.422590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:37.436289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.437786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.439338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.441331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.441913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.443509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.459350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.486151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.492407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.493917 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ed7d992-397e-4e3f-9152-482086ace3e8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.237018 Oct 03 10:33:37.510541 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 467/896] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:37 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:37.518848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4ffb4372-42bc-40fe-b81b-36a6397ce05a req-6473451c-555c-4635-bc0c-2d61283cf3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ec7889-ef50-4158-a548-945a648bbd6f", "name": "network-vif-unplugged", "status": "completed", "tag": "de529bdc-d7ad-4cfd-bf71-a8bca22179f9"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:37.528980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4ffb4372-42bc-40fe-b81b-36a6397ce05a req-6473451c-555c-4635-bc0c-2d61283cf3e6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.529500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4ffb4372-42bc-40fe-b81b-36a6397ce05a req-6473451c-555c-4635-bc0c-2d61283cf3e6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.530121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4ffb4372-42bc-40fe-b81b-36a6397ce05a req-6473451c-555c-4635-bc0c-2d61283cf3e6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.545732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4ffb4372-42bc-40fe-b81b-36a6397ce05a req-6473451c-555c-4635-bc0c-2d61283cf3e6 service nova] Creating event network-vif-unplugged:de529bdc-d7ad-4cfd-bf71-a8bca22179f9 for instance f1ec7889-ef50-4158-a548-945a648bbd6f on n-h2-858383-3 Oct 03 10:33:37.556102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-4ffb4372-42bc-40fe-b81b-36a6397ce05a req-6473451c-555c-4635-bc0c-2d61283cf3e6 service nova] Instance f1ec7889-ef50-4158-a548-945a648bbd6f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:33:37.561305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.565289 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4ffb4372-42bc-40fe-b81b-36a6397ce05a req-6473451c-555c-4635-bc0c-2d61283cf3e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050174 Oct 03 10:33:37.566962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 468/897] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:37.571847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.573344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:37.578902 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b7c863c-ffd1-40b8-a544-e0b3494edc50 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.171782 Oct 03 10:33:37.580198 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 430/898] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:37 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:37.758748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:37.760396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:37.771844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.780310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.781676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:37.782632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:37.783530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:37.784133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.059082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:38.059851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:38.066210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.067012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.067670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.068721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.069413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.070028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.156873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.170095 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43a26eee-6289-43ac-80b2-7d9b4a5d3f75 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1474 microversion: 2.1 time: 0.416658 Oct 03 10:33:38.171184 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 469/899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:37 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1474 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:38.181978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:38.186654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:38.199182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.199865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.201332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.208337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.209079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.209608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.255598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.265643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68385dfe-afc7-4282-878d-9562c7c6cc71 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.209904 Oct 03 10:33:38.279899 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 431/900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:38 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:38.285953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:38.286664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:38.299240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:38.300790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.301326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.301864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.302977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.303106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.303611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.474731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.484279 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3400682-b0f0-44b4-a23b-770cfba388d4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.201926 Oct 03 10:33:38.501550 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 432/901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:38 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:38.507001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:38.507331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:38.514039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.514497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.515504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.516210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.517036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.517483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.602262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.611842 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eace73fc-bdf3-453e-9d59-d9e3bfe25c91 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.438928 Oct 03 10:33:38.612729 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 470/902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:38 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:38.614232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:38.619647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:38.627685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:38.634595 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5f126c0-d3e3-481e-bc2d-9e1ab3f5d65a tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.131849 Oct 03 10:33:38.635662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.636066 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 433/903] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:38 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:38.636615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.637840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.638988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.639660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.640924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.641497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:38.642104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:38.650329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.650911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.651424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.652205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:38.652731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:38.653315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:38.726138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.736449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.738665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.744616 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-857607d2-9623-4b6d-83f3-611c1d0ba9d0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.107387 Oct 03 10:33:38.745977 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 434/904] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:38 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:38.843859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.859557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.861985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:38.863671 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-34c67c4c-7c77-4793-89d2-c7b6fd91a0c3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.249644 Oct 03 10:33:38.865824 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 471/905] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:38 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:39.195294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:39.196220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:39.205932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.213439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.214028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.214650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.215117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.215550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.292796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:39.292796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:39.300449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.301430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.302560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.303982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.305054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.305805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.508419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:39.516885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:39.520185 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fed6e418-dc94-415a-8e6e-7d8595d915b8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1474 microversion: 2.1 time: 0.328970 Oct 03 10:33:39.521744 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 435/906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:39 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:39.526667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:39.527545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:39.535001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.535850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.536515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.537459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.538274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.539077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.562506 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e65a7d3c-52a5-47b0-833d-5ce7a758e072 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.275188 Oct 03 10:33:39.563367 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 472/907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:39 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:39.639446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:39.640953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:39.654556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.656048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.657057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.659350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.660715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.662343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.821485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:39.832433 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a570b3d-bf79-4b1b-8c28-40dba062db1e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.309326 Oct 03 10:33:39.836640 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 436/908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:39 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:39.852695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:39.858747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:39.880128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.880626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.881643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:39.882356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:39.882810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:39.883243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.010560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:40.048136 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96d44eba-e9b6-4067-8d3f-e065904da2e8 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.208120 Oct 03 10:33:40.063995 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 437/909] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:39 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:40.063995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:40.063995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:40.075481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.075481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.075481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.076157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.077089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.078361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.078791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.085784 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a2df1ff-0de7-4d2a-b08e-8b5a65be986b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.450863 Oct 03 10:33:40.109778 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 473/910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:39 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:40.115020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:40.125708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:40.133062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.141331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.142072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.143226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.144258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.145227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.243149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.263447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.265720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.273603 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-76ca978e-942c-4da4-be96-125b6b8b1e8b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.220444 Oct 03 10:33:40.273603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 438/911] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:40 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:40.395628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:40.423431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.435353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.438022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.439378 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3c59ee4e-a046-48a0-93d3-b20c334eca34 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.328282 Oct 03 10:33:40.441128 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 474/912] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:40 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:40.548331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:40.549466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:40.582600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.583237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.583690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.584463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.588021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.588548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.591464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:40.592541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:40.604861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:40.605117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=18 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:40.608315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.609354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.609788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.614794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.615291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.615711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.860258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.870388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b2b6ef1-6ce5-4043-8962-f28d1ad9eca6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.283861 Oct 03 10:33:40.871110 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 475/913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:40 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:40.890731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:40.891535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:40.898807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.899493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.899943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.900667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:40.901214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:40.901660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:40.917163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:40.956122 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-369e577a-2ed5-4656-83bc-eb971aa17efb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1474 microversion: 2.1 time: 0.412984 Oct 03 10:33:40.968836 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 439/914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:40 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1474 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:41.081817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:41.082493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:41.093670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.097120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.098295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.103752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.105959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.117974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.317138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.321898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:41.328325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f84797d5-7733-432a-b452-f1633f0c1273 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.455518 Oct 03 10:33:41.348132 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 476/915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:40 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:41.360368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:41.362842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:41.364801 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e98586a-ca76-4d59-9b93-2c41d5173950 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.287424 Oct 03 10:33:41.365661 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 440/916] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:41 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:41.371057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:41.371667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:41.379703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.387311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.387311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.387311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.387311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.388032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.399078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.399647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.400013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.400738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.401233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.406365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.512927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.528623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.537118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.545824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56c0f620-7e1d-40b2-86d9-1030bfe23402 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.178038 Oct 03 10:33:41.551866 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 441/917] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:41 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:41.567066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:41.567741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:41.579526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.582302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.582767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.587020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.587130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.587899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.755264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.794313 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7bf06253-07c3-4598-b908-0a052108e5a3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.444650 Oct 03 10:33:41.798827 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 477/918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:41 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:41.845920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.848446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:41.867452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.874006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:41.875605 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-750dcefc-df0c-4728-a78b-7ca0ca8316a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.322782 Oct 03 10:33:41.876326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 442/919] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:41 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:41.896363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:41.897211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:41.907412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.909066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.909874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.910944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.911829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.912754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.918566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6e0b3fb1-4f70-498b-bfe6-aebca59637a9 req-a704c076-f6b3-464a-9bf3-0dfc34a206f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4", "name": "network-vif-plugged", "status": "completed", "tag": "a89a8059-2a12-495e-b540-36d4fb268a64"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:41.939507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e0b3fb1-4f70-498b-bfe6-aebca59637a9 req-a704c076-f6b3-464a-9bf3-0dfc34a206f5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:41.944811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e0b3fb1-4f70-498b-bfe6-aebca59637a9 req-a704c076-f6b3-464a-9bf3-0dfc34a206f5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:41.945385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e0b3fb1-4f70-498b-bfe6-aebca59637a9 req-a704c076-f6b3-464a-9bf3-0dfc34a206f5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:41.963089 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6e0b3fb1-4f70-498b-bfe6-aebca59637a9 req-a704c076-f6b3-464a-9bf3-0dfc34a206f5 service nova] Creating event network-vif-plugged:a89a8059-2a12-495e-b540-36d4fb268a64 for instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 on n-h2-858383-3 Oct 03 10:33:41.969862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6e0b3fb1-4f70-498b-bfe6-aebca59637a9 req-a704c076-f6b3-464a-9bf3-0dfc34a206f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056531 Oct 03 10:33:41.970795 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 443/920] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:41.993495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:41.994794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:42.004240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.005158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.006201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.008124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.008963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.010238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.357928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:42.365360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:42.381632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2931d946-f1ad-4f82-9127-4bc53bcbbdbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.489966 Oct 03 10:33:42.404096 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 478/921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:41 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:42.409595 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a82a98d6-f535-42b5-aa4c-39a098991b6d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1474 microversion: 2.1 time: 0.425358 Oct 03 10:33:42.410597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:42.411504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:42.417454 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 444/922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:41 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1474 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:42.426165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:42.428829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:42.442004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.442562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.443003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.443818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.444273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.444664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.444811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.445423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.445950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.446800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.447265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.448226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.600982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:42.705827 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7ae0f89c-8ab4-44bc-a1be-378fa3bee424 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.259309 Oct 03 10:33:42.705827 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 445/923] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:42 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:42.705827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:42.705827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:42.711800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.712400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.712748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.714015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.714483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.714910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.824281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:42.841336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:42.844413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:42.850857 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1cfb2951-442f-4afd-98f2-503cf2462712 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.169281 Oct 03 10:33:42.851708 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 446/924] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:42 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:42.865047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:42.865047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:42.867006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.868055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.874925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.874925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:42.874925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:42.874925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:42.995534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:43.006476 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-84886e5f-183d-4ad4-ba46-45eda40d12ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.601045 Oct 03 10:33:43.010951 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 479/925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:42 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:43.016991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:43.018201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:43.025050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.026128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.026857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.034368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.034960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.035816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.115032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:43.160273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d25197c-7151-46c2-ba2d-d38b35fc51b2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.307259 Oct 03 10:33:43.172860 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 447/926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:42 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:43.267961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:43.276597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:43.278234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:43.279446 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33ea5287-9f88-4a5c-8651-ba1e33fa3a25 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.267216 Oct 03 10:33:43.280224 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 480/927] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:43 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:43.419907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:43.420870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:43.427551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.428222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.428724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.429637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.430170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.430667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.440608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:43.441825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:43.451144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.451883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.452615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.453656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.454265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.455005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.667651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:43.677879 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-925e6b54-78d8-4261-bf07-689dde66fbdb tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.261992 Oct 03 10:33:43.678744 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 448/928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:43 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:43.684283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-25b468b5-7ee3-424c-ae2f-1e51848c371b req-55f281e6-d70a-43d5-80ba-e1642e99ed98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483b0eff-2eb2-45a1-a1df-c3526b899003", "tag": "276c6807-4487-4e1a-a016-1ca442f76c12"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:43.696232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-25b468b5-7ee3-424c-ae2f-1e51848c371b req-55f281e6-d70a-43d5-80ba-e1642e99ed98 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.696714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-25b468b5-7ee3-424c-ae2f-1e51848c371b req-55f281e6-d70a-43d5-80ba-e1642e99ed98 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.697548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-25b468b5-7ee3-424c-ae2f-1e51848c371b req-55f281e6-d70a-43d5-80ba-e1642e99ed98 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.710534 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-25b468b5-7ee3-424c-ae2f-1e51848c371b req-55f281e6-d70a-43d5-80ba-e1642e99ed98 service nova] Creating event network-changed:276c6807-4487-4e1a-a016-1ca442f76c12 for instance 483b0eff-2eb2-45a1-a1df-c3526b899003 on n-h2-858383-3 Oct 03 10:33:43.715698 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-25b468b5-7ee3-424c-ae2f-1e51848c371b req-55f281e6-d70a-43d5-80ba-e1642e99ed98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035596 Oct 03 10:33:43.716293 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 449/929] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:43.726838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:43.735765 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1288d988-5b13-4c12-85b1-cc03250d9cfb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1474 microversion: 2.1 time: 0.300058 Oct 03 10:33:43.736903 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 481/930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:43 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1474 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:43.747975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:43.750063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:43.757286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.757906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.758441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.759249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.759802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.760339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.840031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:43.858263 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53316b11-aa32-4487-be44-89a4ae088670 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.121578 Oct 03 10:33:43.858996 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 450/931] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:43 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:33:43.886918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:43.888533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:43.899209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.899947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.900565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:43.901728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:43.902197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:43.902626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:44.011831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:44.016017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:44.022422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:44.023894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:44.030280 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8f5858a7-eff5-461f-b62c-0a085b4a5182 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.149814 Oct 03 10:33:44.032125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 482/932] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:43 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:44.048839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:44.050255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:44.060954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:44.061630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:44.062303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:44.063097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:44.063562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:44.064183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:44.185600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:44.186616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:44.199089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:44.200004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:44.200664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:44.201716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:44.202894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:44.203529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:44.600644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:44.609006 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ea0241b-35a5-4294-9062-e090a78eca30 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.576700 Oct 03 10:33:44.621330 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 451/933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:44 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:44.630340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:44.631263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:44.639189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:44.641812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:44.642523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:44.643463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:44.644107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:44.644697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:44.947718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:44.965726 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b3673ecd-6fcb-4d42-8a8a-66fed074af0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.783648 Oct 03 10:33:44.984619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:44.985702 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 483/934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:44 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:44.990719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:44.995255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:44.999638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:45.000272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:45.001499 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f99233cb-e103-42af-a3f6-302b9652eae6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.379075 Oct 03 10:33:45.012798 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 452/935] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:44 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:45.013005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.013005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.013005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.013005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.013310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.013310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.019351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:45.019976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:45.037097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.037602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.038276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.040836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.041651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.043004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.216164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:45.230948 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b2652011-422b-45bf-836b-61eaf3e02ccb tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1471 microversion: 2.1 time: 0.222422 Oct 03 10:33:45.231829 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 453/936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:45 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1471 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:45.258467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:45.259104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:45.282106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.282662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.283374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.284102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.284565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.285021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.398229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:45.413550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:45.426548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42140bb8-643c-4e94-8b4e-a862a0db6c69 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.439433 Oct 03 10:33:45.426954 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 484/937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:44 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:45.440698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:45.447112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:45.466925 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf4392d3-67ec-4986-bfd9-717de2cb8ddc tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.233497 Oct 03 10:33:45.467203 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 454/938] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:45 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:45.470911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.471415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.471851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.474780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.478779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.482928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:45.483704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.494954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:45.517370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.518721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.519335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.520230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.520875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.521467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.566749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:45.594145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:45.606573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:45.608146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:45.614501 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93b02d11-24c9-426d-832d-f224e5727787 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.186395 Oct 03 10:33:45.615318 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 485/939] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:45 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:45.633290 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37b6d868-e618-4943-adf4-ccc13947c22f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f/action" status: 204 len: 0 microversion: 2.1 time: 0.164773 Oct 03 10:33:45.636192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:45.637106 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 455/940] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:33:45 2022] POST /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f/action => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:33:45.637257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:45.644322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:45.645474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:45.647014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.647515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.648224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.649558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.650229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.650812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.652744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.653558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.654217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:45.655282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:45.655971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:45.656602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.002442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.013356 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-82337978-10df-4cb6-8337-e9519c4e5c9d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.380773 Oct 03 10:33:46.014572 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 486/941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:45 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:33:46.020049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:46.020792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:46.027061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.027664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.028202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.029268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.030094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.031672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.064945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.074662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42db8f8e-7494-4ca7-bc9a-b9fb0fa072b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1471 microversion: 2.1 time: 0.435364 Oct 03 10:33:46.076814 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 456/942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:45 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:46.083851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:46.085538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:46.092960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.096937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.097656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.098565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.099218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.099677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.321299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.333409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.334864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.336002 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-583ab44d-84c2-4b8a-94cc-c383ed5c487f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1362 microversion: 2.25 time: 0.258010 Oct 03 10:33:46.348793 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 457/943] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:46 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:46.449005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:46.449630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:46.463952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.464492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.464973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.465685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.466141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.466567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.607120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.620440 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a435d8d5-d080-47fb-beec-50e0110980ff tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.604605 Oct 03 10:33:46.622381 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 487/944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:46 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:46.642490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:46.643367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:46.652114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.661677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.662148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.662913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.663390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.663826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.746244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.766006 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d49bd5a-714b-40d3-85bc-07b40045842d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.320893 Oct 03 10:33:46.767434 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 458/945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:46 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:46.776671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:46.783686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:46.809582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.810145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.811863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.812653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.813164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.813602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.873681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:46.900611 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-499998df-0f8c-4f4a-8502-6091a7ec7d56 tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.277138 Oct 03 10:33:46.902991 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 488/946] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:46 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:46.909375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5010461b-1a37-4df1-acd9-70055637b00c req-73d9dd44-af1a-49ea-a6e2-66835ac6b68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0654af6f-0bf5-409f-aff3-fedeec38a352", "name": "network-vif-unplugged", "status": "completed", "tag": "fff89d8c-bb3a-4906-8c8b-c7845f09ec8c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:46.920357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5010461b-1a37-4df1-acd9-70055637b00c req-73d9dd44-af1a-49ea-a6e2-66835ac6b68b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:46.920568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.921495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5010461b-1a37-4df1-acd9-70055637b00c req-73d9dd44-af1a-49ea-a6e2-66835ac6b68b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:46.922149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5010461b-1a37-4df1-acd9-70055637b00c req-73d9dd44-af1a-49ea-a6e2-66835ac6b68b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:46.938455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.939914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:46.940339 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5010461b-1a37-4df1-acd9-70055637b00c req-73d9dd44-af1a-49ea-a6e2-66835ac6b68b service nova] Creating event network-vif-unplugged:fff89d8c-bb3a-4906-8c8b-c7845f09ec8c for instance 0654af6f-0bf5-409f-aff3-fedeec38a352 on n-h1-858383-3 Oct 03 10:33:46.946068 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4bbdadd9-35ad-411a-857b-55c6e5489604 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.175878 Oct 03 10:33:46.947463 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 459/947] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:46 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:46.950554 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5010461b-1a37-4df1-acd9-70055637b00c req-73d9dd44-af1a-49ea-a6e2-66835ac6b68b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045630 Oct 03 10:33:46.951443 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 489/948] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:47.036570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:47.037212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:47.045231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.045784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.046266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.051271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.051846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.052479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.114817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:47.117837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:47.154231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.156461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.162784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.163796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.164443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.165075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.486192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:47.494718 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-356bd228-520e-463c-bf4f-bac701606135 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.461499 Oct 03 10:33:47.494718 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 460/949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:47 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:47.513638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:47.514326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:47.521273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.521767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.522208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.522927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.523496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.523799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.681925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:47.692218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:47.693792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:47.695577 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bbb3c2a6-a98a-4536-91bc-3026f364b734 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1558 microversion: 2.25 time: 0.193604 Oct 03 10:33:47.700355 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 461/950] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:47 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1558 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:47.705378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0697c738-0345-4005-aef0-897b21872b86 req-ef92a23b-a0e8-4620-b340-cc68fc52278e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ec7889-ef50-4158-a548-945a648bbd6f", "name": "network-vif-plugged", "status": "completed", "tag": "de529bdc-d7ad-4cfd-bf71-a8bca22179f9"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:47.715203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0697c738-0345-4005-aef0-897b21872b86 req-ef92a23b-a0e8-4620-b340-cc68fc52278e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.715688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0697c738-0345-4005-aef0-897b21872b86 req-ef92a23b-a0e8-4620-b340-cc68fc52278e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.716129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0697c738-0345-4005-aef0-897b21872b86 req-ef92a23b-a0e8-4620-b340-cc68fc52278e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.736548 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0697c738-0345-4005-aef0-897b21872b86 req-ef92a23b-a0e8-4620-b340-cc68fc52278e service nova] Creating event network-vif-plugged:de529bdc-d7ad-4cfd-bf71-a8bca22179f9 for instance f1ec7889-ef50-4158-a548-945a648bbd6f on n-h2-858383-3 Oct 03 10:33:47.745422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-0697c738-0345-4005-aef0-897b21872b86 req-ef92a23b-a0e8-4620-b340-cc68fc52278e service nova] Instance f1ec7889-ef50-4158-a548-945a648bbd6f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:33:47.755865 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0697c738-0345-4005-aef0-897b21872b86 req-ef92a23b-a0e8-4620-b340-cc68fc52278e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054218 Oct 03 10:33:47.757527 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 462/951] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:47.764149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:47.765185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:47.771798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.772564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.773196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.774077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.775005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.775702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.931547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:47.944096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-971cce90-70d0-4695-a600-17eea74218f4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1471 microversion: 2.1 time: 0.847796 Oct 03 10:33:47.947304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 490/952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:47 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1471 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:47.953105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:47.958609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:47.978435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.979225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.980081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:47.981167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:47.981842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:47.982485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.013318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:48.025371 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9609a5a1-ae2e-40a3-8400-0162ae30efb3 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.266438 Oct 03 10:33:48.026545 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 463/953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:47 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:48.038050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:48.039488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:48.045835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.046901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.047351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.048073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.048529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.049987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.200526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:48.208944 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b6aa5a51-690f-433f-b040-f31d29d978c6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.181229 Oct 03 10:33:48.209519 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 464/954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:48 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:48.216285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:48.217060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:48.223906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.224610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.225248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.226112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.226567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.227026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.311469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:48.332803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:48.362683 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7cae24f7-8add-4163-b765-e50bf9a52e84 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 2051 microversion: 2.25 time: 0.414017 Oct 03 10:33:48.380979 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b82a605b-5dd5-4f1e-9efe-0e39d19a999b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1933 microversion: 2.75 time: 0.166103 Oct 03 10:33:48.380979 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 465/956] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:48 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1933 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:48.381439 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 491/956] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:47 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 2051 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:48.391483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:48.392294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:48.398876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:48.399220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.399893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.400498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.401178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:48.401635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.402268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.402856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.427224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.427728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.428166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.428966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.429472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.429892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.628189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:48.640940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:48.642685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:48.649451 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f2518ee-cf0e-4c17-9f54-e13b112945d6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.268540 Oct 03 10:33:48.652895 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 466/957] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:48 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:48.657834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:48.659029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:48.665644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.666322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.666912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.668145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.668753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.669528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.821528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:48.856920 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff8325e8-18fb-48ab-81fe-cd0330f3a591 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 2051 microversion: 2.25 time: 0.469963 Oct 03 10:33:48.859483 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 492/958] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:48 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 2051 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:33:48.885058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:48.895095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.895541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.895985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.896901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.897276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.897701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.936667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2b69cac-17cd-499d-b1c4-cc1266034e88 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054621 Oct 03 10:33:48.947976 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 493/959] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 3 10:33:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:33:48.953295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:48.954208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:48.970140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.970556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.970997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:48.971705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:48.972161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:48.972589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.032791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:49.044276 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-84364bc1-5168-4110-b585-0042736fb1d9 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.392648 Oct 03 10:33:49.066643 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 467/960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:48 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:49.071610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:49.072618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:49.084118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.084622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.087045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.087802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.088280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.088687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.102057 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-89f0b833-4528-4d5e-a4e4-47a3106611e7 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4/action" status: 202 len: 0 microversion: 2.25 time: 0.152499 Oct 03 10:33:49.110753 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 494/961] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:33:48 2022] POST /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:33:49.118535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-076ed7a2-43cb-4ac5-9407-178333cac3e7 req-7df2495c-88af-4e9b-bd2f-f962ad408f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0654af6f-0bf5-409f-aff3-fedeec38a352", "tag": "fff89d8c-bb3a-4906-8c8b-c7845f09ec8c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:49.144571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-076ed7a2-43cb-4ac5-9407-178333cac3e7 req-7df2495c-88af-4e9b-bd2f-f962ad408f1f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.149740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-076ed7a2-43cb-4ac5-9407-178333cac3e7 req-7df2495c-88af-4e9b-bd2f-f962ad408f1f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.152366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-076ed7a2-43cb-4ac5-9407-178333cac3e7 req-7df2495c-88af-4e9b-bd2f-f962ad408f1f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.180743 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-076ed7a2-43cb-4ac5-9407-178333cac3e7 req-7df2495c-88af-4e9b-bd2f-f962ad408f1f service nova] Creating event network-changed:fff89d8c-bb3a-4906-8c8b-c7845f09ec8c for instance 0654af6f-0bf5-409f-aff3-fedeec38a352 on n-h1-858383-3 Oct 03 10:33:49.186507 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-076ed7a2-43cb-4ac5-9407-178333cac3e7 req-7df2495c-88af-4e9b-bd2f-f962ad408f1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073475 Oct 03 10:33:49.187709 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 495/962] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:49.193846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:49.194741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:49.204688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.205422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.206234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.207116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.207728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.208316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.364238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:49.379668 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5b325f0-be3d-4b95-ae79-9e6f2142059d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1471 microversion: 2.1 time: 0.310485 Oct 03 10:33:49.380830 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 468/963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:49 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:49.386405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:49.387224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:49.395981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:49.397659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.399140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.400021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.400974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.402380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.403142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.709948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:49.723165 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5433b487-a78e-4a4c-8d10-936fb2a91577 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.534033 Oct 03 10:33:49.724050 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 496/964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:49 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:49.728810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:49.729593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:49.733244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:49.737594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.738092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.738535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.739238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.739862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.740580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.748345 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-16cc8c94-9522-4531-9a4d-32ce0a351ab5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 2056 microversion: 2.25 time: 0.366298 Oct 03 10:33:49.759200 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 469/965] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:49 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 2056 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:49.759200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:49.759200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:49.764991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.766284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.766284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.766880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.768048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.768848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.853060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:49.857020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] Lazy-loading 'services' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:49.878448 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ef47dabb-5b33-4ea4-a7fb-f542d22f612b tempest-ServersAdmin275Test-620520392 tempest-ServersAdmin275Test-620520392-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1918 microversion: 2.75 time: 0.127027 Oct 03 10:33:49.879034 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 470/966] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:49 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1918 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:49.884923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:49.885740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:49.891777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.892511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.892979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.893677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:49.894289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:49.894874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:49.987110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:49.992258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:49.995342 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-884a1e95-0bfc-48cd-b149-b2e85b9a804d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.270074 Oct 03 10:33:49.996117 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 497/967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:49 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:50.002762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:50.004718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:50.010819 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe71a72a-afd7-41f4-9578-407c450c7552 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.130567 Oct 03 10:33:50.013139 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 471/968] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:49 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:50.028707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:50.034710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:50.041599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.042438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.042886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:50.044218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.044679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.045131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:50.073087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:33:50.073498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:50.074175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:50.081580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.082073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.082515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:50.083257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.083716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.084140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:50.105008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:50.170045 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f0ea0839-453d-4b16-9e99-8cdc521a7069 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 204 len: 0 microversion: 2.75 time: 0.172407 Oct 03 10:33:50.170811 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 498/969] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:33:49 2022] DELETE /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:33:50.384421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe18cf7a-606a-41ec-a352-81c916a472eb tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Action: 'create', calling method: .version_select at 0x7f074f8303a0>, body: {"pool": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:50.624133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:50.632185 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3a10e78c-2719-45d6-b885-ca298ba4dfc7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.562405 Oct 03 10:33:50.633091 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 472/970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:50 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:50.646307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:50.646924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:50.654458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.655185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.656360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:50.657734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.658611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.659187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:50.758872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:50.775518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:50.779315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:50.786676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-003eae3f-7c9d-4d0f-a1ae-e72dc54662a6 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1443 microversion: 2.75 time: 0.152967 Oct 03 10:33:50.787876 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 473/971] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:50 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:50.792919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:50.793735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:50.800698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.801535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.801992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:50.802754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:50.803222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:50.803658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.095230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:51.105194 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7d85ac5-0b0a-4ce1-953b-861182ab36b2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1463 microversion: 2.1 time: 0.315943 Oct 03 10:33:51.106440 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 474/972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:50 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1463 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:51.111747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:51.112360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:51.118317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.118931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.119374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.120092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.120553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.120998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.285825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:51.294234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96f62bb9-a8e1-495d-8362-4602378ee699 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.186540 Oct 03 10:33:51.295224 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 475/973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:51 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:51.300965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:51.301828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:51.308677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.309466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.310293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.311373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.312594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.313217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.458979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:51.476756 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b2898227-5b3b-4a72-9d3d-092e7b4b7d0a tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 2036 microversion: 2.25 time: 0.180063 Oct 03 10:33:51.495611 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 476/974] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:51 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 2036 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:51.500610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:51.501331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:51.509683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.510276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.510800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.511637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.512694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.512694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.658056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:51.666809 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-00179687-680d-425b-b6fc-e2de58bc20e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.171540 Oct 03 10:33:51.672812 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 477/975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:51 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:51.673114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1c1b5092-9cbc-495c-b96e-42fcb88298ef req-febd7ee5-794a-4496-bbf1-19d9c8d944cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58627021-c0f0-46b7-b841-a30e90028959", "name": "network-vif-plugged", "status": "completed", "tag": "780bd99c-62a9-42b2-8345-af7d10aee9c4"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:51.682587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1c1b5092-9cbc-495c-b96e-42fcb88298ef req-febd7ee5-794a-4496-bbf1-19d9c8d944cb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.683547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1c1b5092-9cbc-495c-b96e-42fcb88298ef req-febd7ee5-794a-4496-bbf1-19d9c8d944cb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.683547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1c1b5092-9cbc-495c-b96e-42fcb88298ef req-febd7ee5-794a-4496-bbf1-19d9c8d944cb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.694885 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1c1b5092-9cbc-495c-b96e-42fcb88298ef req-febd7ee5-794a-4496-bbf1-19d9c8d944cb service nova] Creating event network-vif-plugged:780bd99c-62a9-42b2-8345-af7d10aee9c4 for instance 58627021-c0f0-46b7-b841-a30e90028959 on n-h1-858383-3 Oct 03 10:33:51.699909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1c1b5092-9cbc-495c-b96e-42fcb88298ef req-febd7ee5-794a-4496-bbf1-19d9c8d944cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030731 Oct 03 10:33:51.700422 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 478/976] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:51.705554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:51.706243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:51.712469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.713133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.713722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.714291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.714748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.715253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.797624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:51.806647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:51.808689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:51.819074 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0a4e9b7d-7596-4e1f-8836-eaa857159837 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1533 microversion: 2.91 time: 0.116145 Oct 03 10:33:51.819858 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 479/977] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:51 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1533 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:51.824349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:51.824980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:51.831823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.832376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.832760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.833721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:51.833938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:51.834386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:51.984610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:51.992744 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e31adf15-91e4-4288-bf52-6bdd01f8c637 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1463 microversion: 2.1 time: 0.172000 Oct 03 10:33:51.993542 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 480/978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:51 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1463 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:51.998700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-3", "block_migration": "auto"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:52.002014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:52.010857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:52.011606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:52.012684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:52.013614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:52.014068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:52.014659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:52.043228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'flavor' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:52.056488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Going to try to live migrate instance to n-h1-858383-3 {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:33:52.821460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe18cf7a-606a-41ec-a352-81c916a472eb tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.647557 Oct 03 10:33:52.828954 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 499/979] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:33:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:52.836451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:52.838152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:52.848232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:52.848731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:52.849200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:52.850042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:52.850512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:52.850945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.135878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:53.144052 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d1e40bd1-1eb7-48c5-aa22-781932887292 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.319801 Oct 03 10:33:53.144640 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 500/980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:52 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:53.151429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:53.152042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:53.162415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.162914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.163382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.164088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.164546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.165185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.233273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:53.242738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:53.244184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:53.249764 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53d03a73-62f3-4f98-895a-db93e63a15b4 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1443 microversion: 2.75 time: 0.101953 Oct 03 10:33:53.250168 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 501/981] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:53 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:53.254751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:53.255374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:53.257561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:53.262272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.262747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.263177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.263862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.264310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.264975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.350813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lazy-loading 'services' on Instance uuid bd7aa640-cc81-4558-8a95-020b29cfebd9 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:53.375999 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-80ac7da2-fd14-46df-abe8-77e4faaf1029 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1938 microversion: 2.91 time: 0.124673 Oct 03 10:33:53.388799 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 502/982] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:53 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1938 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:53.388799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71fd9587-ba4f-4c56-b241-dec36d9a64b6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'create', calling method: .version_select at 0x7f074f8b71f0>, body: {"keypair": {"name": "tempest-keypair-212917802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUK2lbrVMigssiep/1iSa0PKJRDjq+ULYZkqzAn5LA5Dh/BpVX/g/mywVhvsMJnNJLOwB/OR5j6QXIvFtePvl3FAN4xI2TMApRX3pgcj1Y1EXi31RT9p0SHgMheGgaAkQ=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:53.402834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-71fd9587-ba4f-4c56-b241-dec36d9a64b6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:33:53.414033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-71fd9587-ba4f-4c56-b241-dec36d9a64b6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for user fa6ea468370b4bacb98dd5457b0e6aea and project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:33:53.440478 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71fd9587-ba4f-4c56-b241-dec36d9a64b6 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062067 Oct 03 10:33:53.441167 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 503/983] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:33:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:53.445813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:53.446471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:53.453475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.453971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.454394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.455085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.455539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.456022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.661888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:53.670049 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb501146-4b22-407f-9ed2-ce08cf257036 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1313 microversion: 2.1 time: 0.227856 Oct 03 10:33:53.670873 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 504/984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:53 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:53.690774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:53.691412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:53.697465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.700737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.700737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.700737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:53.700737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:53.701255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:53.863556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:53.871989 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0729bd42-91fd-4cb3-96e1-500991a7410e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.185561 Oct 03 10:33:53.872576 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 505/985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:53 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:53.877905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac79e0ef-f759-445b-9b5f-53cba4a751f5 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Calling method '.version_select at 0x7f074f802af0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:54.166060 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac79e0ef-f759-445b-9b5f-53cba4a751f5 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/4272bcdf-d257-4584-829d-31e5dde1391b" status: 200 len: 142 microversion: 2.1 time: 0.291947 Oct 03 10:33:54.166737 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 506/986] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:33:53 2022] GET /compute/v2.1/os-floating-ips/4272bcdf-d257-4584-829d-31e5dde1391b => generated 142 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:54.179317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:54.179977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:54.186133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:54.186701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:54.187716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:54.188414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:54.188906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:54.189337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:54.212115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lazy-loading 'flavor' on Instance uuid bd7aa640-cc81-4558-8a95-020b29cfebd9 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:54.406779 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2085787-a774-430a-9944-d08aebccc5e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action" status: 202 len: 0 microversion: 2.91 time: 0.231061 Oct 03 10:33:54.407385 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 507/987] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:33:54 2022] POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:33:54.412996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b510a495-c0bf-4a06-a6ae-4a642f02ef01 req-7441a700-c755-4c6e-865c-187eb4672e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483b0eff-2eb2-45a1-a1df-c3526b899003", "name": "network-vif-plugged", "status": "completed", "tag": "276c6807-4487-4e1a-a016-1ca442f76c12"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:54.423293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b510a495-c0bf-4a06-a6ae-4a642f02ef01 req-7441a700-c755-4c6e-865c-187eb4672e4b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:54.423777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b510a495-c0bf-4a06-a6ae-4a642f02ef01 req-7441a700-c755-4c6e-865c-187eb4672e4b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:54.424209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b510a495-c0bf-4a06-a6ae-4a642f02ef01 req-7441a700-c755-4c6e-865c-187eb4672e4b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:54.435797 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b510a495-c0bf-4a06-a6ae-4a642f02ef01 req-7441a700-c755-4c6e-865c-187eb4672e4b service nova] Creating event network-vif-plugged:276c6807-4487-4e1a-a016-1ca442f76c12 for instance 483b0eff-2eb2-45a1-a1df-c3526b899003 on n-h2-858383-3 Oct 03 10:33:54.441482 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b510a495-c0bf-4a06-a6ae-4a642f02ef01 req-7441a700-c755-4c6e-865c-187eb4672e4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032772 Oct 03 10:33:54.442423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 508/988] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:54.447153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:54.447853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:54.454466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:54.454954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:54.455394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:54.456092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:54.456552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:54.457009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:54.887731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:54.898555 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc467210-6e7e-4d93-8ea9-d386a2307b14 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1370 microversion: 2.1 time: 0.454979 Oct 03 10:33:54.910079 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 509/989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:54 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:54.922625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c0ad58f2-112c-4502-a87c-d64eb4893cce tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Calling method '.version_select at 0x7f074f86f0d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.215267 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c0ad58f2-112c-4502-a87c-d64eb4893cce tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.303746 Oct 03 10:33:55.216163 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 510/990] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:33:54 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:55.222187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.223062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:55.232748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.233817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.234474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.235394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.236112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.236757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.283992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.284728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.285335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.285795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lazy-loading 'fault' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:55.363308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.375301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.377165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.393776 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ceca2ea8-a9cd-4e99-8c63-e1adbb63168d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1448 microversion: 2.75 time: 0.174916 Oct 03 10:33:55.394812 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 511/991] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:55 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:55.401794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.403347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:55.416038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.416535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.417003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.417784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.418243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.418724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.487062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.495634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.497378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.503256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5583613-49b3-494b-a9e2-ed09f13b575e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.105898 Oct 03 10:33:55.503795 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 512/992] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:55 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:55.508366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.509179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:55.515676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.516162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.516597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.517312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.518048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.518480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.659873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.668901 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b498400-8df4-4d86-aa8e-766435a729cb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1463 microversion: 2.1 time: 0.163940 Oct 03 10:33:55.669473 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 513/993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:55 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:55.678443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.679059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:55.679676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0fc920a-50b2-4713-b41d-b3f33a969bbb tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4/action" status: 202 len: 0 microversion: 2.25 time: 3.684856 Oct 03 10:33:55.681093 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 481/994] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:33:51 2022] POST /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4/action => generated 0 bytes in 3687 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:33:55.686433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-525988d7-c523-4c94-bc08-57e197c5a0ca tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '.version_select at 0x7f074faa8ca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.690524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.691292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.691928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.692084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-525988d7-c523-4c94-bc08-57e197c5a0ca tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.692634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.693181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.693476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-525988d7-c523-4c94-bc08-57e197c5a0ca tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.693748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.694122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-525988d7-c523-4c94-bc08-57e197c5a0ca tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.708279 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-525988d7-c523-4c94-bc08-57e197c5a0ca tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2335 microversion: 2.1 time: 0.026007 Oct 03 10:33:55.709113 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 482/995] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:33:55 2022] GET /compute/v2.1/os-migrations => generated 2335 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:55.714242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-452b64c3-6c1a-440f-8bec-373aca85de86 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Calling method '.version_select at 0x7f074fbf6040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.844319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:55.854301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24d95ca7-2461-428a-87c0-007003838b65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.183736 Oct 03 10:33:55.854896 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 514/996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:55 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:55.864984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:55.864984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:55.869881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.870453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.870961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:55.871738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:55.872197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:55.872626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.004983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.013234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.014824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.016185 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e3af174-49bf-4927-af75-c30a06165245 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.160367 Oct 03 10:33:56.016834 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 515/997] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:55 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:56.165180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:56.177516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Searching by: {'deleted': False, 'project_id': '2ee3a185c52a41eab2f93119fa4b6b85'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:33:56.187382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.188204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.188891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.189715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.190417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.190913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.299392 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cca040de-7352-4169-9437-5cfc2029a470 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.281102 Oct 03 10:33:56.299977 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 516/998] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:33:56 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:33:56.304574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0658217d-9a88-4a58-a425-b579d09b044e tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:56.311685 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0658217d-9a88-4a58-a425-b579d09b044e tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010547 Oct 03 10:33:56.312555 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 517/999] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:33:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:56.317515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:56.318312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:56.325061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.325786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.326380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.327250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.327922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.328502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.347948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:56.546963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.554849 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2cf344a2-f51a-46ef-81ee-2bea8a9ea31a tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1556 microversion: 2.1 time: 0.241107 Oct 03 10:33:56.555435 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 518/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:56 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:56.565601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:56.585010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Searching by: {'deleted': False} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:33:56.590006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.590668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.591319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.592204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.592861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.594053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.630899 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-452b64c3-6c1a-440f-8bec-373aca85de86 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/4272bcdf-d257-4584-829d-31e5dde1391b" status: 202 len: 0 microversion: 2.1 time: 0.919995 Oct 03 10:33:56.631551 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 483/1001] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:33:55 2022] DELETE /compute/v2.1/os-floating-ips/4272bcdf-d257-4584-829d-31e5dde1391b => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:33:56.636353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-435a263c-b939-4138-a744-9a5637bde535 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-386539936", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:56.670787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-435a263c-b939-4138-a744-9a5637bde535 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.038097 Oct 03 10:33:56.672036 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 484/1002] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Oct 3 10:33:56 2022] POST /compute/v2.1/flavors => generated 498 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:56.676871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:56.677658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:56.688037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.688636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.689032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.689968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.691213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.691658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.726853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.727347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.727785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.728237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lazy-loading 'fault' on Instance uuid d56b8513-d2dd-4a7f-9604-66674e77046b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:33:56.729008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:33:56.771884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.781464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.783028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79fde9028a7d43b4b8e5e603f8a1f2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184473c6010b43ceb894770b7a45161d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.788327 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0dec6177-698a-4314-a5c7-95e45ccccd3d tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 200 len: 1448 microversion: 2.75 time: 0.115169 Oct 03 10:33:56.788930 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 485/1003] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:56 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 1448 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:56.793428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:56.793981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:56.799783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.800267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.800712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.801456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.801919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.802362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.852565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.853078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.853520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.869396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.878187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.879688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:56.884670 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e2e1c12-4d99-44e7-b882-b88617834736 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.094779 Oct 03 10:33:56.896957 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 486/1004] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:56 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:56.896957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:56.896957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:56.897339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.897652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.898294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.899150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:56.899767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:56.900365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:56.986518 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ef5339d6-fc3d-4a8c-aa50-2496764e0353 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099351 Oct 03 10:33:56.986875 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 487/1005] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:33:56 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:56.992419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28edae5a-4c9f-417c-98cd-5c0a1afdae23 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Action: 'create', calling method: .version_select at 0x7f074f99af70>, body: {"pool": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:57.583016 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ec43c5c1-898f-41a9-93eb-da4f552949f6 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19232 microversion: 2.1 time: 1.026344 Oct 03 10:33:57.584337 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 519/1006] 10.222.0.27 () {58 vars in 1171 bytes} [Mon Oct 3 10:33:56 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19232 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:33:57.589081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20bff529-f88a-4f6c-a44e-759939fc1d8c tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:57.597692 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20bff529-f88a-4f6c-a44e-759939fc1d8c tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012072 Oct 03 10:33:57.598909 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 520/1007] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 3 10:33:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:33:57.603714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:57.604486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:57.612525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:57.613294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:57.613977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:57.614840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:57.615474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:57.616057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:58.231256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:58.241101 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-30cfac54-1fad-47e1-aaee-d55a20a704c7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1504 microversion: 2.1 time: 0.640851 Oct 03 10:33:58.242374 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 521/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:57 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:33:58.247446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:58.248388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:58.256342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:58.257511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:58.258199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:58.260400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:58.261110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:58.261603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:58.565160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:58.590294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:58.592409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:58.593717 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed4d744f-85ed-47e8-ae38-48aa19b2b4ea tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.349952 Oct 03 10:33:58.609785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 522/1009] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:58 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:58.617407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:58.627089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Searching by: {'deleted': False, 'project_id': '2ee3a185c52a41eab2f93119fa4b6b85'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:33:58.632326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:58.632977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:58.633519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:58.634353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:58.634912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:58.635470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:58.681661 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9c3d1e4b-2d17-4571-8d7d-4a6b4b1b7265 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=b4201301e9cb42d3bcdff6d0416140f0" status: 200 len: 15 microversion: 2.1 time: 0.070176 Oct 03 10:33:58.694537 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 523/1010] 10.222.0.27 () {58 vars in 1231 bytes} [Mon Oct 3 10:33:58 2022] GET /compute/v2.1/servers/detail?tenant_id=b4201301e9cb42d3bcdff6d0416140f0 => generated 15 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:33:58.705198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-126993747", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "5824661e-3d58-44ff-8bac-fc06b7a189f2"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:58.770070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:33:59.295049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:33:59.295687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:33:59.296261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:33:59.296736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:33:59.297453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:33:59.320808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.322018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.322732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.323590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.327054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.328453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.354804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:33:59.360239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for user fa6ea468370b4bacb98dd5457b0e6aea and project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:33:59.365734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28edae5a-4c9f-417c-98cd-5c0a1afdae23 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.377604 Oct 03 10:33:59.374201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:33:59.375100 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 488/1011] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:33:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:59.377817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:33:59.379994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:59.383985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] [instance: d56b8513-d2dd-4a7f-9604-66674e77046b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:59.392712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.393239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.393686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.398350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.399133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.399724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.433523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:33:59.436598 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] HTTP exception thrown: Instance d56b8513-d2dd-4a7f-9604-66674e77046b could not be found. Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Request method failure captured: Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b HTTP/1.1 Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrokBJc0Djsvvmb5LU2l7la82u6ucjyZviipbJH1qIMfi9odp-hn7AgwF-xRaOFH8FHgKnBmqkfaBALN4k8qBrcJBS0pTSU2v3gg-o1aJBAAJ4PlQHF8uBav1Ro32P74206oMQGhqGHpM5MUsuUxSoNVAHMEsM20mufXC58gfbUXqSA Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.75 Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 184473c6010b43ceb894770b7a45161d Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersAdmin275Test-1836117484 Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:33:59.439132 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/184473c6010b43ceb894770b7a45161d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_184473c6010b43ceb894770b7a45161d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/184473c6010b43ceb894770b7a45161d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/184473c6010b43ceb894770b7a45161d"}]}] Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersAdmin275Test-1836117484 Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 184473c6010b43ceb894770b7a45161d Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersAdmin275Test-1836117484 Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersAdmin275Test-1836117484-project Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 79fde9028a7d43b4b8e5e603f8a1f2fd Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersAdmin275Test-1836117484-project Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance d56b8513-d2dd-4a7f-9604-66674e77046b could not be found. Oct 03 10:33:59.441230 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd56b8513-d2dd-4a7f-9604-66674e77046b'} Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56b8513-d2dd-4a7f-9604-66674e77046b could not be found. Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:33:59.445260 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56b8513-d2dd-4a7f-9604-66674e77046b could not be found. Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56b8513-d2dd-4a7f-9604-66674e77046b could not be found. Oct 03 10:33:59.446905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:33:59.448337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] Returning 404 to user: Instance d56b8513-d2dd-4a7f-9604-66674e77046b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:33:59.448337 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c534f10b-29c1-4df1-9ae6-ba558bd03546 tempest-ServersAdmin275Test-1836117484 tempest-ServersAdmin275Test-1836117484-project] 10.222.0.27 "GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b" status: 404 len: 111 microversion: 2.75 time: 0.064583 Oct 03 10:33:59.448337 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 489/1012] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:59 2022] GET /compute/v2.1/servers/d56b8513-d2dd-4a7f-9604-66674e77046b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:33:59.451682 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8150df4b-8516-467a-b92f-e4e1a00da2ee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753409 Oct 03 10:33:59.453805 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 524/1013] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:33:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:33:59.461762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:59.462390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:59.465896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-afdab295-ee7a-4dec-9fc3-e42ad4554387 req-9e23c705-3fa8-474c-b073-7f35cfba3e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4", "name": "network-vif-unplugged", "status": "completed", "tag": "a89a8059-2a12-495e-b540-36d4fb268a64"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:59.478134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.478521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.478998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.482506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.484968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.488999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-afdab295-ee7a-4dec-9fc3-e42ad4554387 req-9e23c705-3fa8-474c-b073-7f35cfba3e59 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.489931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.499094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-afdab295-ee7a-4dec-9fc3-e42ad4554387 req-9e23c705-3fa8-474c-b073-7f35cfba3e59 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.500564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-afdab295-ee7a-4dec-9fc3-e42ad4554387 req-9e23c705-3fa8-474c-b073-7f35cfba3e59 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.524340 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-afdab295-ee7a-4dec-9fc3-e42ad4554387 req-9e23c705-3fa8-474c-b073-7f35cfba3e59 service nova] Creating event network-vif-unplugged:a89a8059-2a12-495e-b540-36d4fb268a64 for instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 on n-h2-858383-3 Oct 03 10:33:59.532455 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-afdab295-ee7a-4dec-9fc3-e42ad4554387 req-9e23c705-3fa8-474c-b073-7f35cfba3e59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076832 Oct 03 10:33:59.533429 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 525/1014] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:59.559727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:59.584704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Searching by: {'tenant_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'deleted': False} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:33:59.586693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:59.597061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:59.598513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:33:59.603263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.603790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.604184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.604970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.605401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.605827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.620038 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0fa9d21a-2bf1-4d22-b148-d7ad9b1db47a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.177013 Oct 03 10:33:59.625446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 490/1015] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:33:59 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:33:59.636670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d89da3a0-6ea6-4c5d-a295-1bd67a462acc req-7058fa09-d8bd-4e93-8b6d-a7df06cb09b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483b0eff-2eb2-45a1-a1df-c3526b899003", "tag": "276c6807-4487-4e1a-a016-1ca442f76c12"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:33:59.650061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:33:59.657908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d89da3a0-6ea6-4c5d-a295-1bd67a462acc req-7058fa09-d8bd-4e93-8b6d-a7df06cb09b3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.662377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d89da3a0-6ea6-4c5d-a295-1bd67a462acc req-7058fa09-d8bd-4e93-8b6d-a7df06cb09b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.663133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d89da3a0-6ea6-4c5d-a295-1bd67a462acc req-7058fa09-d8bd-4e93-8b6d-a7df06cb09b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.689040 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d89da3a0-6ea6-4c5d-a295-1bd67a462acc req-7058fa09-d8bd-4e93-8b6d-a7df06cb09b3 service nova] Creating event network-changed:276c6807-4487-4e1a-a016-1ca442f76c12 for instance 483b0eff-2eb2-45a1-a1df-c3526b899003 on n-h2-858383-3 Oct 03 10:33:59.706625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d89da3a0-6ea6-4c5d-a295-1bd67a462acc req-7058fa09-d8bd-4e93-8b6d-a7df06cb09b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079913 Oct 03 10:33:59.707247 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 491/1016] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:33:59.717116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:33:59.717826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:33:59.734272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.735185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.737873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.740106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.742567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.743329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:33:59.829569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:33:59.830271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:33:59.830799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.055607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f354fd9-5790-4443-84ce-9f01d9aa4a6a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b4201301e9cb42d3bcdff6d0416140f0" status: 200 len: 4824 microversion: 2.1 time: 0.517459 Oct 03 10:34:00.056217 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 526/1017] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 3 10:33:59 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b4201301e9cb42d3bcdff6d0416140f0 => generated 4824 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:00.061057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8a8863c-b3ae-43e2-8f8b-c2d84a1ea88b tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Calling method '.version_select at 0x7f074fd06940>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.111547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.121280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5df90a1f-95a3-4bcf-a606-10c255976a7d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1479 microversion: 2.1 time: 0.412822 Oct 03 10:34:00.121857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 492/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:33:59 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1479 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:00.135678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c084d3c4-acc4-4558-989c-bb44595a3a1e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.136423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c084d3c4-acc4-4558-989c-bb44595a3a1e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:00.245757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c084d3c4-acc4-4558-989c-bb44595a3a1e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.258666 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c084d3c4-acc4-4558-989c-bb44595a3a1e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1278 microversion: 2.1 time: 0.132056 Oct 03 10:34:00.259329 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 493/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:00 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:00.271959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.272568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:00.288276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.295257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.298177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.299152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.299980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.301312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.541238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.553458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.555588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.557139 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-55879d48-681c-4307-a0e2-493bf3809df1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.288977 Oct 03 10:34:00.557747 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 494/1020] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:00 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:00.563298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.569931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Searching by: {'tenant_id': '2ee3a185c52a41eab2f93119fa4b6b85', 'deleted': False} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:34:00.577622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.579136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.579742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.581189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.581828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.582434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.731281 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51eda6f3-0e2a-49f7-b7d0-b27894149309 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2ee3a185c52a41eab2f93119fa4b6b85" status: 200 len: 15 microversion: 2.1 time: 0.172292 Oct 03 10:34:00.732329 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 495/1021] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 3 10:34:00 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2ee3a185c52a41eab2f93119fa4b6b85 => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:00.739124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7b6598c-ce14-472b-bc5a-15eb29f523c3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '.version_select at 0x7f074f95d1f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.743440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7b6598c-ce14-472b-bc5a-15eb29f523c3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.744275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7b6598c-ce14-472b-bc5a-15eb29f523c3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.745004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7b6598c-ce14-472b-bc5a-15eb29f523c3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.760033 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7b6598c-ce14-472b-bc5a-15eb29f523c3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2334 microversion: 2.1 time: 0.026250 Oct 03 10:34:00.761182 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 496/1022] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:34:00 2022] GET /compute/v2.1/os-migrations => generated 2334 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:00.767171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.768029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:00.777636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.778337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.779241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.791884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.793340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.794887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.884919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.894920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.897375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:00.905251 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-21b75686-7478-4fc9-9b42-467984e9b232 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.142779 Oct 03 10:34:00.916800 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 497/1023] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:00 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:00.916800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0611b08-1d92-46bc-9864-0a5bb5d67da1 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.916800 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0611b08-1d92-46bc-9864-0a5bb5d67da1 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009099 Oct 03 10:34:00.917135 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 498/1024] 10.222.0.27 () {58 vars in 1189 bytes} [Mon Oct 3 10:34:00 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:00.922184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:00.923088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:00.929438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.930121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.930832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:00.931683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:00.933837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:00.934596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.128297 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aae6496f-088f-43c0-83aa-52b3eafc35d0 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1630 microversion: 2.1 time: 0.209761 Oct 03 10:34:01.129227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 499/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:00 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1630 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:01.135049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:01.138386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:01.145442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.146308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.147162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.158118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.160221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.161323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.278288 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f79d0775-bc75-434e-b877-bd937df82e7c tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action" status: 202 len: 0 microversion: 2.1 time: 0.147134 Oct 03 10:34:01.279623 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 500/1026] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:01 2022] POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:34:01.288439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21e34ff6-3c11-4e53-9d55-600f1c33d969 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Action: 'create', calling method: .version_select at 0x7f074f95d550>, body: {"keypair": {"name": "tempest-keypair-907746691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpDpuW0XkQwF3KoHnv4lqLnANqm2EUsXsv/kQ9i4ITAMziF/wDYxO1+MPrkTx2gHlQHgAhs+xnInqbYi27oCxav3sSRVqdCnigoWEiVsB7PKxGwAEN/Qb/zyhffP6y18Q=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:01.309691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-21e34ff6-3c11-4e53-9d55-600f1c33d969 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:01.316046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-21e34ff6-3c11-4e53-9d55-600f1c33d969 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for user 6f0eda1654514026b803bcf2a1b8f4f4 and project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:01.374049 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-21e34ff6-3c11-4e53-9d55-600f1c33d969 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092990 Oct 03 10:34:01.375524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 501/1027] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:34:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:01.381499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:01.382385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:01.401246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.401897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.402429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.403247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.403838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.404340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.544567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:01.558227 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f5d5609f-9a4e-42f1-a5ae-d3857b77b82b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1330 microversion: 2.1 time: 0.180949 Oct 03 10:34:01.559947 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 502/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:01 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1330 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:01.576348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:01.592125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:01.601801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:34:01.631500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.632073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.632642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.633670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.634197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.634701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.744204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:34:01.905078 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a8a8863c-b3ae-43e2-8f8b-c2d84a1ea88b tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a" status: 202 len: 0 microversion: 2.1 time: 1.847454 Oct 03 10:34:01.905957 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 527/1029] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:34:00 2022] DELETE /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:34:01.911994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f77fe6cd-dfa0-4a12-bfd2-58691a77a2bc req-8f22e484-326f-444f-8c18-b323d0cc999f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4", "tag": "a89a8059-2a12-495e-b540-36d4fb268a64"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:01.913343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1671e600-800e-4fe4-8101-53c0f713d070 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.351373 Oct 03 10:34:01.915478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 503/1030] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 3 10:34:01 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:01.921844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:01.922728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:01.930255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.931109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.932115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.933338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.934236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.934920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.947207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f77fe6cd-dfa0-4a12-bfd2-58691a77a2bc req-8f22e484-326f-444f-8c18-b323d0cc999f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:01.947766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f77fe6cd-dfa0-4a12-bfd2-58691a77a2bc req-8f22e484-326f-444f-8c18-b323d0cc999f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:01.948122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f77fe6cd-dfa0-4a12-bfd2-58691a77a2bc req-8f22e484-326f-444f-8c18-b323d0cc999f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:01.969412 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f77fe6cd-dfa0-4a12-bfd2-58691a77a2bc req-8f22e484-326f-444f-8c18-b323d0cc999f service nova] Creating event network-changed:a89a8059-2a12-495e-b540-36d4fb268a64 for instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 on n-h2-858383-3 Oct 03 10:34:01.987395 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f77fe6cd-dfa0-4a12-bfd2-58691a77a2bc req-8f22e484-326f-444f-8c18-b323d0cc999f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080046 Oct 03 10:34:01.988305 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 528/1031] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:02.001298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0451a0f-df42-4c5f-bf92-3a2938eb0e82 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Calling method '.version_select at 0x7f074fc883a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:02.092480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-e0451a0f-df42-4c5f-bf92-3a2938eb0e82 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65032889-fe32-4e84-9d9d-9a15191f010a could not be found", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:34:02.093640 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e0451a0f-df42-4c5f-bf92-3a2938eb0e82 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] HTTP exception thrown: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0451a0f-df42-4c5f-bf92-3a2938eb0e82 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Request method failure captured: Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a HTTP/1.1 Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqNDlnY82eKqUF1KWn1EJuDqm4clk5K7hJKPQXffGcZTuDTuRhjIJN4KhJkFvdTSxhAqeV3EHAG76U45b8TKQdTy2E9zGiqM8eQ2oNzPY6PENA36v8eFCtrzS65_hIs4soZy3w3FYhr5f9zAGEyNT7gRHJZAlveqCv7koJ9xTuXTy4 Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: c5e64981e4e14e71b13d72d1b2a7e06b Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FloatingIPsTestJSON-501826268 Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:34:02.128164 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5e64981e4e14e71b13d72d1b2a7e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c5e64981e4e14e71b13d72d1b2a7e06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c5e64981e4e14e71b13d72d1b2a7e06b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5e64981e4e14e71b13d72d1b2a7e06b"}]}] Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FloatingIPsTestJSON-501826268 Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: c5e64981e4e14e71b13d72d1b2a7e06b Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FloatingIPsTestJSON-501826268 Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FloatingIPsTestJSON-501826268-project Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e89bf0c313a14fbab38219ee380b555e Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FloatingIPsTestJSON-501826268-project Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: exception: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '65032889-fe32-4e84-9d9d-9a15191f010a'} Oct 03 10:34:02.129591 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:34:02.130422 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65032889-fe32-4e84-9d9d-9a15191f010a could not be found Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d2ba811-b1f3-410c-ace0-c05ad195ad22'] Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a. Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:02.131588 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:02.132807 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:02.134032 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.134032 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.134032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0451a0f-df42-4c5f-bf92-3a2938eb0e82 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Returning 404 to user: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:02.134032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0451a0f-df42-4c5f-bf92-3a2938eb0e82 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a" status: 404 len: 111 microversion: 2.1 time: 0.140406 Oct 03 10:34:02.136289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 529/1032] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:34:01 2022] GET /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:34:02.142027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:02.144342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:02.153085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.153575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.154015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.154723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.155182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.156404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.220822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:02.236940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:02.241502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:02.243123 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43e50692-af80-4113-916b-bc9fbacec9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.325996 Oct 03 10:34:02.277840 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 504/1033] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:01 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:02.295105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:02.297116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:02.298076 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d5db3ce4-83ce-4d7e-9a68-5a7c96ce9b97 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action" status: 202 len: 0 microversion: 2.1 time: 0.160249 Oct 03 10:34:02.302122 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 530/1034] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:02 2022] POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:34:02.308113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96a74cb5-52de-4ffb-92cd-46e55496c6e8 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Calling method '.version_select at 0x7f074f846280>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:02.337693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.338304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.339760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.360728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.366224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.370593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.515628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:02.527548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:02.529004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:02.532110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:02.536819 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-261716da-76c3-4469-a62b-9bda88b69860 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.257350 Oct 03 10:34:02.537820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 505/1035] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:02 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:02.545145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:02.545744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:02.564387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.567583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.568095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.569006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.569579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.570021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.578168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-96a74cb5-52de-4ffb-92cd-46e55496c6e8 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65032889-fe32-4e84-9d9d-9a15191f010a could not be found", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:34:02.579032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-96a74cb5-52de-4ffb-92cd-46e55496c6e8 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] HTTP exception thrown: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96a74cb5-52de-4ffb-92cd-46e55496c6e8 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Request method failure captured: Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a HTTP/1.1 Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqNDlnY82eKqUF1KWn1EJuDqm4clk5K7hJKPQXffGcZTuDTuRhjIJN4KhJkFvdTSxhAqeV3EHAG76U45b8TKQdTy2E9zGiqM8eQ2oNzPY6PENA36v8eFCtrzS65_hIs4soZy3w3FYhr5f9zAGEyNT7gRHJZAlveqCv7koJ9xTuXTy4 Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: c5e64981e4e14e71b13d72d1b2a7e06b Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FloatingIPsTestJSON-501826268 Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:34:02.580857 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5e64981e4e14e71b13d72d1b2a7e06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c5e64981e4e14e71b13d72d1b2a7e06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c5e64981e4e14e71b13d72d1b2a7e06b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5e64981e4e14e71b13d72d1b2a7e06b"}]}] Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FloatingIPsTestJSON-501826268 Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: c5e64981e4e14e71b13d72d1b2a7e06b Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FloatingIPsTestJSON-501826268 Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FloatingIPsTestJSON-501826268-project Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e89bf0c313a14fbab38219ee380b555e Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FloatingIPsTestJSON-501826268-project Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: exception: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '65032889-fe32-4e84-9d9d-9a15191f010a'} Oct 03 10:34:02.582448 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:34:02.583834 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65032889-fe32-4e84-9d9d-9a15191f010a could not be found Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8e7ccda-a4f5-4509-b19d-8f881508b16d'] Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a. Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:02.587424 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:02.589216 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:02.590653 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a Oct 03 10:34:02.590653 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:02.593596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96a74cb5-52de-4ffb-92cd-46e55496c6e8 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] Returning 404 to user: Floating IP not found for ID 65032889-fe32-4e84-9d9d-9a15191f010a {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:02.593596 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96a74cb5-52de-4ffb-92cd-46e55496c6e8 tempest-FloatingIPsTestJSON-501826268 tempest-FloatingIPsTestJSON-501826268-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a" status: 404 len: 111 microversion: 2.1 time: 0.289182 Oct 03 10:34:02.593596 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 531/1036] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:34:02 2022] DELETE /compute/v2.1/os-floating-ips/65032889-fe32-4e84-9d9d-9a15191f010a => generated 111 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:34:02.599344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:02.606689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:02.631656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.632226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.632733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.633524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:02.634069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:02.635933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:02.756097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:02.766922 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19715349-894f-4452-bedd-0fc77881c21e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1336 microversion: 2.1 time: 0.172233 Oct 03 10:34:02.767507 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 532/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:02 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:02.995416 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24764521-f00a-4d47-95fe-9407c03d1d7e tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1614 microversion: 2.1 time: 0.456458 Oct 03 10:34:03.005216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 506/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:02 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1614 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:03.020035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:03.021933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:03.028479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.029267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.031089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.032047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.032721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.033420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.254327 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb4777ee-5787-4635-901e-f56af9fd905a tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1614 microversion: 2.1 time: 0.238191 Oct 03 10:34:03.267112 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 533/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:03 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1614 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:03.280155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:03.281544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:03.289601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.293177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:03.293885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.294497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.295406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.297930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.298768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.303825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Searching by: {'host': 'n-h1-858383-3', 'deleted': False} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:34:03.321436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.329053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.329723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.330701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.331337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.331919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.451220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:34:03.528917 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c5056d9-cb90-4ccd-b798-c559269487a9 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h1-858383-3&all_tenants=1" status: 200 len: 2308 microversion: 2.1 time: 0.242699 Oct 03 10:34:03.529848 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 534/1040] 10.222.0.27 () {58 vars in 1190 bytes} [Mon Oct 3 10:34:03 2022] GET /compute/v2.1/servers?host=n-h1-858383-3&all_tenants=1 => generated 2308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:03.545770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:03.553850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:34:03.561578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.562789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.563265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.564092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.565558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.565981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.642236 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e46cdad-da9c-452b-8a91-dc7613c72d25 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.102579 Oct 03 10:34:03.642834 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 535/1041] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Oct 3 10:34:03 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:03.654694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:03.655312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:03.667411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.667411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.667838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.672375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.673002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.673449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.768554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:03.783182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:03.785398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:03.789012 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-11e1b5f0-9f8b-4802-837e-96938564e444 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.512654 Oct 03 10:34:03.792301 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 507/1042] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:03 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:03.803389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:03.814978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:03.830780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.836540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.837027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.838456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:03.838928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:03.839365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:03.953402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:03.998187 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e4c2b03-383c-4f4b-98be-12fc41f5228d tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action" status: 202 len: 0 microversion: 2.1 time: 0.203545 Oct 03 10:34:04.004852 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 508/1043] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:03 2022] POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:34:04.011420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:04.012656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:04.022610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.023241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.023551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.025196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.025834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.026273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.238128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:04.251607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:04.254192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:04.260610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:04.262786 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58fcc7e5-f917-40eb-89e4-781d5896439f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.618819 Oct 03 10:34:04.264133 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 536/1044] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:03 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:04.271800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:04.274530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:04.290576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.291639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.292438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.293573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.294377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.295016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.406089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:34:04.406777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:34:04.407432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:34:04.407997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:34:04.408413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:34:04.462204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:04.480743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:04.488207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.488999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.489596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.490482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.491552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.492221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.524717 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-98656c29-7900-4ac3-aac4-d79b67e75f4c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action" status: 202 len: 1067 microversion: 2.1 time: 0.259051 Oct 03 10:34:04.537966 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 537/1045] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:04 2022] POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action => generated 1067 bytes in 273 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 10:34:04.738893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:04.742863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.743350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.743787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.744515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.744997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.745419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.771068 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7a54b146-861d-4384-bab5-f0e0576d3558 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.231789 Oct 03 10:34:04.772025 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 538/1046] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:34:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:04.785037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:04.785648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:04.791597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.792086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.792525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.793332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.793790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.794215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.854214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:04.874576 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-594c7e8a-728c-4a10-87c6-bc66dd5de3f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.868262 Oct 03 10:34:04.878059 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 509/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:04 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:04.889644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:04.893923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.894406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.898328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.900221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.901473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.902010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.935852 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08708424-e43e-4cbe-9345-f4fc6620abd6 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.055870 Oct 03 10:34:04.943150 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 510/1048] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 3 10:34:04 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:04.951169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:04.952102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:04.959376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.959963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.960402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:04.961893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:04.962353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:04.963222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.114909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.125034 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-780438b5-e105-47b9-bfdf-3163bcfb60e9 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.343891 Oct 03 10:34:05.125701 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 539/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:04 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:05.146140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:05.151867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.152364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.152919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.153769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.154227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.154653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.183999 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20c14855-577e-4ba3-bb68-2172a3718904 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041495 Oct 03 10:34:05.185329 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 540/1050] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:34:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:05.191722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1568210158", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "f3f01fec-6192-4230-9d75-0f9c0fe4d3e8"}], "security_groups": [{"name": "tempest-securitygroup--565564843"}], "key_name": "tempest-keypair-907746691", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:05.245701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.264863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.267433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.269010 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7422f2c8-51f4-41af-b3a5-ca26230d39d5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.330514 Oct 03 10:34:05.270117 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 511/1051] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:04 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:05.278232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:05.283515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.284662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.285502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.286622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.289432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.290217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.319074 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57b8582b-dfd8-48d5-b414-7800c21a5a6e tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-858383-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.047599 Oct 03 10:34:05.320006 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 512/1052] 10.222.0.27 () {58 vars in 1194 bytes} [Mon Oct 3 10:34:05 2022] GET /compute/v2.1/os-services?host=n-d-858383-3&binary=xxx => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:05.333418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:05.334212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:05.341415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.342101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.342611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.343423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.343958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.344453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.438300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.446747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.448437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.450801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] validate_networks() for [('f3f01fec-6192-4230-9d75-0f9c0fe4d3e8', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:34:05.454007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c80d81b-104e-4f84-8b3b-af5b980a9a30 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.124983 Oct 03 10:34:05.455015 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 513/1053] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:05 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:05.459507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:05.463179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.463767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.464372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.465266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.465720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.466214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.491113 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fcfe6606-ffb6-43dc-a5da-7dae03e11559 tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.034827 Oct 03 10:34:05.491834 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 514/1054] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:34:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:05.502620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-89c0e354-01be-42b4-b3fd-aa870217bc7a req-bbdc1cf4-4447-450c-a627-9140304aabc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:05.512479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-89c0e354-01be-42b4-b3fd-aa870217bc7a req-bbdc1cf4-4447-450c-a627-9140304aabc9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.513075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-89c0e354-01be-42b4-b3fd-aa870217bc7a req-bbdc1cf4-4447-450c-a627-9140304aabc9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.513576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-89c0e354-01be-42b4-b3fd-aa870217bc7a req-bbdc1cf4-4447-450c-a627-9140304aabc9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.525205 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-89c0e354-01be-42b4-b3fd-aa870217bc7a req-bbdc1cf4-4447-450c-a627-9140304aabc9 service nova] Creating event network-changed:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h1-858383-3 Oct 03 10:34:05.530311 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-89c0e354-01be-42b4-b3fd-aa870217bc7a req-bbdc1cf4-4447-450c-a627-9140304aabc9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037013 Oct 03 10:34:05.530989 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 515/1055] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:05.536429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:05.541541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.542323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.542930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.543860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.544513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.544952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.572724 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09741ebb-7255-47b7-b1af-a109438c95cf tempest-ServicesAdminNegativeTestJSON-448276951 tempest-ServicesAdminNegativeTestJSON-448276951-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.040322 Oct 03 10:34:05.573516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 516/1056] 10.222.0.27 () {58 vars in 1198 bytes} [Mon Oct 3 10:34:05 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:05.711208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7655eb4a-e8eb-4348-a4b0-051a22f3ef9e tempest-ServicesAdminNegativeTestJSON-365077865 tempest-ServicesAdminNegativeTestJSON-365077865-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:05.715034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7655eb4a-e8eb-4348-a4b0-051a22f3ef9e tempest-ServicesAdminNegativeTestJSON-365077865 tempest-ServicesAdminNegativeTestJSON-365077865-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a543b2358d5c462d86dd6879f996289d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34620a2347b74ef1a695aa4cffa82bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7655eb4a-e8eb-4348-a4b0-051a22f3ef9e tempest-ServicesAdminNegativeTestJSON-365077865 tempest-ServicesAdminNegativeTestJSON-365077865-project] Request method failure captured: Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqbvkRoZrodnte-DFE_QtwQjzkMifqOtqY3lGDq5aA03IJY_VCqvW8FJXvFdkPPH_2FemCV5YQ-12iDNeBSlPf_IJ6Lq3T5sndKgND_QYLJbam6-AC8SBo12VfDohaxcL3fURycUWU_sjqozXmveWEfO90smutYSZ-IKWHGpU81I34 Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 34620a2347b74ef1a695aa4cffa82bb3 Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-365077865 Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:05.721768 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34620a2347b74ef1a695aa4cffa82bb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34620a2347b74ef1a695aa4cffa82bb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34620a2347b74ef1a695aa4cffa82bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34620a2347b74ef1a695aa4cffa82bb3"}]}] Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-365077865 Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 34620a2347b74ef1a695aa4cffa82bb3 Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-365077865 Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServicesAdminNegativeTestJSON-365077865-project Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a543b2358d5c462d86dd6879f996289d Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-365077865-project Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 10:34:05.723105 n-d-858383-3 devstack@n-api.service[122269]: action_args: {} Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:34:05.723850 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 10:34:05.725086 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:05.727399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7655eb4a-e8eb-4348-a4b0-051a22f3ef9e tempest-ServicesAdminNegativeTestJSON-365077865 tempest-ServicesAdminNegativeTestJSON-365077865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:05.727399 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7655eb4a-e8eb-4348-a4b0-051a22f3ef9e tempest-ServicesAdminNegativeTestJSON-365077865 tempest-ServicesAdminNegativeTestJSON-365077865-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.141313 Oct 03 10:34:05.731137 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 517/1057] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:34:05 2022] GET /compute/v2.1/os-services => generated 112 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:34:05.903579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:05.905229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:05.919601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.922247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.925212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:05.926159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:05.936108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:05.937023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.263696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:06.272937 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ccd5811-7115-42f0-8a3b-84104a039fda tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.373161 Oct 03 10:34:06.290921 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 518/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:05 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:06.298057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:06.313646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:06.321847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.322823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.323522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.325370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.326114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.328662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.617369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:06.626865 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f0c6eae-c8a8-4a52-a519-5d6163d8db7a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.334487 Oct 03 10:34:06.637436 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 519/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:06 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:06.637436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:06.637436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:06.642418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.642902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.643336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.644034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.644483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.645080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.680453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:34:06.682003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:34:06.682707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:34:06.683943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:34:06.684785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:34:06.712408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.713333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.713996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.715060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.715738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.717620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.753305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:06.762043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for user 6f0eda1654514026b803bcf2a1b8f4f4 and project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:06.781352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:34:06.784759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:34:06.846493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7eb68b77-72ab-436c-8f5a-802211b5fd86 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.659415 Oct 03 10:34:06.847490 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 541/1060] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:34:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:34:06.852692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:06.853984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:06.861482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.862151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.863233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.864226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:06.864704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:06.865308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:06.982816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:06.997192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.000730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.008276 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cde55b20-1acf-483c-ad9c-96e0718ec0b0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.159513 Oct 03 10:34:07.010516 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 542/1061] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:06 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:07.016469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fb70a29-f760-4b69-9e4e-24e2ea27797d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:07.017420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fb70a29-f760-4b69-9e4e-24e2ea27797d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:07.092102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fb70a29-f760-4b69-9e4e-24e2ea27797d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.099666 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fb70a29-f760-4b69-9e4e-24e2ea27797d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1234 microversion: 2.1 time: 0.087475 Oct 03 10:34:07.100619 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 543/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:07 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1234 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:07.115534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.134839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.134986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.136336 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df5a6025-ddd2-4ce9-8d33-f3bc55a8ed9d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.506401 Oct 03 10:34:07.136962 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 520/1063] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:06 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:07.299480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:07.300101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:07.321722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:07.322299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:07.322712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:07.323471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:07.323922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:07.324351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:07.619418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.627939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fdeb1ee-7bc3-4332-946c-60943dee3ee3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.333741 Oct 03 10:34:07.629542 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 544/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:07 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:07.651077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:07.651972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:07.659035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:07.659683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:07.660192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:07.661530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:07.662690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:07.663302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:07.902780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:07.917513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3f2e9a0-e07c-4553-9354-ea6462c94436 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.270168 Oct 03 10:34:07.929549 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 521/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:07 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:08.037698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:08.038303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:08.048932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.049430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.049871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.050618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.051367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.051924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.123157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:08.125548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:08.133368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.133852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.134278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.134967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.135416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.135844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.145660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.161223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.163078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.172943 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6090f6a2-5531-4134-85ff-d546ef5472ab tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.139201 Oct 03 10:34:08.174284 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 545/1066] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:08 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:08.180339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:08.181326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:08.201353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.201851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.202286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.203607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.206203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.214440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.217327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.224738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e5b5659-5a6b-4796-ae3c-f9f6208d7210 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1238 microversion: 2.1 time: 0.105489 Oct 03 10:34:08.225344 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 522/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:08 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:08.467081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.480494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.483688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.487391 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bef97b0d-b92c-4310-95db-4a013c737ef1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.311097 Oct 03 10:34:08.488380 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 546/1068] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:08 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:08.651431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:08.652046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:08.659342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.659808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.661024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.662049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.662688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.663119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.873327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:08.883185 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-35ba796e-abfe-4b25-a5f6-3e241b2a352d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.235734 Oct 03 10:34:08.900614 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 523/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:08 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:08.943864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:08.944478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:08.951331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.952364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.953142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.954133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:08.954878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:08.955478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:08.999689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-be2b3ac5-98ce-4e46-9203-cc9078c7ddfb req-88184e67-1052-4183-8c31-9a6545e9cfbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4", "name": "network-vif-plugged", "status": "completed", "tag": "a89a8059-2a12-495e-b540-36d4fb268a64"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:09.012648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-be2b3ac5-98ce-4e46-9203-cc9078c7ddfb req-88184e67-1052-4183-8c31-9a6545e9cfbe service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.013246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-be2b3ac5-98ce-4e46-9203-cc9078c7ddfb req-88184e67-1052-4183-8c31-9a6545e9cfbe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.013901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-be2b3ac5-98ce-4e46-9203-cc9078c7ddfb req-88184e67-1052-4183-8c31-9a6545e9cfbe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.037040 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-be2b3ac5-98ce-4e46-9203-cc9078c7ddfb req-88184e67-1052-4183-8c31-9a6545e9cfbe service nova] Creating event network-vif-plugged:a89a8059-2a12-495e-b540-36d4fb268a64 for instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 on n-h2-858383-3 Oct 03 10:34:09.042245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-be2b3ac5-98ce-4e46-9203-cc9078c7ddfb req-88184e67-1052-4183-8c31-9a6545e9cfbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046015 Oct 03 10:34:09.043117 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 524/1070] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:34:09.135264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.145135 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5beda86e-b1a9-4cde-8ebb-121031e8d8ab tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.205157 Oct 03 10:34:09.145715 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 547/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:08 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:09.205821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:09.206526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:09.213231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.213913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.214902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.215661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.216149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.216750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.247196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:09.248536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:09.255141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.255878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.256653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.258240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.258863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.259285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.335477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.339962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.345105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.346807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.349760 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b2f75f92-847c-4444-81ec-2d5bd92c8783 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1238 microversion: 2.1 time: 0.106297 Oct 03 10:34:09.351257 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 548/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:09 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:09.354656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd3a57ff-11a9-4782-8d9c-689ec878e8cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.154636 Oct 03 10:34:09.355257 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 525/1073] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:09 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:09.516492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:09.517369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:09.523554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.524340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.524977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.525894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.526354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.526774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.690286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.701232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.703294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:09.705552 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96373f3c-70cb-46b7-b6e1-8f8e3f2ae9f8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.193891 Oct 03 10:34:09.708680 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 549/1074] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:09 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:09.916811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:09.918230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:09.937697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.941166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.941807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:09.942948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:09.943568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:09.944150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.170087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:10.173495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:10.174100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:10.180310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.180835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.181278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.181985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.182445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.182867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.184379 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0820d3b8-2665-4cae-a345-6a8b22f0ab81 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.280890 Oct 03 10:34:10.186354 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 526/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:09 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:10.515520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Action: 'update', calling method: .version_select at 0x7f074f3a1040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:10.519345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.519841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.520273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.529586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.530078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.530509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.540255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] HTTP exception thrown: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Request method failure captured: Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe HTTP/1.1 Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 56 Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqiawSrZ3aEl-eCQ4ddtT74-9Mtn5wV5b3fb5MCrKvH6-7n2TCtssdD8gUqDBJ576HE6wcpUc1jkAPkxpykFNieJNHuZnYKPOiSQ9aoQqPl5nYn_OxdS09y5Gesk3uT4XvUV_rGE2qpJoVxp1Qxu2CjuOn4k5OB2A7A77tDqED33xE Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: fb1c5498224e4ecc98d226dafb10a1e4 Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:34:10.542052 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb1c5498224e4ecc98d226dafb10a1e4"}]}] Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: fb1c5498224e4ecc98d226dafb10a1e4 Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0f81d4ea6cc34bbb81749a99a04c6cb0 Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:10.544369 n-d-858383-3 devstack@n-api.service[122269]: exception: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f0592db3-c304-46a5-a602-7d4a4e05a3fe', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.546098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.551758 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:10.555511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:10.555511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.555511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.555511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Returning 404 to user: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:10.555511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bbb5fe23-e0f7-4b8f-b02a-9efcd69356a2 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe" status: 404 len: 110 microversion: 2.53 time: 0.354726 Oct 03 10:34:10.555511 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 527/1076] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 3 10:34:10 2022] PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe => generated 110 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:34:10.610132 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81ab59ec-7d4c-4ad6-bda1-82da4270c642 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.060123 Oct 03 10:34:10.610671 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 528/1077] 10.222.0.27 () {58 vars in 1128 bytes} [Mon Oct 3 10:34:10 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 10:34:10.619107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:10.619743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:10.626309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.626807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.627250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.628149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.628610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.629209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.710316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:10.718988 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4ca38634-feba-4f14-9c60-c04200a41f8a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1286 microversion: 2.1 time: 0.106416 Oct 03 10:34:10.719791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 529/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:10 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:10.724702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:10.725510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:10.733180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.734294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.734954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.735962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.736063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.736441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.806279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:10.809009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:10.815206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:10.817796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:10.817965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce99d3c1-fea0-4962-a9cb-4d6cea39821e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.651180 Oct 03 10:34:10.829499 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 550/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:10 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:10.829857 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b29c1a7b-0c38-4f50-a1a0-9013bd51ce03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.101838 Oct 03 10:34:10.830001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Action: 'update', calling method: .version_select at 0x7f074f7f33a0>, body: {"status": "disabled"} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:10.830093 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 530/1080] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:10 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:10.830171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.830171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.830171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.835635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=23 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:10.836411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee4e694d-6f46-4d9d-8dca-baeebe6895ad tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Calling method '.version_select at 0x7f074f387dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:10.837091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.837640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.838113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.849510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] HTTP exception thrown: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Request method failure captured: Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe HTTP/1.1 Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 22 Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqiawSrZ3aEl-eCQ4ddtT74-9Mtn5wV5b3fb5MCrKvH6-7n2TCtssdD8gUqDBJ576HE6wcpUc1jkAPkxpykFNieJNHuZnYKPOiSQ9aoQqPl5nYn_OxdS09y5Gesk3uT4XvUV_rGE2qpJoVxp1Qxu2CjuOn4k5OB2A7A77tDqED33xE Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: fb1c5498224e4ecc98d226dafb10a1e4 Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:34:10.851523 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb1c5498224e4ecc98d226dafb10a1e4"}]}] Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: fb1c5498224e4ecc98d226dafb10a1e4 Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0f81d4ea6cc34bbb81749a99a04c6cb0 Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: {"status": "disabled"} Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: exception: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.852950 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f0592db3-c304-46a5-a602-7d4a4e05a3fe', 'body': {'status': 'disabled'}} Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.853967 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:10.855192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:10.856423 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.856423 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.856423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Returning 404 to user: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:10.856423 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-396a91d0-f3c2-42c5-9907-e7da8f228357 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe" status: 404 len: 110 microversion: 2.53 time: 0.033634 Oct 03 10:34:10.857807 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 551/1081] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 3 10:34:10 2022] PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:34:10.862944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:10.863547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:10.869487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.869966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.870395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.871109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.871558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.871973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.892634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ee4e694d-6f46-4d9d-8dca-baeebe6895ad tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] HTTP exception thrown: Image not found. Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee4e694d-6f46-4d9d-8dca-baeebe6895ad tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Request method failure captured: Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqinoTwxoez_x_EAyfOgxxGkbSTzT2y2VAWDN8qTZvQ5YU8WllTF0TCgkPnPtoFM8n2H-Ux8tXFyvsrjMhhxe6SdMsGoEbgGgIYltLA2DHQGKPmM3H2uGssfVOKK8MYstoL7yqH401skLL_MYkHtf4iFlnV6VJxDPmR1iwMD7q7-Ho Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:10.914371 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}] Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 92958724219b4bafbb93ae0cfd4295a5 Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '-1'} Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:10.916041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.917128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:10.918511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee4e694d-6f46-4d9d-8dca-baeebe6895ad tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee4e694d-6f46-4d9d-8dca-baeebe6895ad tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.091720 Oct 03 10:34:10.921729 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 531/1082] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 3 10:34:10 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:34:10.926817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Action: 'update', calling method: .version_select at 0x7f074f721310>, body: {"status": "enabled"} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:10.930465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.930923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.931612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.938824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:10.939309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:10.939939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:10.945272 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] HTTP exception thrown: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Request method failure captured: Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe HTTP/1.1 Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 21 Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqiawSrZ3aEl-eCQ4ddtT74-9Mtn5wV5b3fb5MCrKvH6-7n2TCtssdD8gUqDBJ576HE6wcpUc1jkAPkxpykFNieJNHuZnYKPOiSQ9aoQqPl5nYn_OxdS09y5Gesk3uT4XvUV_rGE2qpJoVxp1Qxu2CjuOn4k5OB2A7A77tDqED33xE Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: fb1c5498224e4ecc98d226dafb10a1e4 Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:34:10.946922 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fb1c5498224e4ecc98d226dafb10a1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fb1c5498224e4ecc98d226dafb10a1e4"}]}] Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: fb1c5498224e4ecc98d226dafb10a1e4 Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273 Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0f81d4ea6cc34bbb81749a99a04c6cb0 Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: {"status": "enabled"} Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: exception: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.948313 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f0592db3-c304-46a5-a602-7d4a4e05a3fe', 'body': {'status': 'enabled'}} Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.949232 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:10.950462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:10.951634 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. Oct 03 10:34:10.951634 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.951634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Returning 404 to user: Service f0592db3-c304-46a5-a602-7d4a4e05a3fe could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:10.951634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8325f70-ac13-4eb5-825c-d1ede63149d4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe" status: 404 len: 110 microversion: 2.53 time: 0.025610 Oct 03 10:34:10.951634 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 532/1083] 10.222.0.27 () {62 vars in 1309 bytes} [Mon Oct 3 10:34:10 2022] PUT /compute/v2.1/os-services/f0592db3-c304-46a5-a602-7d4a4e05a3fe => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:34:10.956331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-488f662a-f064-4135-92ab-a4d109ddf7b1 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Calling method '.version_select at 0x7f074f3c3700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:10.990846 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-488f662a-f064-4135-92ab-a4d109ddf7b1 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] HTTP exception thrown: Image not found. Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-488f662a-f064-4135-92ab-a4d109ddf7b1 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Request method failure captured: Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/images/4a165a76-2c05-47bd-9af1-6726edbead5j HTTP/1.1 Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqinoTwxoez_x_EAyfOgxxGkbSTzT2y2VAWDN8qTZvQ5YU8WllTF0TCgkPnPtoFM8n2H-Ux8tXFyvsrjMhhxe6SdMsGoEbgGgIYltLA2DHQGKPmM3H2uGssfVOKK8MYstoL7yqH401skLL_MYkHtf4iFlnV6VJxDPmR1iwMD7q7-Ho Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:10.993619 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}] Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 92958724219b4bafbb93ae0cfd4295a5 Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '4a165a76-2c05-47bd-9af1-6726edbead5j'} Oct 03 10:34:10.995112 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4a165a76-2c05-47bd-9af1-6726edbead5j to delete Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.996039 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a165a76-2c05-47bd-9af1-6726edbead5j could not be found. Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:10.997929 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-488f662a-f064-4135-92ab-a4d109ddf7b1 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:11.005836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-488f662a-f064-4135-92ab-a4d109ddf7b1 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] 10.222.0.27 "DELETE /compute/v2.1/images/4a165a76-2c05-47bd-9af1-6726edbead5j" status: 404 len: 62 microversion: 2.1 time: 0.049068 Oct 03 10:34:11.008194 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 533/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:10 2022] DELETE /compute/v2.1/images/4a165a76-2c05-47bd-9af1-6726edbead5j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:34:11.011662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.016609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.017187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.017634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.018382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.018846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.019282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.024363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:11.048291 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-438d514b-d30d-492e-825a-9e7f416db681 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.046614 Oct 03 10:34:11.049012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 534/1085] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 3 10:34:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:11.053916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3aec1ed9-11e1-4760-9db4-c3e0cb783519 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Calling method '.version_select at 0x7f074f36ad30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.073573 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-3aec1ed9-11e1-4760-9db4-c3e0cb783519 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] HTTP exception thrown: Image not found. Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3aec1ed9-11e1-4760-9db4-c3e0cb783519 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Request method failure captured: Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/images/eb81d5cd-d5a8-443c-bbf5-38e7f9eb40751 HTTP/1.1 Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqinoTwxoez_x_EAyfOgxxGkbSTzT2y2VAWDN8qTZvQ5YU8WllTF0TCgkPnPtoFM8n2H-Ux8tXFyvsrjMhhxe6SdMsGoEbgGgIYltLA2DHQGKPmM3H2uGssfVOKK8MYstoL7yqH401skLL_MYkHtf4iFlnV6VJxDPmR1iwMD7q7-Ho Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:11.075363 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}] Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 92958724219b4bafbb93ae0cfd4295a5 Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'eb81d5cd-d5a8-443c-bbf5-38e7f9eb40751'} Oct 03 10:34:11.077003 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb81d5cd-d5a8-443c-bbf5-38e7f9eb40751 to delete Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.078720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb81d5cd-d5a8-443c-bbf5-38e7f9eb40751 could not be found. Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:11.081830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3aec1ed9-11e1-4760-9db4-c3e0cb783519 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:11.083414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3aec1ed9-11e1-4760-9db4-c3e0cb783519 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] 10.222.0.27 "DELETE /compute/v2.1/images/eb81d5cd-d5a8-443c-bbf5-38e7f9eb40751" status: 404 len: 62 microversion: 2.1 time: 0.026482 Oct 03 10:34:11.084468 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 535/1086] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:34:11 2022] DELETE /compute/v2.1/images/eb81d5cd-d5a8-443c-bbf5-38e7f9eb40751 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:34:11.086951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.091519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.092012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.092458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.093402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.093707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.094136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.115791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:11.118907 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf23e3f6-9fc0-4ee9-8b5b-bd19014601c4 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035431 Oct 03 10:34:11.119510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 536/1087] 10.222.0.27 () {60 vars in 1211 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:11.128233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-570022b1-b942-4385-af77-f559b54b0fdc tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Calling method '.version_select at 0x7f074f50faf0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.128326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:11.128326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:11.128326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da229cb2-c1d7-497f-b3c5-37460fe3d7e1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1568 microversion: 2.25 time: 0.269063 Oct 03 10:34:11.128659 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 552/1088] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:10 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:11.133130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.137973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.138865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.139600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.141243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.141831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.142362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.167148 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-570022b1-b942-4385-af77-f559b54b0fdc tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] HTTP exception thrown: Image not found. Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-570022b1-b942-4385-af77-f559b54b0fdc tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Request method failure captured: Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/images/tempest-invalid-532074227 HTTP/1.1 Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqinoTwxoez_x_EAyfOgxxGkbSTzT2y2VAWDN8qTZvQ5YU8WllTF0TCgkPnPtoFM8n2H-Ux8tXFyvsrjMhhxe6SdMsGoEbgGgIYltLA2DHQGKPmM3H2uGssfVOKK8MYstoL7yqH401skLL_MYkHtf4iFlnV6VJxDPmR1iwMD7q7-Ho Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:11.169348 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}] Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 92958724219b4bafbb93ae0cfd4295a5 Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'tempest-invalid-532074227'} Oct 03 10:34:11.170690 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-532074227 to delete Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.176591 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-532074227 could not be found. Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:11.177777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-570022b1-b942-4385-af77-f559b54b0fdc tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:11.178965 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-570022b1-b942-4385-af77-f559b54b0fdc tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-532074227" status: 404 len: 62 microversion: 2.1 time: 0.050117 Oct 03 10:34:11.179852 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 537/1089] 10.222.0.27 () {58 vars in 1203 bytes} [Mon Oct 3 10:34:11 2022] DELETE /compute/v2.1/images/tempest-invalid-532074227 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:34:11.181923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e462a9e-978b-4918-9f72-fe134829cd22 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Calling method '.version_select at 0x7f074f337700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.186370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11de2c01-6906-4e58-8276-9c2597122378 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045726 Oct 03 10:34:11.188819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 553/1090] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:11.202027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.206884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.207382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.207948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.208559 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5e462a9e-978b-4918-9f72-fe134829cd22 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] HTTP exception thrown: Image not found. Oct 03 10:34:11.208686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.209168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.209599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e462a9e-978b-4918-9f72-fe134829cd22 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Request method failure captured: Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/images/03fc5b26-fa9d-4650-85fa-f04f99daf13b HTTP/1.1 Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqinoTwxoez_x_EAyfOgxxGkbSTzT2y2VAWDN8qTZvQ5YU8WllTF0TCgkPnPtoFM8n2H-Ux8tXFyvsrjMhhxe6SdMsGoEbgGgIYltLA2DHQGKPmM3H2uGssfVOKK8MYstoL7yqH401skLL_MYkHtf4iFlnV6VJxDPmR1iwMD7q7-Ho Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:11.210579 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b571eebdb8f421f8cf83f6946ad6259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b571eebdb8f421f8cf83f6946ad6259"}]}] Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 9b571eebdb8f421f8cf83f6946ad6259 Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-711214226 Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 92958724219b4bafbb93ae0cfd4295a5 Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-711214226-project Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '03fc5b26-fa9d-4650-85fa-f04f99daf13b'} Oct 03 10:34:11.211875 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 03fc5b26-fa9d-4650-85fa-f04f99daf13b to delete Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.213349 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 03fc5b26-fa9d-4650-85fa-f04f99daf13b could not be found. Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:11.216106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e462a9e-978b-4918-9f72-fe134829cd22 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:11.219655 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e462a9e-978b-4918-9f72-fe134829cd22 tempest-ImagesDeleteNegativeTestJSON-711214226 tempest-ImagesDeleteNegativeTestJSON-711214226-project] 10.222.0.27 "DELETE /compute/v2.1/images/03fc5b26-fa9d-4650-85fa-f04f99daf13b" status: 404 len: 62 microversion: 2.1 time: 0.035798 Oct 03 10:34:11.222644 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 538/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:11 2022] DELETE /compute/v2.1/images/03fc5b26-fa9d-4650-85fa-f04f99daf13b => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:34:11.234854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.235487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:11.240452 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1980068f-e7f3-4a4c-ace8-033ef5ce1810 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-858383-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.043035 Oct 03 10:34:11.245211 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 554/1092] 10.222.0.27 () {60 vars in 1235 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/os-services?host=n-d-858383-3&binary=xxx => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:11.250795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.251643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.252296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.253436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.254108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.254897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.258868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.262416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.262911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.263358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.264106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.264568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.265084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.297079 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-320d9e9e-397a-4e24-8852-1775d2f0ddc5 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043666 Oct 03 10:34:11.299125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 555/1093] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:11.319406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.323625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.325301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:11.325549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.326068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.329417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.329988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.330499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.361817 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-baa3e1ba-2bf8-430a-b140-a9ec14e317a9 tempest-ServicesAdminNegativeV253TestJSON-666968273 tempest-ServicesAdminNegativeV253TestJSON-666968273-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.047324 Oct 03 10:34:11.363577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 556/1094] 10.222.0.27 () {60 vars in 1239 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:11.413848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:11.425168 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c8f98f1-81bb-4a7e-b790-b0ea0b7e4408 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.209172 Oct 03 10:34:11.425827 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 539/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:11.560235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92c734e6-72c7-450b-b090-763f26bb49bc tempest-ServicesAdminNegativeV253TestJSON-11832549 tempest-ServicesAdminNegativeV253TestJSON-11832549-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.564693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-92c734e6-72c7-450b-b090-763f26bb49bc tempest-ServicesAdminNegativeV253TestJSON-11832549 tempest-ServicesAdminNegativeV253TestJSON-11832549-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '23aa808cfc9a47bbb08afbb3add08a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fde90f5d0e74ad5bed1d16f76f0995d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92c734e6-72c7-450b-b090-763f26bb49bc tempest-ServicesAdminNegativeV253TestJSON-11832549 tempest-ServicesAdminNegativeV253TestJSON-11832549-project] Request method failure captured: Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqh79_Y-W4UT3vtsryk073Gp6-blrvb8CI5e60mxEVHcW10zHJ2Rccdf3qrFcK15XIW-veSiYT9DWQUp2u0eMB-UFJpeoN8uxmXzpcdm_dP1v4Lvq6ukuUO2YQHTPyGpIrK6wh7kGiWsDaRq7M8-N1I_bS63btDIMI7m4es-3vlkO4 Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 3fde90f5d0e74ad5bed1d16f76f0995d Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-11832549 Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:34:11.566723 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fde90f5d0e74ad5bed1d16f76f0995d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fde90f5d0e74ad5bed1d16f76f0995d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fde90f5d0e74ad5bed1d16f76f0995d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fde90f5d0e74ad5bed1d16f76f0995d"}]}] Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-11832549 Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 3fde90f5d0e74ad5bed1d16f76f0995d Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-11832549 Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServicesAdminNegativeV253TestJSON-11832549-project Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 23aa808cfc9a47bbb08afbb3add08a63 Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-11832549-project Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 10:34:11.568109 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:34:11.568912 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 10:34:11.570030 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:11.572692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92c734e6-72c7-450b-b090-763f26bb49bc tempest-ServicesAdminNegativeV253TestJSON-11832549 tempest-ServicesAdminNegativeV253TestJSON-11832549-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:11.573795 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-92c734e6-72c7-450b-b090-763f26bb49bc tempest-ServicesAdminNegativeV253TestJSON-11832549 tempest-ServicesAdminNegativeV253TestJSON-11832549-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.200265 Oct 03 10:34:11.579753 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 557/1096] 10.222.0.27 () {60 vars in 1178 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:34:11.753825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.755381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:11.776539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.777709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.778693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.780317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.782338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.783185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.841323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.842592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:11.853054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.854219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.854952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.856074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.856750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.857430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.870288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:11.879831 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb12ab86-187d-4986-b78d-5a81de6a935f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1292 microversion: 2.1 time: 0.139353 Oct 03 10:34:11.881033 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 540/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:11.886370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:11.886975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:11.894001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.894495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.894994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.895636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:11.896087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:11.897025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:11.995367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.005153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.007853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.016751 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-204f6e0e-d0f0-4ca5-a5c1-a003a06be801 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.133915 Oct 03 10:34:12.017448 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 541/1098] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:12.110253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.123306 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1db51a51-9d43-4834-82aa-28d6a7671b6d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.286174 Oct 03 10:34:12.126192 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 558/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:11 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:12.157636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:12.158354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:12.166967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.167847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.168506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.169641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.170392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.171079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.397313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.405887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.407336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.408573 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df4f1fed-f337-4953-a7a1-a1e2deb9f9ae tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1543 microversion: 2.25 time: 0.256399 Oct 03 10:34:12.409701 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 542/1100] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:12 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1543 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:12.433821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df7b6318-6ad7-4db6-8210-e74a676237aa tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '.version_select at 0x7f074f23a790>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:12.437812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7b6318-6ad7-4db6-8210-e74a676237aa tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.438301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7b6318-6ad7-4db6-8210-e74a676237aa tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.438741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7b6318-6ad7-4db6-8210-e74a676237aa tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.449355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:12.449681 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df7b6318-6ad7-4db6-8210-e74a676237aa tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.019532 Oct 03 10:34:12.450165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:12.450579 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 559/1101] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 3 10:34:12 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:12.466432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:12.467466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:12.467593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.468280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.469245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.470341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.471389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.472169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.474882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.475547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.476170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.477256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.477902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.478712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.692093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:12.709787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd787f49-6691-4f3e-99a7-24bd3615cd06 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.264143 Oct 03 10:34:12.711519 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 543/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:12 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:12.810296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:34:12.825577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bdeaf708-3b78-4fab-9766-a266c8ab68f1 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 2036 microversion: 2.25 time: 0.363017 Oct 03 10:34:12.837543 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 560/1103] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:12 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 2036 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:34:12.866633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b322926-36de-4ba1-a7c8-7b2236b026f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Action: 'create', calling method: .version_select at 0x7f074f3c39d0>, body: {"keypair": {"name": "tempest-keypair-695582331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMiQ0AQTMqT2FnP8OtG2zrTdvCvzZBMAwRndQcSeW9RVNMHc1FMHoG0pj2f9HEU5zB1Ya+UEwTPWS6lfbv4Fucv0iccdiLQ8/NPegNYzkACTJr0hhmudTUBbTyA8B2Zqw=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:12.889710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-4b322926-36de-4ba1-a7c8-7b2236b026f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:12.895867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-4b322926-36de-4ba1-a7c8-7b2236b026f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for user 7b6d14fc83e74c34b2e6d5845f4ed9bf and project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:12.909795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:12.910322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:12.919946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.920444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.922676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.925426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:12.926332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:12.927712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:12.955667 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b322926-36de-4ba1-a7c8-7b2236b026f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.093821 Oct 03 10:34:12.967534 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 544/1104] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:34:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:34:12.973914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:13.047047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:13.049675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:13.062344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:13.062849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:13.065187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:13.069122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:13.069624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:13.070068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:13.329434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:13.362144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:13.368699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:13.387098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:13.388071 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5ca7865-89b6-4448-b077-4608bad140ba tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.347828 Oct 03 10:34:13.391662 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 545/1105] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:13 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:13.400493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:13.407996 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6567e5f2-8754-43fe-b182-433faeede97f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.504219 Oct 03 10:34:13.409961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:13.413096 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 561/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:12 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:13.423123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a2e7f7d3-6259-48b5-b93d-418daaa11347 req-f84b2523-c879-4072-9bd9-3b113903f658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "name": "network-vif-plugged", "status": "completed", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:13.438985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:13.439492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:13.439940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:13.440666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:13.441351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:13.441786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:13.450186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a2e7f7d3-6259-48b5-b93d-418daaa11347 req-f84b2523-c879-4072-9bd9-3b113903f658 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:13.460033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a2e7f7d3-6259-48b5-b93d-418daaa11347 req-f84b2523-c879-4072-9bd9-3b113903f658 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:13.460680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a2e7f7d3-6259-48b5-b93d-418daaa11347 req-f84b2523-c879-4072-9bd9-3b113903f658 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:13.511700 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a2e7f7d3-6259-48b5-b93d-418daaa11347 req-f84b2523-c879-4072-9bd9-3b113903f658 service nova] Creating event network-vif-plugged:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h1-858383-3 Oct 03 10:34:13.528071 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a2e7f7d3-6259-48b5-b93d-418daaa11347 req-f84b2523-c879-4072-9bd9-3b113903f658 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112324 Oct 03 10:34:13.528690 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 562/1107] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:13.738013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:13.738825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:13.750780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:13.753677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:13.755704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:13.757841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:13.759078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:13.759982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:13.861378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:13.873979 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42614ac5-ecb9-4cb4-9167-261153f4a54f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.480743 Oct 03 10:34:13.875908 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 546/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:13 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:14.076528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:14.089502 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb375fd6-63ab-4dfe-9410-17d94a390eb1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.356591 Oct 03 10:34:14.090647 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 563/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:13 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:14.420594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:14.421983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:14.442783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:14.443877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:14.448401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:14.452470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:14.457602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:14.458366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:14.461995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:14.462451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:14.463670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:14.467096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:14.468787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:14.473362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:14.473806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:14.477775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:14.835012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:14.855000 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6c81ef0-110c-4de9-bdb3-216f0f3548a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.418601 Oct 03 10:34:14.856333 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 564/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:14 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:14.901270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:14.902417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:14.911503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:14.912275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:14.912976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:14.914189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:14.914875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:14.916212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:14.926471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:14.941980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:14.945257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:14.954367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:14.958824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-45b37268-d18b-4603-b9df-a39f86522ffd tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.542409 Oct 03 10:34:14.960946 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 547/1111] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:14 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:15.119990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:15.120573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:15.133727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:15.134247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:15.135267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:15.135998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:15.137165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:15.137605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:15.225470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:15.233925 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2715342d-6bee-49bc-a714-941e2e47664c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.338267 Oct 03 10:34:15.249387 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 565/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:14 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:15.258150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3bc89910-78db-40e7-a00c-6d568ee3bd82 req-476285fb-c2e6-49e1-8641-468162eef437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af81a64b-4ea6-48b9-80fd-a0b4659d39e4", "tag": "5f6d0bfe-3323-40af-8755-76910c1d237e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:15.269624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3bc89910-78db-40e7-a00c-6d568ee3bd82 req-476285fb-c2e6-49e1-8641-468162eef437 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:15.270307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3bc89910-78db-40e7-a00c-6d568ee3bd82 req-476285fb-c2e6-49e1-8641-468162eef437 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:15.271000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3bc89910-78db-40e7-a00c-6d568ee3bd82 req-476285fb-c2e6-49e1-8641-468162eef437 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:15.285479 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3bc89910-78db-40e7-a00c-6d568ee3bd82 req-476285fb-c2e6-49e1-8641-468162eef437 service nova] Creating event network-changed:5f6d0bfe-3323-40af-8755-76910c1d237e for instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 on n-h1-858383-3 Oct 03 10:34:15.291065 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3bc89910-78db-40e7-a00c-6d568ee3bd82 req-476285fb-c2e6-49e1-8641-468162eef437 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039410 Oct 03 10:34:15.292535 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 566/1113] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:15.386593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:15.394987 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e972f5c0-5f6b-4a1c-a5fb-bde843d56808 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.282516 Oct 03 10:34:15.396132 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 548/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:15 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:15.884390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:15.889503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:15.895885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-942574166", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "4237c513-9590-4957-9766-25a24a956f31"}], "security_groups": [{"name": "tempest-securitygroup--301627250"}], "key_name": "tempest-keypair-695582331", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:15.908178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:15.909607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:15.911697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:15.914236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:15.915106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:15.915543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:16.115627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:16.126764 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ae82568-447a-44e6-ad17-0eeedb5ca2e6 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.248545 Oct 03 10:34:16.127818 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 567/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:15 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:16.134017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:16.134923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:16.142565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:16.143352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:16.143972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:16.145014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:16.145658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:16.146447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:16.185248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] validate_networks() for [('4237c513-9590-4957-9766-25a24a956f31', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:34:16.268501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:16.284993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:16.286948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:16.300099 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3f83bbfa-4a6c-4c29-87d4-22f55d62cfce tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.170566 Oct 03 10:34:16.301090 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 568/1116] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:16 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:16.306542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:16.307378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:16.318426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:16.320296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:16.324685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:16.325300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:16.326054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:16.326526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:16.327153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:16.637777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:16.666820 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bad07104-8b2f-4286-8045-9f2e80cc3911 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1471 microversion: 2.1 time: 0.364454 Oct 03 10:34:16.667427 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 569/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:16 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:16.672938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:16.673254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:16.689471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:16.689980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:16.690418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:16.691130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:16.691790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:16.692003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:16.959666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:16.971481 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4bca41b3-1055-4b6c-8ef0-a1ce3ff69033 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1378 microversion: 2.1 time: 0.302474 Oct 03 10:34:16.974266 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 570/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:16 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1378 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:17.079566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:34:17.079566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:34:17.079566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:34:17.079992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:34:17.080406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:34:17.103191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.104018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.104493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:17.125839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.126464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.126926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:17.162008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:17.163018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:17.174536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=22 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:17.179730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.180746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.181772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:17.182751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.183453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.184132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:17.194123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:17.216387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for user 7b6d14fc83e74c34b2e6d5845f4ed9bf and project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:17.251554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:34:17.263593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:34:17.391865 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0df0feaf-e8fa-47cc-a39e-ff53d84cf515 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.501118 Oct 03 10:34:17.392944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 549/1119] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:34:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:34:17.399655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:17.400720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:17.413110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.413642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.414097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:17.414814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.416886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.417526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:17.612328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:17.628137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:17.629629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:17.649312 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc84fef1-8ecb-44b9-ae49-86ee7d0d8f1a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.255179 Oct 03 10:34:17.650465 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 550/1120] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:17 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:17.656523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9cfae512-c131-40dd-ab14-d3edc5029591 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:17.661749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9cfae512-c131-40dd-ab14-d3edc5029591 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:17.772974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cfae512-c131-40dd-ab14-d3edc5029591 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:17.782290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cfae512-c131-40dd-ab14-d3edc5029591 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:17.783833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cfae512-c131-40dd-ab14-d3edc5029591 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:17.788652 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9cfae512-c131-40dd-ab14-d3edc5029591 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1284 microversion: 2.25 time: 0.136890 Oct 03 10:34:17.793314 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 551/1121] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:17 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:17.800531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:17.802461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:17.816139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.821461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.822179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:17.823171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:17.823845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:17.825315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.152967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:18.171247 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7a88315b-fe90-41d4-93a2-042e627f18e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 1.023374 Oct 03 10:34:18.173009 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 571/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:17 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:18.183606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:18.184555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:18.206777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.216704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.217688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.219300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.219971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.220613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.230042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:18.238510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ae46a11-b87b-4bee-9a78-35915cb58dd2 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.443682 Oct 03 10:34:18.239106 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 552/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:17 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:18.485219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:18.494613 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61d11b0c-70cd-4dcf-bc2a-0e2ee2700f6e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1528 microversion: 2.1 time: 0.319123 Oct 03 10:34:18.497788 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 572/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:18 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1528 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:18.525144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:18.527106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:18.542033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.546058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.548897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.551184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.551664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.556964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.693273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:18.698380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:18.748693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.749486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.755821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.756617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.759454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.759914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.906315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:18.926412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:18.930869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:18.934915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:18.940014 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf12d12e-cad2-45c1-b5e3-7293f4dbdf91 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1528 microversion: 2.1 time: 0.419626 Oct 03 10:34:18.953254 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca0ea932-5890-4d2e-b81f-cf53fb7bf2a4 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.270953 Oct 03 10:34:18.954157 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 573/1125] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:18 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:18.965633 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 553/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:18 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:18.976999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:18.978119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:18.990293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.991050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.991698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:18.994511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:18.995194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:18.997129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.007049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0cbd605c-0d45-4440-b5fa-f99ea44852a8 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:19.050123 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0cbd605c-0d45-4440-b5fa-f99ea44852a8 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/5824661e-3d58-44ff-8bac-fc06b7a189f2" status: 202 len: 0 microversion: 2.1 time: 0.047509 Oct 03 10:34:19.050717 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 554/1127] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:34:19 2022] DELETE /compute/v2.1/flavors/5824661e-3d58-44ff-8bac-fc06b7a189f2 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:34:19.059881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0c9bec75-f1a4-40e5-8224-96d0f2467b71 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:19.088330 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0c9bec75-f1a4-40e5-8224-96d0f2467b71 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032748 Oct 03 10:34:19.089375 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 555/1128] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:34:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:19.110343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:19.123158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:19.131487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.132224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.132892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.133765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.134391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.148941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.149163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:19.158530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:19.160220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:19.167747 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-beaf1e58-4748-47e4-a85b-60f261610888 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1336 microversion: 2.25 time: 0.206848 Oct 03 10:34:19.170070 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 574/1129] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:18 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1336 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:19.199288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:19.200320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:19.211438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.214637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.215269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.216668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.217866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.219162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.224608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:19.247780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Old instance type tempest-test_resize_flavor_-386539936, new instance type m1.heat {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 10:34:19.270309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:34:19.271032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:34:19.271714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:34:19.272344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:34:19.272969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:34:19.434560 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-60fbf209-c969-420a-b820-e126837e5bcc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a/action" status: 202 len: 0 microversion: 2.1 time: 0.328128 Oct 03 10:34:19.438181 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 556/1130] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:19 2022] POST /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:34:19.460486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:19.461428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:19.489141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.491762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.492833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.496756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.498552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.501881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.591175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:19.604626 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe212373-d947-4d4e-8b95-30547dee72e8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.411656 Oct 03 10:34:19.605372 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 575/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:19 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:19.625171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:19.628025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:19.644193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.644808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.645149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:19.645875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:19.646329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:19.653916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:20.158739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.168300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-594a69c5-cc29-4efe-8f9d-c7f93eeacb7d tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.728850 Oct 03 10:34:20.169229 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 557/1132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:19 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:20.174392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:20.175290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:20.182135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:20.183064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:20.184079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:20.185377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:20.186661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:20.188547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:20.211669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.220080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:20.221662 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-50ddd616-abdf-48b1-a026-bbfc4bdc1add tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1537 microversion: 2.1 time: 0.605161 Oct 03 10:34:20.223769 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 576/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:19 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1537 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:20.236306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:20.237279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:20.252161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:20.253017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:20.254000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:20.255387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:20.257332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:20.258269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:20.435883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.452164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.456467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.458949 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b245bc66-c934-41ba-bad8-62233bc04f5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1342 microversion: 2.25 time: 0.234006 Oct 03 10:34:20.461866 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 577/1134] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:20 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1342 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:20.548261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.561730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.575654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:20.583959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fbf972a7-dbf3-4863-a98c-2c2902aecad2 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.413203 Oct 03 10:34:20.595198 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 558/1135] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:20 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:20.633068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:20.633682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:20.643330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:20.643816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:20.644250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:20.644982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:20.645433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:20.645849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.126800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:21.151683 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1aedbeb8-36fe-4be7-a16d-0011a574ac2a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.524488 Oct 03 10:34:21.154308 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 578/1136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:20 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:21.193889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:21.194546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:21.206804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.210980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.211704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.214490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.216426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.217238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.247664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:21.248336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:21.256956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.258102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.259101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.260528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.269285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.270463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.310619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:21.336220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=9 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:21.668237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:21.689027 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a30e09c2-8e40-4869-af95-b68841fa5564 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.498716 Oct 03 10:34:21.692519 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 559/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:21 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:21.702559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:21.704606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:21.721953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.724013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.724738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.727032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.728091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.728836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.878973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:21.891836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:21.893307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:21.894418 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-52e8bc60-ba13-4129-9207-6eb0529f4cb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1342 microversion: 2.25 time: 0.197905 Oct 03 10:34:21.895346 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 560/1138] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:21 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:21.899778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:21.900521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:21.907256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.907748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.908179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:21.909067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:21.909801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:21.910366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:22.011644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:22.020576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:22.022736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:22.027815 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5528168c-8502-4daf-a1a3-ced2d97c638f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.131392 Oct 03 10:34:22.032812 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 561/1139] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:21 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:22.045028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2b550331-3a38-444a-922b-4fcf0ed0d6f5 req-6c48d317-a799-4310-b31d-c7d2562637ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d64078-3f94-45fb-a864-a10c79b8c92e", "name": "network-vif-unplugged", "status": "completed", "tag": "357dbd63-2219-4a26-ac04-d34854ccbbfd"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:22.072277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2b550331-3a38-444a-922b-4fcf0ed0d6f5 req-6c48d317-a799-4310-b31d-c7d2562637ad service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:22.072905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2b550331-3a38-444a-922b-4fcf0ed0d6f5 req-6c48d317-a799-4310-b31d-c7d2562637ad service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:22.073570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2b550331-3a38-444a-922b-4fcf0ed0d6f5 req-6c48d317-a799-4310-b31d-c7d2562637ad service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:22.092340 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-2b550331-3a38-444a-922b-4fcf0ed0d6f5 req-6c48d317-a799-4310-b31d-c7d2562637ad service nova] Creating event network-vif-unplugged:357dbd63-2219-4a26-ac04-d34854ccbbfd for instance 63d64078-3f94-45fb-a864-a10c79b8c92e on n-h1-858383-3 Oct 03 10:34:22.099797 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2b550331-3a38-444a-922b-4fcf0ed0d6f5 req-6c48d317-a799-4310-b31d-c7d2562637ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069696 Oct 03 10:34:22.103715 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 562/1140] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:22.183608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:22.184634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:22.209158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:22.213772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:22.214333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:22.219173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:22.219995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:22.220482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:22.220984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:22.229239 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb005da5-8a5d-4b2c-807a-898e09cc19f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1537 microversion: 2.1 time: 0.984389 Oct 03 10:34:22.232086 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 579/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:21 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1537 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:22.667674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:22.688398 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65e4e1dc-02f0-4280-bd8a-5bf8bb1f6a4e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.509490 Oct 03 10:34:22.689782 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 563/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:22 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:22.719555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:22.722102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:22.729181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:22.729866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:22.730460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:22.732132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:22.733524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:22.734190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:22.925699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:22.927311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:22.949847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:22.950366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:22.956480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:22.957076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:22.959971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:22.960520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:23.164299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.188068 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9c20f61f-4afe-4dd7-b7ab-703312ea7e26 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.469337 Oct 03 10:34:23.203682 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 580/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:22 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:23.203682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:23.203682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:23.228509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:23.230859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:23.238361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:23.239397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:23.239908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:23.241902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:23.461963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.476661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.479521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.490496 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dcaa3337-d806-457a-b7f4-fc21ba6421a7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.299523 Oct 03 10:34:23.506620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 581/1144] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:23 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:23.520980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:23.521609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:23.529975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:23.531026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:23.531667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:23.532556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:23.533211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:23.533801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:23.600447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.649108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.655637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.660574 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-636a50b9-2d3c-48f9-88fd-de5d64227eb7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1409 microversion: 2.25 time: 0.737440 Oct 03 10:34:23.685554 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 564/1145] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:22 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1409 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:23.723815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:23.745907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:23.763032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:23.766889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:23.767963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:23.768887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:23.769377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:23.770352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:23.827648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:23.837110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e70602a3-de12-4156-a828-2fac1e73689d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1537 microversion: 2.1 time: 0.329331 Oct 03 10:34:23.857039 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 582/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:23 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1537 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:24.082275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:24.094500 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06c987e0-4990-4269-914c-a28565408972 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.380528 Oct 03 10:34:24.099385 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 565/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:23 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:24.224679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:24.225785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:24.231562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1971829736", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "6afe4139-285e-4668-b631-5b7bdefbe50f"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:24.236469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:24.237315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:24.237979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:24.238926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:24.239601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:24.240951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:24.324216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] validate_networks() for [('6afe4139-285e-4668-b631-5b7bdefbe50f', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:34:24.528176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:24.542654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-077a98f4-49e0-456e-902b-73bf3f71499c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.329269 Oct 03 10:34:24.543581 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 566/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:24 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:24.548624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:24.549579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:24.556305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:24.557199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:24.565498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:24.566428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:24.567008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:24.567542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:24.709152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:24.721575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:24.723726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:24.736348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8acd11da-033c-4e01-92ca-a7fcf4c0ab62 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.191378 Oct 03 10:34:24.740336 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 567/1149] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:24 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:24.763208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:24.763828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:24.793458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:24.795823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:24.797178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:24.798901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:24.802408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:24.803037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.264677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:34:25.265750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:34:25.266895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:34:25.267561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:34:25.268152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:34:25.284948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:25.285683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:25.286317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.287597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:25.288219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:25.288826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.315978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:25.322987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for user d55ab76047b047f4b45b003fd15f8ea3 and project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:25.357115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:34:25.360609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:34:25.436511 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91ce7ad8-c9aa-43fb-a3f1-9478207c4bb0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418967 Oct 03 10:34:25.438193 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 583/1150] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:34:25.452512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e14d440f-109c-4f66-a519-b18e89739f66 req-623fd666-dcea-4683-a8b7-045786cfb102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17", "tag": "bf72179b-5688-4e66-81af-f082edc266f4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:25.466868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e14d440f-109c-4f66-a519-b18e89739f66 req-623fd666-dcea-4683-a8b7-045786cfb102 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:25.467637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e14d440f-109c-4f66-a519-b18e89739f66 req-623fd666-dcea-4683-a8b7-045786cfb102 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:25.469158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e14d440f-109c-4f66-a519-b18e89739f66 req-623fd666-dcea-4683-a8b7-045786cfb102 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.488560 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e14d440f-109c-4f66-a519-b18e89739f66 req-623fd666-dcea-4683-a8b7-045786cfb102 service nova] Creating event network-changed:bf72179b-5688-4e66-81af-f082edc266f4 for instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 on n-h2-858383-3 Oct 03 10:34:25.510960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:25.518503 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e14d440f-109c-4f66-a519-b18e89739f66 req-623fd666-dcea-4683-a8b7-045786cfb102 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078953 Oct 03 10:34:25.521575 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 584/1151] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:25.522764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:25.524716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:25.526056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4962e5ab-d316-46ad-a829-d0fadf6e612a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1409 microversion: 2.25 time: 0.784529 Oct 03 10:34:25.526758 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 568/1152] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:24 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1409 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:25.532175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:25.533487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:25.543967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:25.544684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:25.547871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:25.548941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:25.549556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.551506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:25.552141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:25.553242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.571698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:25.572454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:25.573114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.573986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:25.577159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:25.578345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:25.980286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:25.990976 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e66f622c-a7e0-4b7a-ba59-2621f81d6f45 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.462884 Oct 03 10:34:25.991569 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 569/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:25 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:26.001028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-750a6b89-1666-4f25-8767-f5d79f6ccff9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:26.005626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-750a6b89-1666-4f25-8767-f5d79f6ccff9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:26.099147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.107751 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e23c569-f34e-48df-a1b3-beeb523ee979 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1537 microversion: 2.1 time: 0.584748 Oct 03 10:34:26.108802 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 585/1154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:25 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1537 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:26.119141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:26.122741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:26.140383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-750a6b89-1666-4f25-8767-f5d79f6ccff9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.143512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:26.144098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:26.144528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:26.145273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:26.145729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:26.147297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:26.157571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-750a6b89-1666-4f25-8767-f5d79f6ccff9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1225 microversion: 2.1 time: 0.163949 Oct 03 10:34:26.158871 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 570/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:25 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:26.173447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:26.174323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:26.186485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:26.187742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:26.192714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:26.194361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:26.195091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:26.195761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:26.371642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.386445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.394443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.401934 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9e9944c-5e18-4eb5-b689-b821b2680a1d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.241524 Oct 03 10:34:26.402524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 571/1156] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:26 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:26.418742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ac608f4e-e5a7-4eed-a9c0-e712ba4dd25f req-88aa029a-511b-4b20-88d2-7060337840b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d64078-3f94-45fb-a864-a10c79b8c92e", "name": "network-vif-plugged", "status": "completed", "tag": "357dbd63-2219-4a26-ac04-d34854ccbbfd"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:26.436432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac608f4e-e5a7-4eed-a9c0-e712ba4dd25f req-88aa029a-511b-4b20-88d2-7060337840b2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:26.437206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac608f4e-e5a7-4eed-a9c0-e712ba4dd25f req-88aa029a-511b-4b20-88d2-7060337840b2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:26.437834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac608f4e-e5a7-4eed-a9c0-e712ba4dd25f req-88aa029a-511b-4b20-88d2-7060337840b2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:26.450905 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ac608f4e-e5a7-4eed-a9c0-e712ba4dd25f req-88aa029a-511b-4b20-88d2-7060337840b2 service nova] Creating event network-vif-plugged:357dbd63-2219-4a26-ac04-d34854ccbbfd for instance 63d64078-3f94-45fb-a864-a10c79b8c92e on n-h1-858383-3 Oct 03 10:34:26.466222 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ac608f4e-e5a7-4eed-a9c0-e712ba4dd25f req-88aa029a-511b-4b20-88d2-7060337840b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056721 Oct 03 10:34:26.467568 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 572/1157] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:26.539756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.557141 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5285d137-a195-47c2-87f0-0a6fb44f6c4a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.446312 Oct 03 10:34:26.557719 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 586/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:26 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:26.565664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:26.568453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:26.588900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:26.589400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:26.589840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:26.590552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:26.591018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:26.591432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:26.842890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.858778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.861924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:26.864395 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e786c2cc-c314-46fe-9e3d-e140fed797dc tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1409 microversion: 2.25 time: 0.308006 Oct 03 10:34:26.866476 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 573/1159] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:26 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1409 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:27.014255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:27.014871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:27.025449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.030297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.031001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.032038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.032652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.033288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.139524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:27.143320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:27.151273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=22 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:27.161365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.166579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.167048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.167808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.168265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.168905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.394282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:27.415969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe52926e-0b2f-4050-991a-86c23f55df7f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1537 microversion: 2.1 time: 0.285058 Oct 03 10:34:27.425846 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 574/1160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:27 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1537 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:27.529308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d25f045a-a337-4a4b-9d58-79dbf7d8eed3 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Calling method '.version_select at 0x7f074f3c3550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:27.612946 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d25f045a-a337-4a4b-9d58-79dbf7d8eed3 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.186822 Oct 03 10:34:27.625801 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 575/1161] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:34:27 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:27.633789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:27.636419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:27.643495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.643992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.645764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.646493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.646953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.647383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.753670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:27.764283 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3af3121b-78fe-40a8-9a8c-c03df97cdd06 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1277 microversion: 2.1 time: 0.136928 Oct 03 10:34:27.765637 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 576/1162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:27 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:27.772712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:27.773720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:27.783223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.783968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.784837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.786181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.786807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.787797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.929090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:27.940441 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-70ed7691-5228-4752-baec-9e0246debdba tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.930032 Oct 03 10:34:27.949652 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 587/1163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:27 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:27.966249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:27.966875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:27.981036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.981529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.981971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:27.982683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:27.983140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:27.983566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.013596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.033388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.038035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.046038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:28.056086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f9a6f2c-48a5-4aa6-a729-0d75a4cc3c18 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.289021 Oct 03 10:34:28.056716 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 577/1164] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:27 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:28.067665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b382644-6915-41ef-9f29-b9a814d036a7 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Action: 'create', calling method: .version_select at 0x7f074f36a310>, body: {"pool": "non_exist_pool"} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:28.131117 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1b382644-6915-41ef-9f29-b9a814d036a7 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] HTTP exception thrown: Floating IP pool not found. Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b382644-6915-41ef-9f29-b9a814d036a7 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Request method failure captured: Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 26 Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqyrSVM6CT1IaCmnaW6Nlki9QNmcpq_IZxQJMQV2B1-auv5EQ4pA_8I2SwO23k4pMyedAJyrAyu7QVxbt0chB9aUzt9Sr3HVyhFIPfcKjLbn0eN_qys5BU1CY73lAk57jMBJi5Bzpj3CDJgcHPqqK13y3aiXXtcEyrUcVNidl2Diz0 Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a00f9092d6b1486487fea4c32ee8369d Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1506157081 Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:28.135767 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a00f9092d6b1486487fea4c32ee8369d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a00f9092d6b1486487fea4c32ee8369d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a00f9092d6b1486487fea4c32ee8369d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a00f9092d6b1486487fea4c32ee8369d"}]}] Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1506157081 Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a00f9092d6b1486487fea4c32ee8369d Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1506157081 Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsNegativeTestJSON-1506157081-project Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3f8e5f45d9c548b39cf0f034b9a251d6 Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1506157081-project Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: {"pool": "non_exist_pool"} Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: exception: Floating IP pool not found. Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 03 10:34:28.137427 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:28.138386 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 03 10:34:28.140723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.143422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b382644-6915-41ef-9f29-b9a814d036a7 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Returning 404 to user: Floating IP pool not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:28.145364 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b382644-6915-41ef-9f29-b9a814d036a7 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.081212 Oct 03 10:34:28.146225 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 578/1165] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:34:28 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:34:28.152301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:28.153513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:28.164651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.165772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.166410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.167322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.167986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.168595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.198459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:28.397622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.408958 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dda970a8-5210-4cf5-bc7d-fb630774662b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.457386 Oct 03 10:34:28.411950 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 588/1166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:27 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:28.417349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c868907-c13f-4827-95bf-60d344a29e79 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Calling method '.version_select at 0x7f074f23a430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:28.493314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-4c868907-c13f-4827-95bf-60d344a29e79 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 49048b36-3642-4bb4-a3f4-5d989730df79 could not be found", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:34:28.494688 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4c868907-c13f-4827-95bf-60d344a29e79 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] HTTP exception thrown: Floating IP not found for ID 49048b36-3642-4bb4-a3f4-5d989730df79 Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c868907-c13f-4827-95bf-60d344a29e79 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Request method failure captured: Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-floating-ips/49048b36-3642-4bb4-a3f4-5d989730df79 HTTP/1.1 Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqyrSVM6CT1IaCmnaW6Nlki9QNmcpq_IZxQJMQV2B1-auv5EQ4pA_8I2SwO23k4pMyedAJyrAyu7QVxbt0chB9aUzt9Sr3HVyhFIPfcKjLbn0eN_qys5BU1CY73lAk57jMBJi5Bzpj3CDJgcHPqqK13y3aiXXtcEyrUcVNidl2Diz0 Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a00f9092d6b1486487fea4c32ee8369d Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1506157081 Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:34:28.498104 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a00f9092d6b1486487fea4c32ee8369d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a00f9092d6b1486487fea4c32ee8369d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a00f9092d6b1486487fea4c32ee8369d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a00f9092d6b1486487fea4c32ee8369d"}]}] Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1506157081 Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a00f9092d6b1486487fea4c32ee8369d Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1506157081 Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FloatingIPsNegativeTestJSON-1506157081-project Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3f8e5f45d9c548b39cf0f034b9a251d6 Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1506157081-project Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: exception: Floating IP not found for ID 49048b36-3642-4bb4-a3f4-5d989730df79 Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '49048b36-3642-4bb4-a3f4-5d989730df79'} Oct 03 10:34:28.499430 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:34:28.501212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 49048b36-3642-4bb4-a3f4-5d989730df79 could not be found Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df7ac8db-5a25-4d66-899c-a0333e9ac1af'] Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 49048b36-3642-4bb4-a3f4-5d989730df79. Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:28.502440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 49048b36-3642-4bb4-a3f4-5d989730df79 Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:28.503666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:28.505686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 49048b36-3642-4bb4-a3f4-5d989730df79 Oct 03 10:34:28.505686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:28.505686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c868907-c13f-4827-95bf-60d344a29e79 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] Returning 404 to user: Floating IP not found for ID 49048b36-3642-4bb4-a3f4-5d989730df79 {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:28.505686 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c868907-c13f-4827-95bf-60d344a29e79 tempest-FloatingIPsNegativeTestJSON-1506157081 tempest-FloatingIPsNegativeTestJSON-1506157081-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/49048b36-3642-4bb4-a3f4-5d989730df79" status: 404 len: 111 microversion: 2.1 time: 0.086321 Oct 03 10:34:28.505686 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 589/1167] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:34:28 2022] DELETE /compute/v2.1/os-floating-ips/49048b36-3642-4bb4-a3f4-5d989730df79 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:34:28.508728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:28.509378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:28.526433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.529706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.530113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.531998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.532486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.535205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.694893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.708700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.710543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.717192 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa533b4e-dadb-4a9e-b2e1-dc7b3c99eb1e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1409 microversion: 2.25 time: 0.569611 Oct 03 10:34:28.717986 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 579/1168] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:28 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1409 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:28.754113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.786448 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ca7a996-853e-4b17-98c7-cbb5b07bbe49 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1537 microversion: 2.1 time: 0.274610 Oct 03 10:34:28.788150 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 590/1169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:28 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1537 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:28.819550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:28.820853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:28.846479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.847775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.848247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.850763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.851256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.851695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.976558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:28.977300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:28.984800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.985474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:28.985757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.986361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.987237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:28.989323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:28.990371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:28.993142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9376488a-f064-4815-9104-4a3c5dd4a92f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1283 microversion: 2.1 time: 0.205204 Oct 03 10:34:28.993727 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 580/1170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:28 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:29.083734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:29.084242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:29.095557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.096075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.096521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:29.097274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.097732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.098157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:29.250603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:29.260137 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e3b4794-499e-4fd0-9320-8b1526822b5b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.292347 Oct 03 10:34:29.290222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 591/1171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:28 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:29.434640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:29.437989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:29.456455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.457416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.458051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:29.459091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.460266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.461239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:29.524188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:29.538628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:29.540101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:29.556128 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-498aa541-3cf6-4469-8cd3-cf819ddaeeb7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.476128 Oct 03 10:34:29.556895 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 581/1172] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:29 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:29.744030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:29.746549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:29.748180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:29.753476 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae5212dc-4741-4426-8339-e5ada5c9122f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1477 microversion: 2.1 time: 0.323077 Oct 03 10:34:29.754806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 592/1173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:29 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:29.758434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.758941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.759386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:29.760128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.764528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.766041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:29.820980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:29.824359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:29.872194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.879169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.879747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:29.881573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:29.882146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:29.883416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.208453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.216850 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0d2d100-b1de-499e-b5e1-c45b18c18b4a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.405933 Oct 03 10:34:30.234648 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 593/1174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:29 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:30.240153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:30.245660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:30.266871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.267653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.268304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.269426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.270057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.270655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.394286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.411589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.413558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.414851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d699cfce-d0a5-4982-8748-3b31a1bf581c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1409 microversion: 2.25 time: 0.672672 Oct 03 10:34:30.415555 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 582/1175] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:29 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1409 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:30.420315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:30.426857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:30.436690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.444520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.445253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.450368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.451196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.451862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.460679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.479030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-73938913-9bf3-4f2d-828e-f9ac158550dd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 0.242737 Oct 03 10:34:30.479897 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 594/1176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:30 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:30.587455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:30.588290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:30.595996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.596496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.596980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.597792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.598264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.598672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.665974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.674973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.676420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.681442 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d7ad478-0a92-4df8-a473-24db5ccfc53d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.097885 Oct 03 10:34:30.681996 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 595/1177] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:30 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:34:30.783172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:30.784948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:30.791332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.791871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.792466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.793560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.794569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.794916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.823817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.831801 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b5b433c-1961-464e-801f-ada196e9560a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.415143 Oct 03 10:34:30.832749 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 583/1178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:30 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:30.945741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:30.955020 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d714b7a6-9840-41e8-8b1b-0960b4fbabdb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1463 microversion: 2.1 time: 0.176264 Oct 03 10:34:30.955913 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 596/1179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:30 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:30.979767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:30.980682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:30.987446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.988234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.989204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:30.990692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:30.991405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:30.992300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.255449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:31.258626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:31.276475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.277862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.278537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.279475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.280541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.281788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.364247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:31.377093 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8906dcdc-a9b6-430c-aecf-1863f1376c55 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1463 microversion: 2.1 time: 0.401517 Oct 03 10:34:31.378954 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 584/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:30 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1463 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:31.407252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:31.414853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:31.424087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.424585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.425282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.427453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.428017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.429035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.487885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:31.496059 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cadce920-3690-4569-b5f8-46e4fa599336 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.249501 Oct 03 10:34:31.498173 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 597/1181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:31 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:31.503649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:31.504502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:31.510726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.511426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.512054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.513015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.513633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.514223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.534366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:31.566105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:34:31.566544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:34:31.567089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:34:31.567496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:34:31.573601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:34:31.728748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:31.741417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.744551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.745971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.747186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.750214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.753320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.817575 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3319bf6c-875c-4d2a-9dbf-4af1491d467c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action" status: 202 len: 1067 microversion: 2.1 time: 0.419195 Oct 03 10:34:31.819063 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 585/1182] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:31 2022] POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action => generated 1067 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 10:34:31.824108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:31.824718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:31.832376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.834256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.836057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.838775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.838953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:31.840008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.844795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.848496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:31.850555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:31.851732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-341397f6-4d00-405c-bec4-dd3ddd7079e0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1409 microversion: 2.25 time: 0.352350 Oct 03 10:34:31.860805 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 598/1183] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:31 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1409 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:31.865198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:31.871135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:31.880234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.883328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.883895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.884985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:31.885743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:31.886478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:31.992716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:32.004479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:32.005979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:32.020988 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64cdd55d-3320-4dba-a368-91cb03332a03 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.167111 Oct 03 10:34:32.021597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 599/1184] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:31 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:32.026739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:32.027347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:32.035276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.035980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.036579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.037493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.038246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.038827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.186131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:32.194695 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5fd53521-177b-4e8e-b964-eaa343085887 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.171877 Oct 03 10:34:32.195359 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 600/1185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:32 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:32.200828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:32.202002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:32.208954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.210334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.210771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.211494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.212085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.212507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.376100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:32.376937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:32.383834 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62f456aa-a633-4955-b57c-f3507a2bd383 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 0.563741 Oct 03 10:34:32.384025 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e3cc588-c9ae-4ac3-af55-b78e9d3082ad tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.187084 Oct 03 10:34:32.390916 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 586/1186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:31 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:32.395810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fe9a9025-3bdb-4cb7-9b96-0cc9663130b3 req-3d2fce9e-bcde-4549-850c-b26cf8248531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17", "name": "network-vif-plugged", "status": "completed", "tag": "bf72179b-5688-4e66-81af-f082edc266f4"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:32.401306 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 601/1187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:32 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:32.411386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fe9a9025-3bdb-4cb7-9b96-0cc9663130b3 req-3d2fce9e-bcde-4549-850c-b26cf8248531 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.411869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fe9a9025-3bdb-4cb7-9b96-0cc9663130b3 req-3d2fce9e-bcde-4549-850c-b26cf8248531 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.412303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fe9a9025-3bdb-4cb7-9b96-0cc9663130b3 req-3d2fce9e-bcde-4549-850c-b26cf8248531 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.423078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f41c877b-e7b3-4218-b61c-e49705de3efc req-27ace9b1-52aa-43ff-8515-34e587dfec7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38e9f1f-e1e7-4c75-a454-806d7b3f4503", "tag": "70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:32.424003 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fe9a9025-3bdb-4cb7-9b96-0cc9663130b3 req-3d2fce9e-bcde-4549-850c-b26cf8248531 service nova] Creating event network-vif-plugged:bf72179b-5688-4e66-81af-f082edc266f4 for instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 on n-h2-858383-3 Oct 03 10:34:32.430037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fe9a9025-3bdb-4cb7-9b96-0cc9663130b3 req-3d2fce9e-bcde-4549-850c-b26cf8248531 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Oct 03 10:34:32.431756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 587/1188] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:32.434228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f41c877b-e7b3-4218-b61c-e49705de3efc req-27ace9b1-52aa-43ff-8515-34e587dfec7e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.434703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f41c877b-e7b3-4218-b61c-e49705de3efc req-27ace9b1-52aa-43ff-8515-34e587dfec7e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.436045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f41c877b-e7b3-4218-b61c-e49705de3efc req-27ace9b1-52aa-43ff-8515-34e587dfec7e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.449273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f41c877b-e7b3-4218-b61c-e49705de3efc req-27ace9b1-52aa-43ff-8515-34e587dfec7e service nova] Creating event network-changed:70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f for instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 on n-h2-858383-3 Oct 03 10:34:32.455836 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f41c877b-e7b3-4218-b61c-e49705de3efc req-27ace9b1-52aa-43ff-8515-34e587dfec7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036368 Oct 03 10:34:32.457222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 602/1189] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:32.527000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:32.527702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:32.534674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.535421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.536066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.536839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.537258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.537686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.806236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:32.816541 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aac20c24-5583-408a-9298-7383eba7976c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.293576 Oct 03 10:34:32.817181 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 588/1190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:32 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:32.881830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:32.882526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:32.888611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.889151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.889608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:32.890861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:32.891330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:32.891754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.027779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.050534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:33.051770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:33.055390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.060318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.060675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.060828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.061266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.061897 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-507a9aff-e438-417c-ba19-215e4521b235 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1409 microversion: 2.25 time: 0.184396 Oct 03 10:34:33.062049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.063089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.063703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.065444 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 603/1191] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:32 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1409 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:33.139096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.148385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.150268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.155437 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eaabf7cb-765c-4fd1-bf96-854da250960f tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1560 microversion: 2.91 time: 0.109577 Oct 03 10:34:33.156385 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 589/1192] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:33 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1560 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:33.219245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:33.219870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:33.226246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.226667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.227100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.227785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.228229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.228853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.408275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:33.409192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:33.415859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.416494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.417068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.417867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.418428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.419199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.471000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.479612 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01920972-4e55-45e7-bf3f-e00d3be5ed8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.264845 Oct 03 10:34:33.480798 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 604/1193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:33 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:33.486639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:33.487240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:33.493521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.494272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.494862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.496363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.497023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.497613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.743969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.756988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:33.765841 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34903f6a-78b3-40f8-b7f9-b4ccc6197bd7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 0.361813 Oct 03 10:34:33.768391 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-50b04fe5-3331-4c21-942d-07d732c8cc72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.286222 Oct 03 10:34:33.769246 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 605/1194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:33 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:33.770338 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 590/1195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:33 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:33.840904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:33.841617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:33.862922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.863413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.863846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:33.864636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:33.865281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:33.865714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.091383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:34.092000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:34.099230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.099936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.100576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.101318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.101776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.102204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.176882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:34.190639 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de422a90-f1dd-48da-8154-dcd193bd0fb2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.354070 Oct 03 10:34:34.193477 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 606/1196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:33 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:34.199897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:34.201385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:34.212071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.213134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.213935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.214842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.215476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.216073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.302898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:34.311416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:34.313757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:34.315139 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6ef09eaf-4481-4a85-8d3c-119028331e38 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1604 microversion: 2.25 time: 0.227632 Oct 03 10:34:34.315712 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 591/1197] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:34 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:34:34.337482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:34.346326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:34.347076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:34.348261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:34.349771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:34.353882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.354556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.355252 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-714515b3-d2ac-40fd-ad03-1608469b7823 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.160278 Oct 03 10:34:34.355518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.355837 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 607/1198] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:34 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:34.356572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.357217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.357941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.449093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f4ca5941-b225-414e-85b7-4aafc22c28a8 req-aa465336-31c3-4fae-bd94-17d96f62419d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af81a64b-4ea6-48b9-80fd-a0b4659d39e4", "name": "network-vif-plugged", "status": "completed", "tag": "5f6d0bfe-3323-40af-8755-76910c1d237e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:34.466992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:34.469973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4ca5941-b225-414e-85b7-4aafc22c28a8 req-aa465336-31c3-4fae-bd94-17d96f62419d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.470490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4ca5941-b225-414e-85b7-4aafc22c28a8 req-aa465336-31c3-4fae-bd94-17d96f62419d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.478330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4ca5941-b225-414e-85b7-4aafc22c28a8 req-aa465336-31c3-4fae-bd94-17d96f62419d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.508310 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f4ca5941-b225-414e-85b7-4aafc22c28a8 req-aa465336-31c3-4fae-bd94-17d96f62419d service nova] Creating event network-vif-plugged:5f6d0bfe-3323-40af-8755-76910c1d237e for instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 on n-h1-858383-3 Oct 03 10:34:34.514032 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-76ce2bca-91a8-415f-b7e7-f76aa3681277 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.170787 Oct 03 10:34:34.525285 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f4ca5941-b225-414e-85b7-4aafc22c28a8 req-aa465336-31c3-4fae-bd94-17d96f62419d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071842 Oct 03 10:34:34.525285 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 608/1199] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:34.525836 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 592/1200] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:34:34 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:34:34.525934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:34.529725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:34.545760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.546505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.547380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.548268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.548964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.549569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.792595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:34.793377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:34.811578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.816960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.817675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:34.820607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:34.821275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:34.821858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:35.063100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:35.072715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-478ed591-3462-4910-8cb1-1ad465edde3e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.553576 Oct 03 10:34:35.077112 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 609/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:34 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:35.083751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:35.091062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:35.104014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:35.105032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:35.107688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:35.108752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:35.109983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:35.113536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:35.302908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:35.347785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:35.479525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:35.492564 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8373bbc8-02b0-4ec8-8be1-dd173a46bfd5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.410616 Oct 03 10:34:35.493238 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 610/1202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:35 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:35.500903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:35.501730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:35.515087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:35.517836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:35.518604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:35.525239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:35.526139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:35.526821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:35.742742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:35.758328 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e4faaa1-927a-448a-ad25-a2c9ead52f7e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.259048 Oct 03 10:34:35.759095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 611/1203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:35 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:35.764146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:35.770147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:35.780328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:35.782668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:35.784506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:35.788356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:35.789426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:35.790351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:35.791503 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-84a0806e-7dff-4257-ab1f-a55de5ba95ba tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 1.003302 Oct 03 10:34:35.792108 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 593/1204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:34 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:35.793662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:36.105066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:36.105740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:36.119664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:36.121305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:36.121774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:36.122523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:36.122990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:36.123429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:36.166110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:36.461788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:36.479056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:36.484168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:36.504339 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f1e5861-a835-4905-9810-9566b0c4eef1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.743732 Oct 03 10:34:36.508402 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 612/1205] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:35 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:36.531027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:36.531681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:36.543815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:36.544864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:36.544864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:36.545476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:36.549440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:36.549929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:36.915762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:36.990469 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-803e9d2b-8b18-4950-ae78-da40c7a64fca tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.880989 Oct 03 10:34:36.994309 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 594/1206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:36 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:36.996943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:37.011224 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e1a0efb-f507-450a-9f17-f4d5f3bda34a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1359 microversion: 2.1 time: 0.484308 Oct 03 10:34:37.012650 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 613/1207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:36 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1359 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:37.026645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:37.033438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:37.048963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:37.051826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:37.082874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:37.088412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:37.090478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:37.092796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:37.093436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:37.098302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:37.098521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:37.099590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:37.099759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:37.100311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:37.101298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:37.102084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:37.113418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:37.475605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:37.484489 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fec689a6-2b9c-44be-b83c-4249cab846f5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 0.470494 Oct 03 10:34:37.504875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 614/1208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:37 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:37.505607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e5694489-2ca6-4506-8c81-9dfeb3eb3ba1 req-eb997632-1254-4f85-967f-419efa27180b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17", "tag": "bf72179b-5688-4e66-81af-f082edc266f4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:37.534142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e5694489-2ca6-4506-8c81-9dfeb3eb3ba1 req-eb997632-1254-4f85-967f-419efa27180b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:37.535932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e5694489-2ca6-4506-8c81-9dfeb3eb3ba1 req-eb997632-1254-4f85-967f-419efa27180b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:37.538313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e5694489-2ca6-4506-8c81-9dfeb3eb3ba1 req-eb997632-1254-4f85-967f-419efa27180b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:37.558383 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e5694489-2ca6-4506-8c81-9dfeb3eb3ba1 req-eb997632-1254-4f85-967f-419efa27180b service nova] Creating event network-changed:bf72179b-5688-4e66-81af-f082edc266f4 for instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 on n-h2-858383-3 Oct 03 10:34:37.566626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:37.575069 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-998fd784-7491-4fc6-9e8d-5399495e46cc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.577009 Oct 03 10:34:37.582781 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 595/1209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:36 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:37.591308 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e5694489-2ca6-4506-8c81-9dfeb3eb3ba1 req-eb997632-1254-4f85-967f-419efa27180b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089232 Oct 03 10:34:37.608331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:37.609724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:37.610836 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 615/1210] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:34:37.627701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:37.629497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:37.630215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:37.631212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:37.641638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:37.643034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:37.957586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:37.974016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:37.979039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:37.994716 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c24bd9af-80e8-4d70-9043-c5f07815c5e7 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.410382 Oct 03 10:34:37.995537 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 596/1211] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:37 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:38.019123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:38.019907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:38.035609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.036857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.038775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.040853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.040853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.046089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:38.047291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:38.054462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.063479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.063980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.064419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.065170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.070817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.071287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.346936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:38.359523 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d5f3a6b6-e25f-407a-89ef-dcba07d5bcda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.347419 Oct 03 10:34:38.361996 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 616/1212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:38 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:38.515154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:38.516041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:38.571103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.574659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.576278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.577536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.581161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.581842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.592225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:38.605857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:38.620134 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b78a7ca-ce1e-4a3a-8599-58aa7a28f84b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1543 microversion: 2.1 time: 0.577764 Oct 03 10:34:38.637158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 597/1213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:38 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1543 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:38.650306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:38.653078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:38.679608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.681771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.683154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.688111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:38.691002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:38.691569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:38.974833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:38.999730 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8be4edb-0592-4641-b174-1014b5ce56c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 0.488317 Oct 03 10:34:39.001015 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 617/1214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:38 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:39.017372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:39.019329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:39.035910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:39.046006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:39.047628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:39.050100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:39.055898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:39.055898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:39.333441 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d14c5fe8-4996-4cb1-ac55-f96495981b9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.330994 Oct 03 10:34:39.334442 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 618/1215] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:34:39 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-interface => generated 285 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:39.339794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:39.340532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:39.372517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:39.376266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:39.378926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:39.383751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:39.385715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:39.386308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:39.536600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:39.546933 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a6d7e70-f136-44d6-acd5-a2a1f14c7665 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.905892 Oct 03 10:34:39.549327 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 598/1216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:38 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:39.553885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:39.563727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:39.628868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:39.649441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:39.651286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:39.652065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:39.652566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:39.653019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:39.871057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:39.882710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89d94b9b-9aa7-4918-ba04-0cc9a329988e tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.330700 Oct 03 10:34:39.883508 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 599/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:39 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:39.909259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:39.926581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:39.934220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:39.945362 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-edb59931-cdc3-438f-a592-3b122609814b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.609650 Oct 03 10:34:39.950334 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 619/1218] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:39 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:39.960132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-dfaff560-04ad-406b-bedc-270eb2aa311f req-cf672a78-3fe1-460a-ae26-de7946743d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38e9f1f-e1e7-4c75-a454-806d7b3f4503", "name": "network-vif-plugged", "status": "completed", "tag": "70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:39.987437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dfaff560-04ad-406b-bedc-270eb2aa311f req-cf672a78-3fe1-460a-ae26-de7946743d04 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:39.987857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dfaff560-04ad-406b-bedc-270eb2aa311f req-cf672a78-3fe1-460a-ae26-de7946743d04 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:39.988281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dfaff560-04ad-406b-bedc-270eb2aa311f req-cf672a78-3fe1-460a-ae26-de7946743d04 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:39.992270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e81f2b9-bd16-450e-b6b9-aec77c2c331c"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:39.994866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:40.009120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.009120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.009420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.010304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.012106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.013177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.036565 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-dfaff560-04ad-406b-bedc-270eb2aa311f req-cf672a78-3fe1-460a-ae26-de7946743d04 service nova] Creating event network-vif-plugged:70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f for instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 on n-h2-858383-3 Oct 03 10:34:40.066703 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-dfaff560-04ad-406b-bedc-270eb2aa311f req-cf672a78-3fe1-460a-ae26-de7946743d04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110253 Oct 03 10:34:40.067308 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 600/1219] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:40.072566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:40.085929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:40.111042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.114849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.115589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.119156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.122855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.124348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.422688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:40.434367 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5748912f-7e2b-4766-b3b1-cb1ac1b9bcd0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 0.365122 Oct 03 10:34:40.435550 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 601/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:40 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:40.584013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:40.584666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:40.607380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.607937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.615357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.618026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.619626 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f27052b5-897e-4a98-b25d-af16283c53cd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "POST /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631109 Oct 03 10:34:40.620842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.621957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.622747 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 620/1221] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:34:39 2022] POST /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:34:40.810244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:40.822958 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a5680641-3d0a-4fc2-8c1b-c99ebf92c931 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.242744 Oct 03 10:34:40.824159 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 602/1222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:40 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:40.910439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:40.912174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:40.920027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.920167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.920639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.921646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.922278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:40.922911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:40.987412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:40.989507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:40.998928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:40.999829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:41.000630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:41.001975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:41.002805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:41.006260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:41.076498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:41.093334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:41.095372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:41.102494 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-797fb29b-979b-45e4-be3d-d40ecaed5317 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.118801 Oct 03 10:34:41.103730 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 603/1223] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:40 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:41.172276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a3aa835-7ff0-468f-82f6-c04035250202 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f257b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:41.235366 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4a3aa835-7ff0-468f-82f6-c04035250202 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a" status: 200 len: 637 microversion: 2.1 time: 0.067289 Oct 03 10:34:41.241847 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 604/1224] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:34:41 2022] GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a => generated 637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:34:41.248469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:41.257271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c79c406-3cd3-4cf0-93f1-4e408fbf7a97 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update_all', calling method: .version_select at 0x7f074f247dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:41.258885 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-353cb781-c8f1-4bfc-af79-bd50113ac3ae tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.354539 Oct 03 10:34:41.272845 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 621/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:40 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:41.338729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3c79c406-3cd3-4cf0-93f1-4e408fbf7a97 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:41.348364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3c79c406-3cd3-4cf0-93f1-4e408fbf7a97 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:41.462257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:41.465043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:41.480347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:41.483575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:41.487339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:41.488643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:41.489955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:41.491077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:41.870158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:41.878577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4147cc2b-e86f-49d0-af85-3a0231fcc2d6 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1325 microversion: 2.1 time: 0.423750 Oct 03 10:34:41.885890 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 622/1226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:41 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:41.911247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-53949324-c1a2-44b6-85a7-4874a5dd8239 req-00f2e2b1-0b5f-4605-901b-e00f3e76f18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af81a64b-4ea6-48b9-80fd-a0b4659d39e4", "tag": "5f6d0bfe-3323-40af-8755-76910c1d237e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:41.922439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-53949324-c1a2-44b6-85a7-4874a5dd8239 req-00f2e2b1-0b5f-4605-901b-e00f3e76f18c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:41.923259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-53949324-c1a2-44b6-85a7-4874a5dd8239 req-00f2e2b1-0b5f-4605-901b-e00f3e76f18c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:41.923885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-53949324-c1a2-44b6-85a7-4874a5dd8239 req-00f2e2b1-0b5f-4605-901b-e00f3e76f18c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:41.936030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-53949324-c1a2-44b6-85a7-4874a5dd8239 req-00f2e2b1-0b5f-4605-901b-e00f3e76f18c service nova] Creating event network-changed:5f6d0bfe-3323-40af-8755-76910c1d237e for instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 on n-h1-858383-3 Oct 03 10:34:41.941361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-53949324-c1a2-44b6-85a7-4874a5dd8239 req-00f2e2b1-0b5f-4605-901b-e00f3e76f18c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053920 Oct 03 10:34:41.947550 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 623/1227] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:41.953577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:41.954507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:41.961394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:41.962115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:41.962764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:41.963704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:41.964354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:41.965011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:42.043434 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3c79c406-3cd3-4cf0-93f1-4e408fbf7a97 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.791043 Oct 03 10:34:42.044022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 605/1228] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:34:41 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 61 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:34:42.053792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-504bfe94-0f9b-4a1d-aba9-43f395abcc85 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f360940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:42.241138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:42.251196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f97e4ca4-36ab-4215-9894-ddbe4c103772 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.302131 Oct 03 10:34:42.254695 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 624/1229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:41 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:42.262052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:42.262854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:42.288652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:42.289412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:42.290041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:42.290931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:42.296254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:42.298780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:42.511687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:42.533388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:42.535541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:42.548939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb6d3c6d-5d6f-4fa9-a92b-6c321f6b1c27 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.290672 Oct 03 10:34:42.553627 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 625/1230] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:42 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:42.564530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:42.565595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:42.579623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:42.580272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:42.581427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:42.582417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:42.585259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:42.585976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:42.616592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-504bfe94-0f9b-4a1d-aba9-43f395abcc85 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "DELETE /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.566479 Oct 03 10:34:42.617480 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 606/1231] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 3 10:34:42 2022] DELETE /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata/os_version => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:34:42.639704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d0aafd3-69a5-4c5d-b102-f706e6aab1d8 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f274040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:42.723109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d0aafd3-69a5-4c5d-b102-f706e6aab1d8 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.090703 Oct 03 10:34:42.730199 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 607/1232] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:34:42 2022] GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 37 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:42.737992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-16fcc30c-5bba-4816-a0a3-1d74933dc44d tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update_all', calling method: .version_select at 0x7f074f247a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:42.848862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-16fcc30c-5bba-4816-a0a3-1d74933dc44d tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:42.856237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-16fcc30c-5bba-4816-a0a3-1d74933dc44d tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:42.988679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:43.000510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4799b695-aa3e-4f74-aef5-1bbec4a99b3f tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.442972 Oct 03 10:34:43.001187 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 626/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:42 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:43.016286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:43.017232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:43.032193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.035471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.037137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.039322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.040949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.041623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.324863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:43.336886 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-79233de4-709e-4fe1-bdb2-a1572d9f129f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.333042 Oct 03 10:34:43.344887 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 627/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:43 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:43.361545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:43.362372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:43.372348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.373388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.374345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.376046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.376741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.377570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.413923 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-16fcc30c-5bba-4816-a0a3-1d74933dc44d tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.680964 Oct 03 10:34:43.414778 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 608/1235] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:34:42 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 61 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:43.423856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:43.424476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:43.444544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.446177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.446626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.447361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.447818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.448246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.648471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:43.657466 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8fd7897-44f5-4559-bfd2-b4be5185d4a1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.310617 Oct 03 10:34:43.666184 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 628/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:43 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:43.683284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-735538aa-999a-4c6f-9cb5-78b87297a69e tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f23ae50>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:43.717443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:43.734703 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1a3a379-3f72-4569-a3a2-f8a768704678 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.318791 Oct 03 10:34:43.750745 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 609/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:43 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:43.756644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:43.757432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:43.761936 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-735538aa-999a-4c6f-9cb5-78b87297a69e tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.092146 Oct 03 10:34:43.769033 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 629/1238] 10.222.0.27 () {58 vars in 1290 bytes} [Mon Oct 3 10:34:43 2022] GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata/os_distro => generated 33 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:43.771709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.772236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.772677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.773450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.773901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.774320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.783039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc9f25e5-478f-489e-9c02-253227acb212 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792028290", "metadata": {"": ""}}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc9f25e5-478f-489e-9c02-253227acb212 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action HTTP/1.1 Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 106 Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:34:43.787389 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792028290", "metadata": {"": ""}}} Oct 03 10:34:43.788790 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'e38e9f1f-e1e7-4c75-a454-806d7b3f4503', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-792028290', 'metadata': {'': ''}}}} Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'': ''} Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:43.789565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:43.790922 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc9f25e5-478f-489e-9c02-253227acb212 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:43.792137 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc9f25e5-478f-489e-9c02-253227acb212 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action" status: 400 len: 170 microversion: 2.1 time: 0.025265 Oct 03 10:34:43.798358 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 630/1239] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 3 10:34:43 2022] POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action => generated 170 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:34:43.803668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40d3f546-595b-4360-8ad7-b5b79b690905 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update_all', calling method: .version_select at 0x7f074f0d9af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:43.857154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:43.867905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:43.870103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:43.873421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-40d3f546-595b-4360-8ad7-b5b79b690905 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:43.876257 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66dade95-d7df-4d9c-9a21-b0d67c84d460 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.139429 Oct 03 10:34:43.877281 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 610/1240] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:43 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:43.879046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-40d3f546-595b-4360-8ad7-b5b79b690905 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:43.894290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:43.894965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:43.902419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.902934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.903370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:43.904507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:43.905339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:43.907034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.108623 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40d3f546-595b-4360-8ad7-b5b79b690905 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.308907 Oct 03 10:34:44.113614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 631/1241] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:34:43 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 61 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:44.114382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:44.115000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:44.129535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.130043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.130497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.131240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.131696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.138512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.235730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:44.244213 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3c21f0c-bebf-4f14-ab41-a757da9690b5 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.365812 Oct 03 10:34:44.252960 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 611/1242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:43 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:44.256829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9952deaa-3799-46e6-80bf-0a0f2fdb9326 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f2578b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:44.325680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9952deaa-3799-46e6-80bf-0a0f2fdb9326 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.079077 Oct 03 10:34:44.326715 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 612/1243] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:34:44 2022] GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 61 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:44.333141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:44.333777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:44.339770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.340266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.340680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.341740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.342573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.343349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.349846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:44.359081 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-592db97e-1547-4683-8e6d-41b3896c20bf tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.248451 Oct 03 10:34:44.360051 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 632/1244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:44 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:44.372987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1452bced-26e3-40c9-982a-cce2da7f5442 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update_all', calling method: .version_select at 0x7f074f0b0670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:44.457443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1452bced-26e3-40c9-982a-cce2da7f5442 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:44.464357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1452bced-26e3-40c9-982a-cce2da7f5442 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:44.562650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:44.587877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f9b2fde-c948-4d11-9667-fe9fd111b7a2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.259638 Oct 03 10:34:44.589375 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 613/1245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:44 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:44.622036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5c943c08-c910-4df6-8a5b-ae7a650913ef tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1565254016", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5c943c08-c910-4df6-8a5b-ae7a650913ef tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action HTTP/1.1 Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 619 Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:44.629274 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:44.631089 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:34:44.632494 n-d-858383-3 devstack@n-api.service[122269]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1565254016", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 03 10:34:44.632494 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:34:44.632494 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'e38e9f1f-e1e7-4c75-a454-806d7b3f4503', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1565254016', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 03 10:34:44.632806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:44.633739 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:44.635056 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:44.635957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:44.635957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:44.635957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:34:44.635957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:34:44.635957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:34:44.635957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:44.638095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5c943c08-c910-4df6-8a5b-ae7a650913ef tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:44.639151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5c943c08-c910-4df6-8a5b-ae7a650913ef tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action" status: 400 len: 938 microversion: 2.1 time: 0.030165 Oct 03 10:34:44.661347 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 614/1246] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 3 10:34:44 2022] POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action => generated 938 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:34:44.667514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:44.671414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:44.680075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.680577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.681046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.681752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.682338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.686282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.736926 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1452bced-26e3-40c9-982a-cce2da7f5442 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.375260 Oct 03 10:34:44.741973 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 633/1247] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:34:44 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 61 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:44.743610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:44.748691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:44.787679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.788497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.789218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.790164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:44.790815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:44.791426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:44.923245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:44.933479 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2710dedc-678c-4908-8b2e-c5ecce9f6b13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.270648 Oct 03 10:34:44.934802 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 615/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:44 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:44.942393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-25fb4a66-9b48-4d4f-92fa-0bfce5811dd3 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update_all', calling method: .version_select at 0x7f074f2578b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:45.010089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:45.013155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-25fb4a66-9b48-4d4f-92fa-0bfce5811dd3 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:45.019721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-25fb4a66-9b48-4d4f-92fa-0bfce5811dd3 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:45.021162 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7824eff8-a2f2-4c3d-9202-2a4774c6c1c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.281173 Oct 03 10:34:45.032809 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 634/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:44 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:45.046616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:45.047516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:45.054192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.054742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.055179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.056913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.057806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.058404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.208434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:45.219248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:45.228650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:45.239976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f4f7c494-a609-44df-beed-7acb6095c6b5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.209981 Oct 03 10:34:45.242843 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 635/1250] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:45 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:45.256551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:45.257365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:45.274764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.275404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.275935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.276757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.277332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.277853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.456162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:45.470959 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bccc6970-d04a-49f2-b6fd-199c10b2e48d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.218697 Oct 03 10:34:45.482918 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 636/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:45 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:45.496457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:45.498559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:45.510270 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-25fb4a66-9b48-4d4f-92fa-0bfce5811dd3 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.572720 Oct 03 10:34:45.510945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 616/1252] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:34:44 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 64 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:45.513196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.513770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.514302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.515075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.515685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.516186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.516506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-823047d8-ce74-438c-8878-770042575f83 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-823047d8-ce74-438c-8878-770042575f83 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action HTTP/1.1 Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 285 Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:34:45.533882 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:34:45.536306 n-d-858383-3 devstack@n-api.service[122269]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'e38e9f1f-e1e7-4c75-a454-806d7b3f4503', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:34:45.543813 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:34:45.545706 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:34:45.548792 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:34:45.549771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:34:45.549771 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:34:45.549771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-823047d8-ce74-438c-8878-770042575f83 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:45.549771 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-823047d8-ce74-438c-8878-770042575f83 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action" status: 400 len: 619 microversion: 2.1 time: 0.024470 Oct 03 10:34:45.550198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:45.550304 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 617/1253] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 3 10:34:45 2022] POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:34:45.550304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b61f652-91a4-47bf-9b01-7930f4c9367d tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f2741f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:45.613768 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b61f652-91a4-47bf-9b01-7930f4c9367d tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.075078 Oct 03 10:34:45.615071 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 618/1254] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:34:45 2022] GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 64 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:45.619805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:45.620696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:45.624204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:45.627838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.628678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.629365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.630294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.630955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.631606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.763968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:45.773119 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a7f68a48-c705-432d-9803-02672f8cde5c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.288863 Oct 03 10:34:45.786589 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 637/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:45 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:45.796262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-05f08a8e-e5c8-43ba-82a5-e32c106f1a41 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update_all', calling method: .version_select at 0x7f074f167f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:45.806017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:45.816067 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17efb43d-66ac-4a31-a649-b6280e337638 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.199762 Oct 03 10:34:45.831073 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 619/1256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:45 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:45.850517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:45.851446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:45.858486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.859752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.860401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.861399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:45.862219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:45.862839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:45.877840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-05f08a8e-e5c8-43ba-82a5-e32c106f1a41 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:45.886371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-05f08a8e-e5c8-43ba-82a5-e32c106f1a41 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:46.067347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:46.075938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f66ef8e7-b702-4e36-89ea-6a7fe4f808b2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.235162 Oct 03 10:34:46.080981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 620/1257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:45 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:46.106728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:46.108001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:46.114879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.115594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.116191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.117091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.117702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.118327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.333934 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-05f08a8e-e5c8-43ba-82a5-e32c106f1a41 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.546829 Oct 03 10:34:46.335847 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 638/1258] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:34:45 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 61 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:46.339380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:46.346957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1173591668"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:46.350013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:46.353634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0d307ee-130a-4fb7-a1a7-300407dae528 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.251794 Oct 03 10:34:46.357702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.358420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.359034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.360522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.361166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.361751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.373519 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 621/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:46 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:46.386569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:46.387689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:46.401874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.402462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.402940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.403637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.405421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.407224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.441027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:46.514599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:46.525183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:46.528438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:46.536606 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-90d01151-8411-4b60-af61-3e254abcdbfa tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.159480 Oct 03 10:34:46.549362 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 622/1260] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:46 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:46.549362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-391ff385-6ea3-4f2e-9e16-aad2c06212e6 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update', calling method: .version_select at 0x7f074f2043a0>, body: {"meta": {"os_version": "alt"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:46.676316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-391ff385-6ea3-4f2e-9e16-aad2c06212e6 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:46.683796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-391ff385-6ea3-4f2e-9e16-aad2c06212e6 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:46.720386 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed007bad-f9cc-4914-8def-66e94d2db63c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action" status: 202 len: 0 microversion: 2.1 time: 0.383116 Oct 03 10:34:46.728359 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 639/1261] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:46 2022] POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:34:46.752131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1098832881"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:46.759168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:46.772755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.773781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.774394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.775358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.776470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.784261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Cannot 'createImage' instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 while it is in task_state image_snapshot_pending Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action HTTP/1.1 Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 85 Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:34:46.933121 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1098832881"}} Oct 03 10:34:46.934990 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'createImage' instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 while it is in task_state image_snapshot_pending Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'e38e9f1f-e1e7-4c75-a454-806d7b3f4503', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1098832881'}}} Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:34:46.939578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 while it is in task_state image_snapshot_pending Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 while it is in task_state image_snapshot_pending Oct 03 10:34:46.942606 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:34:46.945698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 409 to user: Cannot 'createImage' instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 while it is in task_state image_snapshot_pending {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:34:46.945698 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5582784c-15b7-42ef-bdf3-9ae710b6a25f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action" status: 409 len: 167 microversion: 2.1 time: 0.159063 Oct 03 10:34:46.945698 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 640/1262] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:34:46 2022] POST /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503/action => generated 167 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:34:46.945698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:46.945698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:46.949430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.949430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.949430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:46.949430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:46.950344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:46.950344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:47.162268 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-391ff385-6ea3-4f2e-9e16-aad2c06212e6 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.619300 Oct 03 10:34:47.163516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 623/1263] 10.222.0.27 () {60 vars in 1313 bytes} [Mon Oct 3 10:34:46 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata/os_version => generated 31 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:47.169204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f93009aa-6448-4ee1-940a-98e3286e256f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '.version_select at 0x7f074f204280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:47.359186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f93009aa-6448-4ee1-940a-98e3286e256f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/images/5ad7fd94-5200-4909-bac0-9a89b8a92870" status: 204 len: 0 microversion: 2.1 time: 0.194401 Oct 03 10:34:47.359975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 624/1264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:47 2022] DELETE /compute/v2.1/images/5ad7fd94-5200-4909-bac0-9a89b8a92870 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:34:47.366109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-762df5d1-ebbf-49d2-b0f7-e862203f2dea tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f5183a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:47.368608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:47.389121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c625dc38-16f2-49f6-b7aa-d0d45ed18683 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.487098 Oct 03 10:34:47.392639 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 641/1265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:46 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:47.398149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:47.398968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:47.407638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:47.408525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:47.424861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:47.425888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:47.426380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:47.426822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:47.480821 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-762df5d1-ebbf-49d2-b0f7-e862203f2dea tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.118654 Oct 03 10:34:47.481639 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 625/1266] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:34:47 2022] GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 58 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:47.489499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:47.497420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:47.509513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:47.512538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:47.513217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:47.515945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:47.517533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:47.518080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:47.664694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:47.687439 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9eac1bf5-3509-4d5b-8afc-b3e1c80abb18 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1534 microversion: 2.1 time: 0.293185 Oct 03 10:34:47.710927 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 642/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:47 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1534 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:47.728172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e15abf8-a4b6-442b-9279-d261c4feb464 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'update_all', calling method: .version_select at 0x7f074f846280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:47.767232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:47.784537 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f3e25fa-887f-4ac8-aa0e-95878006133c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.301662 Oct 03 10:34:47.785692 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 626/1268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:47 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:47.790505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:47.801708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:47.808558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:47.809079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:47.809539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:47.810222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:47.810830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:47.811411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:47.833511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-2e15abf8-a4b6-442b-9279-d261c4feb464 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:47.839328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-2e15abf8-a4b6-442b-9279-d261c4feb464 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:47.926754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:47.938377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:47.940106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:47.946191 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6ab9dabb-cc3c-4e51-addc-201731a685e6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.159032 Oct 03 10:34:47.947185 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 627/1269] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:47 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:48.181485 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e15abf8-a4b6-442b-9279-d261c4feb464 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.469025 Oct 03 10:34:48.182663 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 643/1270] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:34:47 2022] PUT /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 61 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:48.194054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1bc9541d-13f1-427a-b3b1-bedf30c6d243 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Action: 'create', calling method: .version_select at 0x7f074f257f70>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:48.267253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-1bc9541d-13f1-427a-b3b1-bedf30c6d243 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:48.272796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-1bc9541d-13f1-427a-b3b1-bedf30c6d243 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Getting quotas for user b7787492d456422699034fa1c8c67ed4 and project b69275de72a14841bd9569ec6f0d864c. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:48.417209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:48.418396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:48.420832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:48.431336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:48.433869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:48.434588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:48.436044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:48.437342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:48.438019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:48.652080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:48.661066 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86bb1310-be6e-4d4d-a223-d0e2e55916aa tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.248947 Oct 03 10:34:48.661665 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 644/1271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:48 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:48.717687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:48.720305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:48.729121 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1bc9541d-13f1-427a-b3b1-bedf30c6d243 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "POST /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.539573 Oct 03 10:34:48.730041 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 628/1272] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 3 10:34:48 2022] POST /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 85 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:48.738994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:48.739552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:48.739993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:48.740702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:48.741526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9b768f8-c5e7-4755-bd6a-55b025e2c6b9 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] Calling method '.version_select at 0x7f074f2579d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:48.742253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:48.743825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:48.813368 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9b768f8-c5e7-4755-bd6a-55b025e2c6b9 tempest-ImagesMetadataTestJSON-1048647176 tempest-ImagesMetadataTestJSON-1048647176-project] 10.222.0.27 "GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.076451 Oct 03 10:34:48.817557 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 629/1273] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:34:48 2022] GET /compute/v2.1/images/24178c68-965e-47d0-91de-a3d171af931a/metadata => generated 85 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:34:48.833653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:48.834301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:48.845635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:48.846139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:48.846603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:48.849859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:48.850376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:48.853780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:48.949589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:48.959018 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc1e1b12-4f51-47ab-853e-2c727e745aa8 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1540 microversion: 2.1 time: 0.245473 Oct 03 10:34:48.959753 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 645/1274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:48 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1540 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:48.990707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:48.994120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:49.009290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:49.010745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:49.012283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:49.014486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:49.016183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:49.016837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:49.059421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:49.071132 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28ba19eb-530d-4560-a939-fe27f00912da tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.252226 Oct 03 10:34:49.071736 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 630/1275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:48 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:49.121621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:49.133330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:49.135030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:49.141856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29f9339d-8835-4987-adab-227b6cd1f921 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.158624 Oct 03 10:34:49.142681 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 646/1276] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:48 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:49.685988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:49.686614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:49.695363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:49.695795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:49.696247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:49.697031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:49.698597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:49.699036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:49.912990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:49.928537 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0d70427b-a06d-4039-ad08-e1bd4b373e00 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.246977 Oct 03 10:34:49.934153 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 631/1277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:49 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:49.987758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:49.989311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:49.996841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:49.997442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:49.998140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:49.999284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:50.000047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:50.000901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:50.100077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:50.101653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:50.126931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:50.127764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:50.128370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:50.134377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:50.135200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:50.136450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:50.278707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:50.289318 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e482be12-adc9-4115-953d-828498ab6df3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1540 microversion: 2.1 time: 0.305471 Oct 03 10:34:50.316496 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 647/1278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:49 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1540 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:50.337001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:50.338216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:50.375797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:50.376539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:50.384208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:50.384208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:50.384537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:50.384846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:50.395753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:50.415792 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-653546d6-fe4a-43e4-b3d3-7710b175a5f5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.321352 Oct 03 10:34:50.416842 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 632/1279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:50 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:50.494168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:50.507324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:50.510218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:50.518257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6bb690ea-47b8-4c3c-b5ae-d4ef7c8a349d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.200538 Oct 03 10:34:50.519047 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 648/1280] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:50 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:50.956658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:50.957285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:50.963414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:50.963893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:50.964330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:50.971427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:50.972640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:50.973392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.204290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:51.213283 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-31cf0bde-411f-4855-b0d9-c3aafc7c61d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.261586 Oct 03 10:34:51.215189 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 633/1281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:50 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:51.319957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:51.322226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:51.330431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.331639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.332259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.333268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.333883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.334546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.534120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:51.542453 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8aab23bd-1f41-4e39-8d84-7ee96fc55cd2 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1522 microversion: 2.1 time: 0.231679 Oct 03 10:34:51.544202 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 649/1282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:51 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:51.549537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:51.550346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:51.556510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.557336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.557959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.558812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.559426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.560064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.589202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1914922848", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:51.668937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:34:51.743363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:51.752259 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd2932bd-1d07-4edb-9817-cd1464811f42 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1542 microversion: 2.1 time: 0.206708 Oct 03 10:34:51.769439 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 650/1283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:51 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:51.798550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:51.799184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:51.816867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.817654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.818254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.819842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.820460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.821124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.911237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:51.923646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:51.925204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:51.931084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f48e316-c9f9-4dbd-8160-2748948cc9cf tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1555 microversion: 2.91 time: 0.155603 Oct 03 10:34:51.931669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 651/1284] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:51 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:51.936227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:51.936708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:51.943860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.944567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.945194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.945948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.946467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.946955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.955830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:34:51.956242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:34:51.956713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:34:51.957562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:34:51.958008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:34:51.967723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.968467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.969595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.970315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:51.970766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:51.971199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:51.976039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:34:52.000826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Getting quotas for project fecd91e631b84f2fba9f7756cbdc63a1. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:34:52.012311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Getting quotas for user 9ea84c4ec0e14b78817e9767bfbe2a1a and project fecd91e631b84f2fba9f7756cbdc63a1. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:34:52.028372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:34:52.031817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:34:52.063500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4411dbd3-ba3e-4e18-8386-3067777ce7fe tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 204 len: 0 microversion: 2.1 time: 0.130493 Oct 03 10:34:52.064034 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 652/1285] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:34:51 2022] DELETE /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:34:52.069630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-652a7fc3-abfe-4a55-8657-057ad0d82e0a req-44380186-c04b-4968-b31a-88872ef5ff85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38e9f1f-e1e7-4c75-a454-806d7b3f4503", "name": "network-vif-plugged", "status": "completed", "tag": "70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:52.080130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-652a7fc3-abfe-4a55-8657-057ad0d82e0a req-44380186-c04b-4968-b31a-88872ef5ff85 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.080531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-652a7fc3-abfe-4a55-8657-057ad0d82e0a req-44380186-c04b-4968-b31a-88872ef5ff85 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.080991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-652a7fc3-abfe-4a55-8657-057ad0d82e0a req-44380186-c04b-4968-b31a-88872ef5ff85 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.083560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:52.086643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8d726950-78e5-4e33-97cf-dde800b83536 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679197 Oct 03 10:34:52.087298 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 634/1286] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:34:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:34:52.098387 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-652a7fc3-abfe-4a55-8657-057ad0d82e0a req-44380186-c04b-4968-b31a-88872ef5ff85 service nova] Creating event network-vif-plugged:70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f for instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 on n-h2-858383-3 Oct 03 10:34:52.104316 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-652a7fc3-abfe-4a55-8657-057ad0d82e0a req-44380186-c04b-4968-b31a-88872ef5ff85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038539 Oct 03 10:34:52.105071 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 653/1287] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:52.106380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:52.107243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:52.113575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.113831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4cbacbe2-bf3c-48e6-a1b9-eb787691aab3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:52.114469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.114663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4cbacbe2-bf3c-48e6-a1b9-eb787691aab3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:52.115313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.117863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.118518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.119109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.210856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4cbacbe2-bf3c-48e6-a1b9-eb787691aab3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:52.228104 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4cbacbe2-bf3c-48e6-a1b9-eb787691aab3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1217 microversion: 2.1 time: 0.110625 Oct 03 10:34:52.229116 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 654/1288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:52 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:52.236529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:52.237335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:52.250614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.250614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.251046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.251493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.252924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.253461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.323941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:52.335818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c3cbf99-13ea-4c8b-988c-c9567651683d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1528 microversion: 2.1 time: 0.246648 Oct 03 10:34:52.340856 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 635/1289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:52 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1528 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:52.434201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:52.444670 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-60868766-939f-4b51-ad02-ab06d21236d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.212461 Oct 03 10:34:52.445453 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 655/1290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:52 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:52.775213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:52.775827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:52.781773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.782249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.783115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.783810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.784274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.784698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.925076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:52.933161 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a45071f8-b65e-4ac4-a4fb-ccc081fa8bfc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1541 microversion: 2.1 time: 0.161850 Oct 03 10:34:52.933721 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 636/1291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:52 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1541 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:52.962679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:52.963286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:52.970006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.970490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.970925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:52.971618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:52.972074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:52.972498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.043349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:53.056142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:53.059395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:53.065902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01212b82-ce9e-4d5e-b387-59d8edf34209 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1537 microversion: 2.91 time: 0.107064 Oct 03 10:34:53.066639 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 656/1292] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:52 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:53.251642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:53.252242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:53.258625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.259102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.259530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.260206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.260652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.261115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.322730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:53.330839 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c2b6929-6b38-433c-9e1c-a1c7ac9d2b87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1221 microversion: 2.1 time: 0.083472 Oct 03 10:34:53.331404 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 637/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:53 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:53.360050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:53.360654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:53.367041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.367528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.367966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.368652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.369198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.369621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.469455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:53.470147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:53.476487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.477016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.477457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.478159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.478620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.479047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.502118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:53.509888 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bb79539-517b-4fc9-b5cf-7e51e98ed8c4 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1528 microversion: 2.1 time: 0.153611 Oct 03 10:34:53.510549 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 657/1294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:53 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1528 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:53.612549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:53.620182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e76e0f51-da0e-488c-9880-437c7b893767 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.154761 Oct 03 10:34:53.620743 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 638/1295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:53 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:53.955255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:53.955863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:53.961799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.962283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.962737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:53.963418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:53.963878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:53.964449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.095162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:54.095607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:54.095920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:54.102209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.102700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.103144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.103318 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e81c65e6-fe17-43b4-9e5e-18d1c8c4a849 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1541 microversion: 2.1 time: 0.151860 Oct 03 10:34:54.104076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.104197 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 658/1296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:53 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1541 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:54.104290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.104716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.168653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:54.176818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:54.178262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:54.183142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a99f86f-9fe2-4b98-a6c0-7120a1a66b4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1537 microversion: 2.91 time: 0.092540 Oct 03 10:34:54.183700 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 639/1297] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:54 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1537 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:34:54.354199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:54.354831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:54.361630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.362107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.362737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.363440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.363887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.364301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.433062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:54.441033 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de4d34be-7070-4e95-850f-fb1943009d3f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1213 microversion: 2.1 time: 0.090806 Oct 03 10:34:54.441790 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 659/1298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:54 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:54.534188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:54.534856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:54.541589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.542075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.542515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.543207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.543665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.544093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.644500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:54.645363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:54.651663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.652197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.652665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.653394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.653851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.654278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.773984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:54.783144 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee5ae369-b007-4a52-a4ae-4976e419f410 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1528 microversion: 2.1 time: 0.253386 Oct 03 10:34:54.784883 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 640/1299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:54 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1528 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:54.791013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-feec27d4-597a-4a40-abc2-bd0b644ffb3e req-edb4b997-12d2-4f10-8706-e15dcb2ce576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "name": "network-vif-unplugged", "status": "completed", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:54.796535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:54.806159 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-781ea67b-c2b8-467b-a8a3-d463a6a728fc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.166201 Oct 03 10:34:54.806755 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 660/1300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:54 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:54.809388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-feec27d4-597a-4a40-abc2-bd0b644ffb3e req-edb4b997-12d2-4f10-8706-e15dcb2ce576 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:54.809876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-feec27d4-597a-4a40-abc2-bd0b644ffb3e req-edb4b997-12d2-4f10-8706-e15dcb2ce576 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:54.810312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-feec27d4-597a-4a40-abc2-bd0b644ffb3e req-edb4b997-12d2-4f10-8706-e15dcb2ce576 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:54.823394 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-feec27d4-597a-4a40-abc2-bd0b644ffb3e req-edb4b997-12d2-4f10-8706-e15dcb2ce576 service nova] Creating event network-vif-unplugged:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h2-858383-3 Oct 03 10:34:54.829518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-feec27d4-597a-4a40-abc2-bd0b644ffb3e req-edb4b997-12d2-4f10-8706-e15dcb2ce576 service nova] Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:34:54.841069 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-feec27d4-597a-4a40-abc2-bd0b644ffb3e req-edb4b997-12d2-4f10-8706-e15dcb2ce576 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054370 Oct 03 10:34:54.841718 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 641/1301] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:55.128698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:55.129364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:55.136040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.136562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.137405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.138110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.138572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.139004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.209952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:55.210657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:55.218131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.218637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.219269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.219785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.220243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.220915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.276698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:55.286868 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f60cce1-e807-4f1b-b6bc-6f7804c1ace1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1541 microversion: 2.1 time: 0.162993 Oct 03 10:34:55.301069 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 661/1302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:55 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1541 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:55.305129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:55.313313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:55.314763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:55.319724 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-727d9fea-efc9-4f38-a150-e54c49f7f32d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1537 microversion: 2.91 time: 0.113968 Oct 03 10:34:55.320328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 642/1303] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:55 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1537 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:34:55.463647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:55.464282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:55.471893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.472377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.472834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.473534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.473980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.474402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.811760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:55.813362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:55.822676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.824933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.826232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.828657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.845622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.846982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.866503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:55.874535 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-974345e6-904b-4b20-addd-e29b6928ab5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1213 microversion: 2.1 time: 0.414912 Oct 03 10:34:55.875145 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 662/1304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:55 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1213 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:55.883574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:55.884187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:55.902563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.903061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.903498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:55.904206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:55.904652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:55.905356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.183989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:56.185808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:56.197385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d2e5e30-14a6-45b2-90e7-6dc2be3c390e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1528 microversion: 2.1 time: 0.393835 Oct 03 10:34:56.197991 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 643/1305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:55 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1528 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:56.205469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-47032b57-36f6-4af6-9a69-9f736ff147b7 req-09e275cb-ee59-432d-92b2-6375412b5182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38e9f1f-e1e7-4c75-a454-806d7b3f4503", "name": "network-vif-unplugged", "status": "completed", "tag": "70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:56.206266 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4cd197b2-b408-4463-a65e-92d9251abe8a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.330078 Oct 03 10:34:56.220688 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 663/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:55 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:56.233392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47032b57-36f6-4af6-9a69-9f736ff147b7 req-09e275cb-ee59-432d-92b2-6375412b5182 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.233945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47032b57-36f6-4af6-9a69-9f736ff147b7 req-09e275cb-ee59-432d-92b2-6375412b5182 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.234410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47032b57-36f6-4af6-9a69-9f736ff147b7 req-09e275cb-ee59-432d-92b2-6375412b5182 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.246141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-47032b57-36f6-4af6-9a69-9f736ff147b7 req-09e275cb-ee59-432d-92b2-6375412b5182 service nova] Creating event network-vif-unplugged:70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f for instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 on n-h2-858383-3 Oct 03 10:34:56.251805 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-47032b57-36f6-4af6-9a69-9f736ff147b7 req-09e275cb-ee59-432d-92b2-6375412b5182 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051887 Oct 03 10:34:56.252822 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 644/1307] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:56.285970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:56.288246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:56.294378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.294865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.295301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.295997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.296452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.296949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.313990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:56.315239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:56.322668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.323055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.323489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.324322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.324867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.325332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.329545 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d3479d1-6583-414b-b54e-9dd4c6d4ec06 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047773 Oct 03 10:34:56.330437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 664/1308] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:34:56 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:34:56.340684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:56.341338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:56.348365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.349459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.349900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.350611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.351168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.351999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.623061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:56.627712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:56.630971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lazy-loading 'services' on Instance uuid 483b0eff-2eb2-45a1-a1df-c3526b899003 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:34:56.641945 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1308bc20-34e7-47af-a387-b02ffdf2822e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1541 microversion: 2.1 time: 0.334229 Oct 03 10:34:56.642546 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 645/1309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:56 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1541 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:56.661346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:56.661969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:56.669770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.670613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.671273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.673034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.673748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.674383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.777769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:56.789645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:56.791724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:56.803192 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfd05ef4-1ae9-4a40-b313-ea78156478c5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1480 microversion: 2.91 time: 0.159480 Oct 03 10:34:56.803761 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 646/1310] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:56 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1480 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:56.809064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6af84f63-5c57-4042-9194-db8057f70cb8 req-e48e9bb8-4581-45f4-b7e6-96e395babb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38e9f1f-e1e7-4c75-a454-806d7b3f4503", "name": "network-vif-deleted", "tag": "70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:56.834679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6af84f63-5c57-4042-9194-db8057f70cb8 req-e48e9bb8-4581-45f4-b7e6-96e395babb75 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.835258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6af84f63-5c57-4042-9194-db8057f70cb8 req-e48e9bb8-4581-45f4-b7e6-96e395babb75 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.835807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6af84f63-5c57-4042-9194-db8057f70cb8 req-e48e9bb8-4581-45f4-b7e6-96e395babb75 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.851137 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6af84f63-5c57-4042-9194-db8057f70cb8 req-e48e9bb8-4581-45f4-b7e6-96e395babb75 service nova] Creating event network-vif-deleted:70a03dd4-4d2d-4cb0-8689-92bc9bb5ec5f for instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 on n-h2-858383-3 Oct 03 10:34:56.858414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6af84f63-5c57-4042-9194-db8057f70cb8 req-e48e9bb8-4581-45f4-b7e6-96e395babb75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053145 Oct 03 10:34:56.860119 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 647/1311] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:56.866037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:56.870252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:56.878015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.878824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.879471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.880668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:56.881443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:56.882098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:56.932121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-3". {{(pid=122269) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 10:34:56.984357 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba39a8f9-42ef-45c3-84fc-1797048461f4 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "DELETE /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments/7e81f2b9-bd16-450e-b6b9-aec77c2c331c" status: 202 len: 0 microversion: 2.1 time: 0.646895 Oct 03 10:34:56.989503 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 665/1312] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:34:56 2022] DELETE /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments/7e81f2b9-bd16-450e-b6b9-aec77c2c331c => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:34:56.995208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ed47025f-b9ae-4fca-bd05-dd2247810ad2 req-4a980036-18ae-4093-848a-1c4ddfade5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:57.001596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7dafd26-f889-447e-aff8-9c87acfcf8f3 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action" status: 202 len: 0 microversion: 2.91 time: 0.139878 Oct 03 10:34:57.003728 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 648/1313] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:34:56 2022] POST /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:34:57.009152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:57.009962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:57.010551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ed47025f-b9ae-4fca-bd05-dd2247810ad2 req-4a980036-18ae-4093-848a-1c4ddfade5d9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.011029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ed47025f-b9ae-4fca-bd05-dd2247810ad2 req-4a980036-18ae-4093-848a-1c4ddfade5d9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.011460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ed47025f-b9ae-4fca-bd05-dd2247810ad2 req-4a980036-18ae-4093-848a-1c4ddfade5d9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.018927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.019670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.020334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.021350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.021990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.022723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.026516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ed47025f-b9ae-4fca-bd05-dd2247810ad2 req-4a980036-18ae-4093-848a-1c4ddfade5d9 service nova] Creating event network-changed:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h2-858383-3 Oct 03 10:34:57.035386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-ed47025f-b9ae-4fca-bd05-dd2247810ad2 req-4a980036-18ae-4093-848a-1c4ddfade5d9 service nova] Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:34:57.050765 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ed47025f-b9ae-4fca-bd05-dd2247810ad2 req-4a980036-18ae-4093-848a-1c4ddfade5d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059671 Oct 03 10:34:57.051513 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 666/1314] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:34:57.072882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:57.072882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:57.072882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.072882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.073292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.073292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.073292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.073554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.113366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:57.129497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6bb0280d-6e72-43c2-8836-6f543780834f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1275 microversion: 2.1 time: 0.124228 Oct 03 10:34:57.133606 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 649/1315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:57 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:57.204480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:57.214328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:57.216683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:57.222776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:57.224090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:57.225918 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a039f873-9f2d-48be-ba28-2b922d6a859d tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1488 microversion: 2.91 time: 0.173358 Oct 03 10:34:57.227191 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 667/1316] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:57 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1488 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:34:57.249570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.250694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.251167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.252432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:57.253086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:57.254167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.254868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.255916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.260387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.260970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.261586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.262258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.262769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.265076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.304926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.305418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.305858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.306319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lazy-loading 'fault' on Instance uuid e38e9f1f-e1e7-4c75-a454-806d7b3f4503 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:34:57.358730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:57.378610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40f8cb3c-c15f-40f7-9d54-ab694dcf2b53 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1315 microversion: 2.1 time: 0.161033 Oct 03 10:34:57.380826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 650/1317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:57 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:57.639634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:57.648564 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3317b233-5549-4302-a8d3-8fcb5fc4932b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.407223 Oct 03 10:34:57.649178 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 668/1318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:57 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:34:57.665683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:57.666747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:57.670651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:57.675916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.676433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.676901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.677616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:57.678072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:57.678505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:57.825185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:57.833315 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e09abdd0-5c74-4c37-bd58-e5733ec862b3 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1473 microversion: 2.1 time: 0.171553 Oct 03 10:34:57.833992 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 651/1319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:57 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:58.159713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:58.160335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:58.166978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.167465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.167903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.168608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.169107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.169534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.253811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:58.254495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:58.261196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.261753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.262251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.263056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.263505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.263924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.305007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:58.313422 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf67362c-6f03-4d23-bc96-7601c1a1888f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.158051 Oct 03 10:34:58.314269 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 669/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:58 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:58.335551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:58.343861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:58.345362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:58.350190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-90e96a1f-e71c-4207-9817-b61dc2ea6745 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1488 microversion: 2.91 time: 0.100231 Oct 03 10:34:58.350765 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 652/1321] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:58 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1488 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:34:58.404619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:58.405165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:58.411286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.411769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.412203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.412916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.413372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.413796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.444714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.445232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.445671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.446118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lazy-loading 'fault' on Instance uuid e38e9f1f-e1e7-4c75-a454-806d7b3f4503 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:34:58.486316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:58.488575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:34:58.496243 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f9431bd-6341-4e5a-b5ad-924e1da5d9d0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1315 microversion: 2.1 time: 0.095664 Oct 03 10:34:58.496828 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 670/1322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:58 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1315 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:58.673686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:58.674230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:58.680148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.680632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.681171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.681860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.682314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.682742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.848344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:58.873347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:58.875439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:58.886322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.886872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.887312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:58.887668 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ae34c386-323d-406c-8d2d-bed415fadba7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.218384 Oct 03 10:34:58.888270 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 653/1323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:58 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:58.888742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:58.889222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:58.889643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.126847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:59.136570 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-483bc077-3d23-4929-8c10-1d2b9f75e1bc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1473 microversion: 2.1 time: 0.283226 Oct 03 10:34:59.137767 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 671/1324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:58 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1473 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:59.336588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:59.337220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:59.344111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.344592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.345055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.345746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.346196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.347023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.377473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:59.378082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:59.384644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.385298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.385801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.386573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.387114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.387607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.478420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:59.479062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:59.486512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:59.487425 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3c60a611-08e1-4b71-806e-0e34b9b43cad tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.154707 Oct 03 10:34:59.487954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:59.493130 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-430f87fc-6e4e-4cf4-97d8-4dbe7239a084 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1490 microversion: 2.91 time: 0.119411 Oct 03 10:34:59.493699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 672/1325] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:34:59 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1490 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:34:59.501248 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 654/1326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:59 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:59.520973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:59.521588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:59.524142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ea0cd9dc-80b3-453c-b0b6-2ffbe65556f9 req-6a18c5ba-8680-4629-a4a3-8a3eab9450bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5914cb9d-936d-4df2-b759-da941b2982df", "tag": "72809ff0-0bb2-4fd1-8b14-2f84af87b5b6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:34:59.528538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.529137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.529752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.530681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.532996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.533594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.536372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ea0cd9dc-80b3-453c-b0b6-2ffbe65556f9 req-6a18c5ba-8680-4629-a4a3-8a3eab9450bd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.536998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ea0cd9dc-80b3-453c-b0b6-2ffbe65556f9 req-6a18c5ba-8680-4629-a4a3-8a3eab9450bd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.537673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ea0cd9dc-80b3-453c-b0b6-2ffbe65556f9 req-6a18c5ba-8680-4629-a4a3-8a3eab9450bd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.552386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ea0cd9dc-80b3-453c-b0b6-2ffbe65556f9 req-6a18c5ba-8680-4629-a4a3-8a3eab9450bd service nova] Creating event network-changed:72809ff0-0bb2-4fd1-8b14-2f84af87b5b6 for instance 5914cb9d-936d-4df2-b759-da941b2982df on n-h2-858383-3 Oct 03 10:34:59.558216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ea0cd9dc-80b3-453c-b0b6-2ffbe65556f9 req-6a18c5ba-8680-4629-a4a3-8a3eab9450bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037372 Oct 03 10:34:59.559712 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 655/1327] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:34:59.760964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.761453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.768909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.769799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lazy-loading 'fault' on Instance uuid e38e9f1f-e1e7-4c75-a454-806d7b3f4503 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:34:59.833584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:34:59.844814 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e4e75810-7fe2-41e4-be2c-1908e84ca2c3 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 200 len: 1315 microversion: 2.1 time: 0.327714 Oct 03 10:34:59.845397 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 673/1328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:59 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:34:59.912078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:34:59.912786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:34:59.919006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.919486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.919950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:34:59.920667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:34:59.921146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:34:59.921573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.048492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:00.056080 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2f69b3d2-ae05-4871-8cf3-15a16eab55ce tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.148518 Oct 03 10:35:00.056664 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 656/1329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:34:59 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:00.159342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:00.159968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:00.166227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.166705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.167139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.167823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.168288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.168694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.464589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:00.478766 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-573b2149-b847-40bb-9db2-a3274a4d109e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1470 microversion: 2.1 time: 0.323176 Oct 03 10:35:00.479552 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 674/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:00 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1470 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:00.503850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:00.506218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:00.520598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.525210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.525773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.526520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.526994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.527484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.529604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:00.530509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:00.545042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.549003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.549775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.553843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.554836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.555500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.633865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.636314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.637558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.638910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.639581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.640217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.668361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:35:00.674606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for user fa6ea468370b4bacb98dd5457b0e6aea and project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:35:00.836220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2632876b-fddc-4b9a-9973-f65422f88f5d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a/action" status: 202 len: 0 microversion: 2.1 time: 0.337154 Oct 03 10:35:00.837569 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 657/1331] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:35:00 2022] POST /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:35:00.845554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:00.846530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:00.853472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.854211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.855430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:00.856666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:00.857610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:00.860485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.027471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:01.040980 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40194c64-ce3c-486e-952d-787f12b59d10 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.529852 Oct 03 10:35:01.056902 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 675/1332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:00 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:01.061424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:01.068810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:01.074906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:01.075089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:01.076799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:01.082278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:01.082876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:01.083333 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d4c012d-4aac-4816-b814-9e9b2dedb3a1 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.243874 Oct 03 10:35:01.083453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.084065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:01.084656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:01.084819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 658/1333] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:00 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:01.085410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.089471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:01.090351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:01.096794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:01.097522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:01.098170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.099076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:01.099736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:01.100366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.104807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:01.116653 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 HTTP/1.1 Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:35:01.118744 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:35:01.120107 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'e38e9f1f-e1e7-4c75-a454-806d7b3f4503'} Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:01.120893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:35:01.123042 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:01.125209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:01.126309 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e59c3a33-be56-4fd0-a28c-155a64262db9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 404 len: 111 microversion: 2.1 time: 0.040316 Oct 03 10:35:01.133414 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 659/1334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:01 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:35:01.138594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:01.139459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:01.147947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:01.148815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:01.149382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.150329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:01.151025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:01.151684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.247408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:01.256042 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de00e3f1-0797-4c70-a8e1-e53c0e867dbc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.197604 Oct 03 10:35:01.256975 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 676/1335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:01 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:01.271087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8403786c-f937-4a9b-b68a-0b53bfa6531e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'create', calling method: .version_select at 0x7f074f0b0a60>, body: {"keypair": {"name": "tempest-keypair-1352004022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT8sMk6BwQco53ro13PryLFv94ojrGUelRLwFjnBG7eX0f0roo1DGeGfo1HrGuzwektUP8H+CIO7bnd6ktv5RFoazz3kztFxxCeLISE0P9eyFjcWiAF4QSg3ecFW4w2XQ=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:01.290654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8403786c-f937-4a9b-b68a-0b53bfa6531e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:35:01.296904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8403786c-f937-4a9b-b68a-0b53bfa6531e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for user d55ab76047b047f4b45b003fd15f8ea3 and project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:35:01.315209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:01.319940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:01.326539 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e32d4441-e136-491d-9611-f5b33c64ca0a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.191777 Oct 03 10:35:01.327885 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 660/1336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:01 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:01.332106 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8403786c-f937-4a9b-b68a-0b53bfa6531e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073293 Oct 03 10:35:01.339454 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 677/1337] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:35:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:01.879190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2f258902-80e3-4600-9da8-e476f7e7dbf7 req-82bf6f87-bf1c-48c9-b984-30244a7adacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "name": "network-vif-plugged", "status": "completed", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:01.895200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2f258902-80e3-4600-9da8-e476f7e7dbf7 req-82bf6f87-bf1c-48c9-b984-30244a7adacc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:01.896090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2f258902-80e3-4600-9da8-e476f7e7dbf7 req-82bf6f87-bf1c-48c9-b984-30244a7adacc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:01.896853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2f258902-80e3-4600-9da8-e476f7e7dbf7 req-82bf6f87-bf1c-48c9-b984-30244a7adacc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:01.932197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-2f258902-80e3-4600-9da8-e476f7e7dbf7 req-82bf6f87-bf1c-48c9-b984-30244a7adacc service nova] Creating event network-vif-plugged:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h2-858383-3 Oct 03 10:35:01.948172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-2f258902-80e3-4600-9da8-e476f7e7dbf7 req-82bf6f87-bf1c-48c9-b984-30244a7adacc service nova] Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:35:01.975043 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2f258902-80e3-4600-9da8-e476f7e7dbf7 req-82bf6f87-bf1c-48c9-b984-30244a7adacc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100771 Oct 03 10:35:01.978893 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 661/1338] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:02.064011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:02.065292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:02.081569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.082384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.083194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.084347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.085370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.086126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.113571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=26 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:02.118366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:02.119010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:02.127160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.127983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.128649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.129631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.130326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.131009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.218071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:02.227760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:02.229962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:02.236408 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-101cc72e-4719-4b07-acdb-6e1f76ee4cb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.123749 Oct 03 10:35:02.237360 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 662/1339] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:02 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:02.285702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:02.287707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:02.295837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.297780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.298386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.299616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.300242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.300844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.354866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:02.364573 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce4accdb-44e4-48f0-8d39-ce212a5ded95 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.304808 Oct 03 10:35:02.365373 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 678/1340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:02 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:02.372824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:02.373576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:02.380206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.380966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.381312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.382036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:02.382846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:02.383076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:02.475452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:02.483896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1f492651-5146-495d-8497-a000f9e57af0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.207837 Oct 03 10:35:02.485300 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 663/1341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:02 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:02.595437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:02.608588 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1d986c0-8704-4a9c-95ed-4329c18df26c tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.239191 Oct 03 10:35:02.610220 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 679/1342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:02 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:03.272175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:03.273422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:03.282667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.283154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.283591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.284289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.284734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.285578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.353834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:03.362727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:03.364646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:03.370935 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c05ed4a-7d71-48d8-a130-593a21007a2c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.109942 Oct 03 10:35:03.378770 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 664/1343] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:03 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:03.395287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:03.398985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:03.406758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.407535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.408077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.409003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.409572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.410253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.518992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:03.519971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:03.530118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.531078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.532673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.533506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.534341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.534915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.722955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:03.735324 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b29013f4-a57c-4310-b08f-c377a2fba438 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.343930 Oct 03 10:35:03.736253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 680/1344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:03 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:03.741967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:03.742827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:03.768392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.769180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.769975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.770838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:03.771440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:03.772015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:03.824487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:03.843361 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fac1b747-b7e4-49ae-acd5-84c0fb8bbe63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.328335 Oct 03 10:35:03.845671 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 665/1345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:03 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:04.087355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:04.099015 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb9a1926-b61a-4061-91b3-b6f42599be1a tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1472 microversion: 2.1 time: 0.360958 Oct 03 10:35:04.100343 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 681/1346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:03 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:04.348332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1445563694", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:04.405697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:04.407508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:04.418053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.418629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.419174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.419887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.420345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.420865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.455909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] validate_networks() for [('6afe4139-285e-4668-b631-5b7bdefbe50f', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:35:04.534533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:04.543767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:04.545446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:04.551271 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ec712d7-2250-4de9-98f8-9ea5a3c65c1c tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.149352 Oct 03 10:35:04.552511 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 682/1347] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:04 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:04.762412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:04.763023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:04.769387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.769879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.770314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.771191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.771453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.771876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.888321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:35:04.888863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:35:04.889529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:35:04.890599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:35:04.891247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:35:04.900202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.900761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.901459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.902368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.902885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.903370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.917831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:04.921045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:35:04.926481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for user d55ab76047b047f4b45b003fd15f8ea3 and project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:35:04.926655 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7653dc40-5839-4041-8119-ea5d181ff371 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.168116 Oct 03 10:35:04.927108 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 683/1348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:04 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:04.931734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:04.932409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:04.938895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.939580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.940165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.941064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:04.941669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:04.942252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:04.951503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:35:04.954065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:35:05.005637 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c38e84bc-ff87-4157-9512-aaa83b9c6d67 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.662126 Oct 03 10:35:05.006878 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 666/1349] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:35:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:35:05.019592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10004a7e-1cea-427d-87c6-a8cb96e110e9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:05.020430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10004a7e-1cea-427d-87c6-a8cb96e110e9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:05.095600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-10004a7e-1cea-427d-87c6-a8cb96e110e9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:05.100325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:05.103594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10004a7e-1cea-427d-87c6-a8cb96e110e9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1225 microversion: 2.1 time: 0.088018 Oct 03 10:35:05.104740 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 667/1350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:05 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:05.124493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca5189cc-d862-4450-b734-6d3ff44d4165 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.196117 Oct 03 10:35:05.125391 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 684/1351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:04 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:05.125858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:05.127246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:05.136221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.136221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.137188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:05.138201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.138779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.139378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:05.284236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:05.292738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f119fa9f-c4ba-4c4d-8c59-c349ffc71b39 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.172127 Oct 03 10:35:05.293369 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 668/1352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:05 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:05.580558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:05.581320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:05.587676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.588161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.588593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:05.589339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.589789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.590207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:05.657459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:05.665815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:05.667267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:05.672058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1805063e-bc0d-4eb9-bb39-959e6b301bd5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.096106 Oct 03 10:35:05.673150 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 685/1353] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:05 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:05.771760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:05.774169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:05.780590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.781126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.782773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:05.783511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.783972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.784406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:05.815729 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d921f55d-68cd-43a0-9427-008e8f00d945 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 Oct 03 10:35:05.815729 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 669/1354] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:05 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:05.951600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:05.952634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:05.959561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.960149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.960631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:05.961420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:05.961930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:05.962391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.127269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:06.128244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:06.129571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:06.136534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.137476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.137856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-38eefbaa-6766-4a9d-9d3f-888bf294b400 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.191367 Oct 03 10:35:06.138389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.154852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.154852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.154852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.155961 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 686/1355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:05 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:06.163266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:06.164347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:06.170783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.171500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.172612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.173532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.174910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.175516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.233422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:06.249383 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9f043fc-96ed-477a-8cc8-02ef96c6ae26 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1229 microversion: 2.1 time: 0.125627 Oct 03 10:35:06.250826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 670/1356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:06 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1229 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:06.319173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:06.319980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:06.326670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:06.327786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.328541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.329205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.330085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.330541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.331154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.335590 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7118f283-8f7f-4a8f-9114-4f2bf82dff31 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.178194 Oct 03 10:35:06.336489 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 687/1357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:06 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:06.504051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:06.511920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d05b9e9-cc78-4bf6-b69a-4bdb609e1424 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.197431 Oct 03 10:35:06.512487 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 671/1358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:06 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:06.705946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:06.706918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:06.715641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.716348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.717726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.719174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.719817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.720413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.726571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:06.792799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:06.801684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:06.803136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:06.808019 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-54693e1f-aef1-4cf2-9862-45a2e87faf4a tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.112234 Oct 03 10:35:06.808591 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 688/1359] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:06 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:06.832532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:06.834776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:06.841166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.841676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.842209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.842991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:06.843460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:06.844457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:06.878083 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53963e7d-1e91-4075-8644-d58811094d02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049387 Oct 03 10:35:06.883023 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 672/1360] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:06 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:07.164075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:07.165133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:07.172827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.173486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.174006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.174817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.175375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.175816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.277521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:07.278151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:07.284824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.285304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.285734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.286686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.287134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.287553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.321357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:07.331946 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e8bfc57-076a-4e69-90e9-4b855105e123 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.172222 Oct 03 10:35:07.333290 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 689/1361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:07 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:07.361104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:07.361764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:07.368472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.369265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.369858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.370768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.371393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.371967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.387052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:07.400522 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d66a50cd-0087-42e5-b39e-9491a8b00586 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1229 microversion: 2.1 time: 0.126833 Oct 03 10:35:07.401715 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 673/1362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:07 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:07.535237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:07.535848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:07.542091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.542570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.543003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.543698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.544174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.544603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.564087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:07.587205 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0ad992cb-ac70-4a01-837a-eac3ad063b0b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.231395 Oct 03 10:35:07.588844 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 690/1363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:07 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:07.755857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:07.763862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1f63626-e4af-4a0d-8308-7902eaa276b7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.232533 Oct 03 10:35:07.764439 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 674/1364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:07 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:07.837709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:07.838956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:07.847017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.847862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.848571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.849535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.850281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.850947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.890135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:07.895884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:07.919459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.924736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.925550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.928269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:07.929099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:07.930392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:07.989261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:07.997967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba877eb3-63dd-4882-a5bf-f388a6916ecb tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111765 Oct 03 10:35:07.999342 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 675/1365] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:07 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:08.002209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:08.005679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-50d30de9-59a7-48d9-b7d4-db53587fac2b req-b4ab6f21-6ec0-42cd-a110-ec46eb7c9228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5914cb9d-936d-4df2-b759-da941b2982df", "name": "network-vif-plugged", "status": "completed", "tag": "72809ff0-0bb2-4fd1-8b14-2f84af87b5b6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:08.006274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:08.016559 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-471f2771-c947-4c28-a39d-7ab0e6e91ac3 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.184359 Oct 03 10:35:08.036800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 691/1366] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:07 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:08.039595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-50d30de9-59a7-48d9-b7d4-db53587fac2b req-b4ab6f21-6ec0-42cd-a110-ec46eb7c9228 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.041191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-50d30de9-59a7-48d9-b7d4-db53587fac2b req-b4ab6f21-6ec0-42cd-a110-ec46eb7c9228 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.042242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-50d30de9-59a7-48d9-b7d4-db53587fac2b req-b4ab6f21-6ec0-42cd-a110-ec46eb7c9228 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.056145 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-50d30de9-59a7-48d9-b7d4-db53587fac2b req-b4ab6f21-6ec0-42cd-a110-ec46eb7c9228 service nova] Creating event network-vif-plugged:72809ff0-0bb2-4fd1-8b14-2f84af87b5b6 for instance 5914cb9d-936d-4df2-b759-da941b2982df on n-h2-858383-3 Oct 03 10:35:08.061217 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-50d30de9-59a7-48d9-b7d4-db53587fac2b req-b4ab6f21-6ec0-42cd-a110-ec46eb7c9228 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059434 Oct 03 10:35:08.061817 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 676/1367] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:08.355467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:08.356093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:08.372291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.373077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.373704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.374777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.375435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.376056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.425721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:08.427009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:08.443688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.444610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.445321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.446271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.448239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.449641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.573506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:08.587088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b71609b-2a6a-4194-8af4-77fd384020eb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1277 microversion: 2.1 time: 0.166927 Oct 03 10:35:08.588106 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 677/1368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:08 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:08.611181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:08.612740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:08.619893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.620379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.620972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.621887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.622893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.623684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.637298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:08.647259 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db2a2164-dee2-4be1-aa43-9a58a4154986 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.295579 Oct 03 10:35:08.652141 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 692/1369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:08 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:08.788171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:08.789149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:08.802169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.807776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.810088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.811400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:08.812249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:08.813701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:08.830920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:08.841449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d53c2aa9-1bba-4fef-bc8b-56c660deb8b9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.234548 Oct 03 10:35:08.845201 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 678/1370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:08 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:09.009331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:09.012802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:09.016502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:09.021172 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5c97cb9d-9ff0-4c5d-a8f4-540fe14a7adb tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.237023 Oct 03 10:35:09.022980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 693/1371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:08 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:09.036697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.039880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.042398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.043066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.046158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.046680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.051729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:09.052976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:09.060861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:09.069522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.071446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.072913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.073855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.075686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.077752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.108993 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-895ccffb-9298-44c2-9151-8b6409a769dd tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100888 Oct 03 10:35:09.110442 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 679/1372] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:09 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:09.185774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:09.195931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:09.197945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:09.205033 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3ddf3a5-6340-43aa-8de7-13f69ab0b91e tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.160032 Oct 03 10:35:09.225310 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 694/1373] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:09 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:09.620599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:09.620599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:09.634529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.635028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.635474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.636204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.636655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.637114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.678782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:09.679400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:09.690752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.692576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.693476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.694531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.695405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.696056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.902897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:09.914250 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7843d3a-4cef-4bc0-aeed-470d33605482 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.303133 Oct 03 10:35:09.921179 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 680/1374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:09 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:09.933947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:09.934702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:09.942875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.943541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.943994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:09.944927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:09.945392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:09.945861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.103204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:10.111554 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3cd4972-d053-4b94-8897-2437dd6b2070 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.189276 Oct 03 10:35:10.112131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 681/1375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:09 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:10.116853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:10.117776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:10.120921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:10.126038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.126629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.127140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.128079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.128535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.129259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.164422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:10.174531 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e6b1f90-52ae-457f-9dc2-9d42b1258624 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.499903 Oct 03 10:35:10.188800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 695/1376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:09 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:10.198056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b0911873-0487-46cf-8abe-3025e6b237f9 req-4499de3f-cd8b-4ba0-af90-49c61f7b0ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d64078-3f94-45fb-a864-a10c79b8c92e", "name": "network-vif-unplugged", "status": "completed", "tag": "357dbd63-2219-4a26-ac04-d34854ccbbfd"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:10.220572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b0911873-0487-46cf-8abe-3025e6b237f9 req-4499de3f-cd8b-4ba0-af90-49c61f7b0ff2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.221086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b0911873-0487-46cf-8abe-3025e6b237f9 req-4499de3f-cd8b-4ba0-af90-49c61f7b0ff2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.221520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b0911873-0487-46cf-8abe-3025e6b237f9 req-4499de3f-cd8b-4ba0-af90-49c61f7b0ff2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.257177 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b0911873-0487-46cf-8abe-3025e6b237f9 req-4499de3f-cd8b-4ba0-af90-49c61f7b0ff2 service nova] Creating event network-vif-unplugged:357dbd63-2219-4a26-ac04-d34854ccbbfd for instance 63d64078-3f94-45fb-a864-a10c79b8c92e on n-h1-858383-3 Oct 03 10:35:10.264257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b0911873-0487-46cf-8abe-3025e6b237f9 req-4499de3f-cd8b-4ba0-af90-49c61f7b0ff2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087018 Oct 03 10:35:10.266655 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 696/1377] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:10.279748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:10.292330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:10.305341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.305833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.306271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.306982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.307434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.307970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.335858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:10.349037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a61a440-1e90-45a8-85b2-08e48017a844 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.235568 Oct 03 10:35:10.351668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c327365-6a82-4ce7-9227-e920dbcef612 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083421 Oct 03 10:35:10.352498 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 697/1379] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:10 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:10.353490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 682/1379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:10 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:10.357297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:10.357904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:10.365655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.366159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.366600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.367311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.367755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.368271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.506467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:10.515369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:10.516994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:10.522811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f821c9c8-c1a9-4272-821e-c514a117b318 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.169161 Oct 03 10:35:10.523405 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 698/1380] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:10 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:10.822515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b0675aa6-4b54-4961-bd96-b7d526f6c531 req-344b936a-dd91-4432-bb49-cc2e85465990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d11e46cc-232c-4567-b838-7c009c4629ab", "tag": "ee928549-744d-45bc-acd1-1b9b96206371"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:10.849875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b0675aa6-4b54-4961-bd96-b7d526f6c531 req-344b936a-dd91-4432-bb49-cc2e85465990 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.850508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b0675aa6-4b54-4961-bd96-b7d526f6c531 req-344b936a-dd91-4432-bb49-cc2e85465990 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.853357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b0675aa6-4b54-4961-bd96-b7d526f6c531 req-344b936a-dd91-4432-bb49-cc2e85465990 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.874787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b0675aa6-4b54-4961-bd96-b7d526f6c531 req-344b936a-dd91-4432-bb49-cc2e85465990 service nova] Creating event network-changed:ee928549-744d-45bc-acd1-1b9b96206371 for instance d11e46cc-232c-4567-b838-7c009c4629ab on n-h1-858383-3 Oct 03 10:35:10.883103 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b0675aa6-4b54-4961-bd96-b7d526f6c531 req-344b936a-dd91-4432-bb49-cc2e85465990 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063616 Oct 03 10:35:10.883103 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 683/1381] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:10.939759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:10.945578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:10.959730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.960222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.960994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:10.962073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:10.962974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:10.963575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.138151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:11.138913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:11.152617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.155255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.155963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.157043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.158506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.161090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.194541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:11.202562 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b0c79938-8df5-450c-a014-b7e33465c1d7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.266934 Oct 03 10:35:11.203691 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 699/1382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:10 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:11.222984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:11.223887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:11.241833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.242611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.243223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.244103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.244721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.245403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.306701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=22 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:11.422528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:11.430333 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a21135b-0d3b-4522-92ac-4e3d1dd14da1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.296868 Oct 03 10:35:11.431224 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 684/1383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:11 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:11.436132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:11.438907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:11.445108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.445600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.446038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.446735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.447357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.447788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.488934 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-52181b0e-91c0-4471-8cc2-169e8eb36b3d tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056435 Oct 03 10:35:11.490201 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 685/1384] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:11 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:11.498664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:11.504543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:11.517494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.519240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.519873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.521294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.522054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.522654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.570333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:11.579196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff026f22-f9e4-4b08-803d-e0209ed18750 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.359917 Oct 03 10:35:11.587764 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 700/1385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:11 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:11.593134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:11.593928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:11.600079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.600652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.601135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.601843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:11.602305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:11.602739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:11.668254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:11.677127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:11.677302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:11.678643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:11.684670 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11dd7a5f-84c5-4c7b-9734-1b0951bf1feb tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.095626 Oct 03 10:35:11.685751 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 701/1386] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:11 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:11.703797 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b606e8eb-e4c3-492c-8888-2319dac9f6dd tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.212248 Oct 03 10:35:11.704745 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 686/1387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:11 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:12.226036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:12.226697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:12.233216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.233700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.234191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.234873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.235325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.235751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.280422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e936442c-d08e-4ea1-a2f1-44f3441e7079 req-c8a668bb-1064-4ca0-a403-342b04d8e24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d64078-3f94-45fb-a864-a10c79b8c92e", "name": "network-vif-plugged", "status": "completed", "tag": "357dbd63-2219-4a26-ac04-d34854ccbbfd"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:12.290885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e936442c-d08e-4ea1-a2f1-44f3441e7079 req-c8a668bb-1064-4ca0-a403-342b04d8e24d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.291355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e936442c-d08e-4ea1-a2f1-44f3441e7079 req-c8a668bb-1064-4ca0-a403-342b04d8e24d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.291781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e936442c-d08e-4ea1-a2f1-44f3441e7079 req-c8a668bb-1064-4ca0-a403-342b04d8e24d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.303525 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e936442c-d08e-4ea1-a2f1-44f3441e7079 req-c8a668bb-1064-4ca0-a403-342b04d8e24d service nova] Creating event network-vif-plugged:357dbd63-2219-4a26-ac04-d34854ccbbfd for instance 63d64078-3f94-45fb-a864-a10c79b8c92e on n-h1-858383-3 Oct 03 10:35:12.308619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e936442c-d08e-4ea1-a2f1-44f3441e7079 req-c8a668bb-1064-4ca0-a403-342b04d8e24d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031714 Oct 03 10:35:12.309344 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 687/1388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:12.383516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:12.392173 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e1651305-5ea8-4700-b084-57256ac7a4da tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.170030 Oct 03 10:35:12.392744 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 702/1389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:12 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:12.455738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:12.456426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:12.462524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.463003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.463433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.464171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.464619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.465062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.502765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:12.505480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:12.512493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.513282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.513964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.515169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.516391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.517097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.554459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c2b0386b-cfcf-47c3-8463-766271891715 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055801 Oct 03 10:35:12.555651 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 703/1390] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:12 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:12.602390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:12.603097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:12.609151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.609751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.610201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.610983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.611514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.612017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.630183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:12.638555 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3fea12ab-12f6-46f2-bf10-a907c1d238fc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.187689 Oct 03 10:35:12.639258 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 688/1391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:12 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:12.726884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:12.727660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:12.734481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.735233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.735858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.736562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.737187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.737624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.765220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:12.773848 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-296923c9-35b3-4a9c-83e7-0e80a09ffc61 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.175404 Oct 03 10:35:12.774428 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 704/1392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:12 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:12.779025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:12.779633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:12.785991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.786770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.787215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.787934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:12.788388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:12.788903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:12.806606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:12.807239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:12.822536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:12.824011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:12.830749 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7869ad21-84c0-4f99-bb7f-d306e5758819 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.109038 Oct 03 10:35:12.831412 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 689/1393] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:12 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:35:12.955545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:12.963130 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9d47841-bdd4-4da2-9bd0-7533a955ceb5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.187762 Oct 03 10:35:12.963697 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 705/1394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:12 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:13.415626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:13.416241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:13.423545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.424124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.424600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.425369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.425849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.426284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.567297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:13.573856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:13.576669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:13.585913 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-05e58e12-526e-42b2-960c-b4683601250b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.174320 Oct 03 10:35:13.586148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.586516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 690/1395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:13 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:13.586646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.587139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.588026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.588496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.589069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.629740 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e2d9f46-ae78-4058-a4e3-7dfafa89c32f tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066402 Oct 03 10:35:13.630781 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 706/1396] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:13 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:13.663736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:13.664383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:13.676174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.676620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.677088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.677795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.678246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.678667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.797596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:13.798487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:13.805014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.805510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.805950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.806656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.807116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.807547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.851944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:13.861371 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce40a519-5c77-44f9-b492-29e6b90204b4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.201635 Oct 03 10:35:13.866217 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 691/1397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:13 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:13.868161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:13.868785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:13.875195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.875909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.876356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.877083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.877539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.877964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.943680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:13.960943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:13.968642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:13.970971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:13.971257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc1aa9cf-0380-4a87-a6c6-0577bb8f5d18 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.177411 Oct 03 10:35:13.973825 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 707/1398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:13 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:13.976654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ab0a96e2-7674-47fa-b681-a2055ebe605b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.112570 Oct 03 10:35:13.977423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 692/1399] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:13 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:13.987793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:13.988947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:13.995871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:13.997005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:13.997678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:13.999337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:14.000056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:14.000701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:14.144137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:14.152914 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8caf2bd3-a9f7-4630-8bdc-3768cee574d0 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.170295 Oct 03 10:35:14.153505 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 708/1400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:13 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:14.612262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:14.612887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:14.619332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:14.619807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:14.620236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:14.620948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:14.621397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:14.621818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:14.642902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:14.645117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:14.651608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:14.652086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:14.652522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:14.653317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:14.653766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:14.654185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:14.684459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28ae813f-2536-4ffd-a3c1-380105efac4b tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045726 Oct 03 10:35:14.685048 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 709/1401] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:14 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:14.767675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:14.775686 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0c260a11-ecb3-405b-928e-218f3982643d tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.167965 Oct 03 10:35:14.776264 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 693/1402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:14 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:14.884080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:14.885048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:14.898902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:14.899423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:14.899918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:14.900698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:14.901187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:14.901623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:14.998657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:14.999291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:15.001455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=7 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:15.007774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.007774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.008180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.008917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.009379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.009810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.067994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:15.075960 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-179991a5-e0b4-4764-b343-ba9b942442fd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.196102 Oct 03 10:35:15.076530 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 710/1403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:14 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:15.081184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:15.081782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:15.087468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.087954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.088402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.089751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.090212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.090641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.101149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:15.147852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:15.160753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:15.162115 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2d07a93-dff2-47b3-9643-068242f59f31 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.167414 Oct 03 10:35:15.162706 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 694/1404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:14 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:15.171425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:15.173132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:15.176276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:15.176940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:15.178632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91eb644b-b889-441b-8a2d-d1f9d6d306c0 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.100931 Oct 03 10:35:15.179125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 711/1405] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:15 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:15.184100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.184611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.185086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.185781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.186232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.186654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.315416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:15.323207 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0ec2f630-6f18-43bf-9c5a-b7cdd7521462 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1478 microversion: 2.1 time: 0.150596 Oct 03 10:35:15.323777 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 695/1406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:15 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1478 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:15.697504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:15.699798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:15.707125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.707637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.708076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.708794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.709256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.709679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.738234 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3674d7c7-17c3-443a-af32-63aa9c0f6835 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 Oct 03 10:35:15.738784 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 712/1407] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:15 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:15.799247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:15.799900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:15.806950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.807432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.807863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.808556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:15.809026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:15.809444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:15.948334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:15.956254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4c675b5-15c6-46e9-8f07-dcdb4efbd440 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.161314 Oct 03 10:35:15.956854 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 696/1408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:15 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:16.099040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.099742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.106049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.106545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.106988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.107693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.108160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.108584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.185328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.185944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.192517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.193054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.193480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.194181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.194641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.195072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.200378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:16.245533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:16.254278 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f69387f0-b0fb-4ff2-8e6b-e79c32cef5f9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.159182 Oct 03 10:35:16.254870 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 713/1409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:16.259391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.260004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.265714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.266193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.266628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.267350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.267803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.268228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.328648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:16.332559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:16.337247 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0bbd669-8bdc-4299-9e86-50e52ee595d7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.155775 Oct 03 10:35:16.337834 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 697/1410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:16.340884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:16.342486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:16.346589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.347256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.348229 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-36364aba-b67e-461b-ad2c-e3659064473b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.092379 Oct 03 10:35:16.353095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 714/1411] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:16.353478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.354066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.354577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.355361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.355891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.356385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.492083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:16.499822 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0728bca-5bf4-4e40-aff2-cab70b3a320b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1463 microversion: 2.1 time: 0.157561 Oct 03 10:35:16.500421 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 698/1412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:16.532759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:16.535048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.541214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.541701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.542143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.542843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.543301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.543731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.620869 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3818e5d5-db9a-4bc3-9533-fb4d2b0225f2 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action" status: 202 len: 0 microversion: 2.1 time: 0.088794 Oct 03 10:35:16.620869 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 715/1413] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:35:16 2022] POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:35:16.626488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.627125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.633066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.633560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.633979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.634654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.635096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.635511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.666430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.666897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.667330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.667765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lazy-loading 'fault' on Instance uuid 63d64078-3f94-45fb-a864-a10c79b8c92e {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:16.750841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.753047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.765050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.766363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.767021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.767809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.768364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.768897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.771236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9ea5dd9-0ea6-48b6-a404-556579c3e839 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1597 microversion: 2.1 time: 0.148578 Oct 03 10:35:16.771820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 699/1414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1597 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:16.794175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:16.796453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.801647 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e6df958-6142-4891-be56-23e4a0883d73 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054763 Oct 03 10:35:16.802492 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 716/1415] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:35:16.802617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.803077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.803422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.804120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.804568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.805013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.869577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.871860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.878314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.878838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.879282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.879979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.880435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.880881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.894362 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-05023ecf-027d-448f-94be-c4ff1b6a5ef5 tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action" status: 202 len: 0 microversion: 2.1 time: 0.103782 Oct 03 10:35:16.895022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 700/1416] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:35:16 2022] POST /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:35:16.902885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.903497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.910082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.910724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.911291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.912102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.912736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.913191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.918706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2cedc2d5-9e92-4d5e-b721-a446c31a3a05 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052916 Oct 03 10:35:16.919276 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 717/1417] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:35:16.982035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:16.982649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:16.985212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:16.995179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.995637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.996074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:16.997017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:16.997657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:16.998086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.056872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4fb5ba1-7c1a-4beb-a1d6-93363c6ca4fc tempest-ServersAdminTestJSON-589696069 tempest-ServersAdminTestJSON-589696069-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1614 microversion: 2.1 time: 0.157602 Oct 03 10:35:17.057451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 701/1418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1614 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:17.062415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:17.063215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:17.070206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.070206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.070655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.071480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.072494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.072494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.099071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:35:17.132956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.141293 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5fe0938c-8d26-4adb-ae37-fceb7d83f546 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.163036 Oct 03 10:35:17.142007 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 718/1419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:16 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:17.146780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:17.147396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:17.153591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.154235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.154769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.155601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.156129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.157391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.182152 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed3688d4-e6b1-4b8a-b673-0f3e1ce786ab tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "DELETE /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 204 len: 0 microversion: 2.1 time: 0.123466 Oct 03 10:35:17.182736 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 702/1420] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:35:17 2022] DELETE /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:35:17.184208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:35:17.191902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:17.192525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:17.198587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.199068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.199497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.200188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.200632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.201082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.217235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:17.273605 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc544a66-d16c-43d2-b756-7a96bf4cb3dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 204 len: 0 microversion: 2.1 time: 0.129997 Oct 03 10:35:17.274495 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 719/1421] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:35:17 2022] DELETE /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:35:17.281084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:17.282335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:17.288493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.289015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.289457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.290170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.290599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.291026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.343494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.353394 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff26e1fa-df09-4d29-bb83-336a415677c7 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1681 microversion: 2.1 time: 0.165792 Oct 03 10:35:17.355538 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 703/1422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:17 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:17.366553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:17.366553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:17.374755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.375298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.375771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.376494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.377292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.377384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.462294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.471136 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-038c0322-e18d-47ec-886b-4f64804d0343 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.195606 Oct 03 10:35:17.472024 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 720/1423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:17 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:17.476798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:17.477465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:17.483299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.483893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.484359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.485155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.485609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.486033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.557944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.566177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b2da450-5202-4056-abe6-e7b4aa9c740b tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1469 microversion: 2.1 time: 0.209683 Oct 03 10:35:17.584983 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 704/1424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:17 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:17.584983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:17.584983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:17.584983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.586144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.586144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.586144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:17.586144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:17.586568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:17.633837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.642302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-674f7526-78e3-48d6-b35f-64719578b32d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.169017 Oct 03 10:35:17.642871 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 721/1425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:17 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:17.653476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.662724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.664184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:17.669031 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15f3bdfc-ed42-4009-89ef-7c1cab20340b tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.101301 Oct 03 10:35:17.669589 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 705/1426] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:17 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:18.166129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:18.166679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:18.173676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.174151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.174584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.175263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.175712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.176135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.306174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.315365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce763475-e690-49e8-9b76-05e69b646a8f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.153382 Oct 03 10:35:18.315950 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 722/1427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:18 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:18.380038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:18.380645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:18.387546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.388096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.388564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.389304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.389761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.390190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.494080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:18.494695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:18.501143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.501633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.502069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.502767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.503221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.503648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.519294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.527036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b26caad-db3d-45f3-bedf-40fce481f8a0 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1681 microversion: 2.1 time: 0.150906 Oct 03 10:35:18.527607 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 706/1428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:18 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:18.598393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:18.599008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:18.605162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.605801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.606247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.606959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.607413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.607872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.643774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.651729 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-315023b7-bb8b-451e-a2a6-0528f3612d12 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.161380 Oct 03 10:35:18.652494 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 723/1429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:18 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:18.665390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:18.666012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:18.672659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.674065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.674513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.675212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.675673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.676096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.743770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.751585 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-044c2235-514d-4da3-845f-f7239654ae65 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1469 microversion: 2.1 time: 0.157633 Oct 03 10:35:18.752160 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 707/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:18 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:18.761142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:18.761870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:18.767884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.768372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.768841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.769546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.770000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.770424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.806443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.814640 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8afed7b1-c914-4f7b-a074-4ef016cf2c1c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.153299 Oct 03 10:35:18.815438 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 724/1431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:18 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:18.842541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.851391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.852976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:18.858491 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c1b5445-1ec7-49af-964f-d0b911b7c4b6 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.100942 Oct 03 10:35:18.859067 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 708/1432] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:18 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:18.961839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5444dfc9-9901-46e8-9a33-cd02d184336f req-25671dd2-fa67-4672-a345-400ab3b3c996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11e46cc-232c-4567-b838-7c009c4629ab", "name": "network-vif-plugged", "status": "completed", "tag": "ee928549-744d-45bc-acd1-1b9b96206371"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:18.975395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5444dfc9-9901-46e8-9a33-cd02d184336f req-25671dd2-fa67-4672-a345-400ab3b3c996 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:18.975927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5444dfc9-9901-46e8-9a33-cd02d184336f req-25671dd2-fa67-4672-a345-400ab3b3c996 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:18.976368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5444dfc9-9901-46e8-9a33-cd02d184336f req-25671dd2-fa67-4672-a345-400ab3b3c996 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:18.994173 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5444dfc9-9901-46e8-9a33-cd02d184336f req-25671dd2-fa67-4672-a345-400ab3b3c996 service nova] Creating event network-vif-plugged:ee928549-744d-45bc-acd1-1b9b96206371 for instance d11e46cc-232c-4567-b838-7c009c4629ab on n-h1-858383-3 Oct 03 10:35:19.000640 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5444dfc9-9901-46e8-9a33-cd02d184336f req-25671dd2-fa67-4672-a345-400ab3b3c996 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043653 Oct 03 10:35:19.001877 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 725/1433] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:19.338282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:19.338983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:19.345830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.346391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.346817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:19.347524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.348054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.348477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:19.488730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:19.496484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f2efd37-2362-4de0-bf25-02195641c99f tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.162080 Oct 03 10:35:19.497166 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 709/1434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:19 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:19.551877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:19.552737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:19.559823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.560316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.560753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:19.561553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.562094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.563059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:19.675870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:19.676026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:19.682897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.683392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.683823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:19.684529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.685141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.685570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:19.713509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:19.852451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:19.861488 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65f6104f-4aa2-4e5a-9dba-703dfa12ddf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.190413 Oct 03 10:35:19.862424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 710/1435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:19 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:19.867291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:19.868023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:19.875120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.876121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.876552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:19.877284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:19.877878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:19.878304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.010750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:20.018700 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e4ce3c6-c012-4adc-a30e-e4ed19a18dda tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1469 microversion: 2.1 time: 0.155202 Oct 03 10:35:20.019810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 711/1436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:19 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:20.023844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:20.024466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:20.040265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.040776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.041257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.041939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.042388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.042818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.081526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:20.089330 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72297b25-8395-459f-b07d-4eec6f5cf782 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1681 microversion: 2.1 time: 0.541705 Oct 03 10:35:20.105139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 726/1437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:19 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1681 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:20.111240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:20.111928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:20.118354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.118862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.119376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.120099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.120554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.121122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.262193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:20.272934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:20.275406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:20.281776 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d98c445-248d-467c-a144-544027679439 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.175074 Oct 03 10:35:20.282947 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 727/1438] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:20 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:20.287896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-da41f360-6ece-429b-85c8-4f6a7848e6d1 req-20cd87f5-ab63-4184-9941-57b29ecf8916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58627021-c0f0-46b7-b841-a30e90028959", "name": "network-vif-deleted", "tag": "780bd99c-62a9-42b2-8345-af7d10aee9c4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:20.297797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-da41f360-6ece-429b-85c8-4f6a7848e6d1 req-20cd87f5-ab63-4184-9941-57b29ecf8916 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.298546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-da41f360-6ece-429b-85c8-4f6a7848e6d1 req-20cd87f5-ab63-4184-9941-57b29ecf8916 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.299149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-da41f360-6ece-429b-85c8-4f6a7848e6d1 req-20cd87f5-ab63-4184-9941-57b29ecf8916 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.307144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:20.311158 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-da41f360-6ece-429b-85c8-4f6a7848e6d1 req-20cd87f5-ab63-4184-9941-57b29ecf8916 service nova] Creating event network-vif-deleted:780bd99c-62a9-42b2-8345-af7d10aee9c4 for instance 58627021-c0f0-46b7-b841-a30e90028959 on n-h1-858383-3 Oct 03 10:35:20.317127 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-da41f360-6ece-429b-85c8-4f6a7848e6d1 req-20cd87f5-ab63-4184-9941-57b29ecf8916 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 Oct 03 10:35:20.318299 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 728/1439] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:20.322418 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca90ed1b-ffab-4b2e-b4a7-8f44446d2ed8 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1317 microversion: 2.1 time: 0.302094 Oct 03 10:35:20.323209 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 712/1440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:20 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:20.521451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:20.522168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:20.528719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.529239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.529677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.530386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.530840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.531271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.585998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:20.587459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:20.597374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.597835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.598267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.598974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.599418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.599836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.689215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:20.697245 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-80f5b187-ae54-46db-810a-76cd800674f0 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1325 microversion: 2.1 time: 0.180250 Oct 03 10:35:20.698407 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 729/1441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:20 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:20.745070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:20.757737 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c3edd23-4116-419f-abe9-c9a50236a0e8 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 2340 microversion: 2.25 time: 0.176081 Oct 03 10:35:20.758402 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 713/1442] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:20 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 2340 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:35:20.787229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:20.791108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.791591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.792024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.792749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.793278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.793699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.817782 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8aa237fb-b70c-457a-9c57-571d3a5ad252 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.034623 Oct 03 10:35:20.818572 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 730/1443] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 3 10:35:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:35:20.886131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:20.886921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:20.894306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.894795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.895232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:20.895934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:20.896385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:20.896867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.028185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-76ae4f2c-66ac-4ef3-870c-be484d7eb1cb req-a64b3f8f-c4b7-476f-a8c1-62180dccf701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "name": "network-vif-unplugged", "status": "completed", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:21.042537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-76ae4f2c-66ac-4ef3-870c-be484d7eb1cb req-a64b3f8f-c4b7-476f-a8c1-62180dccf701 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.043020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-76ae4f2c-66ac-4ef3-870c-be484d7eb1cb req-a64b3f8f-c4b7-476f-a8c1-62180dccf701 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.043462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-76ae4f2c-66ac-4ef3-870c-be484d7eb1cb req-a64b3f8f-c4b7-476f-a8c1-62180dccf701 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.058029 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-76ae4f2c-66ac-4ef3-870c-be484d7eb1cb req-a64b3f8f-c4b7-476f-a8c1-62180dccf701 service nova] Creating event network-vif-unplugged:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h2-858383-3 Oct 03 10:35:21.064956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-76ae4f2c-66ac-4ef3-870c-be484d7eb1cb req-a64b3f8f-c4b7-476f-a8c1-62180dccf701 service nova] Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:35:21.077222 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-76ae4f2c-66ac-4ef3-870c-be484d7eb1cb req-a64b3f8f-c4b7-476f-a8c1-62180dccf701 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056391 Oct 03 10:35:21.078063 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 731/1444] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:21.087633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:21.088379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:21.099367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.100683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.101404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.102183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.102632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.103061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.143329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.143881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.144328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.144808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lazy-loading 'fault' on Instance uuid 58627021-c0f0-46b7-b841-a30e90028959 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:21.212892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:21.221711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e4752f70-b484-40bd-a2be-a69a88ae8b05 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 200 len: 1303 microversion: 2.1 time: 0.139182 Oct 03 10:35:21.233486 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 732/1445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:21 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:21.233486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:21.233486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:21.233841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.235529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.235529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.235732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.236224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.236612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.243912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:21.254320 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51a9b1d6-ea1a-4177-8cf9-9fd7bf49b302 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1469 microversion: 2.1 time: 0.372145 Oct 03 10:35:21.270541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 714/1446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:20 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:21.316091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:21.317194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:21.329862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.330357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.330795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.331513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.332118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.335024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.458942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:21.468975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dcc036ff-ad7d-4a14-aefd-49f7de81ee02 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1681 microversion: 2.1 time: 0.245228 Oct 03 10:35:21.471372 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 733/1447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:21 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:21.477404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:21.478153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:21.498604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.499391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.501547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.503080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.503705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.504301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.542113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:21.554766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:21.556189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:21.564327 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-600ebd74-7ddc-4d22-a6d9-1d3a0c3adc66 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1546 microversion: 2.91 time: 0.252804 Oct 03 10:35:21.567839 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 715/1448] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:21 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1546 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:35:21.722315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:21.723122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:21.738616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.739233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.740858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.743775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.744321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.744879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.924626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:21.941116 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9532b700-825c-4b75-99f7-aeff9ff2d479 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1466 microversion: 2.1 time: 0.468097 Oct 03 10:35:21.945057 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 734/1449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:21 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1466 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:21.968506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1138644494", "metadata": {"image_type": "test"}}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:21.971800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:21.987191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:21.987545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:21.987983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:21.999656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.001462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.001914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.078669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:22.088140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Getting quotas for project fecd91e631b84f2fba9f7756cbdc63a1. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:35:22.096056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b976eb7-4f50-4e24-809d-14bf6379f124 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1523 microversion: 2.1 time: 0.376861 Oct 03 10:35:22.104229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Getting quotas for user 9ea84c4ec0e14b78817e9767bfbe2a1a and project fecd91e631b84f2fba9f7756cbdc63a1. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:35:22.112541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 716/1450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:21 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:22.137701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:22.138604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:22.147211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.147979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.148892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.149927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.150553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.151168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.545131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:22.550113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:22.560855 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-abbda4c9-464b-43c1-a542-54ba74a78201 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1523 microversion: 2.1 time: 0.427353 Oct 03 10:35:22.565426 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 717/1451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:22 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:22.587258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:22.604740 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4facd300-58aa-4594-92f3-4ba1d8e8be97 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "POST /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df/action" status: 202 len: 0 microversion: 2.1 time: 0.640677 Oct 03 10:35:22.605537 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 735/1452] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:35:21 2022] POST /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:35:22.611136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 58627021-c0f0-46b7-b841-a30e90028959] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:22.633272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.634064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.634667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.634955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:22.636024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.636701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.638033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:22.638644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.661076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.663330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.665229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.666181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.681896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.682398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.683126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] HTTP exception thrown: Instance 58627021-c0f0-46b7-b841-a30e90028959 could not be found. Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Request method failure captured: Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 HTTP/1.1 Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrpFSZy17Uw9cR71mkMo_PSoolZnCvpqr_yEanj8S-noLuzCWQOhhUyHp2vMSPNzalVIdgpncIgZixioxa7rCzAWU9hMqzxsPGw1Mx1pNvZ4CBBy4lY6giDeRI_NyLBs2YEt2ZLYwQC392_pIa8mUs284g50r-MLLKe5wWmoxdeq3Bw Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b4201301e9cb42d3bcdff6d0416140f0 Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:35:22.685043 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4201301e9cb42d3bcdff6d0416140f0"}]}] Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b4201301e9cb42d3bcdff6d0416140f0 Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersAdminTestJSON-623585641-project Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5be59c07a541438ab3cb0db3a0d0250a Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersAdminTestJSON-623585641-project Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 58627021-c0f0-46b7-b841-a30e90028959 could not be found. Oct 03 10:35:22.686862 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '58627021-c0f0-46b7-b841-a30e90028959'} Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58627021-c0f0-46b7-b841-a30e90028959 could not be found. Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:22.688497 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58627021-c0f0-46b7-b841-a30e90028959 could not be found. Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58627021-c0f0-46b7-b841-a30e90028959 could not be found. Oct 03 10:35:22.690201 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:22.691446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Returning 404 to user: Instance 58627021-c0f0-46b7-b841-a30e90028959 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:22.691446 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99e1a193-8a8b-4a41-ab26-2f37140a5455 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959" status: 404 len: 111 microversion: 2.1 time: 0.124625 Oct 03 10:35:22.704350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 718/1453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:22 2022] GET /compute/v2.1/servers/58627021-c0f0-46b7-b841-a30e90028959 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:35:22.712136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:22.712741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:22.741946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.743388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.745064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.749186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.749186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.749186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.888435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:22.898896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7f381a2-a976-4f9a-abd5-c2f23574424e tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1614 microversion: 2.1 time: 0.190432 Oct 03 10:35:22.899804 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 719/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:22 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1614 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:22.905963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1616480198"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:22.910863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:22.918965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.919454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.919888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:22.920588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:22.921165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:22.921588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.077594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:23.089427 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa8e0d8a-cd37-4679-bacc-7d0582da6f8e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1535 microversion: 2.1 time: 0.482311 Oct 03 10:35:23.116739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 736/1455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:22 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1535 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:23.122021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:23.122853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:23.129325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.130091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.130762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.131701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.132328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.132942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.232433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:23.251764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:23.260229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:23.275833 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5c2d222d-0e50-41a7-ba01-e368009343e5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1533 microversion: 2.91 time: 0.157125 Oct 03 10:35:23.277243 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 737/1456] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:23 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1533 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:23.282245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b05b72f-e6af-4594-9c17-8d377be4a7b0 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fab84c0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:23.346808 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff1ddcfe-092b-46c4-8851-ab5d1a3dc390 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab/action" status: 202 len: 0 microversion: 2.1 time: 0.443294 Oct 03 10:35:23.347955 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 720/1457] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:35:22 2022] POST /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:35:23.353392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:23.354268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:23.364865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.365578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.373341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.375594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.376354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.377113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.385786 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b05b72f-e6af-4594-9c17-8d377be4a7b0 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.107238 Oct 03 10:35:23.393479 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 738/1458] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:23 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:23.407379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-071ed64e-5a67-4fa1-90c6-cf15caca9d64 req-295a3cb8-4982-4033-871a-51fb0f58cefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483b0eff-2eb2-45a1-a1df-c3526b899003", "name": "network-vif-deleted", "tag": "276c6807-4487-4e1a-a016-1ca442f76c12"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:23.411480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:35:23.438235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-071ed64e-5a67-4fa1-90c6-cf15caca9d64 req-295a3cb8-4982-4033-871a-51fb0f58cefb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.439043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-071ed64e-5a67-4fa1-90c6-cf15caca9d64 req-295a3cb8-4982-4033-871a-51fb0f58cefb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.439740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-071ed64e-5a67-4fa1-90c6-cf15caca9d64 req-295a3cb8-4982-4033-871a-51fb0f58cefb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.456370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-071ed64e-5a67-4fa1-90c6-cf15caca9d64 req-295a3cb8-4982-4033-871a-51fb0f58cefb service nova] Creating event network-vif-deleted:276c6807-4487-4e1a-a016-1ca442f76c12 for instance 483b0eff-2eb2-45a1-a1df-c3526b899003 on n-h2-858383-3 Oct 03 10:35:23.471998 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-071ed64e-5a67-4fa1-90c6-cf15caca9d64 req-295a3cb8-4982-4033-871a-51fb0f58cefb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076691 Oct 03 10:35:23.473857 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 739/1459] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:23.489768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:23.490887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:23.501083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.501864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.502400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.503238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.503794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.504323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.593836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:23.600757 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7fc5abb1-9a8b-4421-bae2-5643ca174270 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 204 len: 0 microversion: 2.1 time: 0.250029 Oct 03 10:35:23.607787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 721/1460] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:35:23 2022] DELETE /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:35:23.620931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7d34834-7880-43ec-b2b5-dde45e0c400b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '.version_select at 0x7f074f6f2dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:23.643302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] Lazy-loading 'services' on Instance uuid bd7aa640-cc81-4558-8a95-020b29cfebd9 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:23.679409 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2924661-689b-4d89-9332-ee4a06dc0cf0 tempest-UnshelveToHostMultiNodesTest-658887871 tempest-UnshelveToHostMultiNodesTest-658887871-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1938 microversion: 2.91 time: 0.201579 Oct 03 10:35:23.694870 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 740/1461] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:23 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1938 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:23.709421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:23.710045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:23.724607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.725138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.725916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.726824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.727612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.728724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.928524 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e7d34834-7880-43ec-b2b5-dde45e0c400b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012" status: 204 len: 0 microversion: 2.1 time: 0.319335 Oct 03 10:35:23.929971 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 722/1462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:23 2022] DELETE /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:35:23.937738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:23.938599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:23.948981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.950465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.950691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:23.951377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.952114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.952755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.953294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.961068 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d277d5c-63c2-4bc4-8f45-0596e6098dc7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1468 microversion: 2.1 time: 0.264551 Oct 03 10:35:23.962581 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 741/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:23 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:23.968452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9416032f-8fed-4d25-aa1a-ef1a18366429", "device": "/dev/xvdb"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:23.972310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:23.979780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.980273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.980708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:23.981633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:23.982097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:23.982534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.002746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:35:24.087075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:24.120634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0f0a655-0fc5-499c-ad20-ea6bb281b268 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 204 len: 0 microversion: 2.91 time: 0.188989 Oct 03 10:35:24.121263 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 723/1464] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:35:23 2022] DELETE /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:35:24.128128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:24.128851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:24.134745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.135226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.135661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.136347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.136820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.137241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.357515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.357915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.358355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.358814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lazy-loading 'fault' on Instance uuid 483b0eff-2eb2-45a1-a1df-c3526b899003 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:24.414529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c1a377d004245f7ad16835171cab02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82aa1e4fdc142639048492996994669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:24.424619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19c9a015-008a-4d39-bc3a-9edc1a0cdd91 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 200 len: 1331 microversion: 2.1 time: 0.302108 Oct 03 10:35:24.425837 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 724/1465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:24 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 1331 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:24.443879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-69a2c7b9-6ff1-41a6-b72d-0549d16ebf28 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '.version_select at 0x7f074f1be4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:24.466469 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-69a2c7b9-6ff1-41a6-b72d-0549d16ebf28 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Image not found. Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-69a2c7b9-6ff1-41a6-b72d-0549d16ebf28 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012 HTTP/1.1 Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:35:24.468689 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'cb4264f3-c306-4d63-9f4c-209542da9012'} Oct 03 10:35:24.470907 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:35:24.472075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cb4264f3-c306-4d63-9f4c-209542da9012 Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:35:24.473577 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb4264f3-c306-4d63-9f4c-209542da9012 could not be found. Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:35:24.475429 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:24.477158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-69a2c7b9-6ff1-41a6-b72d-0549d16ebf28 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:24.479069 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-69a2c7b9-6ff1-41a6-b72d-0549d16ebf28 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012" status: 404 len: 62 microversion: 2.1 time: 0.043760 Oct 03 10:35:24.479069 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 725/1466] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:24 2022] GET /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:35:24.479801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-071dfa4a-07f8-4620-b4ab-d67c1de67b32 req-a3a1f91f-2c00-416b-ba4e-ace311d17c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:24.490166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-071dfa4a-07f8-4620-b4ab-d67c1de67b32 req-a3a1f91f-2c00-416b-ba4e-ace311d17c5c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.490641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-071dfa4a-07f8-4620-b4ab-d67c1de67b32 req-a3a1f91f-2c00-416b-ba4e-ace311d17c5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.491071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-071dfa4a-07f8-4620-b4ab-d67c1de67b32 req-a3a1f91f-2c00-416b-ba4e-ace311d17c5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.501894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-071dfa4a-07f8-4620-b4ab-d67c1de67b32 req-a3a1f91f-2c00-416b-ba4e-ace311d17c5c service nova] Creating event network-changed:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h1-858383-3 Oct 03 10:35:24.507166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-071dfa4a-07f8-4620-b4ab-d67c1de67b32 req-a3a1f91f-2c00-416b-ba4e-ace311d17c5c service nova] Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:35:24.518141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-071dfa4a-07f8-4620-b4ab-d67c1de67b32 req-a3a1f91f-2c00-416b-ba4e-ace311d17c5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041881 Oct 03 10:35:24.518713 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 726/1467] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:24.523666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:24.524350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:24.530206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.530674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.531111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.532414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.532892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.533318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.662221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:24.672234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d264160a-1305-4112-8078-4c5caf6c590b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1535 microversion: 2.1 time: 0.152285 Oct 03 10:35:24.672943 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 727/1468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:24 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1535 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:24.679631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:24.680495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:24.688401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.689163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.689593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.690296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.690745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.691168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.760567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:24.774812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:24.777268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:24.785468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c822962-17ac-42a2-8a00-354dacd56361 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.110442 Oct 03 10:35:24.786487 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 728/1469] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:24 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:24.813787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f4a905b5-0031-43c6-995b-27a9b9d00305 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1e74c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:24.877632 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f4a905b5-0031-43c6-995b-27a9b9d00305 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.068413 Oct 03 10:35:24.879159 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 729/1470] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:24 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:24.884834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:24.885748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:24.894990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.895803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.896455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.897576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:24.898240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:24.899049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:24.998165 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8dbe9fb6-2884-4721-8487-2225804e2980 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "POST /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.033595 Oct 03 10:35:24.998897 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 742/1471] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 3 10:35:23 2022] POST /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:35:25.027652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:25.028384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:25.040809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.045485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.046155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.047725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.048189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.049538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.208630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:25.216561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1827aa8f-f668-4cdf-9004-0ddf17589499 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1535 microversion: 2.1 time: 0.335994 Oct 03 10:35:25.217444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 730/1472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:24 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1535 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:25.264476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:25.272459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-506b50f5-4720-4f3c-bb53-6397f57716d5 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1468 microversion: 2.1 time: 0.270128 Oct 03 10:35:25.273061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 743/1473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:24 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1468 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:25.450936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:25.451554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:25.458110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.458602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.459035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.459728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.460303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.460730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.474802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] HTTP exception thrown: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Request method failure captured: Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 HTTP/1.1 Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrpG6Uvp7LUEWSsFi59gnGFuNuOkPhjiN3mAAE1ZLZgUDm8lDj3S_2pCCIi-Yl1w2EVG8pLgvIXoQbe84etV4m29IP_lbnwDXDf_QLa_MUJtKX4iEGJTbHZ9WmcZpbela5rDUDLe3ClVfQCxr4q5FbyY45o7rYXOZrD41UdE_yZ3Q8w Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b82aa1e4fdc142639048492996994669 Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:35:25.476466 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82aa1e4fdc142639048492996994669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b82aa1e4fdc142639048492996994669"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b82aa1e4fdc142639048492996994669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82aa1e4fdc142639048492996994669"}]}] Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b82aa1e4fdc142639048492996994669 Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachSCSIVolumeTestJSON-1095765314-project Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8c1a377d004245f7ad16835171cab02e Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1095765314-project Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:25.478160 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '483b0eff-2eb2-45a1-a1df-c3526b899003'} Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:25.479300 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:25.481155 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:25.483174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Returning 404 to user: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:25.483174 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bd4a53c5-00be-417a-8b50-001ae8c1e7e8 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 404 len: 111 microversion: 2.1 time: 0.030894 Oct 03 10:35:25.483174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 731/1474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:25 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:35:25.488236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-734e9f5c-76d7-456d-af3c-54bac5391675 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '.version_select at 0x7f074f2b34c0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:25.510213 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-734e9f5c-76d7-456d-af3c-54bac5391675 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727603332" status: 202 len: 0 microversion: 2.1 time: 0.027168 Oct 03 10:35:25.510805 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 744/1475] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727603332 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:35:25.700888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:25.702144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:25.712552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.713624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.715138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.717500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.722394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.723924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.821368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:25.823328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:25.836964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.838120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.839218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.840417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:25.841080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:25.842002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:25.969578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:25.983885 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-656a70f2-40f2-4485-a672-85642398cdc0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1535 microversion: 2.1 time: 0.289117 Oct 03 10:35:26.001614 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 732/1476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:25 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1535 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:26.004723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5426f470-e77d-455a-a0f9-4e2496395ff3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1bee50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:26.082700 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5426f470-e77d-455a-a0f9-4e2496395ff3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.087947 Oct 03 10:35:26.085429 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 733/1477] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:25 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:26.181189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:26.189418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:26.190892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:26.195935 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd00517e-788b-45ec-98b3-3e5b1e1ebcb5 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.381483 Oct 03 10:35:26.197043 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 745/1478] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:25 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:26.241689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:26.242607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:26.250386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:26.250840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:26.251345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:26.252184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:26.252926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:26.253337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:26.300276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:26.302126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:26.310431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:26.311237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:26.312225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:26.313505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:26.314304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:26.314941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:26.417241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:26.429710 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a18092ac-bf81-4ea2-9909-d7bfaf7f5588 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1426 microversion: 2.1 time: 0.137089 Oct 03 10:35:26.434087 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 746/1479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:26 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1426 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:26.502171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:26.510411 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-366a8616-7052-4f51-88b3-9024f0de7915 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1535 microversion: 2.1 time: 0.273808 Oct 03 10:35:26.510982 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 734/1480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:26 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1535 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:26.533749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0bb59092-5066-4b37-84a0-46222856fdb1 req-5a4369de-5021-49c9-8ceb-885a487b2f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3601b147-4b29-4547-937c-4b98e467641b", "name": "network-vif-deleted", "tag": "eeb63eb4-5236-4ab7-b25a-0e56d9904282"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:26.544581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0bb59092-5066-4b37-84a0-46222856fdb1 req-5a4369de-5021-49c9-8ceb-885a487b2f31 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:26.545090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0bb59092-5066-4b37-84a0-46222856fdb1 req-5a4369de-5021-49c9-8ceb-885a487b2f31 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:26.545518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0bb59092-5066-4b37-84a0-46222856fdb1 req-5a4369de-5021-49c9-8ceb-885a487b2f31 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:26.558620 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0bb59092-5066-4b37-84a0-46222856fdb1 req-5a4369de-5021-49c9-8ceb-885a487b2f31 service nova] Creating event network-vif-deleted:eeb63eb4-5236-4ab7-b25a-0e56d9904282 for instance 3601b147-4b29-4547-937c-4b98e467641b on n-h1-858383-3 Oct 03 10:35:26.563616 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0bb59092-5066-4b37-84a0-46222856fdb1 req-5a4369de-5021-49c9-8ceb-885a487b2f31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034125 Oct 03 10:35:26.564473 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 747/1481] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:27.012506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:27.013394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:27.021630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.022468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.022918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.023658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.024191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.024803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.100288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81d0aa1a-42e5-4c5d-9485-d9b4b009dc6b tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fad41f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:27.164878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81d0aa1a-42e5-4c5d-9485-d9b4b009dc6b tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.068590 Oct 03 10:35:27.165969 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 748/1482] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:27 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:27.213014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:27.223670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:27.224681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:27.225690 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3b31f58-7231-4c64-b988-fb9e2a97af77 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1535 microversion: 2.1 time: 0.218797 Oct 03 10:35:27.226918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 735/1483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:27 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1535 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:27.237344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.237968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.238507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.239320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.239900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.242498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.326813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:27.335809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:27.337495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3995cd3a0f904339ae0482b0a2c83339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde72f6116d47819b3903bafb1a0254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:27.342770 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d2ec1d2-2bf2-44a9-8c02-c3075f93de40 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 200 len: 1539 microversion: 2.91 time: 0.122987 Oct 03 10:35:27.343342 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 749/1484] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:27 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 1539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:35:27.457247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:27.458077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:27.469349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.470343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.470986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.471880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.472502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.473193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.538363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:27.539253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:27.546736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.548033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.548680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.549607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:27.550227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:27.551817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:27.555779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:27.568738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39f2e07e-1cfa-4f12-92b0-f6a30cdf01dc tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1426 microversion: 2.1 time: 0.116815 Oct 03 10:35:27.569898 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 736/1485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:27 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:27.715327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:27.723828 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f12c7012-5cac-482d-be33-65352ebac4ab tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1535 microversion: 2.1 time: 0.192317 Oct 03 10:35:27.740959 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 750/1486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:27 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1535 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:27.994650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a6284cac-8b4b-4d78-9c5a-b2fa1b3fbe0a req-76deeab8-efa9-4c8d-99d5-1948b7c502a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5914cb9d-936d-4df2-b759-da941b2982df", "name": "network-vif-plugged", "status": "completed", "tag": "72809ff0-0bb2-4fd1-8b14-2f84af87b5b6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:28.007398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6284cac-8b4b-4d78-9c5a-b2fa1b3fbe0a req-76deeab8-efa9-4c8d-99d5-1948b7c502a2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.008464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6284cac-8b4b-4d78-9c5a-b2fa1b3fbe0a req-76deeab8-efa9-4c8d-99d5-1948b7c502a2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.009125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6284cac-8b4b-4d78-9c5a-b2fa1b3fbe0a req-76deeab8-efa9-4c8d-99d5-1948b7c502a2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.022372 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a6284cac-8b4b-4d78-9c5a-b2fa1b3fbe0a req-76deeab8-efa9-4c8d-99d5-1948b7c502a2 service nova] Creating event network-vif-plugged:72809ff0-0bb2-4fd1-8b14-2f84af87b5b6 for instance 5914cb9d-936d-4df2-b759-da941b2982df on n-h2-858383-3 Oct 03 10:35:28.027918 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a6284cac-8b4b-4d78-9c5a-b2fa1b3fbe0a req-76deeab8-efa9-4c8d-99d5-1948b7c502a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037104 Oct 03 10:35:28.029222 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 737/1487] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:28.180491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0347c988-eed5-4045-815b-f9eff48e82ec tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fab8670>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:28.250772 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0347c988-eed5-4045-815b-f9eff48e82ec tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.073703 Oct 03 10:35:28.252634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:28.255660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:28.258905 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 751/1488] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:28 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:28.262482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.271873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.272555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.274308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.274934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.276856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.371232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:28.371852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] [instance: bd7aa640-cc81-4558-8a95-020b29cfebd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:28.389015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.392541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.392541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.392541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.392541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.392993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.427160 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] HTTP exception thrown: Instance bd7aa640-cc81-4558-8a95-020b29cfebd9 could not be found. Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Request method failure captured: Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 HTTP/1.1 Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrok9LpyOgXTnUpV07NUOFu9ZMXacNO-XHDzh4VffWydtiDcBN09QQktFoM3pprwu6FNGWeW7PHKNi-3WJT5xpNLCuMsXjvh9ECY-UQtxaRxhi33L5TotWXNyRx-7JW0ZF38VhidBJCvQcybfh2a4ctEYrGGn3iWPSiG0V6zzQreC5o Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.91 Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: edde72f6116d47819b3903bafb1a0254 Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-205777526 Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:35:28.428946 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/edde72f6116d47819b3903bafb1a0254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_edde72f6116d47819b3903bafb1a0254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/edde72f6116d47819b3903bafb1a0254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/edde72f6116d47819b3903bafb1a0254"}]}] Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-205777526 Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: edde72f6116d47819b3903bafb1a0254 Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-205777526 Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-UnshelveToHostMultiNodesTest-205777526-project Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3995cd3a0f904339ae0482b0a2c83339 Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-205777526-project Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance bd7aa640-cc81-4558-8a95-020b29cfebd9 could not be found. Oct 03 10:35:28.430500 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'bd7aa640-cc81-4558-8a95-020b29cfebd9'} Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7aa640-cc81-4558-8a95-020b29cfebd9 could not be found. Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:28.431283 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7aa640-cc81-4558-8a95-020b29cfebd9 could not be found. Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7aa640-cc81-4558-8a95-020b29cfebd9 could not be found. Oct 03 10:35:28.432495 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:28.434144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] Returning 404 to user: Instance bd7aa640-cc81-4558-8a95-020b29cfebd9 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:28.434144 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75bfe4c2-da1b-45a2-ac69-84c43fb1f527 tempest-UnshelveToHostMultiNodesTest-205777526 tempest-UnshelveToHostMultiNodesTest-205777526-project] 10.222.0.27 "GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9" status: 404 len: 111 microversion: 2.91 time: 0.063090 Oct 03 10:35:28.434144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 752/1489] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:28 2022] GET /compute/v2.1/servers/bd7aa640-cc81-4558-8a95-020b29cfebd9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:35:28.511658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:28.520874 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ccd72aaa-3a97-4d8e-afd0-6e25278d1b9a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1535 microversion: 2.1 time: 0.274672 Oct 03 10:35:28.533220 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 738/1490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:28 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1535 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:28.595223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:28.596406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:28.603790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.604526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.605003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.605717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.606176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.606606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.719578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:28.741700 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6e97570-d07c-49dd-a760-3cb7b9d80c29 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1426 microversion: 2.1 time: 0.152148 Oct 03 10:35:28.749656 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 753/1491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:28 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1426 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:28.752863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:28.753899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:28.773988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.775386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.777466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.779139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:28.782077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:28.783410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:28.985896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:28.997716 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48d2d909-2637-407b-8d1f-222c8e372294 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1535 microversion: 2.1 time: 0.251771 Oct 03 10:35:28.999233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 739/1492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:28 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1535 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:29.267770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40a9e1cf-b58e-4848-8bee-da486018669f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f164040>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:29.347064 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40a9e1cf-b58e-4848-8bee-da486018669f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.084268 Oct 03 10:35:29.355941 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 754/1493] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:29 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:29.548386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:29.549551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:29.563270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:29.564293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:29.565013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:29.565975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:29.566677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:29.567442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:29.772713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:29.773419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:29.783851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:29.784886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:29.786218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:29.791554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:29.792395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:29.792989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:30.114771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:30.122881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:30.131780 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b49e4482-9578-436c-ab17-f9f8281c10d0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1535 microversion: 2.1 time: 0.589787 Oct 03 10:35:30.137158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 740/1494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:29 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1535 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:30.161465 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3bc4cbe0-39d0-49b2-a75e-900db9536655 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1298 microversion: 2.1 time: 0.390928 Oct 03 10:35:30.164437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:30.167670 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 755/1495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:29 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1298 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:30.177182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:30.202665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:30.203174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:30.204146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:30.204891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:30.205350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:30.211672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:30.369039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-88a885ab-6284-4c06-9dad-07636c422fa9 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fc88b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:30.522198 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-88a885ab-6284-4c06-9dad-07636c422fa9 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.162307 Oct 03 10:35:30.534439 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 756/1496] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:30 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:30.758602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:30.768068 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-373324eb-0f4b-4030-a379-220cceaa5797 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1541 microversion: 2.1 time: 0.628802 Oct 03 10:35:30.768883 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 741/1497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:30 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1541 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:31.164317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:31.172440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:31.173707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:31.201733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:31.203844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:31.209720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.210685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.221497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.222687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.223416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.224070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.231211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.232486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.232988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.233983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.237382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.240444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.352275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.364918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.365453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.365989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lazy-loading 'fault' on Instance uuid 3601b147-4b29-4547-937c-4b98e467641b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:31.445556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:31.454594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79fa27eb-cb83-4bcb-ba0b-9aac8d614412 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 200 len: 1303 microversion: 2.1 time: 0.262396 Oct 03 10:35:31.456642 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 742/1498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:31 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 1303 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:31.543762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27f71155-6d4d-44b4-895d-03f07c417061 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1e78b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:31.545596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:31.559036 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-138901f9-5cfb-4fcf-9ff5-6d61796190f8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1528 microversion: 2.1 time: 0.396769 Oct 03 10:35:31.573933 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 757/1499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:31 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1528 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:31.584742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:31.585615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:31.591573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:31.595177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.598043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.598815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.599804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.600754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.605310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.636613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:31.652397 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27f71155-6d4d-44b4-895d-03f07c417061 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.112399 Oct 03 10:35:31.653011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 743/1500] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:31 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:31.674494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:31.679063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:31.691301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.696454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.697136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.698346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.698977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.699748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.734363 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] HTTP exception thrown: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Request method failure captured: Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 HTTP/1.1 Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrpG6Uvp7LUEWSsFi59gnGFuNuOkPhjiN3mAAE1ZLZgUDm8lDj3S_2pCCIi-Yl1w2EVG8pLgvIXoQbe84etV4m29IP_lbnwDXDf_QLa_MUJtKX4iEGJTbHZ9WmcZpbela5rDUDLe3ClVfQCxr4q5FbyY45o7rYXOZrD41UdE_yZ3Q8w Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b82aa1e4fdc142639048492996994669 Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:35:31.743429 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82aa1e4fdc142639048492996994669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b82aa1e4fdc142639048492996994669"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b82aa1e4fdc142639048492996994669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82aa1e4fdc142639048492996994669"}]}] Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b82aa1e4fdc142639048492996994669 Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachSCSIVolumeTestJSON-1095765314-project Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8c1a377d004245f7ad16835171cab02e Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1095765314-project Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.745237 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '483b0eff-2eb2-45a1-a1df-c3526b899003'} Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:31.746119 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.747513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.751119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Returning 404 to user: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:31.754177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c61d00f6-6da9-4a61-bbe1-8291af129208 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "DELETE /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 404 len: 111 microversion: 2.1 time: 0.084265 Oct 03 10:35:31.758124 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 744/1501] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:35:31 2022] DELETE /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:35:31.766797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:31.770162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] [instance: 483b0eff-2eb2-45a1-a1df-c3526b899003] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:31.784111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.792783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.793482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.794417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.795029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.796285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.837662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] HTTP exception thrown: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Request method failure captured: Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 HTTP/1.1 Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrpG6Uvp7LUEWSsFi59gnGFuNuOkPhjiN3mAAE1ZLZgUDm8lDj3S_2pCCIi-Yl1w2EVG8pLgvIXoQbe84etV4m29IP_lbnwDXDf_QLa_MUJtKX4iEGJTbHZ9WmcZpbela5rDUDLe3ClVfQCxr4q5FbyY45o7rYXOZrD41UdE_yZ3Q8w Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b82aa1e4fdc142639048492996994669 Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:35:31.839559 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82aa1e4fdc142639048492996994669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b82aa1e4fdc142639048492996994669"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b82aa1e4fdc142639048492996994669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b82aa1e4fdc142639048492996994669"}]}] Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b82aa1e4fdc142639048492996994669 Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1095765314 Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachSCSIVolumeTestJSON-1095765314-project Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8c1a377d004245f7ad16835171cab02e Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1095765314-project Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.841140 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '483b0eff-2eb2-45a1-a1df-c3526b899003'} Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:31.842025 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. Oct 03 10:35:31.843760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:35:31.846543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] Returning 404 to user: Instance 483b0eff-2eb2-45a1-a1df-c3526b899003 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:31.847666 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-60d90295-400e-4b7e-8e78-000d45cba569 tempest-AttachSCSIVolumeTestJSON-1095765314 tempest-AttachSCSIVolumeTestJSON-1095765314-project] 10.222.0.27 "GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003" status: 404 len: 111 microversion: 2.1 time: 0.088390 Oct 03 10:35:31.850196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 745/1502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:31 2022] GET /compute/v2.1/servers/483b0eff-2eb2-45a1-a1df-c3526b899003 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:35:31.880285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:31.881212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:31.902579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.903347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.905436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.906416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:31.909915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:31.913001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:31.960435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:31.971559 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-becb2830-e975-4568-9384-964b24d3894d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1528 microversion: 2.1 time: 0.391380 Oct 03 10:35:31.975974 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 758/1503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:31 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1528 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:32.007707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53c9b74e-d3f8-4a3a-87b9-f7decf6f6b1f tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:32.014770 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-53c9b74e-d3f8-4a3a-87b9-f7decf6f6b1f tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] HTTP exception thrown: Flavor 5824661e-3d58-44ff-8bac-fc06b7a189f2 could not be found. Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53c9b74e-d3f8-4a3a-87b9-f7decf6f6b1f tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Request method failure captured: Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/flavors/5824661e-3d58-44ff-8bac-fc06b7a189f2 HTTP/1.1 Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroJ5Wdm1rf0uMEEnCMOUrwtJ7LmyLGhb-nHbK3Fe3cGxjJ6XE45GopC68ktKmIMYBHLosul6QByQ74KvkWXqBIylfqNuyWT6_EsRq7Dh1i1DxqVrG3OECkXE8hln8g9fR4AvoYsLsVTTlOtG_szI5wwCjvTMqkPSv9Shfvr1xCmLmM Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 6a69efc7f0eb42358bb06f5356d2cb9b Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-MigrationsAdminTest-2056120529 Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:35:32.027096 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a69efc7f0eb42358bb06f5356d2cb9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6a69efc7f0eb42358bb06f5356d2cb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6a69efc7f0eb42358bb06f5356d2cb9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6a69efc7f0eb42358bb06f5356d2cb9b"}]}] Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-MigrationsAdminTest-2056120529 Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 6a69efc7f0eb42358bb06f5356d2cb9b Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-MigrationsAdminTest-2056120529 Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-MigrationsAdminTest-2056120529-project-admin Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ae3e33471e434e02a003b7dddf2756e8 Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-MigrationsAdminTest-2056120529-project-admin Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: exception: Flavor 5824661e-3d58-44ff-8bac-fc06b7a189f2 could not be found. Oct 03 10:35:32.028562 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '5824661e-3d58-44ff-8bac-fc06b7a189f2'} Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5824661e-3d58-44ff-8bac-fc06b7a189f2 could not be found. Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:32.030323 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5824661e-3d58-44ff-8bac-fc06b7a189f2 could not be found. Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5824661e-3d58-44ff-8bac-fc06b7a189f2 could not be found. Oct 03 10:35:32.032117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.036062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53c9b74e-d3f8-4a3a-87b9-f7decf6f6b1f tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Returning 404 to user: Flavor 5824661e-3d58-44ff-8bac-fc06b7a189f2 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:32.037573 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53c9b74e-d3f8-4a3a-87b9-f7decf6f6b1f tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/5824661e-3d58-44ff-8bac-fc06b7a189f2" status: 404 len: 109 microversion: 2.1 time: 0.034903 Oct 03 10:35:32.038370 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 759/1504] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:35:32 2022] DELETE /compute/v2.1/flavors/5824661e-3d58-44ff-8bac-fc06b7a189f2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:35:32.223752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9aca72cb-0f82-474f-bbe3-d914be61a4a6 req-02b2c812-be8a-4a02-af58-7aa2b93f9609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11e46cc-232c-4567-b838-7c009c4629ab", "name": "network-vif-plugged", "status": "completed", "tag": "ee928549-744d-45bc-acd1-1b9b96206371"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:32.261394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9aca72cb-0f82-474f-bbe3-d914be61a4a6 req-02b2c812-be8a-4a02-af58-7aa2b93f9609 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:32.261880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9aca72cb-0f82-474f-bbe3-d914be61a4a6 req-02b2c812-be8a-4a02-af58-7aa2b93f9609 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:32.262314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9aca72cb-0f82-474f-bbe3-d914be61a4a6 req-02b2c812-be8a-4a02-af58-7aa2b93f9609 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:32.276686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:32.279587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:32.294565 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38c22662-4515-48ea-bb70-2efeab2f1d24 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1541 microversion: 2.1 time: 0.443104 Oct 03 10:35:32.308240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9aca72cb-0f82-474f-bbe3-d914be61a4a6 req-02b2c812-be8a-4a02-af58-7aa2b93f9609 service nova] Creating event network-vif-plugged:ee928549-744d-45bc-acd1-1b9b96206371 for instance d11e46cc-232c-4567-b838-7c009c4629ab on n-h1-858383-3 Oct 03 10:35:32.320461 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9aca72cb-0f82-474f-bbe3-d914be61a4a6 req-02b2c812-be8a-4a02-af58-7aa2b93f9609 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102579 Oct 03 10:35:32.323994 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 746/1505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:31 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1541 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:32.332419 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 760/1506] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:35:32.337273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1333978630", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:32.436932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:35:32.480259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:32.481268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 3601b147-4b29-4547-937c-4b98e467641b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:32.515201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:32.515893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:32.518084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:32.519049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:32.519706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:32.520356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:32.566067 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] HTTP exception thrown: Instance 3601b147-4b29-4547-937c-4b98e467641b could not be found. Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Request method failure captured: Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b HTTP/1.1 Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrpFSZy17Uw9cR71mkMo_PSoolZnCvpqr_yEanj8S-noLuzCWQOhhUyHp2vMSPNzalVIdgpncIgZixioxa7rCzAWU9hMqzxsPGw1Mx1pNvZ4CBBy4lY6giDeRI_NyLBs2YEt2ZLYwQC392_pIa8mUs284g50r-MLLKe5wWmoxdeq3Bw Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b4201301e9cb42d3bcdff6d0416140f0 Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:35:32.574856 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4201301e9cb42d3bcdff6d0416140f0"}]}] Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b4201301e9cb42d3bcdff6d0416140f0 Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminTestJSON-623585641-project Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5be59c07a541438ab3cb0db3a0d0250a Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminTestJSON-623585641-project Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3601b147-4b29-4547-937c-4b98e467641b could not be found. Oct 03 10:35:32.576274 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3601b147-4b29-4547-937c-4b98e467641b'} Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3601b147-4b29-4547-937c-4b98e467641b could not be found. Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:32.577082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3601b147-4b29-4547-937c-4b98e467641b could not be found. Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3601b147-4b29-4547-937c-4b98e467641b could not be found. Oct 03 10:35:32.578417 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:32.579517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Returning 404 to user: Instance 3601b147-4b29-4547-937c-4b98e467641b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:32.593510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f271660-65fc-4adc-a5d9-e25252eb4575 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b" status: 404 len: 111 microversion: 2.1 time: 0.117120 Oct 03 10:35:32.594231 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 761/1507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:32 2022] GET /compute/v2.1/servers/3601b147-4b29-4547-937c-4b98e467641b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:35:32.624431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:32.624979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:32.649936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:32.650438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:32.650882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:32.651598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:32.652053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:32.652473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:32.723671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:35:32.907486 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68fbd5e7-1cb1-4323-9b16-5e7313321a83 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "DELETE /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 204 len: 0 microversion: 2.1 time: 0.305837 Oct 03 10:35:32.913038 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 762/1508] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:35:32 2022] DELETE /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:35:32.919735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-774fa2df-077a-4e5b-9c07-e5c8a9ae7d48 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f23a700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:32.977902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-774fa2df-077a-4e5b-9c07-e5c8a9ae7d48 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.062763 Oct 03 10:35:32.979606 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 763/1509] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:32 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:32.987641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:32.991089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:33.008282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:33.009667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:33.013728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:33.014993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:33.016656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:33.018001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:33.217692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:33.232328 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d483f551-94a5-485c-a0f2-391709c9fce7 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1469 microversion: 2.1 time: 0.248218 Oct 03 10:35:33.233741 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 764/1510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:32 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:33.331060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:33.332319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:33.343514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:33.346567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:33.347379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:33.348369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:33.349093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:33.351425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:33.706136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:33.717978 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-15065a49-5cc0-4bb5-be0b-4f40914c5941 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1541 microversion: 2.1 time: 0.390554 Oct 03 10:35:33.720373 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 765/1511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:33 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1541 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:33.965465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:35:33.966009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:35:33.966335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:35:33.966929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:35:33.967513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:35:33.980607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:33.981394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:33.981995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:33.982889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:33.983521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:33.984317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:33.997909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58bebc74-d63d-440b-bd2e-81d865bd7b7a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fad00d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:34.005897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:35:34.012603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Getting quotas for user fa6ea468370b4bacb98dd5457b0e6aea and project 65c1c5f2ee554c8688e754dd17bf5adc. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:35:34.027569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:35:34.030241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:35:34.109078 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58bebc74-d63d-440b-bd2e-81d865bd7b7a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.116990 Oct 03 10:35:34.110079 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 766/1512] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:33 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:34.125965 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f815d840-9649-471a-9aa3-e99ed467289b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.797913 Oct 03 10:35:34.127113 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 747/1513] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:35:34.139456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-def12658-5e9b-468b-89de-a92509704475 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:34.140089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-def12658-5e9b-468b-89de-a92509704475 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:34.261763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:34.262388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:34.276318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:34.276841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:34.277288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:34.278011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:34.286963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:34.287767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:34.294689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-def12658-5e9b-468b-89de-a92509704475 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:34.304599 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-def12658-5e9b-468b-89de-a92509704475 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1213 microversion: 2.1 time: 0.169662 Oct 03 10:35:34.308124 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 767/1514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:34 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:34.743385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:34.744719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:34.756506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:34.756939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:34.764879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:34.765932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:34.766680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:34.767268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:35.117237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:35.127294 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a1877f9-e05a-41e7-a1c1-a72448b94260 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1541 microversion: 2.1 time: 0.387634 Oct 03 10:35:35.136850 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 768/1515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:34 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1541 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:35.144571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd4ae5dc-0001-43a3-ad5e-af442cdb8cd9 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f23adc0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:35.248376 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd4ae5dc-0001-43a3-ad5e-af442cdb8cd9 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.114333 Oct 03 10:35:35.249140 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 769/1516] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:35 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:35.271309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:35.285617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27482804-a189-43a3-af61-05bffee955ef tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1469 microversion: 2.1 time: 1.027222 Oct 03 10:35:35.286484 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 748/1517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:34 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1469 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:35.335763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:35.341933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:35.414640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:35.415883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:35.417916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:35.421566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:35.429109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:35.437283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:35.618986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:35.636171 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f2349ee-61c4-4dfd-8d92-42eeab54298d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1209 microversion: 2.1 time: 0.305319 Oct 03 10:35:35.637394 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 770/1518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:35 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1209 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:35.896306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-08257da2-b499-4ad8-8af4-856c2c96f293 req-3067431f-44a6-43f6-8507-f6022752272a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "name": "network-vif-plugged", "status": "completed", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:35.935000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-08257da2-b499-4ad8-8af4-856c2c96f293 req-3067431f-44a6-43f6-8507-f6022752272a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:35.935539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-08257da2-b499-4ad8-8af4-856c2c96f293 req-3067431f-44a6-43f6-8507-f6022752272a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:35.935787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-08257da2-b499-4ad8-8af4-856c2c96f293 req-3067431f-44a6-43f6-8507-f6022752272a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:35.968997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-08257da2-b499-4ad8-8af4-856c2c96f293 req-3067431f-44a6-43f6-8507-f6022752272a service nova] Creating event network-vif-plugged:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h1-858383-3 Oct 03 10:35:35.976932 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-08257da2-b499-4ad8-8af4-856c2c96f293 req-3067431f-44a6-43f6-8507-f6022752272a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090289 Oct 03 10:35:35.977907 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 749/1519] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:36.155565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:36.157185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:36.170967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:36.175177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:36.177299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:36.178287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:36.179929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:36.183230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:36.266119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d906d82e-9365-4175-ae09-c48234eb5334 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1e7a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:36.354199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d906d82e-9365-4175-ae09-c48234eb5334 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.092119 Oct 03 10:35:36.355705 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 750/1520] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:36 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:36.362078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:36.369550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:36.391339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:36.392148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:36.392852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:36.393777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:36.394429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:36.395055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:36.594807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:36.611467 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-32f36c4d-35c8-45a3-bd52-55a18d6148f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1536 microversion: 2.1 time: 0.463512 Oct 03 10:35:36.612461 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 771/1521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:36 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1536 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:36.663968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:36.664968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:36.693881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:36.698607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:36.699288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:36.701285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:36.705105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:36.705879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:36.978667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:36.989051 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d41b57c9-f353-4da6-9c1f-a1ce69620b43 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1283 microversion: 2.1 time: 0.330503 Oct 03 10:35:36.996522 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 772/1522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:36 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1283 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:37.417823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-aabc8b25-a144-44b9-bf96-9254c32ed1d5 req-f5c74f45-96a0-4cb9-b7d5-189c5328867a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d64078-3f94-45fb-a864-a10c79b8c92e", "name": "network-vif-deleted", "tag": "357dbd63-2219-4a26-ac04-d34854ccbbfd"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:37.453494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be59c07a541438ab3cb0db3a0d0250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4201301e9cb42d3bcdff6d0416140f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:37.489846 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-71157e0e-2ae4-4202-9d58-0fa1d586d2de tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 200 len: 1469 microversion: 2.1 time: 1.132892 Oct 03 10:35:37.506280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-aabc8b25-a144-44b9-bf96-9254c32ed1d5 req-f5c74f45-96a0-4cb9-b7d5-189c5328867a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:37.506959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-aabc8b25-a144-44b9-bf96-9254c32ed1d5 req-f5c74f45-96a0-4cb9-b7d5-189c5328867a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:37.507707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-aabc8b25-a144-44b9-bf96-9254c32ed1d5 req-f5c74f45-96a0-4cb9-b7d5-189c5328867a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:37.516075 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 751/1523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:36 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 1469 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:37.530417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0eba157c-35c7-4fca-bdb5-0a8fda7cdaba tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f185d30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:37.535890 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-aabc8b25-a144-44b9-bf96-9254c32ed1d5 req-f5c74f45-96a0-4cb9-b7d5-189c5328867a service nova] Creating event network-vif-deleted:357dbd63-2219-4a26-ac04-d34854ccbbfd for instance 63d64078-3f94-45fb-a864-a10c79b8c92e on n-h1-858383-3 Oct 03 10:35:37.546035 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-aabc8b25-a144-44b9-bf96-9254c32ed1d5 req-f5c74f45-96a0-4cb9-b7d5-189c5328867a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415251 Oct 03 10:35:37.549304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 773/1524] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:37.640096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:37.641852 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0eba157c-35c7-4fca-bdb5-0a8fda7cdaba tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.121240 Oct 03 10:35:37.642235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:37.647022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 752/1525] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:37 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:37.654289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:37.655016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:37.662625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:37.663620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:37.664401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:37.665192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.021239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:38.022053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:38.030933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.031487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.032316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.033592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.043778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.047774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.057196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:38.071431 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac87591d-1983-4cd3-b742-1ce08b07b642 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1523 microversion: 2.1 time: 0.435579 Oct 03 10:35:38.073222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 774/1526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:37 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:38.099062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:38.099562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:38.106273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.107133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.107790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.109498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.110347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.111235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.155904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:35:38.192128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:38.200318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-abbd8c0a-90a4-48fa-9218-88dcc999e362 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1271 microversion: 2.1 time: 0.184227 Oct 03 10:35:38.205844 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 753/1527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:38 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:38.332309 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b04cddeb-2c1e-42d8-b6b0-19390446a812 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 204 len: 0 microversion: 2.1 time: 0.237424 Oct 03 10:35:38.337074 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 775/1528] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:35:38 2022] DELETE /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:35:38.341935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:38.342676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:38.358711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.359594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.361399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.362349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.365361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.366033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.541780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:38.543258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] [instance: 63d64078-3f94-45fb-a864-a10c79b8c92e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:38.564040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.564622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.565104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.571477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:38.572216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:38.574096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:38.596808 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] HTTP exception thrown: Instance 63d64078-3f94-45fb-a864-a10c79b8c92e could not be found. Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Request method failure captured: Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e HTTP/1.1 Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrpFSZy17Uw9cR71mkMo_PSoolZnCvpqr_yEanj8S-noLuzCWQOhhUyHp2vMSPNzalVIdgpncIgZixioxa7rCzAWU9hMqzxsPGw1Mx1pNvZ4CBBy4lY6giDeRI_NyLBs2YEt2ZLYwQC392_pIa8mUs284g50r-MLLKe5wWmoxdeq3Bw Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b4201301e9cb42d3bcdff6d0416140f0 Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:35:38.599317 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4201301e9cb42d3bcdff6d0416140f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4201301e9cb42d3bcdff6d0416140f0"}]}] Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b4201301e9cb42d3bcdff6d0416140f0 Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminTestJSON-623585641 Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminTestJSON-623585641-project Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5be59c07a541438ab3cb0db3a0d0250a Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminTestJSON-623585641-project Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 63d64078-3f94-45fb-a864-a10c79b8c92e could not be found. Oct 03 10:35:38.600807 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '63d64078-3f94-45fb-a864-a10c79b8c92e'} Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d64078-3f94-45fb-a864-a10c79b8c92e could not be found. Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:38.601620 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d64078-3f94-45fb-a864-a10c79b8c92e could not be found. Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d64078-3f94-45fb-a864-a10c79b8c92e could not be found. Oct 03 10:35:38.602879 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:38.606609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] Returning 404 to user: Instance 63d64078-3f94-45fb-a864-a10c79b8c92e could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:38.608235 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bcb9d153-fa3e-45b4-9840-01dcce1adb50 tempest-ServersAdminTestJSON-623585641 tempest-ServersAdminTestJSON-623585641-project] 10.222.0.27 "GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e" status: 404 len: 111 microversion: 2.1 time: 0.070838 Oct 03 10:35:38.610157 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 776/1529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:38 2022] GET /compute/v2.1/servers/63d64078-3f94-45fb-a864-a10c79b8c92e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:35:38.661280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4966914c-ce5e-46ba-a47f-e568078c6e2c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f7069d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:38.754552 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4966914c-ce5e-46ba-a47f-e568078c6e2c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.098271 Oct 03 10:35:38.756628 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 777/1530] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:38 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:38.984974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:39.001466 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eb2294b8-1f59-4c61-af54-e17e00f5b171 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1529 microversion: 2.1 time: 0.663462 Oct 03 10:35:39.003638 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 754/1531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:38 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1529 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:39.235413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:39.236241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:39.250967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:39.253702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:39.258114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:39.261012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:39.261811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:39.264901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:39.529097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:39.550316 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f15bd47-c92d-4f71-88cd-101ef8162e5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1271 microversion: 2.1 time: 0.320813 Oct 03 10:35:39.551774 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 778/1532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:39 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:39.772883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79547997-19ea-4bf3-913c-2ea00c38152f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1e6dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:39.910246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79547997-19ea-4bf3-913c-2ea00c38152f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.142364 Oct 03 10:35:39.914698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 755/1533] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:39 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:40.030910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:40.031503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:40.041737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:40.042246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:40.042690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:40.043476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:40.045221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:40.045711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:40.581848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:40.585240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:40.599275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:40.600515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:40.602491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:40.608132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:40.609508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:40.645028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:41.402991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:41.411933 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b66727f-55be-4ebe-927a-1ad81ab18117 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1529 microversion: 2.1 time: 1.386076 Oct 03 10:35:41.420382 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 779/1534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:40 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1529 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:41.440388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:41.450216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3916a7d8-f8cc-4de1-a8d5-861fbbf96370 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.878181 Oct 03 10:35:41.458101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51385ae8-a3d6-4974-96a5-f5e921dea703 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f0b0790>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:41.462440 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 756/1535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:40 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:41.614813 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-51385ae8-a3d6-4974-96a5-f5e921dea703 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.191713 Oct 03 10:35:41.627594 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 780/1536] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:41 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:41.833023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-530ca999-29f0-42f8-ae79-6a921e84cc08 req-0883448b-d8ae-4e1b-a37a-7944b7f11083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11e46cc-232c-4567-b838-7c009c4629ab", "name": "network-vif-unplugged", "status": "completed", "tag": "ee928549-744d-45bc-acd1-1b9b96206371"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:41.857630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-530ca999-29f0-42f8-ae79-6a921e84cc08 req-0883448b-d8ae-4e1b-a37a-7944b7f11083 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:41.860402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-530ca999-29f0-42f8-ae79-6a921e84cc08 req-0883448b-d8ae-4e1b-a37a-7944b7f11083 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:41.861152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-530ca999-29f0-42f8-ae79-6a921e84cc08 req-0883448b-d8ae-4e1b-a37a-7944b7f11083 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:41.895461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-530ca999-29f0-42f8-ae79-6a921e84cc08 req-0883448b-d8ae-4e1b-a37a-7944b7f11083 service nova] Creating event network-vif-unplugged:ee928549-744d-45bc-acd1-1b9b96206371 for instance d11e46cc-232c-4567-b838-7c009c4629ab on n-h1-858383-3 Oct 03 10:35:41.902430 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-530ca999-29f0-42f8-ae79-6a921e84cc08 req-0883448b-d8ae-4e1b-a37a-7944b7f11083 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081511 Oct 03 10:35:41.908155 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 757/1537] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:42.346769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:42.347300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:42.356732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:42.361507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:42.361961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:42.362702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:42.363161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:42.363640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:42.414953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:42.456285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:42.457067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:42.463574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:42.464060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:42.464527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:42.465237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:42.465688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:42.466110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:42.748281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:42.815110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3cfa466-6cb0-45d1-b577-8e213ff2174c tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 2418 microversion: 2.25 time: 0.472829 Oct 03 10:35:42.821387 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 781/1538] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:42 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 2418 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:42.826136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:42.840036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:42.875024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:42.878739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:42.879487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:42.882744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:42.886416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:42.887796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:43.081945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:43.097706 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72965c6d-a9b5-4adc-bf08-66bfd0e6e667 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1529 microversion: 2.1 time: 0.640471 Oct 03 10:35:43.102751 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 758/1539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:42 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1529 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:43.132233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0731fc1-246b-404d-bffd-9fddb2989ce1 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f257d30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:43.302245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0731fc1-246b-404d-bffd-9fddb2989ce1 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.197727 Oct 03 10:35:43.305684 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 759/1540] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:43 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:43.315245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-3", "block_migration": "auto"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:43.342291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:43.367886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:43.368183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:43.370543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:43.374695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:43.376963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:43.379618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:43.388476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:43.439610 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f968ffb-1134-450d-b0d1-cd0c988cb6d9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.616729 Oct 03 10:35:43.448137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'flavor' on Instance uuid 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:43.449578 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 782/1541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:42 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:43.490366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Going to try to live migrate instance to n-h1-858383-3 {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:35:43.531395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0429716f-d9fa-41db-a0e2-e4a53e8c9085 req-2e3f76c3-4bc1-46a3-9f24-f6ddd92abc72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11e46cc-232c-4567-b838-7c009c4629ab", "name": "network-vif-deleted", "tag": "ee928549-744d-45bc-acd1-1b9b96206371"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:43.557478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0429716f-d9fa-41db-a0e2-e4a53e8c9085 req-2e3f76c3-4bc1-46a3-9f24-f6ddd92abc72 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:43.559947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0429716f-d9fa-41db-a0e2-e4a53e8c9085 req-2e3f76c3-4bc1-46a3-9f24-f6ddd92abc72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:43.561146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0429716f-d9fa-41db-a0e2-e4a53e8c9085 req-2e3f76c3-4bc1-46a3-9f24-f6ddd92abc72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:43.586890 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0429716f-d9fa-41db-a0e2-e4a53e8c9085 req-2e3f76c3-4bc1-46a3-9f24-f6ddd92abc72 service nova] Creating event network-vif-deleted:ee928549-744d-45bc-acd1-1b9b96206371 for instance d11e46cc-232c-4567-b838-7c009c4629ab on n-h1-858383-3 Oct 03 10:35:43.599404 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0429716f-d9fa-41db-a0e2-e4a53e8c9085 req-2e3f76c3-4bc1-46a3-9f24-f6ddd92abc72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103638 Oct 03 10:35:43.601597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 783/1542] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:43.993889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:44.023223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:44.129838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:44.131017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:44.146667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:44.149077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:44.150935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:44.154093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:44.155188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:44.157567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:44.250774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:44.251271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:44.254163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:44.254676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lazy-loading 'fault' on Instance uuid d11e46cc-232c-4567-b838-7c009c4629ab {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:35:44.305046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:44.365862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:44.380733 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9c31b16-70e0-4daf-a01e-336611d9ad2e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 200 len: 1315 microversion: 2.1 time: 0.256502 Oct 03 10:35:44.383387 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 784/1543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:44 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:44.398329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e17068f-96be-4f2b-ad77-8c0d2f1143f1 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f23a820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:44.483531 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e17068f-96be-4f2b-ad77-8c0d2f1143f1 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.098778 Oct 03 10:35:44.488145 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 785/1544] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:44 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:44.504322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:44.505094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:44.511981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:44.515653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:44.517493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:44.520671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:44.521920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:44.524626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:44.879492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:44.908637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6ba75cec-acf8-41ab-a7d1-93eb82cae9c1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.404064 Oct 03 10:35:44.928955 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 786/1545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:44 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:45.547956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-66757de7-c799-404a-8eb9-d8ddae3dcaab req-5860043d-cbfb-4a01-ac3d-f5397ca1035f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:45.568953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-66757de7-c799-404a-8eb9-d8ddae3dcaab req-5860043d-cbfb-4a01-ac3d-f5397ca1035f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:45.570789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-66757de7-c799-404a-8eb9-d8ddae3dcaab req-5860043d-cbfb-4a01-ac3d-f5397ca1035f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:45.571463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-66757de7-c799-404a-8eb9-d8ddae3dcaab req-5860043d-cbfb-4a01-ac3d-f5397ca1035f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:45.600286 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-66757de7-c799-404a-8eb9-d8ddae3dcaab req-5860043d-cbfb-4a01-ac3d-f5397ca1035f service nova] Creating event network-changed:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h2-858383-3 Oct 03 10:35:45.613179 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-66757de7-c799-404a-8eb9-d8ddae3dcaab req-5860043d-cbfb-4a01-ac3d-f5397ca1035f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506604 Oct 03 10:35:45.614144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 787/1546] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:45.626080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:45.633520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:45.650387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:45.650387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:45.650927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:45.661536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:45.662389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:45.664256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:45.688971 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab HTTP/1.1 Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:35:45.691036 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:35:45.692567 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'd11e46cc-232c-4567-b838-7c009c4629ab'} Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:35:45.693473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:35:45.694792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:35:45.698231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:35:45.699473 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a587e620-8228-4e84-a5ed-73e30d84dffd tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 404 len: 111 microversion: 2.1 time: 0.081387 Oct 03 10:35:45.700579 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 788/1547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:45 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:35:45.705730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ce1aa81-22a1-4420-b97b-177035382d68 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fad4550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:45.772272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ce1aa81-22a1-4420-b97b-177035382d68 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.070215 Oct 03 10:35:45.773952 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 789/1548] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:45 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:45.943374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:45.946835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:45.958777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:45.964695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:45.965427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:45.966348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:45.966958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:45.968699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:46.172102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:46.181162 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f88315d4-a745-4d12-9c34-8df46806eff8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.245960 Oct 03 10:35:46.181737 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 790/1549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:45 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:46.194939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1353113997", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:46.300004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] validate_networks() for [('6afe4139-285e-4668-b631-5b7bdefbe50f', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:35:47.070739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:35:47.073044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:35:47.073044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:35:47.073252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:35:47.073754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:35:47.086323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:47.087172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:47.087809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:47.089360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:47.090830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:47.091474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:47.128854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:35:47.137289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Getting quotas for user d55ab76047b047f4b45b003fd15f8ea3 and project 756f56f1c99d46cc8dcf50f23f32847f. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:35:47.154162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:35:47.157744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:35:47.225290 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-05aea379-f6ab-4bbb-b333-3640b1929275 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.040004 Oct 03 10:35:47.236181 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 791/1550] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:35:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:35:47.262019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7161bda-1beb-4f24-8312-c9fdbff1ef21 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1830d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:47.353054 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7161bda-1beb-4f24-8312-c9fdbff1ef21 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.114279 Oct 03 10:35:47.364927 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 792/1551] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:47 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:47.641906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1169324415", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:47.759781 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-662e9240-f7db-4094-b221-8ce12211c611 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/action" status: 202 len: 0 microversion: 2.25 time: 4.451586 Oct 03 10:35:47.761793 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 760/1552] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:35:43 2022] POST /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/action => generated 0 bytes in 4456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:35:47.765095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:35:47.780427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:47.786620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:47.805726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:47.806679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:47.807620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:47.808815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:47.809543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:47.810679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:48.239467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:35:48.240099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:35:48.241033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:35:48.241712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:35:48.256725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:35:48.278063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:48.279879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:48.282933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:48.286453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:48.290304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:48.296008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:48.373033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Getting quotas for project f157053f0fe9445a84531ef849861521. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:35:48.395682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Getting quotas for user a598123a284943b4a0cd88205e8f1146 and project f157053f0fe9445a84531ef849861521. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:35:48.437633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:35:48.442245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:35:48.538123 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-739de968-4676-4239-97eb-47f44fed7918 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171072 Oct 03 10:35:48.551584 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 793/1553] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:35:48.555700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:48.558869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:48.561938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:48.563595 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7c5990e-498f-441f-9cfd-0b5f499eb3c9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.800390 Oct 03 10:35:48.565805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:48.571263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:48.572027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:48.572984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:48.574342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:48.574835 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 761/1554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:47 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:48.593811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:48.595410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:48.607061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:48.607807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:48.609418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:48.611935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:48.613673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:48.614411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:48.618699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:48.621399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:48.731299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:48.748043 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6dbec71-77e1-4fe2-a5c8-5ce6d3e67441 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1221 microversion: 2.1 time: 0.194791 Oct 03 10:35:48.749041 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 794/1555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:48 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1221 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:48.759261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d32d528-05c6-4ac6-b523-f12d13462912 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f706550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:48.840293 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d32d528-05c6-4ac6-b523-f12d13462912 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.089932 Oct 03 10:35:48.840910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 795/1556] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:48 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:48.850368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40c34921-7c8d-49e3-a4d4-d7d3c4e9e3e9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:48.852363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40c34921-7c8d-49e3-a4d4-d7d3c4e9e3e9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:49.031287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:49.052160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:49.057517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:49.064413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7ffa508-747c-416b-b9b8-81fd68ca5664 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.486586 Oct 03 10:35:49.066551 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 762/1557] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:48 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:49.527981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40c34921-7c8d-49e3-a4d4-d7d3c4e9e3e9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:49.536358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40c34921-7c8d-49e3-a4d4-d7d3c4e9e3e9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1222 microversion: 2.1 time: 0.694221 Oct 03 10:35:49.545117 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 796/1558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:48 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1222 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:49.601479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:49.602097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:49.620777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:49.621290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:49.621739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:49.622469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:49.622929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:49.623388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:49.774538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:49.775415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:49.786985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:49.787585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:49.788526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:49.789315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:49.789806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:49.790544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:49.960178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:49.975217 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c6cb381-6781-4bec-a39b-87fd8f5392aa tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1277 microversion: 2.1 time: 0.202259 Oct 03 10:35:49.980691 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 797/1559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:49 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:49.990419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af1b4ac3-c85e-4d04-b804-5309776ff592 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fad6b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:50.104470 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-af1b4ac3-c85e-4d04-b804-5309776ff592 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.122631 Oct 03 10:35:50.105989 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 798/1560] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:49 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:50.113259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:50.115746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:50.127457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:50.128252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:50.128920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:50.129807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:50.130430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:50.131026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:50.259869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:50.268531 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac75f127-b119-4d9e-9479-82bafdb5b9df tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.670991 Oct 03 10:35:50.269146 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 763/1561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:49 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:50.362926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:50.374501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:50.376966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:50.378522 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-69e88f9b-62fa-4a13-862a-c4fd8021544a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.271415 Oct 03 10:35:50.399225 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 799/1562] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:50 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:50.560353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:50.561285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:50.584391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:50.585112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:50.585751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:50.586651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:50.587280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:50.587953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:51.004370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:51.006615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:51.018046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:51.018603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:51.028826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:51.030182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:51.033321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:51.036429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:51.123978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:51.136357 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8106cbd7-da17-43b6-a5b7-f6fa9593eade tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1274 microversion: 2.1 time: 0.580699 Oct 03 10:35:51.137777 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 764/1563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:50 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1274 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:51.143209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03153b98-23f8-4847-bdf2-20f8e9bbf89c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f247940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:51.200721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-03153b98-23f8-4847-bdf2-20f8e9bbf89c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.061708 Oct 03 10:35:51.209642 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 765/1564] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:51 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:51.292579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:51.293363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:51.304832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:51.306443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:51.306944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:51.307387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:51.308110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:51.308567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:51.309025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:51.964262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:51.972505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d615d571-d258-4ba7-87b1-884e6c9e1556 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.684659 Oct 03 10:35:51.977353 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 766/1565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:51 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:52.003651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:52.004290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:52.029474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:52.029969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:52.038719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:52.040788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:52.044023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:52.046735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:52.182571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:52.196504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64ed65ef-8e4f-4100-ae1f-5aa77233e7b7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 1.196424 Oct 03 10:35:52.207213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 800/1566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:50 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:52.243723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:52.252159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:52.280185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:52.282087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:52.285825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:52.289595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:52.293330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:52.296371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:52.608570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:52.622283 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0c520b0-8276-46ed-b9af-d06f62b0a91f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1280 microversion: 2.1 time: 0.413444 Oct 03 10:35:52.624597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 801/1567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:52 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:52.631486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6120f312-a299-4275-9e5c-897347d527bb tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fad0c10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:52.689963 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6120f312-a299-4275-9e5c-897347d527bb tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.063365 Oct 03 10:35:52.699361 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 802/1568] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:52 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:52.769344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dfba8ffb-4eff-45f6-a661-4143ce931461 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Action: 'create', calling method: .version_select at 0x7f074fa1e160>, body: {"pool": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:52.838918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:52.856435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:52.862544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:52.866761 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-309ec4a6-5b70-4dee-a39f-666b5101c0da tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.885692 Oct 03 10:35:52.869743 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 767/1569] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:51 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:53.001739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:53.003011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:53.012201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:53.015019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:53.017256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:53.018341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:53.021457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:53.022225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:53.060420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:53.370617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:53.380360 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca5a4c92-168d-416c-a01e-ddcb8b6e08d4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.382729 Oct 03 10:35:53.384266 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 768/1570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:52 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:53.395519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:53.399624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:53.414043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:53.415063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:53.416726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:53.421637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:53.423001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:53.423904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:53.780505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:53.794443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e50c736-7d6d-4197-a06a-a48449979077 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.404972 Oct 03 10:35:53.798410 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 769/1571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:53 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:53.806414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:53.809024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:53.835268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:53.836459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:53.837648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:53.840224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:53.843327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:53.844038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:53.974790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:53.984286 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d03da5a9-f9e2-4191-841f-3fe2b33fd67b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1280 microversion: 2.1 time: 0.184518 Oct 03 10:35:53.989134 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 770/1572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:53 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:53.997430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-062c7e7b-d4aa-409b-a9c1-c264c6e88f6e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f185430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:54.151138 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-062c7e7b-d4aa-409b-a9c1-c264c6e88f6e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.160373 Oct 03 10:35:54.162786 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 771/1573] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:53 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:54.168237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:54.169903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:54.177506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:54.178388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:54.179063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:54.180024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:54.181036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:54.181781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:54.396960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:54.410982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:54.412702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:54.414413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f49fce95-df3a-4048-9ac3-8c93dbafe5a4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.250071 Oct 03 10:35:54.426280 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 772/1574] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:54 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:54.444164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:54.446350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:54.463241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:54.465510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:54.467963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:54.473091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:54.473752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:54.474347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:54.798206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:54.818449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac2a4287-a857-485a-874e-3269edbc0989 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.383605 Oct 03 10:35:54.836000 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 773/1575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:54 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:54.850272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:54.853214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:54.868206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:54.869176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:54.871659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:54.874981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:54.879518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:54.879697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:55.293387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:55.308461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-521998af-fec9-494d-b944-1538f9d9963e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.476174 Oct 03 10:35:55.314384 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 774/1576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:54 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:55.453534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-53f4b137-4a0c-4dac-aca3-0ecd7cd8aee8 req-96ea900b-a7e2-4c13-b070-d6050227bfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "name": "network-vif-plugged", "status": "completed", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:55.465089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-53f4b137-4a0c-4dac-aca3-0ecd7cd8aee8 req-96ea900b-a7e2-4c13-b070-d6050227bfa0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:55.465636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-53f4b137-4a0c-4dac-aca3-0ecd7cd8aee8 req-96ea900b-a7e2-4c13-b070-d6050227bfa0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:55.466079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-53f4b137-4a0c-4dac-aca3-0ecd7cd8aee8 req-96ea900b-a7e2-4c13-b070-d6050227bfa0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:55.480704 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-53f4b137-4a0c-4dac-aca3-0ecd7cd8aee8 req-96ea900b-a7e2-4c13-b070-d6050227bfa0 service nova] Creating event network-vif-plugged:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h2-858383-3 Oct 03 10:35:55.488967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-53f4b137-4a0c-4dac-aca3-0ecd7cd8aee8 req-96ea900b-a7e2-4c13-b070-d6050227bfa0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171880 Oct 03 10:35:55.490075 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 775/1577] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:55.504111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:55.508488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:55.518245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:55.518746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:55.519271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:55.520706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:55.521624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:55.521752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:55.691606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:55.699916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d88565ff-3d3d-450f-a3fa-250b11ec427f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1280 microversion: 2.1 time: 0.208457 Oct 03 10:35:55.700436 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 776/1578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:55 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:55.712032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2072c99b-7137-46f9-9fef-2f39140eaf94 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1855e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:55.806398 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2072c99b-7137-46f9-9fef-2f39140eaf94 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1422 microversion: 2.1 time: 0.089217 Oct 03 10:35:55.807631 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 777/1579] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:55 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:55.812691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:55.813588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:55.820005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:55.820755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:55.821393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:55.822315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:55.823007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:55.823667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:56.013746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:56.027507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:56.029415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:56.031003 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-467bf266-9be1-4439-9f92-6b540fed77ab tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.222111 Oct 03 10:35:56.032413 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 778/1580] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:55 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:56.039756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:56.040611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:56.051846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:56.053061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:56.053734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:56.054548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:56.055114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:56.055591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:56.251339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:56.263906 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bec1190a-313e-4d89-bae4-181f654a5b76 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1313 microversion: 2.1 time: 0.230125 Oct 03 10:35:56.265114 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 779/1581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:56 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:56.343942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:56.346228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:56.354298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:56.354918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:56.355449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:56.356423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:56.357258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:56.358472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:56.584340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:56.595055 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28943fac-5211-49ee-9ad9-0aec71463fec tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.262709 Oct 03 10:35:56.601799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 780/1582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:56 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:56.728251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:56.729073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:56.737921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:56.739020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:56.739901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:56.741450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:56.742756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:56.743431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:56.962557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:56.975010 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c8def9b-3934-4996-bed3-aa0d67e95fba tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.251739 Oct 03 10:35:56.976177 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 781/1583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:56 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:35:56.989380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0caec73b-6ef9-4a6d-8ba9-8548bb4a7aa4 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f257dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:57.064753 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0caec73b-6ef9-4a6d-8ba9-8548bb4a7aa4 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1431 microversion: 2.1 time: 0.087287 Oct 03 10:35:57.081708 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 782/1584] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:56 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1431 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:57.095298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1f430bed-2694-4015-b556-ee27733c00e8 req-6e9cedd4-0357-4f44-9cd7-210d86b217de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b22187-cb5e-499a-8d04-e598663c7847", "tag": "49514a07-d304-48dd-8eb8-1a0e8bf4e170"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:57.125292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1f430bed-2694-4015-b556-ee27733c00e8 req-6e9cedd4-0357-4f44-9cd7-210d86b217de service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:57.127514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1f430bed-2694-4015-b556-ee27733c00e8 req-6e9cedd4-0357-4f44-9cd7-210d86b217de service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:57.128189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1f430bed-2694-4015-b556-ee27733c00e8 req-6e9cedd4-0357-4f44-9cd7-210d86b217de service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:57.173866 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1f430bed-2694-4015-b556-ee27733c00e8 req-6e9cedd4-0357-4f44-9cd7-210d86b217de service nova] Creating event network-changed:49514a07-d304-48dd-8eb8-1a0e8bf4e170 for instance 30b22187-cb5e-499a-8d04-e598663c7847 on n-h1-858383-3 Oct 03 10:35:57.189132 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1f430bed-2694-4015-b556-ee27733c00e8 req-6e9cedd4-0357-4f44-9cd7-210d86b217de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103521 Oct 03 10:35:57.192056 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 783/1585] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:57.212304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:57.223279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:57.235254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:57.235759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:57.244326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:57.245428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:57.245992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:57.246440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:57.549370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:57.586547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:57.590897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:57.593382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce5f7c41-dcf0-4815-97ad-53b95536be58 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.397822 Oct 03 10:35:57.596328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 784/1586] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:57 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:57.606549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-63b26318-3760-4d91-8648-e7018b795343 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f185f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:57.698581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-63b26318-3760-4d91-8648-e7018b795343 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 200 len: 1431 microversion: 2.1 time: 0.100778 Oct 03 10:35:57.699303 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 785/1587] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:57 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 1431 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:57.723182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:57.729559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:57.742256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:57.744007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:57.747516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:57.748547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:57.749387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:57.750135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:58.051944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:58.066364 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a454dc53-614a-4625-afa6-73f7b8abddee tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1463 microversion: 2.1 time: 0.356424 Oct 03 10:35:58.070396 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 786/1588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:57 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1463 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:58.083300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:58.085735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:58.099450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:58.101275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:58.105361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:58.107178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:58.109402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:58.110635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:58.323625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:58.479483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:58.488024 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da48f694-8c83-49e3-9dc8-4cb6dc8041d9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.416245 Oct 03 10:35:58.488607 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 787/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:58 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:58.498989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:58.499605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:58.521974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:58.524300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:58.525675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:58.527236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:58.528188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:58.528523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:58.742122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:58.751037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2aa0b3ee-c5e2-47b6-987d-709967ac598a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1466 microversion: 2.1 time: 0.258023 Oct 03 10:35:58.769443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 788/1590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:58 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1466 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:58.774412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:58.775408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:58.783171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:58.784109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:58.784918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:58.785969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:58.786593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:58.787584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:58.984674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:58.993131 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32c7ea92-ffe0-42ce-8047-7d502048bd3b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.222522 Oct 03 10:35:59.007913 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 789/1591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:58 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:59.019638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:59.020706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:59.027778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.028583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.029281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.030370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.031051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.032217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.058380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:59.131921 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dfba8ffb-4eff-45f6-a661-4143ce931461 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.431056 Oct 03 10:35:59.133001 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 803/1592] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:35:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:59.144538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:59.145351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:59.152980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.153879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.154422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.155256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.155926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.156538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.284967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d35b179a-c229-4c4a-a086-b41ddc8e52b6 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1614 microversion: 2.1 time: 0.275432 Oct 03 10:35:59.286228 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 790/1593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:59 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1614 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:35:59.317778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfc1f073-4f20-46ec-abea-bd2f0e111212 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f360ca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:59.357667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:59.372947 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfc1f073-4f20-46ec-abea-bd2f0e111212 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/f290423a-28bb-43d3-ba8c-d44fc0f72e5f" status: 200 len: 784 microversion: 2.1 time: 0.063040 Oct 03 10:35:59.373586 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 791/1594] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:35:59 2022] GET /compute/v2.1/images/f290423a-28bb-43d3-ba8c-d44fc0f72e5f => generated 784 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:59.378894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:59.381720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:59.382686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ed5ce0f-c8aa-4d68-a7f8-adc5a72fb13c tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Action: 'create', calling method: .version_select at 0x7f074f1be040>, body: {"pool": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:59.383418 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-46252333-14c8-4f95-bc22-46e43c879e5d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.249387 Oct 03 10:35:59.385480 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 804/1595] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:35:59 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:35:59.414692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3d5b1ddd-d7ab-425b-b013-79a1c9888e7b req-5aa4a7d0-04d3-4e40-8d02-d7ecdeca48a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259e1246-110d-4c3a-96e4-feea029ecb69", "tag": "412b284e-64de-46fd-832a-d000bec64a46"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:59.424671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3d5b1ddd-d7ab-425b-b013-79a1c9888e7b req-5aa4a7d0-04d3-4e40-8d02-d7ecdeca48a3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.425311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3d5b1ddd-d7ab-425b-b013-79a1c9888e7b req-5aa4a7d0-04d3-4e40-8d02-d7ecdeca48a3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.425984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3d5b1ddd-d7ab-425b-b013-79a1c9888e7b req-5aa4a7d0-04d3-4e40-8d02-d7ecdeca48a3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.442301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3d5b1ddd-d7ab-425b-b013-79a1c9888e7b req-5aa4a7d0-04d3-4e40-8d02-d7ecdeca48a3 service nova] Creating event network-changed:412b284e-64de-46fd-832a-d000bec64a46 for instance 259e1246-110d-4c3a-96e4-feea029ecb69 on n-h1-858383-3 Oct 03 10:35:59.447328 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3d5b1ddd-d7ab-425b-b013-79a1c9888e7b req-5aa4a7d0-04d3-4e40-8d02-d7ecdeca48a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047991 Oct 03 10:35:59.448010 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 805/1596] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:59.454799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:35:59.455517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:59.461780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.462273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.462710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.463412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.463898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.464327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.537879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:35:59.548238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ae3e33471e434e02a003b7dddf2756e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69efc7f0eb42358bb06f5356d2cb9b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:35:59.548940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] flavor_id is None. Assuming migration. {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 10:35:59.549285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 10:35:59.871367 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e5d45ce0-d19f-41ec-82b5-cf53498882be tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30/action" status: 202 len: 0 microversion: 2.1 time: 0.421770 Oct 03 10:35:59.873097 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 806/1597] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:35:59 2022] POST /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:35:59.878613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a2a6de7-64ab-49aa-a750-1a62c3b5596c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:59.890458 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a2a6de7-64ab-49aa-a750-1a62c3b5596c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015976 Oct 03 10:35:59.898036 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 807/1598] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:35:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:35:59.902077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:35:59.902700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:35:59.923428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.924472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.925314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:35:59.926758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:35:59.927548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:35:59.928365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:00.083342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:00.090576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:00.093613 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d9ec7fe-0ddc-4c26-99ab-5c18d2a66082 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.200967 Oct 03 10:36:00.111094 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 808/1599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:35:59 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:00.125146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:00.125795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:00.133272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:00.134017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:00.134724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:00.135603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:00.137036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:00.137736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:00.340442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:00.350257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d5f1fa0-34ab-409c-85aa-426c41731791 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1472 microversion: 2.1 time: 0.237993 Oct 03 10:36:00.350991 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 809/1600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:00 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:00.355539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13149d80-8c4f-4c25-ab65-f4e4a36e3b77 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f2b3b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:01.426723 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ed5ce0f-c8aa-4d68-a7f8-adc5a72fb13c tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.052109 Oct 03 10:36:01.427961 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 792/1601] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:35:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:01.433053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:01.433671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:01.447092 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13149d80-8c4f-4c25-ab65-f4e4a36e3b77 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "DELETE /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 204 len: 0 microversion: 2.1 time: 1.095024 Oct 03 10:36:01.447722 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 810/1602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:00 2022] DELETE /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 0 bytes in 1096 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:36:01.453332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:01.454544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:01.460184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.460953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.461598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.462495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.463112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.463877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.467065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.467561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.467989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.474724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.475440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.476077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.648923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:01.658223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d031577-d002-4048-bc61-a425c372a426 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.229030 Oct 03 10:36:01.673775 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 793/1603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:01 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:01.680684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-99501ca9-5226-4966-a418-b484e04005fa req-d1812783-29bd-4a17-8f2f-ec1d5c2c4205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5914cb9d-936d-4df2-b759-da941b2982df", "name": "network-vif-unplugged", "status": "completed", "tag": "72809ff0-0bb2-4fd1-8b14-2f84af87b5b6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:01.702155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-99501ca9-5226-4966-a418-b484e04005fa req-d1812783-29bd-4a17-8f2f-ec1d5c2c4205 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.702671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-99501ca9-5226-4966-a418-b484e04005fa req-d1812783-29bd-4a17-8f2f-ec1d5c2c4205 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.703113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-99501ca9-5226-4966-a418-b484e04005fa req-d1812783-29bd-4a17-8f2f-ec1d5c2c4205 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.716568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-99501ca9-5226-4966-a418-b484e04005fa req-d1812783-29bd-4a17-8f2f-ec1d5c2c4205 service nova] Creating event network-vif-unplugged:72809ff0-0bb2-4fd1-8b14-2f84af87b5b6 for instance 5914cb9d-936d-4df2-b759-da941b2982df on n-h2-858383-3 Oct 03 10:36:01.722880 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-99501ca9-5226-4966-a418-b484e04005fa req-d1812783-29bd-4a17-8f2f-ec1d5c2c4205 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047451 Oct 03 10:36:01.723494 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 794/1604] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:01.728790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:01.729495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:01.737034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.737575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.738015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.738715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.739486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.739867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.823482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:01.870513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:01.880010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:01.883414 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c999901-8752-48bd-8f91-8614324a7d29 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.433505 Oct 03 10:36:01.885505 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 811/1605] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:01 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:01.891730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:01.892627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:01.900422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.901425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.902308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.903630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:01.904221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:01.904650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:01.949536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:01.961406 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66768862-8805-4180-83da-247774639700 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.233601 Oct 03 10:36:01.974493 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 795/1606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:01 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:01.985920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5844b091-7790-44e2-86b7-52bc07f0f932 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Action: 'create', calling method: .version_select at 0x7f074f185820>, body: {"pool": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:02.336938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:02.354098 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c41aed11-d47b-4fcb-94d4-354eb6a86d08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1472 microversion: 2.1 time: 0.467091 Oct 03 10:36:02.354922 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 812/1607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:01 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:02.370366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41ba42c7-0708-431a-9ec6-c9ee285843a5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fad4c10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:02.406343 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-41ba42c7-0708-431a-9ec6-c9ee285843a5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] HTTP exception thrown: Image not found. Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41ba42c7-0708-431a-9ec6-c9ee285843a5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Request method failure captured: Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 HTTP/1.1 Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrrLneshLfTO9cXV24wC93PuVL8WnazCu3pMwClvsijAFj0xKsXICTTvITj8ki9fibou04um5A8aRBemedPggDVGGSwHsTcrHsILn12s7cP2XGmfnghUU8G-y6gU2EgUXOn78-nL0YjMpeIzUZmy6WYCpBcmC6kGEu8Q0uhgG72tIB4 Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: fecd91e631b84f2fba9f7756cbdc63a1 Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:36:02.417021 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fecd91e631b84f2fba9f7756cbdc63a1"}]}] Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: fecd91e631b84f2fba9f7756cbdc63a1 Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerTestJSON-811490309-project Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 9ea84c4ec0e14b78817e9767bfbe2a1a Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerTestJSON-811490309-project Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'd440da65-6923-4bda-be05-fdff4a1f8797'} Oct 03 10:36:02.419164 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:36:02.420182 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d440da65-6923-4bda-be05-fdff4a1f8797 Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:36:02.421602 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d440da65-6923-4bda-be05-fdff4a1f8797 could not be found. Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:36:02.423085 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:36:02.426365 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:02.443494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41ba42c7-0708-431a-9ec6-c9ee285843a5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:02.445016 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41ba42c7-0708-431a-9ec6-c9ee285843a5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 404 len: 62 microversion: 2.1 time: 0.089155 Oct 03 10:36:02.454287 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 813/1608] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:02 2022] GET /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:36:02.461506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1716885876"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:02.465525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:02.475014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:02.475773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:02.476412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:02.477342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:02.477958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:02.478544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:02.721612 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ac5063b-de73-479f-a8aa-72d26e9a9ffa tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "POST /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df/action" status: 202 len: 0 microversion: 2.1 time: 0.264754 Oct 03 10:36:02.723453 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 814/1609] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:02 2022] POST /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:36:02.737245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:02.738303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:02.748668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:02.749669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:02.750487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:02.751730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:02.752349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:02.753971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:03.081936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:03.091444 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a18cc54-5b74-4639-b1fb-bd068aaef2bf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.365939 Oct 03 10:36:03.092208 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 815/1610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:02 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:03.110127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3043b620-a7da-4ba8-9f21-2caed9ff472c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1f8b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:03.162581 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3043b620-a7da-4ba8-9f21-2caed9ff472c tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.068539 Oct 03 10:36:03.163820 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 816/1611] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:03 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:03.169011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:03.171316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:03.176928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:03.177437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:03.177870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:03.178581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:03.179040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:03.179477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:03.326077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:03.336864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:03.338780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:03.340338 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3a85040-6334-4487-a0e3-cb1ac05bfbe6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.175403 Oct 03 10:36:03.341205 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 817/1612] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:03 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:03.362639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:03.363385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:03.370519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:03.371217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:03.371720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:03.373907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:03.374555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:03.374992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:03.521757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:03.534900 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c11cef03-436e-488b-bea8-47b553c34fea tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.176152 Oct 03 10:36:03.536535 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 818/1613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:03 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:03.542979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:03.543953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:03.551133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:03.552074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:03.553285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:03.554511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:03.555429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:03.556052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:03.716570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:03.730814 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-543aca09-5125-495c-bf51-e17eac1fc40f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1472 microversion: 2.1 time: 0.192790 Oct 03 10:36:03.733419 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 819/1614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:03 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:03.911960 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5844b091-7790-44e2-86b7-52bc07f0f932 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.933571 Oct 03 10:36:03.912899 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 796/1615] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:36:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:03.925508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6972969d-efc0-46a8-a124-a8deeebd9618 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Action: 'create', calling method: .version_select at 0x7f074f183700>, body: {"pool": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:04.120093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:04.120724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:04.127887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.128605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.129087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:04.129796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.130256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.130684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:04.312576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:04.325093 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-751803f0-b0b0-45c0-918b-0ccd8b536738 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.210366 Oct 03 10:36:04.338500 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 797/1616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:04 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:04.349749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ae09384-687c-4bbb-afc4-e44a77741a84 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f2f6700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:04.408672 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ae09384-687c-4bbb-afc4-e44a77741a84 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.068499 Oct 03 10:36:04.410081 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 798/1617] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:04 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:04.426012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:04.426939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:04.433430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.433919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.434361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:04.435068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.435523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.435950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:04.604717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:04.614618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:04.616348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:04.617564 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-07f882a6-9547-4179-b58b-a7344e0ef5d4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.195904 Oct 03 10:36:04.618350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 799/1618] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:04 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:04.623351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:04.624387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:04.630302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.630782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.631535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:04.632424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.632734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.633276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:04.797804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:04.806497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa289cca-fbc9-40f2-b0c1-c6b34f33bc13 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.186771 Oct 03 10:36:04.829365 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 800/1619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:04 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:04.834709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:04.835325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:04.841441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.841968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.842456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:04.843402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:04.844105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:04.845288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:05.038090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:05.046634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-55a3b556-65f1-432f-a280-eb0c5bb766cd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.216048 Oct 03 10:36:05.047686 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 801/1620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:04 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:05.355027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:05.355642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:05.362326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:05.363052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:05.363747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:05.364925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:05.365383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:05.365808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:05.518900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:05.530061 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-63d991af-08cb-4b23-9709-e0f502847df3 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.182040 Oct 03 10:36:05.530863 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 802/1621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:05 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:05.535813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f344df6-34c3-4a1a-9f66-623f6697c7a6 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1beee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:05.575546 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6972969d-efc0-46a8-a124-a8deeebd9618 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.653834 Oct 03 10:36:05.576147 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 820/1622] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:36:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:36:05.588197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cffe272d-bcf9-4a11-b9e6-4f47ee8d70f0 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Calling method '.version_select at 0x7f074f23aee0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:05.596826 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f344df6-34c3-4a1a-9f66-623f6697c7a6 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.064516 Oct 03 10:36:05.598073 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 803/1623] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:05 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:05.643631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:05.644737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:05.651157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:05.651652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:05.652096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:05.652825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:05.653288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:05.653735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:05.802222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:05.812156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:05.813952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:05.815174 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b020cff3-de0b-46d3-988a-379f115b8dd8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.176095 Oct 03 10:36:05.816218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 804/1624] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:05 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:36:05.840164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:05.840731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:05.847785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:05.848684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:05.849175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:05.850391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:05.850854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:05.851286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:05.873445 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cffe272d-bcf9-4a11-b9e6-4f47ee8d70f0 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/8f893fe6-135c-48eb-aec5-16f9cf71cee8" status: 200 len: 142 microversion: 2.1 time: 0.288948 Oct 03 10:36:05.876470 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 821/1625] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:36:05 2022] GET /compute/v2.1/os-floating-ips/8f893fe6-135c-48eb-aec5-16f9cf71cee8 => generated 142 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:36:05.887518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26b53266-b212-47cc-b0f0-684b05c81bec tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Calling method '.version_select at 0x7f074f98e5e0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:06.029779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:06.041663 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2dd99d37-8314-4146-b879-53731d92d993 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.205930 Oct 03 10:36:06.052436 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 805/1626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:05 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:06.073956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:06.075025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:06.081930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:06.082886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:06.083403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:06.084444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:06.085185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:06.085698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:06.243849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:06.252159 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7da4ae7d-b0d2-4230-bd9a-888dbdd1d052 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.183421 Oct 03 10:36:06.269499 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 806/1627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:06 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:06.275523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-74e55269-e766-4b21-b400-f0d1779d0bc5 req-4d637d11-c2d3-447c-996c-61a3de1846c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b22187-cb5e-499a-8d04-e598663c7847", "name": "network-vif-plugged", "status": "completed", "tag": "49514a07-d304-48dd-8eb8-1a0e8bf4e170"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:06.285955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-74e55269-e766-4b21-b400-f0d1779d0bc5 req-4d637d11-c2d3-447c-996c-61a3de1846c9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:06.286432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-74e55269-e766-4b21-b400-f0d1779d0bc5 req-4d637d11-c2d3-447c-996c-61a3de1846c9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:06.286865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-74e55269-e766-4b21-b400-f0d1779d0bc5 req-4d637d11-c2d3-447c-996c-61a3de1846c9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:06.300371 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-74e55269-e766-4b21-b400-f0d1779d0bc5 req-4d637d11-c2d3-447c-996c-61a3de1846c9 service nova] Creating event network-vif-plugged:49514a07-d304-48dd-8eb8-1a0e8bf4e170 for instance 30b22187-cb5e-499a-8d04-e598663c7847 on n-h1-858383-3 Oct 03 10:36:06.305558 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-74e55269-e766-4b21-b400-f0d1779d0bc5 req-4d637d11-c2d3-447c-996c-61a3de1846c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034689 Oct 03 10:36:06.306192 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 807/1628] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:06.558598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:06.560241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:06.569512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:06.570478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:06.571116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:06.571880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:06.572345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:06.572804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:06.747974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:06.760265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f70c383b-a241-4f16-bbf2-48634c301e46 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.207673 Oct 03 10:36:06.761578 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 808/1629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:06 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:06.769430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-45893e80-d112-4d52-b57e-3bae2a49c099 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f185820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:06.856461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-45893e80-d112-4d52-b57e-3bae2a49c099 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.092808 Oct 03 10:36:06.858221 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 809/1630] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:06 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:06.867776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:06.870768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:06.884788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:06.887380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:06.889322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:06.890478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:06.892084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:06.893426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.070045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:07.081256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:07.082840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:07.084248 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3ba1cb8-de21-4a9f-906c-8669fe82a41e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.222721 Oct 03 10:36:07.085209 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 810/1631] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:06 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:07.089949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:07.091071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:07.097605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.098381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.099019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.099918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.100559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.101365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.258827 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91251654-7371-4faa-948e-ce96e693a730 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1813 microversion: 2.1 time: 0.172360 Oct 03 10:36:07.259472 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 811/1632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:07 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1813 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:07.280463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:07.281293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:07.287889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.288384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.289098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.289806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.290406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.290677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.452977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:07.465401 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c13b27c-0779-4f39-8c0e-3aed75abe633 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.198837 Oct 03 10:36:07.466474 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 812/1633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:07 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:07.485516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:07.486709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:07.493015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.493553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.494217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.495726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.496789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.497420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.663323 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26b53266-b212-47cc-b0f0-684b05c81bec tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/8f893fe6-135c-48eb-aec5-16f9cf71cee8" status: 202 len: 0 microversion: 2.1 time: 1.779889 Oct 03 10:36:07.665282 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 822/1634] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:36:05 2022] DELETE /compute/v2.1/os-floating-ips/8f893fe6-135c-48eb-aec5-16f9cf71cee8 => generated 0 bytes in 1783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:36:07.671220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:07.681754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:07.686359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.686876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.687328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.690250 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-410f2853-5661-45d6-8ba9-da86230ee3de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.222480 Oct 03 10:36:07.696377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.696913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.697364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.712088 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 813/1635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:07 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:07.717353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1914ec7-c6aa-4593-a938-3bc1db0e2b77 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Calling method '.version_select at 0x7f074f257b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:07.768482 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1dd5782a-e8f0-4d4d-bdb9-53b8f6b5c46a tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102053 Oct 03 10:36:07.769401 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 823/1636] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:36:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:07.794465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:07.795092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:07.805395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.806412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.806864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:07.809684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:07.810805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:07.811241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:08.072484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:08.083364 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ded31958-d321-4fcb-a843-d2825cb61ee6 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.293433 Oct 03 10:36:08.092031 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 824/1637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:07 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:08.101752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0035ad2c-fe52-4554-84f0-51ae1b0e650b tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f56f8b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:08.193993 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0035ad2c-fe52-4554-84f0-51ae1b0e650b tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.098687 Oct 03 10:36:08.197115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 825/1638] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:08 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:08.209573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:08.210579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:08.236671 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1914ec7-c6aa-4593-a938-3bc1db0e2b77 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.523109 Oct 03 10:36:08.241145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:08.241770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:08.243898 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 814/1639] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 3 10:36:07 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:36:08.244740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:08.249287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b0f3e20-c11c-4d6d-ab06-28ae153cf979 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Calling method '.version_select at 0x7f074f1e7a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:08.250057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:08.251370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:08.251828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:08.522870 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b0f3e20-c11c-4d6d-ab06-28ae153cf979 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.277705 Oct 03 10:36:08.523461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 815/1640] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:36:08 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:08.533374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:08.533374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:08.542668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:08.543148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:08.543599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:08.544315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:08.544868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:08.545305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:08.600301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:08.774935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:08.793558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:08.795101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:08.803647 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f50b08f-d18f-47cf-99df-f442b8d87969 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.605150 Oct 03 10:36:08.804246 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 826/1641] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:08 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:08.818890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3ee1aa33-b123-4f2d-9fee-ce865d071673 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Calling method '.version_select at 0x7f074fa34430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:08.906906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:08.931223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f648c6e7-8ecc-461a-9cdf-b94c36121416 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.406684 Oct 03 10:36:08.946515 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 816/1642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:08 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:08.957958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:08.960526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:08.970842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:08.971982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:08.972795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:08.973850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:08.974535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:08.975209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:09.267622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:09.279631 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59704a83-5f41-4335-baaa-a6542e4d340b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.331570 Oct 03 10:36:09.300237 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 817/1643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:08 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:09.321892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:09.323048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:09.337485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:09.337970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:09.338403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:09.339313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:09.339924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:09.340509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:09.656294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:09.685061 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-07859384-543f-4181-aee4-144c5aeb986b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.383339 Oct 03 10:36:09.702188 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 818/1644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:09 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:09.707102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-01f2231e-343a-417d-8e6e-d8f70c976729 req-f635a9dd-6f47-48e5-baf4-4c115ed4225e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5914cb9d-936d-4df2-b759-da941b2982df", "name": "network-vif-plugged", "status": "completed", "tag": "72809ff0-0bb2-4fd1-8b14-2f84af87b5b6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:09.726871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01f2231e-343a-417d-8e6e-d8f70c976729 req-f635a9dd-6f47-48e5-baf4-4c115ed4225e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:09.727511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01f2231e-343a-417d-8e6e-d8f70c976729 req-f635a9dd-6f47-48e5-baf4-4c115ed4225e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:09.727973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01f2231e-343a-417d-8e6e-d8f70c976729 req-f635a9dd-6f47-48e5-baf4-4c115ed4225e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:09.743088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-01f2231e-343a-417d-8e6e-d8f70c976729 req-f635a9dd-6f47-48e5-baf4-4c115ed4225e service nova] Creating event network-vif-plugged:72809ff0-0bb2-4fd1-8b14-2f84af87b5b6 for instance 5914cb9d-936d-4df2-b759-da941b2982df on n-h2-858383-3 Oct 03 10:36:09.758988 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-01f2231e-343a-417d-8e6e-d8f70c976729 req-f635a9dd-6f47-48e5-baf4-4c115ed4225e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067268 Oct 03 10:36:09.760607 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 819/1645] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:09.770779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b51a7998-ee05-4a05-b060-c22308589998 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f264a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:09.842872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b51a7998-ee05-4a05-b060-c22308589998 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.076829 Oct 03 10:36:09.851960 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 820/1646] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:09 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:09.858445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:09.859411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:09.869155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:09.869654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:09.870096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:09.870819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:09.871274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:09.871698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:10.078419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:10.090917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:10.093714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:10.096065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8060cc88-87e9-4ac3-ac65-d8a99d09e574 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.249424 Oct 03 10:36:10.104012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 821/1647] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:09 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:10.109484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:10.110132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:10.116900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:10.117409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:10.117843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:10.118556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:10.119649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:10.120098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:10.317353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:10.326378 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12b6c122-022f-4f79-95c7-aaf149045dca tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1325 microversion: 2.1 time: 0.220766 Oct 03 10:36:10.329932 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 822/1648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:10 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:10.337127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:10.338202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:10.345629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:10.346415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:10.347234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:10.348694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:10.350054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:10.351125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:10.526479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:10.536601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10772faa-bede-4223-80e6-945ab8137a08 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.204506 Oct 03 10:36:10.537689 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 823/1649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:10 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:10.663310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5707151-4d1a-41c1-a50b-a6f40bb86005", "device": "/dev/xvdb"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:10.667394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:10.682994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:10.683860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:10.684732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:10.685597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:10.686059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:10.686488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:11.304339 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1001530-b61f-4c49-ab52-134c5300df1f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "POST /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643490 Oct 03 10:36:11.307874 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 824/1650] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:36:10 2022] POST /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:36:11.338722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:11.353450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:11.363343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:11.364514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:11.365786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:11.377945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:11.378966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:11.379576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:11.704337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:11.716458 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62b4883d-9cb8-4ff5-956d-ea465ecbc33c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.407124 Oct 03 10:36:11.718791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 825/1651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:11 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:11.724259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d012dbb7-a859-4e43-b428-35755530ca65 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f721430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:11.796936 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d012dbb7-a859-4e43-b428-35755530ca65 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.076834 Oct 03 10:36:11.809327 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 826/1652] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:11 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:11.814552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:11.815473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:11.823251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:11.824010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:11.824641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:11.825558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:11.826214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:11.826804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.080158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:12.096312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:12.097808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:12.099038 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08a9e411-f903-4f17-8216-de76f2e59d8d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.288617 Oct 03 10:36:12.099607 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 827/1653] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:11 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:12.118628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:12.119530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:12.126154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.137589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.138354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.139287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.139914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.140855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.343046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:12.356094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1479b847-32c9-4855-8850-d79493039947 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1523 microversion: 2.1 time: 0.241930 Oct 03 10:36:12.357186 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 828/1654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:12 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:12.362622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:12.363218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:12.370544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.371182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.371623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.372320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.372793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.373617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.503598 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3ee1aa33-b123-4f2d-9fee-ce865d071673 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d8e5b4c6-abe4-439c-9137-0a2218648c56" status: 202 len: 0 microversion: 2.1 time: 3.698291 Oct 03 10:36:12.508359 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 827/1655] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:36:08 2022] DELETE /compute/v2.1/os-floating-ips/d8e5b4c6-abe4-439c-9137-0a2218648c56 => generated 0 bytes in 3704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:36:12.522159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-dcc74634-3043-476e-b761-c0375ab0546c req-6d90411d-64e4-45a3-a39e-912c990eda5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259e1246-110d-4c3a-96e4-feea029ecb69", "name": "network-vif-plugged", "status": "completed", "tag": "412b284e-64de-46fd-832a-d000bec64a46"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:12.585518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dcc74634-3043-476e-b761-c0375ab0546c req-6d90411d-64e4-45a3-a39e-912c990eda5c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.589554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dcc74634-3043-476e-b761-c0375ab0546c req-6d90411d-64e4-45a3-a39e-912c990eda5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.591964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dcc74634-3043-476e-b761-c0375ab0546c req-6d90411d-64e4-45a3-a39e-912c990eda5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.633285 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-dcc74634-3043-476e-b761-c0375ab0546c req-6d90411d-64e4-45a3-a39e-912c990eda5c service nova] Creating event network-vif-plugged:412b284e-64de-46fd-832a-d000bec64a46 for instance 259e1246-110d-4c3a-96e4-feea029ecb69 on n-h1-858383-3 Oct 03 10:36:12.651465 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-dcc74634-3043-476e-b761-c0375ab0546c req-6d90411d-64e4-45a3-a39e-912c990eda5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136022 Oct 03 10:36:12.656018 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 828/1656] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:12.678336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7be3e84f-946b-42b4-a645-00e4477e6286 req-7c641eb6-0165-4f07-9341-b56a2fd3c44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17", "name": "network-vif-unplugged", "status": "completed", "tag": "bf72179b-5688-4e66-81af-f082edc266f4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:12.687547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:12.703802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7be3e84f-946b-42b4-a645-00e4477e6286 req-7c641eb6-0165-4f07-9341-b56a2fd3c44e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.704418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7be3e84f-946b-42b4-a645-00e4477e6286 req-7c641eb6-0165-4f07-9341-b56a2fd3c44e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.704885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7be3e84f-946b-42b4-a645-00e4477e6286 req-7c641eb6-0165-4f07-9341-b56a2fd3c44e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.712632 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9ae4cd4-c86c-4505-8204-2c43ad90d35b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.354053 Oct 03 10:36:12.742066 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 829/1657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:12 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:12.750040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:12.756667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:12.760605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:12.778072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.778993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.779779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.780741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:12.781464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:12.782657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:12.792516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7be3e84f-946b-42b4-a645-00e4477e6286 req-7c641eb6-0165-4f07-9341-b56a2fd3c44e service nova] Creating event network-vif-unplugged:bf72179b-5688-4e66-81af-f082edc266f4 for instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 on n-h2-858383-3 Oct 03 10:36:12.818816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7be3e84f-946b-42b4-a645-00e4477e6286 req-7c641eb6-0165-4f07-9341-b56a2fd3c44e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158269 Oct 03 10:36:12.819338 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 829/1658] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:12.848662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a929486-d635-4fc9-90c6-361bca810707 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Calling method '.version_select at 0x7f074fa348b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:12.852335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:36:13.136605 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eddd296e-a566-4d99-b9fe-6c50971d43f9 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 204 len: 0 microversion: 2.1 time: 0.389281 Oct 03 10:36:13.137573 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 830/1659] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:36:12 2022] DELETE /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:36:13.153381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:13.154348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:13.171673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:13.175861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:13.176583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:13.177520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:13.178343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:13.178938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:13.490967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:13.503203 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0140a4fc-08c8-4d3e-a636-1d889b7d4cd9 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.361588 Oct 03 10:36:13.504335 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 831/1660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:13 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:13.509693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ee01205-f59b-4f00-b46d-56e27e7d7cb4 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f6f20d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:13.606134 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ee01205-f59b-4f00-b46d-56e27e7d7cb4 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.100338 Oct 03 10:36:13.607418 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 832/1661] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:13 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:13.619706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:13.622093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:13.638477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:13.638995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:13.642241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:13.643017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:13.644914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:13.646180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:13.961187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:13.963704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:13.987980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:13.991403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:13.993740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f366cea-7625-47af-aef4-0bcefaee48b1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.385302 Oct 03 10:36:14.009199 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 833/1662] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:13 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:14.023238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:14.024435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:14.033048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:14.034631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:14.035321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:14.036388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:14.037108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:14.037790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:14.278568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:14.294649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b147771-286f-4167-b523-3a5c3e84a83c tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1529 microversion: 2.1 time: 0.283758 Oct 03 10:36:14.295596 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 834/1663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:14 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1529 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:14.300590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:14.305005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:14.326909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:14.327696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:14.328486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:14.330103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:14.331151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:14.331432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:14.656889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:14.666131 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-03b30250-e6ef-484b-b7ae-bdad58871cac tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.369279 Oct 03 10:36:14.666849 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 835/1664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:14 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:14.675561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:14.680004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:14.696320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:14.696829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:14.697273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:14.697988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:14.698434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:14.698857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.062332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:15.076118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a3fe4a5-a0de-4558-bc6e-cc59ce425069 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1322 microversion: 2.1 time: 0.408051 Oct 03 10:36:15.076720 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 836/1665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:14 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:15.086928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d667f59-a28c-43eb-99fd-693a51c90d87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f845790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:15.178230 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d667f59-a28c-43eb-99fd-693a51c90d87 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.099880 Oct 03 10:36:15.178844 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 837/1666] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:15 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:15.187334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-38987d73-2bc3-44c4-8413-0019f765b8e7 req-cdff3c94-3a93-4e4d-b67f-a23fca43aa89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17", "tag": "bf72179b-5688-4e66-81af-f082edc266f4"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:15.215301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-38987d73-2bc3-44c4-8413-0019f765b8e7 req-cdff3c94-3a93-4e4d-b67f-a23fca43aa89 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:15.215663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-38987d73-2bc3-44c4-8413-0019f765b8e7 req-cdff3c94-3a93-4e4d-b67f-a23fca43aa89 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:15.216800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-38987d73-2bc3-44c4-8413-0019f765b8e7 req-cdff3c94-3a93-4e4d-b67f-a23fca43aa89 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.243930 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-38987d73-2bc3-44c4-8413-0019f765b8e7 req-cdff3c94-3a93-4e4d-b67f-a23fca43aa89 service nova] Creating event network-changed:bf72179b-5688-4e66-81af-f082edc266f4 for instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 on n-h2-858383-3 Oct 03 10:36:15.253112 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-38987d73-2bc3-44c4-8413-0019f765b8e7 req-cdff3c94-3a93-4e4d-b67f-a23fca43aa89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072958 Oct 03 10:36:15.254271 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 838/1667] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:15.281061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:15.282474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:15.291188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:15.291955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:15.292561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.293472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:15.294074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:15.294766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.583000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:15.596040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:15.599993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:15.602787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-542b75d3-3e1f-4919-a019-727d5424ca2d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.346816 Oct 03 10:36:15.616794 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 839/1668] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:15 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:15.616794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:15.620097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:15.632415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:15.635337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:15.636020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.637034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:15.639394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:15.640027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.875005 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a929486-d635-4fc9-90c6-361bca810707 tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/19ce229c-5a53-4b0c-a555-4f9f16335e6a" status: 202 len: 0 microversion: 2.1 time: 3.047772 Oct 03 10:36:15.878857 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 830/1669] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:36:12 2022] DELETE /compute/v2.1/os-floating-ips/19ce229c-5a53-4b0c-a555-4f9f16335e6a => generated 0 bytes in 3050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:36:15.881421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:15.882234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:15.905332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:15.906103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:15.908492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.909481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:15.913157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:15.914075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:15.932394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:15.942779 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f6e5c506-238c-42a1-8c41-146621daf571 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1529 microversion: 2.1 time: 0.334286 Oct 03 10:36:15.942779 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 840/1670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:15 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1529 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:15.965869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3afa56e9-0888-42a5-bb46-7c544073068d tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] Calling method '.version_select at 0x7f074f845a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:16.334434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:16.387454 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1956577a-38fa-4e4a-bec5-89236b3992c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.509534 Oct 03 10:36:16.416806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 831/1671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:15 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:16.438814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:16.439793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:16.455063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:16.457347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:16.458005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:16.461164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:16.461848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:16.462462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:16.887137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:16.903678 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-163d3f80-15f0-4675-9b92-4d9adb1e162b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1471 microversion: 2.1 time: 0.488069 Oct 03 10:36:16.908259 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 832/1672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:16 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1471 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:16.924717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1152a390-8b91-4f83-bbfe-36290e9c9d5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f74e700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:17.032667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1152a390-8b91-4f83-bbfe-36290e9c9d5a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.120957 Oct 03 10:36:17.040871 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 833/1673] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:16 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:17.042512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:17.043142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:17.060203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:17.060725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:17.061202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:17.061943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:17.062412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:17.062846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:17.702580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:17.727312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:17.730836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:17.732079 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d8d3729-70ef-4249-9e6b-7cb96c9f040d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.695437 Oct 03 10:36:17.732654 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 834/1674] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:17 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:17.745689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:18.354271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35704f78-cddb-4d45-ba0b-09c18f0e1bc5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:18.354839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-35704f78-cddb-4d45-ba0b-09c18f0e1bc5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] [instance: e4ce1b67-4b69-488f-b195-209a750999c5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:18.366270 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-35704f78-cddb-4d45-ba0b-09c18f0e1bc5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] HTTP exception thrown: Instance e4ce1b67-4b69-488f-b195-209a750999c5 could not be found. Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35704f78-cddb-4d45-ba0b-09c18f0e1bc5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Request method failure captured: Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/e4ce1b67-4b69-488f-b195-209a750999c5/action HTTP/1.1 Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 15 Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrsCM0ci2fO-Vhxy7Aj68oRY0PUINK4EiJQS2Dvb6-bAx8Y87Ek7XAtciPtj8MbEkOXI7Qve2n8VJ3CMHjwPk59Khx1okqp2NTwGYZDaFOeFyctrjI831LLDn0lfN0zu-fMDzfv4-7m1ldNPgoHzpMQWgJQPXWYedI0g2Msy5Y9F_yU Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:36:18.371075 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}] Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3975940661c54c679aa640db1ed69349 Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: {"migrate": {}} Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:36:18.372574 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance e4ce1b67-4b69-488f-b195-209a750999c5 could not be found. Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'e4ce1b67-4b69-488f-b195-209a750999c5', 'body': {'migrate': {}}} Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ce1b67-4b69-488f-b195-209a750999c5 could not be found. Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:18.373511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ce1b67-4b69-488f-b195-209a750999c5 could not be found. Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ce1b67-4b69-488f-b195-209a750999c5 could not be found. Oct 03 10:36:18.374921 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:18.376636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35704f78-cddb-4d45-ba0b-09c18f0e1bc5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Returning 404 to user: Instance e4ce1b67-4b69-488f-b195-209a750999c5 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:18.376636 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-35704f78-cddb-4d45-ba0b-09c18f0e1bc5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e4ce1b67-4b69-488f-b195-209a750999c5/action" status: 404 len: 111 microversion: 2.1 time: 0.638864 Oct 03 10:36:18.386428 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 835/1675] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:17 2022] POST /compute/v2.1/servers/e4ce1b67-4b69-488f-b195-209a750999c5/action => generated 111 bytes in 653 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:36:18.415177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:18.424251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:18.446195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:18.447727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:18.449405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:18.451646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:18.454548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:18.455741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:18.592394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:18.594243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:18.596239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:18.597422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lazy-loading 'fault' on Instance uuid 30b22187-cb5e-499a-8d04-e598663c7847 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:36:18.675465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55ab76047b047f4b45b003fd15f8ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756f56f1c99d46cc8dcf50f23f32847f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:18.685709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:18.692061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff716f1d-6fab-4651-95ec-1d28884f028b tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 200 len: 1315 microversion: 2.1 time: 0.301027 Oct 03 10:36:18.694970 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 836/1676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:18 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:18.695554 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3afa56e9-0888-42a5-bb46-7c544073068d tempest-FloatingIPDetailsTestJSON-935521361 tempest-FloatingIPDetailsTestJSON-935521361-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/837adbe4-c8f1-4185-88f1-0d81a4d09645" status: 202 len: 0 microversion: 2.1 time: 2.735898 Oct 03 10:36:18.699455 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 841/1677] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:36:15 2022] DELETE /compute/v2.1/os-floating-ips/837adbe4-c8f1-4185-88f1-0d81a4d09645 => generated 0 bytes in 2742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:36:18.705094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-44012ef0-41db-4f3a-83fa-f994895ccfde req-692a9a20-9849-4b67-b155-9681777e90ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b22187-cb5e-499a-8d04-e598663c7847", "name": "network-vif-deleted", "tag": "49514a07-d304-48dd-8eb8-1a0e8bf4e170"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:18.715623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:18.717565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:18.723726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=66 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:18.745729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:18.746933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:18.748237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:18.750359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:18.752674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:18.754612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:18.768745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-44012ef0-41db-4f3a-83fa-f994895ccfde req-692a9a20-9849-4b67-b155-9681777e90ed service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:18.783352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-44012ef0-41db-4f3a-83fa-f994895ccfde req-692a9a20-9849-4b67-b155-9681777e90ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:18.784662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-44012ef0-41db-4f3a-83fa-f994895ccfde req-692a9a20-9849-4b67-b155-9681777e90ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:18.859195 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-44012ef0-41db-4f3a-83fa-f994895ccfde req-692a9a20-9849-4b67-b155-9681777e90ed service nova] Creating event network-vif-deleted:49514a07-d304-48dd-8eb8-1a0e8bf4e170 for instance 30b22187-cb5e-499a-8d04-e598663c7847 on n-h1-858383-3 Oct 03 10:36:18.870675 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-44012ef0-41db-4f3a-83fa-f994895ccfde req-692a9a20-9849-4b67-b155-9681777e90ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170989 Oct 03 10:36:18.871643 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 842/1678] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:18.881491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e33b2fa-3679-44ce-969e-94d536d85943 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f21e160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:18.938980 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e33b2fa-3679-44ce-969e-94d536d85943 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.064072 Oct 03 10:36:18.946790 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 843/1679] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:18 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:18.946790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1774776292", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:19.035304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:36:19.477907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:19.495823 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ca97bd2-87b9-4e0b-968f-149260e40c79 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.790596 Oct 03 10:36:19.498639 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 837/1680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:18 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:19.505409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:19.506369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:19.529774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:19.542813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:19.543406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:19.548444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:19.550004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:19.550925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:19.585856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:36:19.589538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:36:19.591011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:36:19.591771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:36:19.592849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:36:19.627908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:19.628693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:19.629435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:19.630457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:19.632988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:19.634374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:19.707785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Getting quotas for project f157053f0fe9445a84531ef849861521. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:36:19.738745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Getting quotas for user a598123a284943b4a0cd88205e8f1146 and project f157053f0fe9445a84531ef849861521. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:36:19.779464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:36:19.782026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:36:19.914838 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5e431dc-b743-42c5-a34f-f3e66c8cf697 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971929 Oct 03 10:36:19.927811 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 844/1681] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:36:19.947292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:19.948413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: 30b22187-cb5e-499a-8d04-e598663c7847] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:19.958736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:19.959434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:19.960047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:19.961792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:19.962517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:19.963125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:19.987889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Instance 30b22187-cb5e-499a-8d04-e598663c7847 could not be found. Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 HTTP/1.1 Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:36:19.993569 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 30b22187-cb5e-499a-8d04-e598663c7847 could not be found. Oct 03 10:36:19.995445 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '30b22187-cb5e-499a-8d04-e598663c7847'} Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b22187-cb5e-499a-8d04-e598663c7847 could not be found. Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:19.996399 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b22187-cb5e-499a-8d04-e598663c7847 could not be found. Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b22187-cb5e-499a-8d04-e598663c7847 could not be found. Oct 03 10:36:19.997884 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.001088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Instance 30b22187-cb5e-499a-8d04-e598663c7847 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:20.002230 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fbee3e5d-4af4-4a50-99cf-c7edabf3eff7 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847" status: 404 len: 111 microversion: 2.1 time: 0.072644 Oct 03 10:36:20.003319 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 845/1682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:19 2022] GET /compute/v2.1/servers/30b22187-cb5e-499a-8d04-e598663c7847 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:36:20.011352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8dd570b2-9f2a-4b4c-b341-e2ea3ea89308 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:20.012203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8dd570b2-9f2a-4b4c-b341-e2ea3ea89308 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:20.163121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8dd570b2-9f2a-4b4c-b341-e2ea3ea89308 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:20.170851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8dd570b2-9f2a-4b4c-b341-e2ea3ea89308 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1222 microversion: 2.1 time: 0.166158 Oct 03 10:36:20.173723 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 846/1683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:20 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:20.178412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a3b514d-68b5-465f-9a5d-50006523658a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f72ec10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:20.234455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:20.247490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:20.261033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:20.276318 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-394597f0-976c-4ea2-8f58-ee95c5d134d0 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.763064 Oct 03 10:36:20.277779 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 838/1684] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:19 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:20.292848 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a3b514d-68b5-465f-9a5d-50006523658a tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.102662 Oct 03 10:36:20.292848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 847/1685] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:20 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:20.293180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bbbe5acf-a7bc-4d8d-8dd0-26e5d1a44c86 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '.version_select at 0x7f074f64e4c0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:20.357481 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-bbbe5acf-a7bc-4d8d-8dd0-26e5d1a44c86 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Image not found. Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bbbe5acf-a7bc-4d8d-8dd0-26e5d1a44c86 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012 HTTP/1.1 Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:36:20.361118 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'cb4264f3-c306-4d63-9f4c-209542da9012'} Oct 03 10:36:20.363161 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cb4264f3-c306-4d63-9f4c-209542da9012 to delete Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:20.364361 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb4264f3-c306-4d63-9f4c-209542da9012 could not be found. Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:20.369913 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bbbe5acf-a7bc-4d8d-8dd0-26e5d1a44c86 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:20.371174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bbbe5acf-a7bc-4d8d-8dd0-26e5d1a44c86 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012" status: 404 len: 62 microversion: 2.1 time: 0.085065 Oct 03 10:36:20.372155 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 839/1686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:20 2022] DELETE /compute/v2.1/images/cb4264f3-c306-4d63-9f4c-209542da9012 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:36:20.377759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:20.378265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:20.395063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:20.395563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:20.396077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:20.396835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:20.397299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:20.397781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:20.446048 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab HTTP/1.1 Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:36:20.448566 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.450660 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd11e46cc-232c-4567-b838-7c009c4629ab'} Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:20.451488 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.452741 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.454893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:20.454893 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d60b120b-a40e-4a5c-9b83-7bb5cef3f165 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 404 len: 111 microversion: 2.1 time: 0.077215 Oct 03 10:36:20.460737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:20.461406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: d11e46cc-232c-4567-b838-7c009c4629ab] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:20.485348 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 848/1687] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:36:20 2022] DELETE /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:36:20.489573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:20.490773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:20.491516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:20.492550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:20.493293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:20.494139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:20.519805 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab HTTP/1.1 Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:36:20.521884 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.523282 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'd11e46cc-232c-4567-b838-7c009c4629ab'} Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:20.524317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. Oct 03 10:36:20.529075 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:20.539324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:20.540479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:20.545387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Instance d11e46cc-232c-4567-b838-7c009c4629ab could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:20.548607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:20.550179 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bf2c0ad2-5c25-4559-8872-c6bafe423f6e tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab" status: 404 len: 111 microversion: 2.1 time: 0.093119 Oct 03 10:36:20.551022 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 840/1688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:20 2022] GET /compute/v2.1/servers/d11e46cc-232c-4567-b838-7c009c4629ab => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:36:20.557547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:20.558362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:20.560948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:20.561691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:20.562838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:20.569491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24060823-cede-491d-a8f5-6cae231dc634 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '.version_select at 0x7f074f105310>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:20.616433 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24060823-cede-491d-a8f5-6cae231dc634 tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352004022" status: 202 len: 0 microversion: 2.1 time: 0.059976 Oct 03 10:36:20.617772 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 841/1689] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352004022 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:36:21.197123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:21.197804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:21.222171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:21.223047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:21.223751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:21.225021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:21.246348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:21.246999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:21.770776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:21.791838 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00820d9e-4925-4165-99e3-d55438b4e706 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1226 microversion: 2.1 time: 0.599988 Oct 03 10:36:21.792324 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 842/1690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:21 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1226 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:21.836906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06321418-a17f-4a65-a7b7-92c0b6816720 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f74e9d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:21.961546 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06321418-a17f-4a65-a7b7-92c0b6816720 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.157473 Oct 03 10:36:21.964223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 843/1691] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:21 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:21.974322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:21.981341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:22.003521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:22.004307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:22.005538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:22.006492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:22.007117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:22.008415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:22.430789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:22.469120 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d1871098-d70a-4849-a661-48e2051e1d0d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 1.935640 Oct 03 10:36:22.470201 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 849/1692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:20 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:22.529050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:22.549593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:22.551671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:22.554922 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf298258-7225-4ce7-bfdc-a481a01e3e67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.587510 Oct 03 10:36:22.555692 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 844/1693] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:21 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:22.832379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:22.833033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:22.865041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:22.865801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:22.866273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:22.867223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:22.867850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:22.868474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:22.978396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0326c70b-fd38-4715-bbf6-9b11a11736d6 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f74e550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:23.062703 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0326c70b-fd38-4715-bbf6-9b11a11736d6 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.087921 Oct 03 10:36:23.064968 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 845/1694] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:22 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:23.100338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:23.111346 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2299217e-ea0e-43c0-86d7-4830f6200219 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1282 microversion: 2.1 time: 0.282750 Oct 03 10:36:23.141043 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 850/1695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:22 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1282 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:23.498682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:23.499307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:23.511752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:23.512177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:23.520913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:23.521719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:23.522421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:23.522858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:23.588120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:23.588976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:23.601553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:23.602454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:23.603770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:23.604724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:23.605701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:23.606356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:23.910233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:23.937555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:23.940329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:23.945561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a71d02a-85a7-43d5-a5ba-b6dae74b5e0c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.360861 Oct 03 10:36:23.946169 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 851/1696] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:23 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:36:24.079438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1468d03-d739-4bb5-bf4d-42d832f27e42 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f6a3ca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:24.166733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:24.183542 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a63e75e6-231b-461c-8d1c-6491e9df1b65 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.688862 Oct 03 10:36:24.184492 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 846/1697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:23 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:24.187319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1468d03-d739-4bb5-bf4d-42d832f27e42 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.110580 Oct 03 10:36:24.190484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:24.194829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:24.198527 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 852/1698] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:24 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:24.216954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:24.217857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:24.218626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:24.220075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:24.221685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:24.222790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:24.397836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:24.409023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91e9f5ca-1932-43fa-86e2-2045f7f9dd40 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1280 microversion: 2.1 time: 0.223094 Oct 03 10:36:24.410281 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 847/1699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:24 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:24.977936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:24.978865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:24.993281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:24.994189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:24.995511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:24.998805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:24.999545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.000216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.069298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b806ccf0-feab-4e89-8a12-6024e1ce31de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '.version_select at 0x7f074f74e3a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:25.098208 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b806ccf0-feab-4e89-8a12-6024e1ce31de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Image not found. Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b806ccf0-feab-4e89-8a12-6024e1ce31de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/5ad7fd94-5200-4909-bac0-9a89b8a92870 HTTP/1.1 Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:36:25.101122 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '5ad7fd94-5200-4909-bac0-9a89b8a92870'} Oct 03 10:36:25.102496 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5ad7fd94-5200-4909-bac0-9a89b8a92870 to delete Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:25.103438 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ad7fd94-5200-4909-bac0-9a89b8a92870 could not be found. Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:25.108878 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:36:25.111771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.117444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b806ccf0-feab-4e89-8a12-6024e1ce31de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:25.117444 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b806ccf0-feab-4e89-8a12-6024e1ce31de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/images/5ad7fd94-5200-4909-bac0-9a89b8a92870" status: 404 len: 62 microversion: 2.1 time: 0.050524 Oct 03 10:36:25.117444 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 848/1700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:25 2022] DELETE /compute/v2.1/images/5ad7fd94-5200-4909-bac0-9a89b8a92870 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:36:25.130137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:25.130823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:25.158952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.159447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.159886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.160604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.170747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.175930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.208714 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 HTTP/1.1 Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:36:25.215534 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.217277 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'e38e9f1f-e1e7-4c75-a454-806d7b3f4503'} Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:25.218263 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.219582 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.225609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:25.229725 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef260dd8-8e4b-48e2-86d3-c239e81891de tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 404 len: 111 microversion: 2.1 time: 0.108733 Oct 03 10:36:25.230862 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 849/1701] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:36:25 2022] DELETE /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:36:25.240387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8518594d-0be4-4fbb-b92b-0cb7f7e5ba47 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f74e280>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:25.325031 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8518594d-0be4-4fbb-b92b-0cb7f7e5ba47 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.092818 Oct 03 10:36:25.326025 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 850/1702] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:25 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:25.338859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:25.339856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:25.356339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.357140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.359624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.360705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.362626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.363317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.509612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:25.545030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:25.548094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:25.548094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-90fe5a01-b6fc-4c7c-8ded-b229fe98e450 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.575061 Oct 03 10:36:25.577866 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 853/1703] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:24 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:25.609629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:25.610242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] [instance: e38e9f1f-e1e7-4c75-a454-806d7b3f4503] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:25.646295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.646815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.647268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.659320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.659935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.660397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.738085 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] HTTP exception thrown: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Request method failure captured: Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 HTTP/1.1 Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrqvHMvF65-hetcoTowDhSrdsZ8wtuQtrx3TiXyMo0KeaeH_Ff0dRGIEA1rSiq4XaU-oxcS_XCHGYG3vbC7U_Ce5zUKpUgAkDdEHa7Tq1IBg6TeAX1jH4aIVzgItws-kLMlDyiyg4dWGXdfyo_B_-GXLA3Fwrm8IC-Hwbb5qnWhXW6w Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:36:25.752940 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/756f56f1c99d46cc8dcf50f23f32847f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/756f56f1c99d46cc8dcf50f23f32847f"}]}] Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 756f56f1c99d46cc8dcf50f23f32847f Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-813482551 Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d55ab76047b047f4b45b003fd15f8ea3 Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-813482551-project Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.754727 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'e38e9f1f-e1e7-4c75-a454-806d7b3f4503'} Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:25.755657 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. Oct 03 10:36:25.758388 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:25.759632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] Returning 404 to user: Instance e38e9f1f-e1e7-4c75-a454-806d7b3f4503 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:25.760679 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e4b22d66-b672-4a36-898b-3ca19f0ba0cb tempest-ImagesOneServerNegativeTestJSON-813482551 tempest-ImagesOneServerNegativeTestJSON-813482551-project] 10.222.0.27 "GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503" status: 404 len: 111 microversion: 2.1 time: 0.181451 Oct 03 10:36:25.772056 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 854/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:25 2022] GET /compute/v2.1/servers/e38e9f1f-e1e7-4c75-a454-806d7b3f4503 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:36:25.796312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:25.800208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:25.828085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.828695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.832837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:25.847053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:25.847675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:25.848140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:26.076072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:26.093276 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-664733ea-169d-4b2a-8bb1-6cbcc6c4784b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1280 microversion: 2.1 time: 0.316262 Oct 03 10:36:26.094358 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 855/1705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:25 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:26.294729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:26.303230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5d43490b-9c18-4105-bd4e-d6528371b225 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.974173 Oct 03 10:36:26.306842 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 851/1706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:25 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:26.340612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53e80d58-b7ef-4e62-af64-dbdd280e6900 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1fb790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:26.460471 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53e80d58-b7ef-4e62-af64-dbdd280e6900 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.123497 Oct 03 10:36:26.461573 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 856/1707] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:26 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:26.592715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:26.593685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:26.606549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:26.607056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:26.607509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:26.608241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:26.608992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:26.612123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:27.122103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:27.122971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:27.160242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:27.162832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:27.164033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:27.165938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:27.169985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:27.171820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:27.523931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:27.542265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:27.543820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:27.545372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0aaecf0d-b79a-471e-9b40-535831368c52 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.959838 Oct 03 10:36:27.545929 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 852/1708] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:26 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:27.562986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:27.567544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:27.587361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:27.588623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:27.589773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:27.590686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:27.591593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:27.592322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:28.141084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:28.154016 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ace0367d-d410-4dbb-a0db-554bc93c82bd tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.602994 Oct 03 10:36:28.157981 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 853/1709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:27 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:28.169157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5688f7e7-4fd5-4ee5-8635-cc9761fc9fb4 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074fa34430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:28.300566 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5688f7e7-4fd5-4ee5-8635-cc9761fc9fb4 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.141191 Oct 03 10:36:28.305996 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 854/1710] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:28 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:28.447748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:28.460566 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9cafdb4-9cec-4e4c-9ea2-c01ec94ca35f tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1322 microversion: 2.1 time: 1.342243 Oct 03 10:36:28.462643 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 857/1711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:27 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1322 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:28.589821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:28.590590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:28.600832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:28.603408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:28.607446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:28.610177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:28.610768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:28.612415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:28.964376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:28.965290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:28.978830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:28.982387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:28.983207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:28.990229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:28.991758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:28.992478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:29.514197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:29.534380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:29.535914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:29.537235 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8209b934-67ac-4c10-8dce-6ac7a0f1f517 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.954606 Oct 03 10:36:29.537801 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 855/1712] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:28 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:29.553222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:29.553838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:29.584997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:29.585499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:29.585930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:29.600128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:29.600796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:29.601096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:29.642528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:29.956038 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2da005f3-bd03-4185-831d-8fb32aa114a8 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1859 microversion: 2.1 time: 1.000240 Oct 03 10:36:29.962557 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 858/1713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:28 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1859 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:29.973880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04ae79ea-5f74-48ea-a347-f80a67ca191d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f72ee50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:30.058413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-04ae79ea-5f74-48ea-a347-f80a67ca191d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.094255 Oct 03 10:36:30.059800 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 859/1714] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:29 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:30.069017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:30.070254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:30.080128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:30.081287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:30.082552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:30.083537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:30.085029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:30.087063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:30.169840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:30.197374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:30.208791 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc50ddab-8430-428e-a90c-0a15fb486dc9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1477 microversion: 2.1 time: 0.669803 Oct 03 10:36:30.221593 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 856/1715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:29 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1477 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:30.233793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:30.239306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:30.249389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:30.250135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:30.250910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:30.251867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:30.252744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:30.253511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:30.318171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lazy-loading 'flavor' on Instance uuid af81a64b-4ea6-48b9-80fd-a0b4659d39e4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:36:30.335474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Going to try to live migrate instance to n-h2-858383-3 {{(pid=122270) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:36:31.113643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:31.140007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12c58942-e795-4cef-9869-94c55bab134b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1322 microversion: 2.1 time: 1.077437 Oct 03 10:36:31.149236 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 860/1716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:30 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1322 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:31.183541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-984cea9a-8185-4506-9d79-86ce8f2862fe req-c7270ea1-a91f-4345-9fe6-8294a979fe3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "212e479b-0b63-4bf2-83f1-3556ef9f4e25", "tag": "710a5f86-d472-417b-a10d-6ebf6dcfbb18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:31.249198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-984cea9a-8185-4506-9d79-86ce8f2862fe req-c7270ea1-a91f-4345-9fe6-8294a979fe3f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:31.250074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-984cea9a-8185-4506-9d79-86ce8f2862fe req-c7270ea1-a91f-4345-9fe6-8294a979fe3f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:31.252003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-984cea9a-8185-4506-9d79-86ce8f2862fe req-c7270ea1-a91f-4345-9fe6-8294a979fe3f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:31.277564 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-984cea9a-8185-4506-9d79-86ce8f2862fe req-c7270ea1-a91f-4345-9fe6-8294a979fe3f service nova] Creating event network-changed:710a5f86-d472-417b-a10d-6ebf6dcfbb18 for instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 on n-h2-858383-3 Oct 03 10:36:31.292238 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-984cea9a-8185-4506-9d79-86ce8f2862fe req-c7270ea1-a91f-4345-9fe6-8294a979fe3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140651 Oct 03 10:36:31.296451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 861/1717] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:31.322349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:31.328619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:31.369993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:31.376345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:31.378550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:31.387329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:31.388882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:31.390145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:32.637565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:32.664706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:32.666229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:32.679392 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17b9e2a4-09eb-4d29-948c-0e44e1fda4ba tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 1.378981 Oct 03 10:36:32.686061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 862/1718] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:31 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:32.697927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6e34faa-e4b9-4154-81c3-945324ed4b86 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f2108b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:32.806633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6e34faa-e4b9-4154-81c3-945324ed4b86 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1427 microversion: 2.1 time: 0.119298 Oct 03 10:36:32.807216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 863/1719] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:32 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:32.818016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:32.818913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:32.838482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:32.838994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:32.839634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:32.840717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:32.841366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:32.841959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:32.855139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:34.054395 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a4ab606-d1a1-4543-9b81-97c2550246e9 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/action" status: 202 len: 0 microversion: 2.1 time: 3.827301 Oct 03 10:36:34.055118 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 857/1720] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:30 2022] POST /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/action => generated 0 bytes in 3833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:36:34.065762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:34.068294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:34.094262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:34.094855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:34.098116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:34.098935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:34.102672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:34.103225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:34.365302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:34.378581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13a5fbaa-cdc0-4738-b3f2-cb5dc9c16679 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1476 microversion: 2.1 time: 1.569739 Oct 03 10:36:34.382493 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 864/1721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:32 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1476 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:34.739110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7d2b81c-f9e9-4ae6-8479-0dbe67be1cdc tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Action: 'create', calling method: .version_select at 0x7f074f1b53a0>, body: {"keypair": {"name": "tempest-keypair-686220556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyTQMo25KjwIN6V1Z8ngp0Ln2jXfXP9RDrF5LzeyNplPr+ycrDPr5zelBUm+RnHygswlYLlIvp+M1O5ySEjOwun8/uf0KU+BxdvGjJFqxWUXqgTVmExQV69EaCIIiaZPg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:34.785034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7d2b81c-f9e9-4ae6-8479-0dbe67be1cdc tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Getting quotas for project 28ea44afdf844c3bbb6b47365689d17f. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:36:34.798242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7d2b81c-f9e9-4ae6-8479-0dbe67be1cdc tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Getting quotas for user d1f1b0913e804b8ba305ce34ac8900a5 and project 28ea44afdf844c3bbb6b47365689d17f. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:36:34.840703 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7d2b81c-f9e9-4ae6-8479-0dbe67be1cdc tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [a1154216-782c-479b-bce8-2deba5830e44] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 10:36:35.089952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:35.109801 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71e177e2-7c73-4d32-bd24-d2c19f49c228 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1322 microversion: 2.1 time: 1.048457 Oct 03 10:36:35.114632 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 858/1722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:34 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1322 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:35.127861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-dbe0cecc-d6b1-413d-957f-03038dd313a7 req-0a1ee5b2-5a79-4742-8863-dec67c2c045d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "name": "network-vif-unplugged", "status": "completed", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:35.161193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dbe0cecc-d6b1-413d-957f-03038dd313a7 req-0a1ee5b2-5a79-4742-8863-dec67c2c045d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:35.163417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dbe0cecc-d6b1-413d-957f-03038dd313a7 req-0a1ee5b2-5a79-4742-8863-dec67c2c045d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:35.163920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dbe0cecc-d6b1-413d-957f-03038dd313a7 req-0a1ee5b2-5a79-4742-8863-dec67c2c045d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:35.186389 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-dbe0cecc-d6b1-413d-957f-03038dd313a7 req-0a1ee5b2-5a79-4742-8863-dec67c2c045d service nova] Creating event network-vif-unplugged:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h1-858383-3 Oct 03 10:36:35.193089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-dbe0cecc-d6b1-413d-957f-03038dd313a7 req-0a1ee5b2-5a79-4742-8863-dec67c2c045d service nova] Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:36:35.207291 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-dbe0cecc-d6b1-413d-957f-03038dd313a7 req-0a1ee5b2-5a79-4742-8863-dec67c2c045d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088660 Oct 03 10:36:35.209313 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 859/1723] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:35.217880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:35.220870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:35.230155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:35.232360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:35.233138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:35.234241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:35.235167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:35.236365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:35.266313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:35.715569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:35.734694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:35.736727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:35.737998 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dfd7972e-c251-4001-bb56-186e9b8675b2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.527232 Oct 03 10:36:35.744589 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 860/1724] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:35 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:35.761831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea2593fe-deae-4fd9-bcfc-7f69d2f3b9b5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f64e160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:35.845992 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea2593fe-deae-4fd9-bcfc-7f69d2f3b9b5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1436 microversion: 2.1 time: 0.094968 Oct 03 10:36:35.849219 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7d2b81c-f9e9-4ae6-8479-0dbe67be1cdc tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [a1154216-782c-479b-bce8-2deba5830e44] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 47160. Oct 03 10:36:35.856980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 861/1725] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:35 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1436 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:35.864225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:35.865271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:35.874361 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7d2b81c-f9e9-4ae6-8479-0dbe67be1cdc tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.472807 Oct 03 10:36:35.875636 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 865/1726] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:36:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:35.885056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:35.886706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:35.893197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:35.893700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:35.894145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:35.894869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:35.895327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:35.896045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:35.899113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:35.899751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:35.900970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:35.901788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:35.902612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:35.903455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:36.424441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:36.434705 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-369e622e-6fa2-4985-856c-b593d19e94c4 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1476 microversion: 2.1 time: 0.557003 Oct 03 10:36:36.435465 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 866/1727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:35 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1476 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:36.441188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed2fa32d-a917-4091-8c6e-448393ea31a5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1fb670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:36.506485 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed2fa32d-a917-4091-8c6e-448393ea31a5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 200 len: 1436 microversion: 2.1 time: 0.069997 Oct 03 10:36:36.507831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 867/1728] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:36 2022] GET /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 1436 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:36.513286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:36.514205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:36.523850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:36.524590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:36.525255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:36.526185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:36.526848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:36.527476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:36.552140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:36.572236 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0356fca7-d292-4919-b917-261eb483514b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.713875 Oct 03 10:36:36.572938 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 862/1729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:35 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:36.598386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:36.599981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:36.608025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:36.608845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:36.609476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:36.610543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:36.611225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:36.612962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:36.821794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:36.833131 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7fbd4421-e17d-41cb-9f62-512d9ab2403b tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1322 microversion: 2.1 time: 0.324007 Oct 03 10:36:36.833741 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 868/1730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:36 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:36.853118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:36.853751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:36.879216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:36.880052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:36.880742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:36.881676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:36.882313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:36.882910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:37.234469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:37.249829 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-56e46161-b54d-4fde-b04a-6e7416711396 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1466 microversion: 2.1 time: 0.662234 Oct 03 10:36:37.250164 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 863/1731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:36 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1466 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:37.278725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e791494c-8b98-4f15-bd54-5dca32a07ca6 req-28f9b52e-5fa3-466d-a741-7cd2042dc110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:37.298882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e791494c-8b98-4f15-bd54-5dca32a07ca6 req-28f9b52e-5fa3-466d-a741-7cd2042dc110 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:37.299365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e791494c-8b98-4f15-bd54-5dca32a07ca6 req-28f9b52e-5fa3-466d-a741-7cd2042dc110 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:37.299803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e791494c-8b98-4f15-bd54-5dca32a07ca6 req-28f9b52e-5fa3-466d-a741-7cd2042dc110 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:37.347167 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e791494c-8b98-4f15-bd54-5dca32a07ca6 req-28f9b52e-5fa3-466d-a741-7cd2042dc110 service nova] Creating event network-changed:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h1-858383-3 Oct 03 10:36:37.363004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:37.366711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-e791494c-8b98-4f15-bd54-5dca32a07ca6 req-28f9b52e-5fa3-466d-a741-7cd2042dc110 service nova] Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:36:37.376468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:37.383604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:37.385021 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-737c8ed3-7234-4113-9a01-e16b19ebf426 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1810 microversion: 2.25 time: 0.550249 Oct 03 10:36:37.385667 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 869/1732] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:36 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1810 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:37.392543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e791494c-8b98-4f15-bd54-5dca32a07ca6 req-28f9b52e-5fa3-466d-a741-7cd2042dc110 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128404 Oct 03 10:36:37.393631 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 864/1733] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:36:37.412175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6402a0d6-fba7-4695-8118-211fabe947f5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f1b5b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:37.467147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:37.467931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:37.486004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:37.486004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:37.486932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:37.491006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:37.493989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:37.494667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:38.388377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:38.400626 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d683b6a-e88a-4a40-b7ac-da488b6d46af tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1476 microversion: 2.1 time: 0.937974 Oct 03 10:36:38.401786 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 865/1734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:37 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1476 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:38.426925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:38.427692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:38.445094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:38.445891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:38.446724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:38.447733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:38.448419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:38.448953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:38.459125 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6402a0d6-fba7-4695-8118-211fabe947f5 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "DELETE /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e" status: 204 len: 0 microversion: 2.1 time: 1.065691 Oct 03 10:36:38.460463 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 870/1735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:37 2022] DELETE /compute/v2.1/images/bafcd453-068a-44c6-865e-25ce27b3e59e => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:36:38.467891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:38.472869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:38.481228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:38.481950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:38.482563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:38.483442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:38.484054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:38.484843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:38.777889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:38.787481 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5666f44-2194-48c9-94ef-3a582809edc1 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1322 microversion: 2.1 time: 0.325775 Oct 03 10:36:38.789432 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 871/1736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:38 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:38.804702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:38.805607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:38.815201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:38.815981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:38.816700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:38.817788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:38.818457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:38.819086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:38.904609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:38.919148 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28397453-4780-4886-a6b2-ca26c29c4d08 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.498848 Oct 03 10:36:38.920623 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 866/1737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:38 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:38.928476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea9d2dad-c17a-43b9-b8d9-87293b11b80d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '.version_select at 0x7f074f599dc0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:38.968223 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-ea9d2dad-c17a-43b9-b8d9-87293b11b80d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] HTTP exception thrown: Image not found. Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea9d2dad-c17a-43b9-b8d9-87293b11b80d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Request method failure captured: Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 HTTP/1.1 Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrrLneshLfTO9cXV24wC93PuVL8WnazCu3pMwClvsijAFj0xKsXICTTvITj8ki9fibou04um5A8aRBemedPggDVGGSwHsTcrHsILn12s7cP2XGmfnghUU8G-y6gU2EgUXOn78-nL0YjMpeIzUZmy6WYCpBcmC6kGEu8Q0uhgG72tIB4 Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: fecd91e631b84f2fba9f7756cbdc63a1 Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:36:38.970944 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fecd91e631b84f2fba9f7756cbdc63a1"}]}] Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: fecd91e631b84f2fba9f7756cbdc63a1 Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesOneServerTestJSON-811490309-project Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 9ea84c4ec0e14b78817e9767bfbe2a1a Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesOneServerTestJSON-811490309-project Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'd440da65-6923-4bda-be05-fdff4a1f8797'} Oct 03 10:36:38.972724 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d440da65-6923-4bda-be05-fdff4a1f8797 to delete Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:38.973782 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d440da65-6923-4bda-be05-fdff4a1f8797 could not be found. Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:38.975359 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:36:38.978228 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:38.981046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea9d2dad-c17a-43b9-b8d9-87293b11b80d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:38.982130 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea9d2dad-c17a-43b9-b8d9-87293b11b80d tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "DELETE /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797" status: 404 len: 62 microversion: 2.1 time: 0.057623 Oct 03 10:36:38.983211 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 867/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:38 2022] DELETE /compute/v2.1/images/d440da65-6923-4bda-be05-fdff4a1f8797 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:36:38.991708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:38.992206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:38.999735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.000132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.000754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.001702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.002323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.002963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.040441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:36:39.271030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f2fb4c71-2e47-49d2-8009-a4442b7382e3 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 204 len: 0 microversion: 2.1 time: 0.282325 Oct 03 10:36:39.276568 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 868/1739] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:36:38 2022] DELETE /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:36:39.285494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:39.293951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:39.311399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.312354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.313202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.321666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.322386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.323459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.350014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:39.365411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:39.369813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:39.374486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-55b17cd1-da44-4808-b75b-db31af4eda4e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1800 microversion: 2.25 time: 0.583395 Oct 03 10:36:39.389716 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 872/1740] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:38 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1800 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:39.404200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bc56b2b-6052-455e-9ecf-bcd0ac8ed27e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '.version_select at 0x7f074f1fb4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:39.408530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bc56b2b-6052-455e-9ecf-bcd0ac8ed27e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.409122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bc56b2b-6052-455e-9ecf-bcd0ac8ed27e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.409852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bc56b2b-6052-455e-9ecf-bcd0ac8ed27e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.442197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bc56b2b-6052-455e-9ecf-bcd0ac8ed27e tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 4723 microversion: 2.25 time: 0.042033 Oct 03 10:36:39.450499 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 873/1741] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 3 10:36:39 2022] GET /compute/v2.1/os-migrations => generated 4723 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:36:39.679344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:39.693524 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-79b42375-7e8e-4b7c-90bc-f551aedae0e7 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1472 microversion: 2.1 time: 0.411925 Oct 03 10:36:39.694289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 869/1742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:39 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:39.701717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:39.702669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:39.720638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.721521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.722182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.723721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.724390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.725188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.848590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:39.850041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:39.866742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.867175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.867619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:39.868341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:39.868818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:39.869252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.011461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:36:40.043145 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da634e20-f1c4-4699-8f08-3789eb33a895 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 2418 microversion: 2.25 time: 0.346723 Oct 03 10:36:40.043944 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 870/1743] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:39 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 2418 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:40.081857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-41004775-804a-4e18-baf9-c07de10367b7 req-fcddbe8d-b74e-4182-b20a-18fb61cdad9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212e479b-0b63-4bf2-83f1-3556ef9f4e25", "name": "network-vif-plugged", "status": "completed", "tag": "710a5f86-d472-417b-a10d-6ebf6dcfbb18"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:40.092488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-41004775-804a-4e18-baf9-c07de10367b7 req-fcddbe8d-b74e-4182-b20a-18fb61cdad9e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.093002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-41004775-804a-4e18-baf9-c07de10367b7 req-fcddbe8d-b74e-4182-b20a-18fb61cdad9e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.093599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-41004775-804a-4e18-baf9-c07de10367b7 req-fcddbe8d-b74e-4182-b20a-18fb61cdad9e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.109569 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-41004775-804a-4e18-baf9-c07de10367b7 req-fcddbe8d-b74e-4182-b20a-18fb61cdad9e service nova] Creating event network-vif-plugged:710a5f86-d472-417b-a10d-6ebf6dcfbb18 for instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 on n-h2-858383-3 Oct 03 10:36:40.116681 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-41004775-804a-4e18-baf9-c07de10367b7 req-fcddbe8d-b74e-4182-b20a-18fb61cdad9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041681 Oct 03 10:36:40.117976 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 871/1744] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:40.125122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:40.126129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:40.133077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.133647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.134172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.135082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.135609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.136108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.291824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:40.302440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb6d42da-3ccd-45c0-a7b2-70b41c074b5f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1474 microversion: 2.1 time: 0.850409 Oct 03 10:36:40.307000 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 874/1745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:39 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1474 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:40.319597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:40.320446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:40.337356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.337731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.338328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.339041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.339499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.345472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.542284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:40.553537 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f989054d-4293-4d2f-8509-100c8a8999cf tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1322 microversion: 2.1 time: 0.434024 Oct 03 10:36:40.554149 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 872/1746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:40 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:40.562047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:40.562668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:40.594342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.594962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.606501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.607318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.607836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.608225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.769353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:40.791269 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3f098b1-1018-4604-b14e-4c2bdd1f893b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.482606 Oct 03 10:36:40.791920 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 875/1747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:40 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:40.841887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:40.842788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:40.848386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:40.860032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.861726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.862325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:40.863297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:40.864211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:40.865355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:41.022717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:36:41.055486 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-77c4974f-d16f-4a1a-aa81-42432f4e5b45 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 2418 microversion: 2.25 time: 0.500225 Oct 03 10:36:41.072693 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 873/1748] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:36:40 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 2418 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:36:41.243568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:41.244241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:41.267466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:41.273080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:41.273731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:41.274609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:41.278650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:41.279225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:41.416189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:41.426349 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d03dfad-3bb0-42b7-b077-9079ba3e9589 tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1472 microversion: 2.1 time: 0.599842 Oct 03 10:36:41.435588 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 876/1749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:40 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1472 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:41.460988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:41.463630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:41.486309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:41.493497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:41.494214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:41.495131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:41.497380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:41.497982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:41.538805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lazy-loading 'services' on Instance uuid 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:36:41.687468 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed1f40ac-a2ca-4794-a823-1ac75efe2df4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments/9416032f-8fed-4d25-aa1a-ef1a18366429" status: 202 len: 0 microversion: 2.25 time: 0.448667 Oct 03 10:36:41.688709 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 874/1750] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 3 10:36:41 2022] DELETE /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments/9416032f-8fed-4d25-aa1a-ef1a18366429 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:36:41.697111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:41.698183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:41.705318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:41.706156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:41.706837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:41.708301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:41.709025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:41.709779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.051284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:42.067401 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c17b7e64-ab8f-46e7-b16a-9f6febc169de tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1474 microversion: 2.1 time: 0.627555 Oct 03 10:36:42.067989 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 877/1751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:41 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1474 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:42.089377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:42.097702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:42.108604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:42.109429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:42.111463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.117829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:42.119556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:42.120507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.196944 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d20231e7-68cc-480d-959d-2ef4c0b12439 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119433 Oct 03 10:36:42.202678 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 878/1752] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:42 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:36:42.209454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:42.210325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:42.216698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:42.217461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:42.218085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.218964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:42.219631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:42.220235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.368495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:42.385302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f742412a-2a75-4eb0-ad9f-7e57766a4471 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1322 microversion: 2.1 time: 0.694893 Oct 03 10:36:42.385977 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 875/1753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:41 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:42.392530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-24c85949-3248-44b4-aff8-d5f141325005 req-78537210-2be8-4e3d-9d09-81e9919521d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5914cb9d-936d-4df2-b759-da941b2982df", "name": "network-vif-unplugged", "status": "completed", "tag": "72809ff0-0bb2-4fd1-8b14-2f84af87b5b6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:42.417460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-24c85949-3248-44b4-aff8-d5f141325005 req-78537210-2be8-4e3d-9d09-81e9919521d5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:42.418279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-24c85949-3248-44b4-aff8-d5f141325005 req-78537210-2be8-4e3d-9d09-81e9919521d5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:42.419313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-24c85949-3248-44b4-aff8-d5f141325005 req-78537210-2be8-4e3d-9d09-81e9919521d5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.439605 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-24c85949-3248-44b4-aff8-d5f141325005 req-78537210-2be8-4e3d-9d09-81e9919521d5 service nova] Creating event network-vif-unplugged:72809ff0-0bb2-4fd1-8b14-2f84af87b5b6 for instance 5914cb9d-936d-4df2-b759-da941b2982df on n-h2-858383-3 Oct 03 10:36:42.448333 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-24c85949-3248-44b4-aff8-d5f141325005 req-78537210-2be8-4e3d-9d09-81e9919521d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060986 Oct 03 10:36:42.453888 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 876/1754] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:42.466728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:42.470783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:42.494875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:42.497994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:42.498613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.500588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:42.501312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:42.503821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:42.552313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:42.731872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:42.747476 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4f1625f-35e3-4995-913f-2870994f421c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.543287 Oct 03 10:36:42.765210 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 879/1755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:42 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:42.976100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:43.000378 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22c517be-cf28-4311-8387-72466403b5af tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1430 microversion: 2.1 time: 0.537480 Oct 03 10:36:43.004391 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 877/1756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:42 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1430 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:43.069501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1613607658", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "ce4be49c-f185-4618-9293-a32849acdd0d"}], "security_groups": [{"name": "tempest-securitygroup--1289017046"}], "key_name": "tempest-keypair-686220556", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:43.093591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:43.094410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:43.102842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:43.109557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:43.115174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:43.116176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:43.116872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:43.117478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:43.378604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] validate_networks() for [('ce4be49c-f185-4618-9293-a32849acdd0d', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:36:44.045821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:44.064231 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c0c77c34-79ed-4632-898a-ce65efba1d04 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1471 microversion: 2.1 time: 0.971170 Oct 03 10:36:44.065225 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 878/1757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:43 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1471 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:44.071835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:44.089378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:44.103854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:44.104347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:44.104804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:44.105572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:44.105964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:44.106380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:44.212147 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0fee3cf-0aff-4306-9981-7d0bbd77bd6b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134044 Oct 03 10:36:44.219373 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 879/1758] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:44 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:36:44.242998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:44.243689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:44.282309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:44.284270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:44.284753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:44.287881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:44.288391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:44.295505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:44.711344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:44.729595 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc4901d4-c07f-4143-92d6-4315572523b0 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1472 microversion: 2.1 time: 0.508539 Oct 03 10:36:44.731202 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 880/1759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:44 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:44.741285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:44.742362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:44.764086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:44.765319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:44.765962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:44.767550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:44.768185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:44.768798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:44.819190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:45.037936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:45.049478 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aed8a86d-4976-4a07-8ea3-b8503d85f4b7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.316693 Oct 03 10:36:45.050822 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 881/1760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:44 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:45.057922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0a4eaf3f-8308-4f9e-b3ba-c5bd9c7c7c87 req-ec9ee290-b533-4268-9120-820152da5aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5914cb9d-936d-4df2-b759-da941b2982df", "name": "network-vif-deleted", "tag": "72809ff0-0bb2-4fd1-8b14-2f84af87b5b6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:45.073329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0a4eaf3f-8308-4f9e-b3ba-c5bd9c7c7c87 req-ec9ee290-b533-4268-9120-820152da5aaf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.074596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0a4eaf3f-8308-4f9e-b3ba-c5bd9c7c7c87 req-ec9ee290-b533-4268-9120-820152da5aaf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.075304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0a4eaf3f-8308-4f9e-b3ba-c5bd9c7c7c87 req-ec9ee290-b533-4268-9120-820152da5aaf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.102301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0a4eaf3f-8308-4f9e-b3ba-c5bd9c7c7c87 req-ec9ee290-b533-4268-9120-820152da5aaf service nova] Creating event network-vif-deleted:72809ff0-0bb2-4fd1-8b14-2f84af87b5b6 for instance 5914cb9d-936d-4df2-b759-da941b2982df on n-h2-858383-3 Oct 03 10:36:45.109721 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0a4eaf3f-8308-4f9e-b3ba-c5bd9c7c7c87 req-ec9ee290-b533-4268-9120-820152da5aaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056658 Oct 03 10:36:45.111145 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 882/1761] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:45.117333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:45.118776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:45.127761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.128437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.129069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.129964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.130660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.131249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.172914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.173740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.174184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.174696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lazy-loading 'fault' on Instance uuid 5914cb9d-936d-4df2-b759-da941b2982df {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:36:45.236190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea84c4ec0e14b78817e9767bfbe2a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecd91e631b84f2fba9f7756cbdc63a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:45.246233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22b6e78a-fc74-4883-8d46-0b6740bbce1f tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 200 len: 1307 microversion: 2.1 time: 0.133744 Oct 03 10:36:45.249140 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 883/1762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:45 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:45.268515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:45.269565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:45.279351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.290348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.294163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.295211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.296592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.300642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.389662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:36:45.390888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:36:45.392660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:36:45.393223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:36:45.394448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:36:45.415772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.417032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.417744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.419751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.420449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.421540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.451556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Getting quotas for project 28ea44afdf844c3bbb6b47365689d17f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:36:45.458950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Getting quotas for user d1f1b0913e804b8ba305ce34ac8900a5 and project 28ea44afdf844c3bbb6b47365689d17f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:36:45.477215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:36:45.480578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:36:45.487422 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-90d4cbbc-5bb3-43d7-8ba3-d03e57baba4c tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "POST /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30/action" status: 202 len: 0 microversion: 2.1 time: 0.236498 Oct 03 10:36:45.487987 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 884/1763] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:45 2022] POST /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:36:45.579865 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-baef5dad-3f7f-42e7-a743-c4607dcc3745 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.515654 Oct 03 10:36:45.581279 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 880/1764] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:36:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:36:45.593429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-cb2b0994-4421-4e0b-b78e-b23b985958e0 req-8484551c-cf9e-4dcb-a19e-094509cdd9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "name": "network-vif-plugged", "status": "completed", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:45.606835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cb2b0994-4421-4e0b-b78e-b23b985958e0 req-8484551c-cf9e-4dcb-a19e-094509cdd9c6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.607634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cb2b0994-4421-4e0b-b78e-b23b985958e0 req-8484551c-cf9e-4dcb-a19e-094509cdd9c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.609060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cb2b0994-4421-4e0b-b78e-b23b985958e0 req-8484551c-cf9e-4dcb-a19e-094509cdd9c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.631317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-cb2b0994-4421-4e0b-b78e-b23b985958e0 req-8484551c-cf9e-4dcb-a19e-094509cdd9c6 service nova] Creating event network-vif-plugged:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h1-858383-3 Oct 03 10:36:45.642834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-cb2b0994-4421-4e0b-b78e-b23b985958e0 req-8484551c-cf9e-4dcb-a19e-094509cdd9c6 service nova] Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:36:45.663825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-cb2b0994-4421-4e0b-b78e-b23b985958e0 req-8484551c-cf9e-4dcb-a19e-094509cdd9c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081042 Oct 03 10:36:45.666903 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 881/1765] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:45.682080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:45.685143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:45.703756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.705383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.706509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.709025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.709594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.710901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.744120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lazy-loading 'flavor' on Instance uuid 212e479b-0b63-4bf2-83f1-3556ef9f4e25 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:36:45.867586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1fa5697d-4740-4285-82ec-10ab656d76b0 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25/action" status: 202 len: 0 microversion: 2.1 time: 0.198865 Oct 03 10:36:45.868312 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 882/1766] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:45 2022] POST /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:36:45.882649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d541dc8-581d-4474-913d-40d53a71c8a7 tempest-ListImagesTestJSON-322537393 tempest-ListImagesTestJSON-322537393-project] Calling method '.version_select at 0x7f074fa343a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:45.902922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:45.910046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:45.926614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.928468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.930173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.931370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:45.933071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:45.935425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:45.979379 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d541dc8-581d-4474-913d-40d53a71c8a7 tempest-ListImagesTestJSON-322537393 tempest-ListImagesTestJSON-322537393-project] 10.222.0.27 "GET /compute/v2.1/images/f290423a-28bb-43d3-ba8c-d44fc0f72e5f" status: 200 len: 784 microversion: 2.1 time: 0.488035 Oct 03 10:36:45.980388 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 885/1767] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:36:45 2022] GET /compute/v2.1/images/f290423a-28bb-43d3-ba8c-d44fc0f72e5f => generated 784 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:45.994569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:45.995734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:46.011409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:46.012465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:46.013347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:46.018561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:46.023210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:46.029814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:46.033980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:46.039749 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-321a53d1-7299-4531-b915-5afd1d24a0d8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.166737 Oct 03 10:36:46.057086 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 883/1768] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:45 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:36:46.062121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1253b40-35a9-49b0-8be5-039b30ae98b2 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:46.062735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1253b40-35a9-49b0-8be5-039b30ae98b2 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:46.251783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1253b40-35a9-49b0-8be5-039b30ae98b2 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:46.261368 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1253b40-35a9-49b0-8be5-039b30ae98b2 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1241 microversion: 2.1 time: 0.203063 Oct 03 10:36:46.275273 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 884/1769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:46 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:46.291431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:46.292044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:46.309770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:46.312528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:46.313042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:46.314457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:46.314918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:46.317961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:46.485734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:46.494593 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41d754cc-d58b-4a78-8415-c61b47b61ebf tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 0.512981 Oct 03 10:36:46.497777 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 886/1770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:45 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:46.503249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ae513b9-96a3-49e4-9b27-cbc0aaedd78d tempest-ListImagesTestJSON-322537393 tempest-ListImagesTestJSON-322537393-project] Calling method '.version_select at 0x7f074fad4c10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:46.690616 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ae513b9-96a3-49e4-9b27-cbc0aaedd78d tempest-ListImagesTestJSON-322537393 tempest-ListImagesTestJSON-322537393-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.190320 Oct 03 10:36:46.700039 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 887/1771] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 3 10:36:46 2022] GET /compute/v2.1/images => generated 445 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:46.705909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:46.706616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:46.713465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:46.714434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:46.715084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:46.716044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:46.716500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:46.717035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.147081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:47.158604 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b84cb5bc-bbaf-416c-ab85-f643dcff881b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.456912 Oct 03 10:36:47.158768 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68a8447a-dbf6-431b-a2a9-79de4ca86093 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1631 microversion: 2.1 time: 0.881668 Oct 03 10:36:47.164037 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 885/1772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:46 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1631 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:47.179426 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 888/1773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:46 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:47.187308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-292ef82b-9186-4872-8917-234b74a56e19 tempest-ListImagesTestJSON-322537393 tempest-ListImagesTestJSON-322537393-project] Calling method '.version_select at 0x7f074f64ef70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:47.192894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:47.206792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] [instance: 5914cb9d-936d-4df2-b759-da941b2982df] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:47.227107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.227601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.228036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.228813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.229278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.229695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.285036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] HTTP exception thrown: Instance 5914cb9d-936d-4df2-b759-da941b2982df could not be found. Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Request method failure captured: Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df HTTP/1.1 Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrrLneshLfTO9cXV24wC93PuVL8WnazCu3pMwClvsijAFj0xKsXICTTvITj8ki9fibou04um5A8aRBemedPggDVGGSwHsTcrHsILn12s7cP2XGmfnghUU8G-y6gU2EgUXOn78-nL0YjMpeIzUZmy6WYCpBcmC6kGEu8Q0uhgG72tIB4 Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: fecd91e631b84f2fba9f7756cbdc63a1 Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:36:47.287207 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fecd91e631b84f2fba9f7756cbdc63a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fecd91e631b84f2fba9f7756cbdc63a1"}]}] Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: fecd91e631b84f2fba9f7756cbdc63a1 Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-811490309 Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesOneServerTestJSON-811490309-project Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9ea84c4ec0e14b78817e9767bfbe2a1a Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesOneServerTestJSON-811490309-project Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 5914cb9d-936d-4df2-b759-da941b2982df could not be found. Oct 03 10:36:47.288940 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '5914cb9d-936d-4df2-b759-da941b2982df'} Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5914cb9d-936d-4df2-b759-da941b2982df could not be found. Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:47.289821 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5914cb9d-936d-4df2-b759-da941b2982df could not be found. Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5914cb9d-936d-4df2-b759-da941b2982df could not be found. Oct 03 10:36:47.291544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:47.297937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] Returning 404 to user: Instance 5914cb9d-936d-4df2-b759-da941b2982df could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:47.302206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2495a435-7aa5-4f0f-b929-3b9747ce3b1e tempest-ImagesOneServerTestJSON-811490309 tempest-ImagesOneServerTestJSON-811490309-project] 10.222.0.27 "GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df" status: 404 len: 111 microversion: 2.1 time: 0.136183 Oct 03 10:36:47.303401 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 886/1774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:47 2022] GET /compute/v2.1/servers/5914cb9d-936d-4df2-b759-da941b2982df => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:36:47.320021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:47.343828 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-292ef82b-9186-4872-8917-234b74a56e19 tempest-ListImagesTestJSON-322537393 tempest-ListImagesTestJSON-322537393-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.161409 Oct 03 10:36:47.344460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 889/1775] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:36:47 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:47.347735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:47.353585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:47.365137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:47.370758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.378276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.380351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.383615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:47.383850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.384498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.385312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.387019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.390410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.391132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.394651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.396275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.396941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.498305 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-381f1542-79f7-4a01-9b72-dad1afe8884c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.193600 Oct 03 10:36:47.517989 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 887/1776] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:47 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:36:47.530919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:47.535477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:47.554051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.554539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.554979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.555686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:47.556281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:47.556741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:47.641977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:47.653331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5bdd9b0-524e-4cac-9923-5cb0addb61fa tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1293 microversion: 2.1 time: 0.304617 Oct 03 10:36:47.654029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 890/1777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:47 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1293 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:47.946124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:47.960449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad843730-2852-4ec0-ac18-0786b09fafc7 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 0.439234 Oct 03 10:36:47.961091 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 888/1778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:47 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:48.192221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:48.192849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:48.194005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:48.197300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:48.213855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.214639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.216691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.217104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.217779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.222117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.225404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.225404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.225404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.226437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.226910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.227338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.553440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c84617f6-c97b-4b18-bf05-eac31af48131 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1614 microversion: 2.1 time: 0.367771 Oct 03 10:36:48.555532 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 889/1779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:48 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1614 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:48.564746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:48.574688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:48.593695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.594432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.595656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.597737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.598385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.599895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.665512 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1bb862c7-9f6b-4c0a-b900-b4c8eb3f76f7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.107391 Oct 03 10:36:48.669223 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 890/1780] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:48 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:36:48.675697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:48.676436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:48.684552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.685275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.685820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.686794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.687528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.689164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.728208 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] HTTP exception thrown: Cannot 'migrate' instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 while it is in vm_state suspended Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Request method failure captured: Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25/action HTTP/1.1 Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 15 Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrsCM0ci2fO-Vhxy7Aj68oRY0PUINK4EiJQS2Dvb6-bAx8Y87Ek7XAtciPtj8MbEkOXI7Qve2n8VJ3CMHjwPk59Khx1okqp2NTwGYZDaFOeFyctrjI831LLDn0lfN0zu-fMDzfv4-7m1ldNPgoHzpMQWgJQPXWYedI0g2Msy5Y9F_yU Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:36:48.731710 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}] Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3975940661c54c679aa640db1ed69349 Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: {"migrate": {}} Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:36:48.733493 n-d-858383-3 devstack@n-api.service[122269]: exception: Cannot 'migrate' instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 while it is in vm_state suspended Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '212e479b-0b63-4bf2-83f1-3556ef9f4e25', 'body': {'migrate': {}}} Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 in vm_state suspended. Cannot resize while the instance is in this state. Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.734418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 while it is in vm_state suspended Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:48.735872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:48.737249 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:48.737249 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:48.737249 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 while it is in vm_state suspended Oct 03 10:36:48.737249 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.740080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Returning 409 to user: Cannot 'migrate' instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 while it is in vm_state suspended {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:48.741298 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0236c541-791a-4924-b7d5-7666e3423f7d tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25/action" status: 409 len: 148 microversion: 2.1 time: 0.070968 Oct 03 10:36:48.742227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 891/1781] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:48 2022] POST /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25/action => generated 148 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:36:48.754486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:48.755427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:48.764540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.765509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.766213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.767264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:48.767946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:48.768606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:48.897683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:48.908996 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2196e67c-3234-4be1-99d7-895530091629 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.724657 Oct 03 10:36:48.912874 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 891/1782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:48 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:48.917937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:48.918722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2dcc659-2a52-464a-81b3-f6c7989b9d5a tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2dcc659-2a52-464a-81b3-f6c7989b9d5a tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Request method failure captured: Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69/action HTTP/1.1 Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 39 Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrsCM0ci2fO-Vhxy7Aj68oRY0PUINK4EiJQS2Dvb6-bAx8Y87Ek7XAtciPtj8MbEkOXI7Qve2n8VJ3CMHjwPk59Khx1okqp2NTwGYZDaFOeFyctrjI831LLDn0lfN0zu-fMDzfv4-7m1ldNPgoHzpMQWgJQPXWYedI0g2Msy5Y9F_yU Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:36:48.935051 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}] Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3975940661c54c679aa640db1ed69349 Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: {"os-resetState": {"state": "invalid"}} Oct 03 10:36:48.936783 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '259e1246-110d-4c3a-96e4-feea029ecb69', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:48.937759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:36:48.939652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 03 10:36:48.941169 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.941169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2dcc659-2a52-464a-81b3-f6c7989b9d5a tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:48.941632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c2dcc659-2a52-464a-81b3-f6c7989b9d5a tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69/action" status: 400 len: 144 microversion: 2.1 time: 0.027466 Oct 03 10:36:48.946658 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 892/1783] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:48 2022] POST /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69/action => generated 144 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:36:48.949641 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-98a7cf05-79d4-4c7d-b056-91fca4c6ae14 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1299 microversion: 2.1 time: 0.205949 Oct 03 10:36:48.950225 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 892/1784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:48 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:48.951423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37ba527c-bbb0-47b8-a9de-56307522eae5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37ba527c-bbb0-47b8-a9de-56307522eae5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Request method failure captured: Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69/action HTTP/1.1 Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 31 Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrsCM0ci2fO-Vhxy7Aj68oRY0PUINK4EiJQS2Dvb6-bAx8Y87Ek7XAtciPtj8MbEkOXI7Qve2n8VJ3CMHjwPk59Khx1okqp2NTwGYZDaFOeFyctrjI831LLDn0lfN0zu-fMDzfv4-7m1ldNPgoHzpMQWgJQPXWYedI0g2Msy5Y9F_yU Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:36:48.958376 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}] Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3975940661c54c679aa640db1ed69349 Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: {"os-resetState": {"state": 1}} Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:36:48.960184 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '259e1246-110d-4c3a-96e4-feea029ecb69', 'body': {'os-resetState': {'state': 1}}} Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 1 Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:48.961260 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 03 10:36:48.963022 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:48.964549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37ba527c-bbb0-47b8-a9de-56307522eae5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:48.964549 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-37ba527c-bbb0-47b8-a9de-56307522eae5 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69/action" status: 400 len: 120 microversion: 2.1 time: 0.012133 Oct 03 10:36:48.971539 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 893/1785] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:36:48 2022] POST /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69/action => generated 120 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:36:48.973975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35c4251f-e656-466b-bbeb-543881017688 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:48.982506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-35c4251f-e656-466b-bbeb-543881017688 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Failed to fetch instance by id 999 {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 10:36:48.983471 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-35c4251f-e656-466b-bbeb-543881017688 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 03 10:36:48.990972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:48.991630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:49.005508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.006159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.006614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35c4251f-e656-466b-bbeb-543881017688 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Request method failure captured: Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 37 Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrsCM0ci2fO-Vhxy7Aj68oRY0PUINK4EiJQS2Dvb6-bAx8Y87Ek7XAtciPtj8MbEkOXI7Qve2n8VJ3CMHjwPk59Khx1okqp2NTwGYZDaFOeFyctrjI831LLDn0lfN0zu-fMDzfv4-7m1ldNPgoHzpMQWgJQPXWYedI0g2Msy5Y9F_yU Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 10:36:49.007258 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ad9d2b8d54f24447904f02e22aebe7ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ad9d2b8d54f24447904f02e22aebe7ac"}]}] Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ad9d2b8d54f24447904f02e22aebe7ac Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-220135718 Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3975940661c54c679aa640db1ed69349 Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersAdminNegativeTestJSON-220135718-project-admin Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: {"os-resetState": {"state": "error"}} Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:36:49.009180 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 999 could not be found. Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:36:49.010269 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 03 10:36:49.011919 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:49.013180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.013180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.013180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.015995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35c4251f-e656-466b-bbeb-543881017688 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:49.019497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-35c4251f-e656-466b-bbeb-543881017688 tempest-ServersAdminNegativeTestJSON-220135718 tempest-ServersAdminNegativeTestJSON-220135718-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.050921 Oct 03 10:36:49.021338 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 893/1786] 10.222.0.27 () {60 vars in 1179 bytes} [Mon Oct 3 10:36:48 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:36:49.034172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:49.036042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:49.059929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.060667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.062565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.063614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.065174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.096856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.156717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:36:49.367780 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-640e7c45-36a0-4c29-a308-f3beb9ab7029 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 204 len: 0 microversion: 2.1 time: 0.330689 Oct 03 10:36:49.369970 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 894/1787] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:36:49 2022] DELETE /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:36:49.392328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:49.392811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:49.399010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.399858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.400299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.401043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.401499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.401922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.646493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:49.655288 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b8dcc8b-bf68-49d1-96bf-1b86bfe019aa tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1469 microversion: 2.1 time: 0.280455 Oct 03 10:36:49.669318 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 895/1788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:49 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:49.747623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:49.760708 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65308cef-ab16-4c69-8a1f-debc24d5bc3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 0.773739 Oct 03 10:36:49.764275 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 894/1789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:48 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:49.780113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:49.782897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:49.799356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.799851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.800273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.801016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.801469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.801961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.868655 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0900ff55-fa2f-4623-80ea-869b4a917bb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.102986 Oct 03 10:36:49.875727 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 895/1790] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:49 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:36:49.938194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:49.939167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:49.952389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.957617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.960301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:49.961667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:49.965371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:49.966031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:50.265380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14e99c36-31ca-4839-b25a-eec3c249ccfb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f074f2195e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2101724793", "description": "tempest-description-1710423832"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:50.414200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:50.431319 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c8ad04c4-aa12-4266-80d2-c77d04d2389b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.496982 Oct 03 10:36:50.434470 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 896/1791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:49 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:36:50.443489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:50.444600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:50.462755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:50.471753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:50.472667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:50.473737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:50.474282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:50.474927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:50.590951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14e99c36-31ca-4839-b25a-eec3c249ccfb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.920208 Oct 03 10:36:50.597898 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 896/1792] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:36:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:50.612004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce4b6a6e-78f0-4994-bd41-5f322c8f6ed0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f074f1b5040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-953417032", "description": "tempest-description-1030707426"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:51.087899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:51.098205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:51.102881 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-398f5b19-db32-4d8b-a77d-fa90384ea4b7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1367 microversion: 2.1 time: 0.664789 Oct 03 10:36:51.103475 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 897/1793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:50 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1367 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:51.117684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:51.126315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:51.153871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.154745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.155355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:51.157962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.169229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.170176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:51.425431 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce4b6a6e-78f0-4994-bd41-5f322c8f6ed0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.818491 Oct 03 10:36:51.426169 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 897/1794] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:36:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:36:51.443402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:51.445516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:51.462639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.463411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.465233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:51.467439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.468487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.471382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:51.793760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:51.805035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:51.805617 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4bcc0e3b-9456-4460-9a40-7b5b6f81cc14 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 200 len: 1469 microversion: 2.1 time: 0.693293 Oct 03 10:36:51.806127 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 898/1795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:51 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 1469 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:51.816717 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-271974fc-adc7-4ef6-9375-6da740784e8b tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 0.376713 Oct 03 10:36:51.819720 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 898/1796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:51 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:51.843861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:51.851665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:51.860958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.861462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.861895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:51.862598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.863044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.863467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:51.940105 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff984fcd-c04a-4559-8d71-f37566468b8f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118520 Oct 03 10:36:51.944014 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 899/1797] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:51 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:36:51.963313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:51.966115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:51.988273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.989129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.990496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:51.991447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:51.993914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:51.996226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:52.182089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Calling method '.version_select at 0x7f074f661160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:52.196586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:52.197976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:52.198597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:52.199511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:52.200149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:52.200786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:52.253845 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-74f6bb3c-2ecb-4b12-ab2f-32efabe31f06 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.431944 Oct 03 10:36:52.260382 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 899/1798] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 3 10:36:51 2022] GET /compute/v2.1/limits => generated 511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:52.268350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1931265959", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "0c772e2c-1a67-43b9-a52d-eb393d19b267"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:52.352246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] validate_networks() for [('0c772e2c-1a67-43b9-a52d-eb393d19b267', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:36:53.189686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:53.203220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b877199-98a7-4f11-a88d-912f7f58ef46 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 1.256584 Oct 03 10:36:53.209233 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 900/1799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:51 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:53.214436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:53.221677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:53.232756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:53.233287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:53.233733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:53.234610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:53.234905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:53.235388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:53.669640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:36:53.670213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:36:53.670519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:36:53.670926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:36:53.671344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:36:53.691499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:53.691992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:53.697733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:53.698600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:53.700346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:53.701365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:53.744342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Getting quotas for project 8758b690683b468393e1e884e6f76fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:36:53.750229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Getting quotas for user 60c925fc8e0b48f19f1ff0934adbf601 and project 8758b690683b468393e1e884e6f76fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:36:53.772267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:36:53.776639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:36:53.867641 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f24c4a33-abc2-4947-8514-aea487da505c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605674 Oct 03 10:36:53.868923 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 900/1800] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:36:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:36:53.875466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-905220432", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:53.964031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:36:54.078522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:54.091829 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-948878bf-afcd-46f2-beba-e6db3a1a2f6a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1367 microversion: 2.1 time: 0.881023 Oct 03 10:36:54.092303 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 901/1801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:53 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1367 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:54.111697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:54.112294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 212e479b-0b63-4bf2-83f1-3556ef9f4e25] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:54.130553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.131064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.131512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.132239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.132700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.133165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.164585 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] HTTP exception thrown: Instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 could not be found. Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Request method failure captured: Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 HTTP/1.1 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrsBUHvEof_uQOx6EiNR4twLTZAGiRFa4Ionc8cUrWB63lZGOuA0oN7qLEJll902Yk4A0DkiFIbgT4YH7XA3LGlYc_Ugjq7HKv90JabyVM1rmWqsyVguLoiW1CTMGXflSNK0tpbkHKhFpx8gOwfd-LTukAwRdq07g9KCs_CjFSKciBg Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: f157053f0fe9445a84531ef849861521 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2045958061 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f157053f0fe9445a84531ef849861521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f157053f0fe9445a84531ef849861521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f157053f0fe9445a84531ef849861521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f157053f0fe9445a84531ef849861521"}]}] Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2045958061 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: f157053f0fe9445a84531ef849861521 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2045958061 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminNegativeTestJSON-2045958061-project Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a598123a284943b4a0cd88205e8f1146 Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2045958061-project Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 could not be found. Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '212e479b-0b63-4bf2-83f1-3556ef9f4e25'} Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 could not be found. Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 could not be found. Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.166441 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 could not be found. Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Returning 404 to user: Instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:54.171760 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ac6b038-a816-43f3-9b7a-f1c7a6092e62 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25" status: 404 len: 111 microversion: 2.1 time: 0.060170 Oct 03 10:36:54.177115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 902/1802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:54 2022] GET /compute/v2.1/servers/212e479b-0b63-4bf2-83f1-3556ef9f4e25 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:36:54.186918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:54.187575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:54.198658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.199338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.199616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.200311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.200858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.201223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.472025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Getting quotas for project 97f4da1b7e9f4a9d9c7654a473cbff99. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:36:54.479515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Getting quotas for user c3285a107026475983f47088a6561059 and project 97f4da1b7e9f4a9d9c7654a473cbff99. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:36:54.510281 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Request method failure captured: Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 1751 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtD8g93TY4CuzC7n6ICJ26oP7lrjnSNVKibDCXyIYngNkWWdqn3JsthQVwfTfBFpTP_H_iH5GsPJstm5VLrBFmQOG8yRuNcHyNdlVMgOcipJcxwGo91aJrColXViNRikdYoPa9WFmQFrSiidIRXKxo8BmCBtW8XesSXMmMx5RWBPKE Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 97f4da1b7e9f4a9d9c7654a473cbff99 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1902895640 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/97f4da1b7e9f4a9d9c7654a473cbff99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_97f4da1b7e9f4a9d9c7654a473cbff99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/97f4da1b7e9f4a9d9c7654a473cbff99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/97f4da1b7e9f4a9d9c7654a473cbff99"}]}] Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1902895640 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 97f4da1b7e9f4a9d9c7654a473cbff99 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1902895640 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: c3285a107026475983f47088a6561059 Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-905220432", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:36:54.528096 n-d-858383-3 devstack@n-api.service[122269]: exception: Maximum number of metadata items exceeds 128 Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-905220432', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:36:54.530937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e40484fd-eaeb-4310-a82c-9972e80308c0 tempest-AbsoluteLimitsNegativeTestJSON-1902895640 tempest-AbsoluteLimitsNegativeTestJSON-1902895640-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.659953 Oct 03 10:36:54.538698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 901/1803] 10.222.0.27 () {60 vars in 1148 bytes} [Mon Oct 3 10:36:53 2022] POST /compute/v2.1/servers => generated 87 bytes in 666 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:36:54.543908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:54.547616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:54.562019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.562794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.563276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.576859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.577366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.582274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.629068 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d336899c-478a-4446-9f03-2352d9fb5b23 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.092561 Oct 03 10:36:54.629936 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 902/1804] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:36:54 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:54.637185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7c2e6afd-ba31-417d-8316-739016952223 req-8ee831f0-e124-4af3-87c5-364769cbd3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "212e479b-0b63-4bf2-83f1-3556ef9f4e25", "name": "network-vif-deleted", "tag": "710a5f86-d472-417b-a10d-6ebf6dcfbb18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:54.647400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c2e6afd-ba31-417d-8316-739016952223 req-8ee831f0-e124-4af3-87c5-364769cbd3e4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.650121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c2e6afd-ba31-417d-8316-739016952223 req-8ee831f0-e124-4af3-87c5-364769cbd3e4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.650595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c2e6afd-ba31-417d-8316-739016952223 req-8ee831f0-e124-4af3-87c5-364769cbd3e4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.669362 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7c2e6afd-ba31-417d-8316-739016952223 req-8ee831f0-e124-4af3-87c5-364769cbd3e4 service nova] Creating event network-vif-deleted:710a5f86-d472-417b-a10d-6ebf6dcfbb18 for instance 212e479b-0b63-4bf2-83f1-3556ef9f4e25 on n-h2-858383-3 Oct 03 10:36:54.678844 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7c2e6afd-ba31-417d-8316-739016952223 req-8ee831f0-e124-4af3-87c5-364769cbd3e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046944 Oct 03 10:36:54.679774 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 903/1805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:54.685900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-479f5f16-5ab2-4613-8664-8962f173c4ce req-8359bbf7-c5db-47a3-afb1-17446f9a979a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "name": "network-vif-unplugged", "status": "completed", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:54.696978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:54.706329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-479f5f16-5ab2-4613-8664-8962f173c4ce req-8359bbf7-c5db-47a3-afb1-17446f9a979a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.707636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-479f5f16-5ab2-4613-8664-8962f173c4ce req-8359bbf7-c5db-47a3-afb1-17446f9a979a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.708244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-479f5f16-5ab2-4613-8664-8962f173c4ce req-8359bbf7-c5db-47a3-afb1-17446f9a979a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.725123 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-479f5f16-5ab2-4613-8664-8962f173c4ce req-8359bbf7-c5db-47a3-afb1-17446f9a979a service nova] Creating event network-vif-unplugged:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h2-858383-3 Oct 03 10:36:54.732720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-479f5f16-5ab2-4613-8664-8962f173c4ce req-8359bbf7-c5db-47a3-afb1-17446f9a979a service nova] Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:36:54.749471 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-479f5f16-5ab2-4613-8664-8962f173c4ce req-8359bbf7-c5db-47a3-afb1-17446f9a979a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068029 Oct 03 10:36:54.750854 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 904/1806] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:54.757199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:54.758390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:54.769340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.770279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.771184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.772576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.773352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.774083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.927542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:54.938111 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-20828ba1-dd35-46e7-94f2-eb7ef8c090c6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1220 microversion: 2.1 time: 0.185184 Oct 03 10:36:54.938753 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 905/1807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:54 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:54.957383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:54.958064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:54.968598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.977586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.978970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:54.980288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:54.982142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:54.982815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:55.046185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:36:55.077848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:36:55.258740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-489b08b5-68d2-4865-91ae-8db3bd119499 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "DELETE /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 204 len: 0 microversion: 2.1 time: 0.306959 Oct 03 10:36:55.261598 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 906/1808] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:36:54 2022] DELETE /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:36:55.276860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:55.277866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:55.304168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:55.341521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:55.344118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:55.346749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:55.353894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:55.357255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:55.361279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:55.362375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c4b8252-0b38-482b-be15-5f88f84a948d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 1.180121 Oct 03 10:36:55.366723 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 903/1809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:54 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:55.391499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:55.400401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:55.419744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:55.425296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:55.425857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:55.426566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:55.428261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:55.429963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:55.935801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:55.950792 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-836eb967-d159-4672-a4d2-5e8af47f49fe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.687216 Oct 03 10:36:55.953423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 907/1810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:55 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:55.982530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:55.983567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:55.997330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:55.997825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:55.998260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:55.998974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:55.999428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:55.999854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.231398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:56.242582 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb74b8cf-dfab-4b2f-86e2-fe54ca458f38 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1367 microversion: 2.1 time: 0.873165 Oct 03 10:36:56.260261 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 904/1811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:55 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1367 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:56.266050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:56.266992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:56.274574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:56.276091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:56.276943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.277834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:56.284055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:56.286391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.341734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:56.355267 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6afe4e61-0abb-4e80-9b28-c7a91dc99c9d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1477 microversion: 2.1 time: 0.375911 Oct 03 10:36:56.370561 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 908/1812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:55 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1477 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:56.391493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:56.396306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:56.408321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:56.461925 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99735793-d44c-4b4a-a206-23268717cbc1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1268 microversion: 2.1 time: 0.200155 Oct 03 10:36:56.464171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:56.464941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:56.469373 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 905/1813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:56 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:56.471467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.473213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:56.474399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:56.475040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.709881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ca691984-302e-4f50-b69a-e1ed9f303ae6 req-00980549-87a8-4f05-88b3-bd597133e7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af81a64b-4ea6-48b9-80fd-a0b4659d39e4", "name": "network-vif-unplugged", "status": "completed", "tag": "5f6d0bfe-3323-40af-8755-76910c1d237e"}, {"name": "network-changed", "server_uuid": "af81a64b-4ea6-48b9-80fd-a0b4659d39e4", "tag": "5f6d0bfe-3323-40af-8755-76910c1d237e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:56.728607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:56.736522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ca691984-302e-4f50-b69a-e1ed9f303ae6 req-00980549-87a8-4f05-88b3-bd597133e7ad service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:56.739961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ca691984-302e-4f50-b69a-e1ed9f303ae6 req-00980549-87a8-4f05-88b3-bd597133e7ad service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:56.740714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ca691984-302e-4f50-b69a-e1ed9f303ae6 req-00980549-87a8-4f05-88b3-bd597133e7ad service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.741200 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caff8cb2-9fdd-46a5-a8f5-0ace5a0ec657 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 0.353643 Oct 03 10:36:56.742262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 909/1814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:56 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:56.762497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ca691984-302e-4f50-b69a-e1ed9f303ae6 req-00980549-87a8-4f05-88b3-bd597133e7ad service nova] Creating event network-vif-unplugged:5f6d0bfe-3323-40af-8755-76910c1d237e for instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 on n-h1-858383-3 Oct 03 10:36:56.763548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ca691984-302e-4f50-b69a-e1ed9f303ae6 req-00980549-87a8-4f05-88b3-bd597133e7ad service nova] Creating event network-changed:5f6d0bfe-3323-40af-8755-76910c1d237e for instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 on n-h1-858383-3 Oct 03 10:36:56.770197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ca691984-302e-4f50-b69a-e1ed9f303ae6 req-00980549-87a8-4f05-88b3-bd597133e7ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.066379 Oct 03 10:36:56.771354 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 906/1815] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:56.843540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71022b1-6680-4a39-941d-79472a4aa61f", "tag": "e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7"}, {"name": "network-changed", "server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:36:56.888042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:56.889037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:56.891428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.923607 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] Creating event network-changed:e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7 for instance c71022b1-6680-4a39-941d-79472a4aa61f on n-h2-858383-3 Oct 03 10:36:56.925144 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] Creating event network-changed:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h2-858383-3 Oct 03 10:36:56.932834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 10:36:56.947858 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5672b498-33a7-470b-8800-da1d26d3010f req-07e826af-6c5d-4307-b82a-40d16410cd6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111743 Oct 03 10:36:56.948877 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 910/1816] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:36:56.976541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:56.977722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:56.989492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:56.990062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:56.998351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:56.999747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:57.000230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:57.000669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:57.267725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:57.269684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:57.289067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:57.289844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:57.293251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:57.294280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:57.294971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:57.297279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:57.731155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:57.747858 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f004ff58-0383-45fb-9754-b484d3611b96 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1367 microversion: 2.1 time: 0.482180 Oct 03 10:36:57.768270 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 911/1817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:57 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:57.773583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:57.776843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:57.793737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:57.796499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:57.797254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:57.798272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:57.799233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:57.799909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:58.225376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:58.251382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62ea4876-a212-4388-b30b-3c92304b635d tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1477 microversion: 2.1 time: 0.479391 Oct 03 10:36:58.253401 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 912/1818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:57 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:58.280885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:58.281932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:58.299425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:58.301410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:58.304044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:58.305159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:58.308133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:58.308927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:58.460048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:58.482937 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9eb02771-1696-421b-8c92-92a3fe514f82 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1286 microversion: 2.1 time: 0.210257 Oct 03 10:36:58.495509 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 913/1819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:58 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:58.505722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:58.506265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:58.520669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:58.522254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:58.522876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:58.524204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:58.524932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:58.525608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:58.801838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:58.817126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-823e8d2e-a7ef-4c4b-8517-8209daf0ff03 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 0.320370 Oct 03 10:36:58.821092 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 914/1820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:58 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:58.833065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:58.833892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:58.849238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:58.850144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:58.850742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:58.851834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:58.857945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:58.858447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:59.087328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:59.104101 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ddc1d898-2d04-4378-8ccb-f188b7b68c26 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 2.131681 Oct 03 10:36:59.106628 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 907/1821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:56 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:59.280716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:59.281455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:59.294170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:59.297710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:59.298739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:59.302517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:59.306008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:59.307325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:59.911811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:36:59.924031 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d580d39a-a65c-4ade-a3de-65e7da179e3e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1367 microversion: 2.1 time: 1.097111 Oct 03 10:36:59.928452 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 915/1822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:58 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1367 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:36:59.936007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:36:59.937184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:36:59.976958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:59.977461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:59.977910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:36:59.985773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:36:59.989808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:36:59.990948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:00.217635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:00.231987 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b279c6d-b3d5-4b1b-92a8-c70461ba479c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1477 microversion: 2.1 time: 0.956955 Oct 03 10:37:00.234454 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 908/1823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:59 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1477 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:00.243128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:00.244460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:00.254736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:00.255660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:00.256338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:00.257356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:00.258087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:00.258748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:00.464619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:00.476112 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-64ec8c44-e95e-4e75-b8cb-90999cc2e2af tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.546266 Oct 03 10:37:00.488793 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 916/1824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:36:59 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:00.501885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:00.502654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:00.511806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:00.512929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:00.514385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:00.515491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:00.516408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:00.517675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:00.773381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:00.779442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:00.788344 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c437f1ef-489c-4127-8d59-d7533482d382 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.306480 Oct 03 10:37:00.789033 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 917/1825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:00 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:00.793082 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1631e958-cac2-4233-9a50-0d214be2a507 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1470 microversion: 2.1 time: 0.552876 Oct 03 10:37:00.793884 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 909/1826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:00 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1470 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:00.888068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-82dd81f3-9508-4b33-9555-b29d1c7bd623 req-33b5ba51-4759-43e3-b288-d91d4936a213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259e1246-110d-4c3a-96e4-feea029ecb69", "name": "network-vif-deleted", "tag": "412b284e-64de-46fd-832a-d000bec64a46"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:00.952579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-82dd81f3-9508-4b33-9555-b29d1c7bd623 req-33b5ba51-4759-43e3-b288-d91d4936a213 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:00.956578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:00.957237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:00.959386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-82dd81f3-9508-4b33-9555-b29d1c7bd623 req-33b5ba51-4759-43e3-b288-d91d4936a213 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:00.960413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-82dd81f3-9508-4b33-9555-b29d1c7bd623 req-33b5ba51-4759-43e3-b288-d91d4936a213 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:00.968334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:00.969056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:00.969275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:00.970056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:00.977549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:00.978007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:01.025814 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-82dd81f3-9508-4b33-9555-b29d1c7bd623 req-33b5ba51-4759-43e3-b288-d91d4936a213 service nova] Creating event network-vif-deleted:412b284e-64de-46fd-832a-d000bec64a46 for instance 259e1246-110d-4c3a-96e4-feea029ecb69 on n-h1-858383-3 Oct 03 10:37:01.049513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-82dd81f3-9508-4b33-9555-b29d1c7bd623 req-33b5ba51-4759-43e3-b288-d91d4936a213 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175634 Oct 03 10:37:01.058552 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 918/1827] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:01.262833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:01.263541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:01.281669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:01.282196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:01.283190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:01.295409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:01.295792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:01.296258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:01.416669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:01.417491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:01.418168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:01.418854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lazy-loading 'fault' on Instance uuid 259e1246-110d-4c3a-96e4-feea029ecb69 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:37:01.504914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598123a284943b4a0cd88205e8f1146', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f157053f0fe9445a84531ef849861521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:01.516724 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da07a5a5-d0d6-40c1-8b96-c962c5977a7c tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 200 len: 1312 microversion: 2.1 time: 0.258453 Oct 03 10:37:01.520488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 919/1828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:01 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:01.534725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7bdbdce8-665b-475b-a61d-59762b7f9903 req-66411780-cd92-43c9-9582-ddccc0965e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71022b1-6680-4a39-941d-79472a4aa61f", "name": "network-vif-plugged", "status": "completed", "tag": "e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:01.557328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7bdbdce8-665b-475b-a61d-59762b7f9903 req-66411780-cd92-43c9-9582-ddccc0965e91 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:01.559657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7bdbdce8-665b-475b-a61d-59762b7f9903 req-66411780-cd92-43c9-9582-ddccc0965e91 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:01.560465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7bdbdce8-665b-475b-a61d-59762b7f9903 req-66411780-cd92-43c9-9582-ddccc0965e91 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:01.606982 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7bdbdce8-665b-475b-a61d-59762b7f9903 req-66411780-cd92-43c9-9582-ddccc0965e91 service nova] Creating event network-vif-plugged:e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7 for instance c71022b1-6680-4a39-941d-79472a4aa61f on n-h2-858383-3 Oct 03 10:37:01.616563 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7bdbdce8-665b-475b-a61d-59762b7f9903 req-66411780-cd92-43c9-9582-ddccc0965e91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094506 Oct 03 10:37:01.617214 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 920/1829] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:01.632371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:01.636894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:01.653388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:01.654235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:01.654883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:01.655803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:01.662541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:01.663609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.075720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:02.089857 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1f17509f-c2eb-46dd-971f-be461204895f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.469488 Oct 03 10:37:02.091662 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 921/1830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:01 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:02.109619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:02.110508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:02.127056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:02.127472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:02.127913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.128605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:02.129141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:02.129720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.493150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:02.525021 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8011c30-e1e7-4f06-81ee-4e19c41a5cec tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.430049 Oct 03 10:37:02.527719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 922/1831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:02 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:02.532150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:02.545220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1b95a162-c4e7-430b-ab35-5713c2277e72 req-f49839e4-0f2e-4e79-bdeb-1bb649a54007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6694c5f-d423-4df4-ad03-88474f2a0d65", "tag": "df81ef11-7a29-4aa2-a522-0e7de13b42e8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:02.557100 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-297f6087-94e2-4150-ac80-bdc2af8c2731 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1367 microversion: 2.1 time: 1.600675 Oct 03 10:37:02.557770 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 910/1832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:00 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1367 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:02.568240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:02.568926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:02.580566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b95a162-c4e7-430b-ab35-5713c2277e72 req-f49839e4-0f2e-4e79-bdeb-1bb649a54007 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:02.581072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b95a162-c4e7-430b-ab35-5713c2277e72 req-f49839e4-0f2e-4e79-bdeb-1bb649a54007 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:02.581501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b95a162-c4e7-430b-ab35-5713c2277e72 req-f49839e4-0f2e-4e79-bdeb-1bb649a54007 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.606373 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1b95a162-c4e7-430b-ab35-5713c2277e72 req-f49839e4-0f2e-4e79-bdeb-1bb649a54007 service nova] Creating event network-changed:df81ef11-7a29-4aa2-a522-0e7de13b42e8 for instance d6694c5f-d423-4df4-ad03-88474f2a0d65 on n-h1-858383-3 Oct 03 10:37:02.609058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:02.609974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:02.610700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.611858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:02.612552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:02.614307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.619894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1b95a162-c4e7-430b-ab35-5713c2277e72 req-f49839e4-0f2e-4e79-bdeb-1bb649a54007 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090757 Oct 03 10:37:02.621344 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 923/1833] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:02.631134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:02.633574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] [instance: 259e1246-110d-4c3a-96e4-feea029ecb69] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:02.649717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:02.651230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:02.652569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.654199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:02.655613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:02.659159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:02.663660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:02.694244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] HTTP exception thrown: Instance 259e1246-110d-4c3a-96e4-feea029ecb69 could not be found. Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Request method failure captured: Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 HTTP/1.1 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrsBUHvEof_uQOx6EiNR4twLTZAGiRFa4Ionc8cUrWB63lZGOuA0oN7qLEJll902Yk4A0DkiFIbgT4YH7XA3LGlYc_Ugjq7HKv90JabyVM1rmWqsyVguLoiW1CTMGXflSNK0tpbkHKhFpx8gOwfd-LTukAwRdq07g9KCs_CjFSKciBg Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f157053f0fe9445a84531ef849861521 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2045958061 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f157053f0fe9445a84531ef849861521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f157053f0fe9445a84531ef849861521"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f157053f0fe9445a84531ef849861521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f157053f0fe9445a84531ef849861521"}]}] Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2045958061 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f157053f0fe9445a84531ef849861521 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2045958061 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersAdminNegativeTestJSON-2045958061-project Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a598123a284943b4a0cd88205e8f1146 Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2045958061-project Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 259e1246-110d-4c3a-96e4-feea029ecb69 could not be found. Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '259e1246-110d-4c3a-96e4-feea029ecb69'} Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259e1246-110d-4c3a-96e4-feea029ecb69 could not be found. Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259e1246-110d-4c3a-96e4-feea029ecb69 could not be found. Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:02.697057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259e1246-110d-4c3a-96e4-feea029ecb69 could not be found. Oct 03 10:37:02.701377 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:02.705387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] Returning 404 to user: Instance 259e1246-110d-4c3a-96e4-feea029ecb69 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:02.708798 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c7b7b34-3f62-4da3-a753-7bb1de015b22 tempest-ServersAdminNegativeTestJSON-2045958061 tempest-ServersAdminNegativeTestJSON-2045958061-project] 10.222.0.27 "GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69" status: 404 len: 111 microversion: 2.1 time: 0.085398 Oct 03 10:37:02.710321 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 924/1834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:02 2022] GET /compute/v2.1/servers/259e1246-110d-4c3a-96e4-feea029ecb69 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:03.114286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:03.115053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:03.133712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:03.134211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:03.134652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:03.140704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:03.144170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:03.144856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:03.300180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:03.312046 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d36cc49-4957-4aad-969d-fba6c3220c3a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1463 microversion: 2.1 time: 0.753159 Oct 03 10:37:03.315244 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 911/1835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:02 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1463 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:03.534051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:03.542397 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-702e389d-5dce-429e-8ad8-e0ed18e900fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.431962 Oct 03 10:37:03.562996 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 925/1836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:03 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:03.571544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:03.575870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:03.597659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:03.598502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:03.599232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:03.601719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:03.603845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:03.605540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:03.721160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:03.770387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:03.771342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:03.780733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:03.783386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:03.786473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:03.794917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:03.795445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:03.796023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:03.951169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:03.961230 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-917ba70b-cba6-4ec4-8b5f-a81ada410be7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.395011 Oct 03 10:37:03.966045 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 926/1837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:03 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:03.984146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:03.985060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:03.995285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.002061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.002843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:04.003767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.004397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.005011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:04.143145 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc5279a2-2a49-43f6-91e2-87f942706593 tempest-MigrationsAdminTest-2056120529 tempest-MigrationsAdminTest-2056120529-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1614 microversion: 2.1 time: 0.803508 Oct 03 10:37:04.144620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 912/1838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:03 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1614 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:04.182692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:04.183485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:04.194723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.197366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.197990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:04.198883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.199500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.201948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:04.277628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:37:04.471530 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64808bb7-de0d-49a8-a552-ce41f74dfab9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "DELETE /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 204 len: 0 microversion: 2.1 time: 0.293316 Oct 03 10:37:04.472482 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 913/1839] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:37:04 2022] DELETE /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:37:04.481209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:04.489427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:04.497331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=20 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:04.504549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.505393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.509210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:04.510240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.510963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.511608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:04.519767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:04.528204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:04.542009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61e4a1e7-ac03-401f-8fb6-ea1a7b78a52c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1557 microversion: 2.1 time: 0.574284 Oct 03 10:37:04.547809 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 927/1840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:03 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1557 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:04.569470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:04.570505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:04.592445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.597995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.598778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:04.599741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:04.600415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:04.601315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:05.029761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:05.042456 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d97fc6ef-8eea-49e9-a543-a5c3e577df63 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1469 microversion: 2.1 time: 0.565509 Oct 03 10:37:05.049788 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 914/1841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:04 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1469 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:05.066057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:05.066930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:05.092718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:05.094404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:05.095758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:05.098159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:05.099577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:05.100941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:05.127140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:05.137959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38a78663-cd33-4414-9291-ce094cdc4f47 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.574269 Oct 03 10:37:05.139676 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 928/1842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:04 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:05.154538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:05.166671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:05.199036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:05.200557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:05.201873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:05.203561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:05.205543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:05.211329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:05.364888 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-763f2d0d-7854-43a8-b98d-aefc3825970c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.313556 Oct 03 10:37:05.365501 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 915/1843] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:37:05 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:06.079639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:06.081094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:06.103109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:06.104747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:06.108357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:06.111639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:06.114749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:06.117821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:06.589108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:06.597979 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5ae8674-ffd8-4944-9d5a-38693af276b9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 1.456207 Oct 03 10:37:06.598839 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 929/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:05 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:06.617914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6e6578be-3da1-4bff-98e3-6a10b74d5093 req-d42fc43d-b2ff-45a3-a44c-bdaa59a8cbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "name": "network-vif-plugged", "status": "completed", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:06.639033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6578be-3da1-4bff-98e3-6a10b74d5093 req-d42fc43d-b2ff-45a3-a44c-bdaa59a8cbfc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:06.639478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6578be-3da1-4bff-98e3-6a10b74d5093 req-d42fc43d-b2ff-45a3-a44c-bdaa59a8cbfc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:06.642686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6578be-3da1-4bff-98e3-6a10b74d5093 req-d42fc43d-b2ff-45a3-a44c-bdaa59a8cbfc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:06.671686 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6e6578be-3da1-4bff-98e3-6a10b74d5093 req-d42fc43d-b2ff-45a3-a44c-bdaa59a8cbfc service nova] Creating event network-vif-plugged:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h2-858383-3 Oct 03 10:37:06.685815 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6e6578be-3da1-4bff-98e3-6a10b74d5093 req-d42fc43d-b2ff-45a3-a44c-bdaa59a8cbfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084673 Oct 03 10:37:06.694402 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 930/1845] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:06.707979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:06.714855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:06.728483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:06.729428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:06.729561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:06.730180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:06.730955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:06.731086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:07.012409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:07.025068 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-244a6fc8-92ab-46dd-9abe-d3c79a485c2a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1469 microversion: 2.1 time: 0.952049 Oct 03 10:37:07.025068 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 916/1846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:06 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1469 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:07.630438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:07.631089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:07.673587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:07.674162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:07.675915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:07.676878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:07.683446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:07.684054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:08.138336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:08.159932 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8dbac4d0-ce3a-405f-927b-f00827760c5c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 1.459770 Oct 03 10:37:08.164069 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 931/1847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:06 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:08.189976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:08.191010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:08.214202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:08.218376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:08.219800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:08.221136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:08.226823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:08.227377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:08.783519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:08.799061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d7a5011f-01c7-49ea-83a6-919b82467ade tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 1.177128 Oct 03 10:37:08.804959 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 917/1848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:07 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:08.808249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:08.819520 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9be01088-5a39-4b67-b7cf-59dda1fd5d83 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 200 len: 1469 microversion: 2.1 time: 0.654351 Oct 03 10:37:08.846467 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 932/1849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:08 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 1469 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:09.185011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:09.187829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:09.199300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:09.200093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:09.200734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:09.203693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:09.204947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:09.206310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:09.446361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2119065917", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:09.538926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:37:10.437888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:37:10.438498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:37:10.439335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:37:10.439730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:37:10.440135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:37:10.455801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.460641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.461400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.462183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.462644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.463069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.512039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Getting quotas for project 8127badec8d542a3834d3a1209daac27. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:10.526737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Getting quotas for user b84a7e72cfe54bae9da6ffedd1e84992 and project 8127badec8d542a3834d3a1209daac27. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:10.555717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:10.567180 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ff73690-0a52-492d-8eac-98c49f098a8c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 1.385940 Oct 03 10:37:10.568473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:37:10.572060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:37:10.576947 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 933/1850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:09 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:10.593346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-82420cd7-08f1-434e-b2d9-39a6838c0c31 req-a94ace2d-ff8d-40f5-825c-1c557ed420c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714143f7-409d-49d5-b36a-aca0ec9d5a30", "name": "network-vif-deleted", "tag": "c09548d8-cb34-4704-adc9-840ebb3a9ab5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:10.619786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-82420cd7-08f1-434e-b2d9-39a6838c0c31 req-a94ace2d-ff8d-40f5-825c-1c557ed420c8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.620267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-82420cd7-08f1-434e-b2d9-39a6838c0c31 req-a94ace2d-ff8d-40f5-825c-1c557ed420c8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.620713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-82420cd7-08f1-434e-b2d9-39a6838c0c31 req-a94ace2d-ff8d-40f5-825c-1c557ed420c8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.641052 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-257a7c3f-d583-4339-a8b3-8620741adbee tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.480801 Oct 03 10:37:10.647045 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-82420cd7-08f1-434e-b2d9-39a6838c0c31 req-a94ace2d-ff8d-40f5-825c-1c557ed420c8 service nova] Creating event network-vif-deleted:c09548d8-cb34-4704-adc9-840ebb3a9ab5 for instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 on n-h2-858383-3 Oct 03 10:37:10.649670 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 918/1851] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:37:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:37:10.656296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:10.657244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:10.664372 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-82420cd7-08f1-434e-b2d9-39a6838c0c31 req-a94ace2d-ff8d-40f5-825c-1c557ed420c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079285 Oct 03 10:37:10.670010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.673626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.674382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.675770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.676466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.677903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.681110 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 934/1852] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:10.695361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:10.696386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 714143f7-409d-49d5-b36a-aca0ec9d5a30] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:10.706788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.707754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.714048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.715114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.716263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.716982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.782143 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] HTTP exception thrown: Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 could not be found. Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Request method failure captured: Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 HTTP/1.1 Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroHFl553rfD6PBhgaINQV0ox9PYyI8sX8CyXZS5_9v7OlLH2Iz3JM4M24vYfY50gErsrk-ruK5HQCvEjxsPh-E1biGsGXuL_Jkjamg2PsdIYrQkNbVQszMn9TbP8ap8kQErU3Nv8QYZ3ClhpRX-44Pc642IMF9WbmHuXVEK89GwNZk Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}] Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: fa6ea468370b4bacb98dd5457b0e6aea Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 could not be found. Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '714143f7-409d-49d5-b36a-aca0ec9d5a30'} Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 could not be found. Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 could not be found. Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:10.784135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 could not be found. Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Returning 404 to user: Instance 714143f7-409d-49d5-b36a-aca0ec9d5a30 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ab63d8ca-568c-42ed-b348-f2fe545f0bf0 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30" status: 404 len: 111 microversion: 2.1 time: 0.099269 Oct 03 10:37:10.793558 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 935/1853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:10 2022] GET /compute/v2.1/servers/714143f7-409d-49d5-b36a-aca0ec9d5a30 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:10.805587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecfb5be3-8cde-4b1a-97fb-129cc2a6af6b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:10.806432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ecfb5be3-8cde-4b1a-97fb-129cc2a6af6b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:10.920170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecfb5be3-8cde-4b1a-97fb-129cc2a6af6b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:10.938708 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ecfb5be3-8cde-4b1a-97fb-129cc2a6af6b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1214 microversion: 2.1 time: 0.144244 Oct 03 10:37:10.952814 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 936/1854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:10 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:10.953529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:10.954005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:10.954005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:10.954163 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cfd710e6-e883-435b-81bd-a6160548f9ca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.302258 Oct 03 10:37:10.963219 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 919/1855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:10 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:10.966970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.966970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.966970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:10.966970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:10.967365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:10.967729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:11.009073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:37:11.144029 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf900dce-f377-4a7d-aadd-76933dc45c5a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 204 len: 0 microversion: 2.1 time: 0.202415 Oct 03 10:37:11.148417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 937/1856] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:37:10 2022] DELETE /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:37:11.154197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:11.155533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:11.171069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:11.171731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:11.171986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:11.172814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:11.173817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:11.182467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:11.305442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9dcbd588-81a8-45b0-a660-ad0f14af11b9 req-8469e494-dcda-49df-a6c7-23d72793a917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71022b1-6680-4a39-941d-79472a4aa61f", "tag": "e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:11.326235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9dcbd588-81a8-45b0-a660-ad0f14af11b9 req-8469e494-dcda-49df-a6c7-23d72793a917 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:11.326765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9dcbd588-81a8-45b0-a660-ad0f14af11b9 req-8469e494-dcda-49df-a6c7-23d72793a917 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:11.327206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9dcbd588-81a8-45b0-a660-ad0f14af11b9 req-8469e494-dcda-49df-a6c7-23d72793a917 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:11.358592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9dcbd588-81a8-45b0-a660-ad0f14af11b9 req-8469e494-dcda-49df-a6c7-23d72793a917 service nova] Creating event network-changed:e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7 for instance c71022b1-6680-4a39-941d-79472a4aa61f on n-h2-858383-3 Oct 03 10:37:11.373883 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9dcbd588-81a8-45b0-a660-ad0f14af11b9 req-8469e494-dcda-49df-a6c7-23d72793a917 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070274 Oct 03 10:37:11.374803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 938/1857] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:37:11.601326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:11.602757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:11.614690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:11.621636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:11.622351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:11.626410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:11.627204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:11.627658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:11.933078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:11.943903 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc6bd54f-3f4e-41cc-8932-585820c3f8d5 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1534 microversion: 2.1 time: 0.794130 Oct 03 10:37:11.949204 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 920/1858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:11 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1534 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:11.968220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:11.968903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:11.978472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:11.986531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:11.987507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:11.988426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:11.989080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:11.989707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:12.023531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:12.035962 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c964a3ed-f111-4fb0-bf0b-8e5191173146 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.439203 Oct 03 10:37:12.038590 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 939/1859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:11 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:12.051142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:12.053378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:12.075092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:12.075603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:12.076057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:12.077037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:12.077507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:12.080282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:12.474165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:12.482824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ae41d57-f6ee-400a-8c89-f6563b49a40e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.442794 Oct 03 10:37:12.484341 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 940/1860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:12 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:12.529344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:12.552223 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de12229f-ede3-4742-bf97-db96852c2e16 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1266 microversion: 2.1 time: 0.589457 Oct 03 10:37:12.560357 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 921/1861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:11 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1266 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:12.753437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-be5fbb1a-30c9-45a7-89c7-e2dce27b4846 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Action: 'create', calling method: .version_select at 0x7f074f1faaf0>, body: {"keypair": {"name": "tempest-keypair-1881983108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWzkjqH6rzsowo3YK9qBzRdA8SOazcksCq1KWnqW6ZDCZvRyqoCNfBYDEMs2pFsmg+Rw4zEtgBcR6LdY75vtn7WL/kRoxXN2Nu/wzcCvDD++0Wm1e8+qYjYbEH2dqCJAw=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:12.776060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-be5fbb1a-30c9-45a7-89c7-e2dce27b4846 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Getting quotas for project acfbece0c17544cd8b1fbc2854ad91ed. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:12.796670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-be5fbb1a-30c9-45a7-89c7-e2dce27b4846 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Getting quotas for user d201f9e124f94e9dae804154df5f0cf5 and project acfbece0c17544cd8b1fbc2854ad91ed. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:12.817975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:12.832911 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-be5fbb1a-30c9-45a7-89c7-e2dce27b4846 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193541 Oct 03 10:37:12.844607 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 941/1862] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:37:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:12.978194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:12.980563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:12.999483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:13.003285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:13.004387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:13.006360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:13.009048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:13.009929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:13.067430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:13.068385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:13.082598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:13.083589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:13.084215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:13.086783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:13.088068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:13.089845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:13.354024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:13.372144 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-23945215-e2d5-4465-878a-e5b1b5bfcf81 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.307914 Oct 03 10:37:13.388384 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 942/1863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:13 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:13.507535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:13.508097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:13.526706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:13.533807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:13.535048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:13.540310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:13.543768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:13.545405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:14.037529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:14.054109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bba8d1bf-b7ca-4918-b0ef-03aea94ed453 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1718 microversion: 2.1 time: 0.550663 Oct 03 10:37:14.054897 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 943/1864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:13 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1718 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:14.067410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:14.067410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:14.087870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:14.090174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:14.090987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:14.094755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:14.095999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:14.096613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:14.170039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:14.275340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:14.292375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9047caeb-c3a0-4c39-8b09-01cfe294a2ae tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1534 microversion: 2.1 time: 1.318563 Oct 03 10:37:14.295666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 922/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:12 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1534 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:14.312319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f198ea8f-82f7-4ac5-8646-38b1d40a54df req-2e59716d-fcda-403f-a204-f1ba7788e354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6694c5f-d423-4df4-ad03-88474f2a0d65", "name": "network-vif-plugged", "status": "completed", "tag": "df81ef11-7a29-4aa2-a522-0e7de13b42e8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:14.356346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f198ea8f-82f7-4ac5-8646-38b1d40a54df req-2e59716d-fcda-403f-a204-f1ba7788e354 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:14.357614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f198ea8f-82f7-4ac5-8646-38b1d40a54df req-2e59716d-fcda-403f-a204-f1ba7788e354 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:14.360489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f198ea8f-82f7-4ac5-8646-38b1d40a54df req-2e59716d-fcda-403f-a204-f1ba7788e354 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:14.382512 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f198ea8f-82f7-4ac5-8646-38b1d40a54df req-2e59716d-fcda-403f-a204-f1ba7788e354 service nova] Creating event network-vif-plugged:df81ef11-7a29-4aa2-a522-0e7de13b42e8 for instance d6694c5f-d423-4df4-ad03-88474f2a0d65 on n-h1-858383-3 Oct 03 10:37:14.396684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f198ea8f-82f7-4ac5-8646-38b1d40a54df req-2e59716d-fcda-403f-a204-f1ba7788e354 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097763 Oct 03 10:37:14.398302 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 923/1866] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:14.407125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:14.409165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:14.420358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:14.421324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:14.422434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:14.424088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:14.425076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:14.426008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:14.520708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:14.531752 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-29a267db-6ef9-4dcb-a731-92d3ab349248 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1272 microversion: 2.1 time: 0.475942 Oct 03 10:37:14.533292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 944/1867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:14 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1272 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:15.090542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:15.091304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:15.109646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.111708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.112487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.114278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.116443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.123128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.163556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:15.179531 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72faf2b7-8184-43f4-8b0c-62a837fa0f32 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.779777 Oct 03 10:37:15.193174 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 924/1868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:14 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:15.316787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:15.319813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:15.330659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.333406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.334091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.335026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.335656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.341098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.552014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:15.564939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-357c5d69-580d-4822-937a-7652a20ca950 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1492 microversion: 2.1 time: 0.252300 Oct 03 10:37:15.570017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 925/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:15 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1492 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:15.583577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:15.584475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:15.608378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.609097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.609727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.610753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.611376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.611969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.727632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:15.750440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-458d5219-eb66-4d9c-8d98-811f3a9d5628 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1708 microversion: 2.1 time: 0.672581 Oct 03 10:37:15.768800 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 945/1870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:15 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1708 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:15.785865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f17b462c-48a8-412e-ad37-36c4506bbe53 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '.version_select at 0x7f074f219d30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:15.794249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f17b462c-48a8-412e-ad37-36c4506bbe53 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.795592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f17b462c-48a8-412e-ad37-36c4506bbe53 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.798004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f17b462c-48a8-412e-ad37-36c4506bbe53 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.848269 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f17b462c-48a8-412e-ad37-36c4506bbe53 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3497 microversion: 2.1 time: 0.068268 Oct 03 10:37:15.856796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 946/1871] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:37:15 2022] GET /compute/v2.1/os-migrations => generated 3497 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:15.863328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fb2da012-47d7-4ed4-8a81-a4e54a3f5fd0 req-acb64100-3477-4ea6-a26e-db2f44f9fb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f552168-2c04-4b3f-a9b3-0f774f3c628a", "name": "network-vif-deleted", "tag": "48633d87-fc05-4a72-ae32-f8e9fd3f4ccf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:15.887700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:15.901002 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c756d4dc-4129-4137-a138-e3a9d252d3a2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1272 microversion: 2.1 time: 0.329610 Oct 03 10:37:15.902432 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 926/1872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:15 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1272 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:15.913014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fb2da012-47d7-4ed4-8a81-a4e54a3f5fd0 req-acb64100-3477-4ea6-a26e-db2f44f9fb8a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.924598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:15.927780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fb2da012-47d7-4ed4-8a81-a4e54a3f5fd0 req-acb64100-3477-4ea6-a26e-db2f44f9fb8a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.928332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fb2da012-47d7-4ed4-8a81-a4e54a3f5fd0 req-acb64100-3477-4ea6-a26e-db2f44f9fb8a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.929785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:15.980859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.985048 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fb2da012-47d7-4ed4-8a81-a4e54a3f5fd0 req-acb64100-3477-4ea6-a26e-db2f44f9fb8a service nova] Creating event network-vif-deleted:48633d87-fc05-4a72-ae32-f8e9fd3f4ccf for instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a on n-h1-858383-3 Oct 03 10:37:15.987721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:15.990980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:15.998435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:15.998580 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fb2da012-47d7-4ed4-8a81-a4e54a3f5fd0 req-acb64100-3477-4ea6-a26e-db2f44f9fb8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146093 Oct 03 10:37:16.000620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:16.003048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:16.011444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 947/1873] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:16.218817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:16.220619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:16.243098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:16.245363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:16.247336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:16.249115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:16.252067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:16.255040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:16.936645 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12b7e08a-72a4-4543-be5b-2e4d246344e3 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1859 microversion: 2.1 time: 1.031970 Oct 03 10:37:16.940148 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 927/1874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:15 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1859 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:16.951264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:16.955905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:16.975237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:16.977292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:16.978269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:16.979108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:16.981569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:16.982137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:16.986715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:17.004348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95fe6d4d-8422-43b0-b00a-a4c37255dc5b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1316 microversion: 2.1 time: 0.791761 Oct 03 10:37:17.006965 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 948/1875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:16 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:17.017606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:17.023167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:17.048043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:17.053176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:17.053176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:17.053176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:17.053904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:17.054015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:17.054015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:17.054213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:17.054312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:17.054618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lazy-loading 'fault' on Instance uuid 2f552168-2c04-4b3f-a9b3-0f774f3c628a {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:37:17.191869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:17.207822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:17.208011 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0de5821b-2fe4-4a6c-9d6a-bf7107ebc91a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 200 len: 1368 microversion: 2.1 time: 0.259617 Oct 03 10:37:17.223153 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 928/1876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:16 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:17.227486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a5e067e-38dc-4012-bfbb-c013a9663b2b tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1272 microversion: 2.1 time: 0.217812 Oct 03 10:37:17.232896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:17.233517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:17.235970 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 949/1877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:17 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:17.246924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:17.247419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:17.247854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:17.248567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:17.263210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:17.263807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:17.940307 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0bcfc71a-df77-48c0-a81d-20a75c122000 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1859 microversion: 2.1 time: 0.715884 Oct 03 10:37:17.956796 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 929/1878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:17 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1859 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:18.030606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:18.031523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:18.055678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.056413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.057057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.060399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.060899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.061546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.109090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:18.109580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:18.119478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:18.134098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.134598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.135037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.135754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.136212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.136629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.400233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lazy-loading 'services' on Instance uuid af81a64b-4ea6-48b9-80fd-a0b4659d39e4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:37:18.401443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:18.413875 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-674464db-5029-478f-ad2d-93548927323e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1504 microversion: 2.1 time: 0.386800 Oct 03 10:37:18.415559 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 950/1879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:18 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:18.423469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:18.428178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2f552168-2c04-4b3f-a9b3-0f774f3c628a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:18.435766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.437186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.437945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.439191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.439871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.440625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.456300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] HTTP exception thrown: Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a could not be found. Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Request method failure captured: Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a HTTP/1.1 Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroHFl553rfD6PBhgaINQV0ox9PYyI8sX8CyXZS5_9v7OlLH2Iz3JM4M24vYfY50gErsrk-ruK5HQCvEjxsPh-E1biGsGXuL_Jkjamg2PsdIYrQkNbVQszMn9TbP8ap8kQErU3Nv8QYZ3ClhpRX-44Pc642IMF9WbmHuXVEK89GwNZk Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}] Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: fa6ea468370b4bacb98dd5457b0e6aea Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a could not be found. Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '2f552168-2c04-4b3f-a9b3-0f774f3c628a'} Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a could not be found. Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a could not be found. Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:18.458189 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a could not be found. Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:18.463243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Returning 404 to user: Instance 2f552168-2c04-4b3f-a9b3-0f774f3c628a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:18.465320 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8a2b523-543b-4cb6-aa2c-5216afcf103a tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a" status: 404 len: 111 microversion: 2.1 time: 0.047625 Oct 03 10:37:18.469799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 951/1880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:18 2022] GET /compute/v2.1/servers/2f552168-2c04-4b3f-a9b3-0f774f3c628a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:18.474215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:18.475410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:18.484588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.485482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.486699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.487612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.489045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.489799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.551854 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2fd42ffc-947c-45f1-af19-32f9146fc228 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments/a5707151-4d1a-41c1-a50b-a6f40bb86005" status: 202 len: 0 microversion: 2.1 time: 0.446837 Oct 03 10:37:18.556819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 930/1881] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:37:18 2022] DELETE /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments/a5707151-4d1a-41c1-a50b-a6f40bb86005 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:37:18.576811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2101724793"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:18.580114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:18.592342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.593833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.594724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.595852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.596555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.597275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.628957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:18.736973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:18.747949 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bfd77a9-ce66-43d4-bf99-13623622c1fa tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.278686 Oct 03 10:37:18.749341 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 952/1882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:18 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:18.755999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59a35ecd-6c58-4059-aeb9-eb564918ca3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '.version_select at 0x7f075756c160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:18.784385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59a35ecd-6c58-4059-aeb9-eb564918ca3d tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212917802" status: 202 len: 0 microversion: 2.1 time: 0.032374 Oct 03 10:37:18.785848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 953/1883] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:37:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212917802 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:37:18.808400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:18.817976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:18.832499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.833024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.833837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.834561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:18.835979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:18.837159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:18.906556 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c1f0c6b-bb9f-4bd5-9481-8188200efe1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117727 Oct 03 10:37:18.907603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 954/1884] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:18 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:19.771988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:19.772655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:19.799637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:19.800312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:19.800653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:19.807028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:19.810947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:19.811431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:20.106791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:20.117024 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f4924b6-45b4-4315-9821-8dbe06438eb3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.348783 Oct 03 10:37:20.119568 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 955/1885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:19 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:20.125730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:20.128630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:20.135257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:20.135915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:20.136536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:20.137451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:20.140124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:20.141292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:20.196282 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8981a7a2-dc9a-454e-b931-ec02b3266ea0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074658 Oct 03 10:37:20.196931 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 956/1886] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:20 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:20.209725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:20.210243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:20.227047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:20.227551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:20.229852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:20.230749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:20.235440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:20.236112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:20.300079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:37:20.325507 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.network.security_group_api [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Adding security group 0561242a-6152-44be-bca9-3257f318c5aa to port df81ef11-7a29-4aa2-a522-0e7de13b42e8 Oct 03 10:37:20.420484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28fb8980-f2a0-4e36-90cf-58baefb74c4e tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 204 len: 0 microversion: 2.1 time: 0.222163 Oct 03 10:37:20.422140 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 957/1887] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:37:20 2022] DELETE /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:37:20.431853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:20.432576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:20.441565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:20.442069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:20.442518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:20.443231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:20.443693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:20.444441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:20.484039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:20.542875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:20.730118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:20.741236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b26bac5c-f4d1-4d82-9820-39f607d803dc tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1469 microversion: 2.1 time: 0.313994 Oct 03 10:37:20.742280 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 958/1888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:20 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1469 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:21.154659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:21.156119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:21.186989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:21.188912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:21.190582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:21.193222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:21.194291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:21.194784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:21.377579 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-661b9ed9-5806-43ea-8c58-9b2a30595bbd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65/action" status: 202 len: 0 microversion: 2.1 time: 2.818855 Oct 03 10:37:21.378699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 931/1889] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:37:18 2022] POST /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65/action => generated 0 bytes in 2821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:37:21.389636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-cf03e549-ae87-4bff-bc93-9c805d23d503 req-725571ba-29ed-4be9-9e51-2d58cc5ac106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "190fc678-4443-461f-a07b-3a4ffd44f740", "tag": "638cf30f-c6bd-4471-9622-caa065a6927d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:21.410872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cf03e549-ae87-4bff-bc93-9c805d23d503 req-725571ba-29ed-4be9-9e51-2d58cc5ac106 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:21.412077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cf03e549-ae87-4bff-bc93-9c805d23d503 req-725571ba-29ed-4be9-9e51-2d58cc5ac106 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:21.413728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cf03e549-ae87-4bff-bc93-9c805d23d503 req-725571ba-29ed-4be9-9e51-2d58cc5ac106 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:21.453199 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-cf03e549-ae87-4bff-bc93-9c805d23d503 req-725571ba-29ed-4be9-9e51-2d58cc5ac106 service nova] Creating event network-changed:638cf30f-c6bd-4471-9622-caa065a6927d for instance 190fc678-4443-461f-a07b-3a4ffd44f740 on n-h2-858383-3 Oct 03 10:37:21.471893 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-cf03e549-ae87-4bff-bc93-9c805d23d503 req-725571ba-29ed-4be9-9e51-2d58cc5ac106 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091781 Oct 03 10:37:21.472889 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 932/1890] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:21.475661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:21.488584 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f0b01f7-1f47-4024-8f27-14940058fdf3 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.347294 Oct 03 10:37:21.489267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 959/1891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:21 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:21.497491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:21.499998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:21.523224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:21.524339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:21.530097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:21.531498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:21.535025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:21.538267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:21.577842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bea152e9-f252-4d99-8eac-60f6605252ad tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Calling method '.version_select at 0x7f074f8b7ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:21.624708 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58ab7f44-e979-4c37-89bb-f3c69b3dd4a0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132675 Oct 03 10:37:21.625760 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 960/1892] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:21 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:21.631636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-953417032"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:21.632272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:21.647391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:21.647391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:21.647915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:21.648656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:21.649159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:21.649587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:21.693825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-bea152e9-f252-4d99-8eac-60f6605252ad tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:21.694636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.security_group_api [None req-bea152e9-f252-4d99-8eac-60f6605252ad tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Neutron security group b0006bdc-f476-429f-bc0d-a94e217d5a00 not found {{(pid=122270) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:37:21.695432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-bea152e9-f252-4d99-8eac-60f6605252ad tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] HTTP exception thrown: Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist Oct 03 10:37:21.695432 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-f2f858ff-d6dc-431b-990f-e315efa7e924'] Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bea152e9-f252-4d99-8eac-60f6605252ad tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Request method failure captured: Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-security-groups/b0006bdc-f476-429f-bc0d-a94e217d5a00 HTTP/1.1 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtgD9K6V8Lm2Jz83H9mHr3z3i4bVu_UJKlwPDyb5fudh0zU48Clj8vjrnpr-f-OvlQFsfkeJS0Tj8UBBIQZkFwNUsHx2cjh2Lzp4qfMWHQRcbp9Z8vpviWvFWtmKalMSqUxEiqWLZjO57lEZeW3JcnsWNrrJfMjEOxxmJ-i10-tbRM Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f44b8c30d7f44a929d351e790426289e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}] Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: da5344ebab7e4c5b84bf252964a96c1a Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: exception: Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-f2f858ff-d6dc-431b-990f-e315efa7e924'] Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b0006bdc-f476-429f-bc0d-a94e217d5a00'} Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:21.718792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2f858ff-d6dc-431b-990f-e315efa7e924'] Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2f858ff-d6dc-431b-990f-e315efa7e924'] Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2f858ff-d6dc-431b-990f-e315efa7e924'] Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2f858ff-d6dc-431b-990f-e315efa7e924'] Oct 03 10:37:21.723460 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:21.728193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bea152e9-f252-4d99-8eac-60f6605252ad tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Returning 404 to user: Security group b0006bdc-f476-429f-bc0d-a94e217d5a00 does not exist Oct 03 10:37:21.728193 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-f2f858ff-d6dc-431b-990f-e315efa7e924'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:21.729394 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bea152e9-f252-4d99-8eac-60f6605252ad tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b0006bdc-f476-429f-bc0d-a94e217d5a00" status: 404 len: 194 microversion: 2.1 time: 0.255157 Oct 03 10:37:21.730160 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 933/1893] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:37:21 2022] DELETE /compute/v2.1/os-security-groups/b0006bdc-f476-429f-bc0d-a94e217d5a00 => generated 194 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:21.740980 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5652768e-f763-4ff8-a73f-9504afecb3cb tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005538 Oct 03 10:37:21.742052 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 934/1894] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 3 10:37:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 10:37:21.751948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71e0626d-fe57-4fbd-9085-803501ec1614 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Calling method '.version_select at 0x7f074f0e3ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:21.963935 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.network.security_group_api [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Adding security group fe22f468-2152-4f3d-a323-90ff9d3f41e7 to port df81ef11-7a29-4aa2-a522-0e7de13b42e8 Oct 03 10:37:22.339040 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71e0626d-fe57-4fbd-9085-803501ec1614 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.592095 Oct 03 10:37:22.339958 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 935/1895] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:37:21 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:22.346190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:22.347182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:22.367228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:22.379867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:22.380991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:22.381947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:22.384431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:22.385110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:22.712321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-49a53a8c-6bbc-42b3-8012-37831a70f491 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65/action" status: 202 len: 0 microversion: 2.1 time: 1.084883 Oct 03 10:37:22.713882 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 961/1896] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:37:21 2022] POST /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65/action => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:37:22.720736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b589f16d-114e-4a5f-8ddd-8ea8b1d6c897 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Calling method '.version_select at 0x7f074f219820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:22.807994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:23.151924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-b589f16d-114e-4a5f-8ddd-8ea8b1d6c897 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:23.154175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b589f16d-114e-4a5f-8ddd-8ea8b1d6c897 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 03 10:37:23.154175 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-efad2883-8434-41b2-8f9f-a8d2b2a65218'] Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b589f16d-114e-4a5f-8ddd-8ea8b1d6c897 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Request method failure captured: Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-groups/09052fc3-332d-4af6-8d98-5ce5002042a1 HTTP/1.1 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtgD9K6V8Lm2Jz83H9mHr3z3i4bVu_UJKlwPDyb5fudh0zU48Clj8vjrnpr-f-OvlQFsfkeJS0Tj8UBBIQZkFwNUsHx2cjh2Lzp4qfMWHQRcbp9Z8vpviWvFWtmKalMSqUxEiqWLZjO57lEZeW3JcnsWNrrJfMjEOxxmJ-i10-tbRM Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f44b8c30d7f44a929d351e790426289e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}] Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: da5344ebab7e4c5b84bf252964a96c1a Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: exception: Insufficient rights for removing default security group. Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-efad2883-8434-41b2-8f9f-a8d2b2a65218'] Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '09052fc3-332d-4af6-8d98-5ce5002042a1'} Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:23.158069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efad2883-8434-41b2-8f9f-a8d2b2a65218'] Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efad2883-8434-41b2-8f9f-a8d2b2a65218'] Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efad2883-8434-41b2-8f9f-a8d2b2a65218'] Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efad2883-8434-41b2-8f9f-a8d2b2a65218'] Oct 03 10:37:23.162881 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.167495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b589f16d-114e-4a5f-8ddd-8ea8b1d6c897 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 03 10:37:23.167495 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-efad2883-8434-41b2-8f9f-a8d2b2a65218'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:23.168631 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b589f16d-114e-4a5f-8ddd-8ea8b1d6c897 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/09052fc3-332d-4af6-8d98-5ce5002042a1" status: 400 len: 182 microversion: 2.1 time: 0.453366 Oct 03 10:37:23.169774 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 962/1897] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:37:22 2022] DELETE /compute/v2.1/os-security-groups/09052fc3-332d-4af6-8d98-5ce5002042a1 => generated 182 bytes in 455 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:37:23.190226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:23.191125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:23.208674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.209436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.210066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.210957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.214450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.215120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.377978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:23.391833 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cfba6051-1f96-4bf0-a8b1-3a1502c3e6c8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1469 microversion: 2.1 time: 1.050150 Oct 03 10:37:23.394842 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 936/1898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:22 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1469 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:23.400424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:23.403030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:23.409942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.411827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.412564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.413527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.414299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.414893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.498359 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22eb3256-a490-42e7-9ea8-d8e24ac9af1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101657 Oct 03 10:37:23.501071 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 937/1899] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:23 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:23.513482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:23.514271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:23.529039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.530473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.531734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.532699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.533987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.536910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.552147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:23.554588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:23.561505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-97b256f6-c4ef-476b-8d79-2057ad0c7789 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.390203 Oct 03 10:37:23.569143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 963/1900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:23 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:23.579220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6ff5129e-b8ed-495d-9d25-dfec94d3c351 req-8613b120-a975-4ae7-a999-984d3130b833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6694c5f-d423-4df4-ad03-88474f2a0d65", "tag": "df81ef11-7a29-4aa2-a522-0e7de13b42e8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:23.623092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ff5129e-b8ed-495d-9d25-dfec94d3c351 req-8613b120-a975-4ae7-a999-984d3130b833 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.631024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ff5129e-b8ed-495d-9d25-dfec94d3c351 req-8613b120-a975-4ae7-a999-984d3130b833 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.633305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ff5129e-b8ed-495d-9d25-dfec94d3c351 req-8613b120-a975-4ae7-a999-984d3130b833 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.679043 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6ff5129e-b8ed-495d-9d25-dfec94d3c351 req-8613b120-a975-4ae7-a999-984d3130b833 service nova] Creating event network-changed:df81ef11-7a29-4aa2-a522-0e7de13b42e8 for instance d6694c5f-d423-4df4-ad03-88474f2a0d65 on n-h1-858383-3 Oct 03 10:37:23.698242 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6ff5129e-b8ed-495d-9d25-dfec94d3c351 req-8613b120-a975-4ae7-a999-984d3130b833 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127522 Oct 03 10:37:23.698983 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 964/1901] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:23.708727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10d3fe67-7200-43f1-b76c-0b65b936dbe3 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Calling method '.version_select at 0x7f07575cc820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:23.800987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-10d3fe67-7200-43f1-b76c-0b65b936dbe3 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:23.801608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-10d3fe67-7200-43f1-b76c-0b65b936dbe3 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Neutron security group caf2053d-ecd2-4292-8ea8-925881385ebb not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:37:23.802122 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-10d3fe67-7200-43f1-b76c-0b65b936dbe3 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] HTTP exception thrown: Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist Oct 03 10:37:23.802122 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-7ef9e743-d34f-4d38-bafd-573fc8b6c596'] Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10d3fe67-7200-43f1-b76c-0b65b936dbe3 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Request method failure captured: Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-security-groups/caf2053d-ecd2-4292-8ea8-925881385ebb HTTP/1.1 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtgD9K6V8Lm2Jz83H9mHr3z3i4bVu_UJKlwPDyb5fudh0zU48Clj8vjrnpr-f-OvlQFsfkeJS0Tj8UBBIQZkFwNUsHx2cjh2Lzp4qfMWHQRcbp9Z8vpviWvFWtmKalMSqUxEiqWLZjO57lEZeW3JcnsWNrrJfMjEOxxmJ-i10-tbRM Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f44b8c30d7f44a929d351e790426289e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}] Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: da5344ebab7e4c5b84bf252964a96c1a Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-7ef9e743-d34f-4d38-bafd-573fc8b6c596'] Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'caf2053d-ecd2-4292-8ea8-925881385ebb'} Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:23.804077 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ef9e743-d34f-4d38-bafd-573fc8b6c596'] Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ef9e743-d34f-4d38-bafd-573fc8b6c596'] Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ef9e743-d34f-4d38-bafd-573fc8b6c596'] Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ef9e743-d34f-4d38-bafd-573fc8b6c596'] Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10d3fe67-7200-43f1-b76c-0b65b936dbe3 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Returning 404 to user: Security group caf2053d-ecd2-4292-8ea8-925881385ebb does not exist Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-7ef9e743-d34f-4d38-bafd-573fc8b6c596'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10d3fe67-7200-43f1-b76c-0b65b936dbe3 tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/caf2053d-ecd2-4292-8ea8-925881385ebb" status: 404 len: 194 microversion: 2.1 time: 0.105576 Oct 03 10:37:23.810633 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 965/1902] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:37:23 2022] GET /compute/v2.1/os-security-groups/caf2053d-ecd2-4292-8ea8-925881385ebb => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:23.814334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b5b62487-f836-4c6f-8231-459f4a5aa545 req-84eeb095-00a2-4658-ba74-58197bfb0228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6694c5f-d423-4df4-ad03-88474f2a0d65", "tag": "df81ef11-7a29-4aa2-a522-0e7de13b42e8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:23.834816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b5b62487-f836-4c6f-8231-459f4a5aa545 req-84eeb095-00a2-4658-ba74-58197bfb0228 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:23.835447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b5b62487-f836-4c6f-8231-459f4a5aa545 req-84eeb095-00a2-4658-ba74-58197bfb0228 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:23.835977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b5b62487-f836-4c6f-8231-459f4a5aa545 req-84eeb095-00a2-4658-ba74-58197bfb0228 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:23.853689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b5b62487-f836-4c6f-8231-459f4a5aa545 req-84eeb095-00a2-4658-ba74-58197bfb0228 service nova] Creating event network-changed:df81ef11-7a29-4aa2-a522-0e7de13b42e8 for instance d6694c5f-d423-4df4-ad03-88474f2a0d65 on n-h1-858383-3 Oct 03 10:37:23.863082 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b5b62487-f836-4c6f-8231-459f4a5aa545 req-84eeb095-00a2-4658-ba74-58197bfb0228 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053627 Oct 03 10:37:23.865967 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 966/1903] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:23.872002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c33ac7a-8266-40d8-8ddb-2eafc46f44df tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Action: 'update', calling method: .version_select at 0x7f0757565e50>, body: {"security_group": {"name": "tempest-sg-429738296", "description": "tempest-description-147037741"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:24.073453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-8c33ac7a-8266-40d8-8ddb-2eafc46f44df tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:24.074424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-8c33ac7a-8266-40d8-8ddb-2eafc46f44df tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Neutron security group 18adcaad-cbc1-4c34-ab35-f0c819288992 not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:37:24.075030 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-8c33ac7a-8266-40d8-8ddb-2eafc46f44df tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] HTTP exception thrown: Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist Oct 03 10:37:24.075030 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-257b05b9-f860-4f7e-9265-52e8e91dfca9'] Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c33ac7a-8266-40d8-8ddb-2eafc46f44df tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Request method failure captured: Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/os-security-groups/18adcaad-cbc1-4c34-ab35-f0c819288992 HTTP/1.1 Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 100 Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtgD9K6V8Lm2Jz83H9mHr3z3i4bVu_UJKlwPDyb5fudh0zU48Clj8vjrnpr-f-OvlQFsfkeJS0Tj8UBBIQZkFwNUsHx2cjh2Lzp4qfMWHQRcbp9Z8vpviWvFWtmKalMSqUxEiqWLZjO57lEZeW3JcnsWNrrJfMjEOxxmJ-i10-tbRM Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f44b8c30d7f44a929d351e790426289e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f44b8c30d7f44a929d351e790426289e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f44b8c30d7f44a929d351e790426289e"}]}] Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f44b8c30d7f44a929d351e790426289e Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233 Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: da5344ebab7e4c5b84bf252964a96c1a Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1337396233-project Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: {"security_group": {"name": "tempest-sg-429738296", "description": "tempest-description-147037741"}} Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-257b05b9-f860-4f7e-9265-52e8e91dfca9'] Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '18adcaad-cbc1-4c34-ab35-f0c819288992', 'body': {'security_group': {'name': 'tempest-sg-429738296', 'description': 'tempest-description-147037741'}}} Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:24.077179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-257b05b9-f860-4f7e-9265-52e8e91dfca9'] Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-257b05b9-f860-4f7e-9265-52e8e91dfca9'] Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-257b05b9-f860-4f7e-9265-52e8e91dfca9'] Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-257b05b9-f860-4f7e-9265-52e8e91dfca9'] Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c33ac7a-8266-40d8-8ddb-2eafc46f44df tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] Returning 404 to user: Security group 18adcaad-cbc1-4c34-ab35-f0c819288992 does not exist Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-257b05b9-f860-4f7e-9265-52e8e91dfca9'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:24.081593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c33ac7a-8266-40d8-8ddb-2eafc46f44df tempest-SecurityGroupsNegativeTestJSON-1337396233 tempest-SecurityGroupsNegativeTestJSON-1337396233-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/18adcaad-cbc1-4c34-ab35-f0c819288992" status: 404 len: 194 microversion: 2.1 time: 0.211719 Oct 03 10:37:24.085998 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 967/1904] 10.222.0.27 () {60 vars in 1290 bytes} [Mon Oct 3 10:37:23 2022] PUT /compute/v2.1/os-security-groups/18adcaad-cbc1-4c34-ab35-f0c819288992 => generated 194 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:24.327839 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b9dd6be-d473-4d86-8340-4d55c5c7bfa8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.824874 Oct 03 10:37:24.328964 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 938/1905] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 3 10:37:23 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65/os-security-groups => generated 1158 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:24.347107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a6e55ee-330e-44b5-b7b2-25f9b9026f61 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f074f6a3ca0>, body: {"security_group": {"name": " tempest-securitygroup -1478025435 ", "description": "tempest-description-1272755038"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:24.422557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:24.423993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:24.437643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:24.438452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:24.439098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:24.440009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:24.441604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:24.442820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:24.514069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:24.515500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:24.516171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:24.516967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lazy-loading 'fault' on Instance uuid f1ec7889-ef50-4158-a548-945a648bbd6f {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:37:24.608750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:24.621235 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d6d70d0e-d976-4e34-8144-3a62aa564047 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1303 microversion: 2.1 time: 0.203454 Oct 03 10:37:24.624522 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 939/1906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:24 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:24.634953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:24.650996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:24.675934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:24.676519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:24.677312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:24.679872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:24.682390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:24.683321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:24.774551 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47c1386d-fa39-43b7-8b3f-9bf25bad29b0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145918 Oct 03 10:37:24.777786 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 940/1907] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:24 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:24.789155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:24.792268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:24.803279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:24.809249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:24.811080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:24.813265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:24.816850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:24.817600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:25.373638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:25.387478 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b35c6e1e-3051-48f1-97b9-e5fe47cb3119 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.607824 Oct 03 10:37:25.405195 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 941/1908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:24 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:25.645913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:25.647449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:25.681805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:25.688209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:25.691411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:25.702276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:25.704133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:25.707513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:25.826961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:25.829942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:25.832300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:25.835599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lazy-loading 'fault' on Instance uuid f1ec7889-ef50-4158-a548-945a648bbd6f {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:37:25.842843 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a6e55ee-330e-44b5-b7b2-25f9b9026f61 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.500761 Oct 03 10:37:25.843911 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 968/1909] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:37:24 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:25.849835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:25.854331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:25.870324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:25.871217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:25.874219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:25.875223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:25.875695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:25.876127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:25.921999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:25.931593 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d52d6488-0cc5-47ca-8a64-103f2930dcd9 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 200 len: 1303 microversion: 2.1 time: 0.290916 Oct 03 10:37:25.936407 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 942/1910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:25 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 1303 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:25.947623 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f19e6bd1-cf56-46ca-a6d4-7e391f8d0987 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102378 Oct 03 10:37:25.951921 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 969/1911] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:25 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:25.957519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40ab0572-9245-48ce-bb7d-9606e1ff0f2d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f075751c820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:25.962291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ac370d07-9b6e-4cc3-87ac-de44ea26f554 req-8105e114-cdf5-4c97-a999-3f8c1a19b627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ec7889-ef50-4158-a548-945a648bbd6f", "name": "network-vif-deleted", "tag": "de529bdc-d7ad-4cfd-bf71-a8bca22179f9"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:25.987367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac370d07-9b6e-4cc3-87ac-de44ea26f554 req-8105e114-cdf5-4c97-a999-3f8c1a19b627 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:25.990883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac370d07-9b6e-4cc3-87ac-de44ea26f554 req-8105e114-cdf5-4c97-a999-3f8c1a19b627 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:25.993899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac370d07-9b6e-4cc3-87ac-de44ea26f554 req-8105e114-cdf5-4c97-a999-3f8c1a19b627 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:26.021468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ac370d07-9b6e-4cc3-87ac-de44ea26f554 req-8105e114-cdf5-4c97-a999-3f8c1a19b627 service nova] Creating event network-vif-deleted:de529bdc-d7ad-4cfd-bf71-a8bca22179f9 for instance f1ec7889-ef50-4158-a548-945a648bbd6f on n-h2-858383-3 Oct 03 10:37:26.034186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ac370d07-9b6e-4cc3-87ac-de44ea26f554 req-8105e114-cdf5-4c97-a999-3f8c1a19b627 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080712 Oct 03 10:37:26.039755 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 970/1912] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:26.183943 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40ab0572-9245-48ce-bb7d-9606e1ff0f2d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578" status: 200 len: 224 microversion: 2.1 time: 0.246519 Oct 03 10:37:26.184970 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 943/1913] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:37:25 2022] GET /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578 => generated 224 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:26.198183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f4f35150-49ba-4028-a26e-3f2630bd3219 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f0757578040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:26.414286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:26.415441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:26.431817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:26.433339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:26.435480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:26.441043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:26.441821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:26.443362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:26.979033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:27.010032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ca1fc6a-9363-4020-9c4c-b303ae9c42a5 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.602627 Oct 03 10:37:27.011585 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 944/1914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:26 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:27.043760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:27.046201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:27.074721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.075214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.081944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.082720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.090354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.090857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.191256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7357b685-d8dd-4683-bec9-736db43dc873 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178279 Oct 03 10:37:27.196383 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 945/1915] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:27 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:27.205393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:27.207297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: f1ec7889-ef50-4158-a548-945a648bbd6f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:27.215146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.215977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.216639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.217610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.221710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.222742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.241514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] HTTP exception thrown: Instance f1ec7889-ef50-4158-a548-945a648bbd6f could not be found. Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Request method failure captured: Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f HTTP/1.1 Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroHFl553rfD6PBhgaINQV0ox9PYyI8sX8CyXZS5_9v7OlLH2Iz3JM4M24vYfY50gErsrk-ruK5HQCvEjxsPh-E1biGsGXuL_Jkjamg2PsdIYrQkNbVQszMn9TbP8ap8kQErU3Nv8QYZ3ClhpRX-44Pc642IMF9WbmHuXVEK89GwNZk Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}] Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: fa6ea468370b4bacb98dd5457b0e6aea Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance f1ec7889-ef50-4158-a548-945a648bbd6f could not be found. Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f1ec7889-ef50-4158-a548-945a648bbd6f'} Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ec7889-ef50-4158-a548-945a648bbd6f could not be found. Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ec7889-ef50-4158-a548-945a648bbd6f could not be found. Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:27.243444 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.247939 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:27.247939 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:27.247939 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:27.247939 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:27.247939 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:27.247939 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ec7889-ef50-4158-a548-945a648bbd6f could not be found. Oct 03 10:37:27.247939 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.255277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Returning 404 to user: Instance f1ec7889-ef50-4158-a548-945a648bbd6f could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:27.257233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e748c1d-d214-431f-8b0d-c1523cad4df8 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f" status: 404 len: 111 microversion: 2.1 time: 0.059676 Oct 03 10:37:27.258395 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 946/1916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:27 2022] GET /compute/v2.1/servers/f1ec7889-ef50-4158-a548-945a648bbd6f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:27.271952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:27.273385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:27.283697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.285071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.285864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.286868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.287695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.288561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.335476 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f4f35150-49ba-4028-a26e-3f2630bd3219 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578" status: 202 len: 0 microversion: 2.1 time: 1.141304 Oct 03 10:37:27.336459 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 971/1917] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:37:26 2022] DELETE /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578 => generated 0 bytes in 1143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:37:27.346314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14910f1e-1f34-4aa9-b460-175414fbae7a tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074f721e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:27.366735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:37:27.441330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-14910f1e-1f34-4aa9-b460-175414fbae7a tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:27.443011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-14910f1e-1f34-4aa9-b460-175414fbae7a tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:37:27.443737 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-14910f1e-1f34-4aa9-b460-175414fbae7a tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:37:27.443737 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-af61ba4b-8b5d-4514-bfa7-4f871cf8229c'] Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14910f1e-1f34-4aa9-b460-175414fbae7a tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578 HTTP/1.1 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-af61ba4b-8b5d-4514-bfa7-4f871cf8229c'] Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd71c3577-a3f0-4cb4-985f-6e98c4e23578'} Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:27.446396 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af61ba4b-8b5d-4514-bfa7-4f871cf8229c'] Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af61ba4b-8b5d-4514-bfa7-4f871cf8229c'] Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af61ba4b-8b5d-4514-bfa7-4f871cf8229c'] Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af61ba4b-8b5d-4514-bfa7-4f871cf8229c'] Oct 03 10:37:27.452363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:27.459070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14910f1e-1f34-4aa9-b460-175414fbae7a tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:37:27.459070 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-af61ba4b-8b5d-4514-bfa7-4f871cf8229c'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:27.459070 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14910f1e-1f34-4aa9-b460-175414fbae7a tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578" status: 404 len: 194 microversion: 2.1 time: 0.117833 Oct 03 10:37:27.459070 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 972/1918] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:37:27 2022] GET /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578 => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:37:27.482659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa863d30-507a-4b6f-b186-a4cc9d145597 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f07575b1820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1528931561", "description": "tempest-description-1393278673"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:27.710228 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-84a144e4-1cf5-49bf-9c98-969281945916 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 204 len: 0 microversion: 2.1 time: 0.444676 Oct 03 10:37:27.711646 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 947/1919] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:37:27 2022] DELETE /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:37:27.726104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:27.729394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:27.743428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.744021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.744526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.745628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:27.746726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:27.747281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:27.986120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:28.001378 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc5ce51c-ea14-4d16-bb4b-2d58bc7fb237 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1469 microversion: 2.1 time: 0.283579 Oct 03 10:37:28.004309 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 948/1920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:27 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:28.041554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:28.044162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:28.054362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:28.056179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:28.057981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:28.060276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:28.064214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:28.067114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:28.373754 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa863d30-507a-4b6f-b186-a4cc9d145597 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.908140 Oct 03 10:37:28.383504 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 973/1921] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:37:27 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:28.386673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:28.394933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:28.417570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:28.424565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:28.426605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:28.427548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:28.430680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:28.431335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:28.469717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:28.479965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-877f5f81-7593-4ad0-9898-25ed561c5154 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.443332 Oct 03 10:37:28.480559 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 949/1922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:28 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:28.493626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f28b60d-a75b-41cb-b0de-9567fcec8611 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f0757565f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1109076950", "description": "tempest-description-1205276284"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:28.503812 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b31abc4a-7a14-4ce5-8e70-fff97f2d631e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121501 Oct 03 10:37:28.507141 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 974/1923] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:28 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:28.820099 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f28b60d-a75b-41cb-b0de-9567fcec8611 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.338010 Oct 03 10:37:28.821778 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 950/1924] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:37:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:28.835286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e89b8a70-6c6a-46ba-ac9a-b227e3763325 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f0757578d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1099841539", "description": "tempest-description-1900490134"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:29.038471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:29.039264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:29.050816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:29.051245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:29.051911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:29.054405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:29.056451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:29.057203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:29.278119 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e89b8a70-6c6a-46ba-ac9a-b227e3763325 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.446788 Oct 03 10:37:29.278743 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 975/1925] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:37:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:29.284067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0aac926c-29a6-4f0e-ba0b-d6c239173e44 req-d2ccb4d9-37f6-4ca7-a790-b60379d5f367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190fc678-4443-461f-a07b-3a4ffd44f740", "name": "network-vif-plugged", "status": "completed", "tag": "638cf30f-c6bd-4471-9622-caa065a6927d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:29.306402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0aac926c-29a6-4f0e-ba0b-d6c239173e44 req-d2ccb4d9-37f6-4ca7-a790-b60379d5f367 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:29.307610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0aac926c-29a6-4f0e-ba0b-d6c239173e44 req-d2ccb4d9-37f6-4ca7-a790-b60379d5f367 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:29.308428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0aac926c-29a6-4f0e-ba0b-d6c239173e44 req-d2ccb4d9-37f6-4ca7-a790-b60379d5f367 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:29.327588 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0aac926c-29a6-4f0e-ba0b-d6c239173e44 req-d2ccb4d9-37f6-4ca7-a790-b60379d5f367 service nova] Creating event network-vif-plugged:638cf30f-c6bd-4471-9622-caa065a6927d for instance 190fc678-4443-461f-a07b-3a4ffd44f740 on n-h2-858383-3 Oct 03 10:37:29.347017 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0aac926c-29a6-4f0e-ba0b-d6c239173e44 req-d2ccb4d9-37f6-4ca7-a790-b60379d5f367 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066571 Oct 03 10:37:29.348717 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 976/1926] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:29.370190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:29.370855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b9abd26-1757-45ca-bd05-ed589024c5f4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f0757565af0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:29.380123 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-712b31e8-d52f-44be-a171-20db9ea22e0f tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1469 microversion: 2.1 time: 0.345667 Oct 03 10:37:29.381412 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 951/1927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:29 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:29.503029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:29.504808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:29.512948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:29.518027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:29.518495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:29.519324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:29.519790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:29.520224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:29.789224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:29.794329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:29.800393 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ddefb04-75ff-4cd4-a344-9072291e03ce tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.301183 Oct 03 10:37:29.801719 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 952/1928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:29 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:29.810481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:29.813620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:29.822028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:29.825264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:29.825740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:29.829090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:29.830411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:29.833715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:29.915970 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d9170f7-388f-4c48-a4d2-1e3af28ebf2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112089 Oct 03 10:37:29.919705 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 953/1929] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:37:29 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:37:30.326899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1fb801df-8bb5-4bf0-a933-006618917ed1 req-19532182-d9a0-411c-8a58-b70fa4afc77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd0ee96-4df2-4007-a07c-bf659b2b569f", "name": "network-vif-deleted", "tag": "8b97993e-7063-4fa2-9c8e-a65af6ae95d8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:30.344962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1fb801df-8bb5-4bf0-a933-006618917ed1 req-19532182-d9a0-411c-8a58-b70fa4afc77e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:30.345799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1fb801df-8bb5-4bf0-a933-006618917ed1 req-19532182-d9a0-411c-8a58-b70fa4afc77e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:30.346482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1fb801df-8bb5-4bf0-a933-006618917ed1 req-19532182-d9a0-411c-8a58-b70fa4afc77e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:30.365886 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1fb801df-8bb5-4bf0-a933-006618917ed1 req-19532182-d9a0-411c-8a58-b70fa4afc77e service nova] Creating event network-vif-deleted:8b97993e-7063-4fa2-9c8e-a65af6ae95d8 for instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f on n-h1-858383-3 Oct 03 10:37:30.374916 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1fb801df-8bb5-4bf0-a933-006618917ed1 req-19532182-d9a0-411c-8a58-b70fa4afc77e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051546 Oct 03 10:37:30.384208 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 954/1930] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:30.406709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:30.407493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:30.432341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:30.432757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:30.433226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:30.433947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:30.434411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:30.434845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:30.520360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6ea468370b4bacb98dd5457b0e6aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c1c5f2ee554c8688e754dd17bf5adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:30.529672 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7eed4315-579c-4f07-b97d-d8a0417db2b1 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 200 len: 1298 microversion: 2.1 time: 0.127585 Oct 03 10:37:30.531044 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 955/1931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:30 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:30.536503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1978051996", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4237c513-9590-4957-9766-25a24a956f31"}], "block_device_mapping_v2": [{"uuid": "a8fd9baa-d51a-413e-937a-2e800d6fd464", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:30.616989 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b9abd26-1757-45ca-bd05-ed589024c5f4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1836 microversion: 2.1 time: 1.266109 Oct 03 10:37:30.618811 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 977/1932] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:37:29 2022] GET /compute/v2.1/os-security-groups => generated 1836 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:30.655213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42a849e0-9e8c-4586-89c0-251a1bb3c910 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f07574ee0d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:30.776168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] validate_networks() for [('4237c513-9590-4957-9766-25a24a956f31', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:37:31.230597 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42a849e0-9e8c-4586-89c0-251a1bb3c910 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b" status: 202 len: 0 microversion: 2.1 time: 0.590682 Oct 03 10:37:31.231424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 978/1933] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:37:30 2022] DELETE /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:37:31.253023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:31.254967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:31.273541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:31.274439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:31.276038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:31.277339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:31.278265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:31.300041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:31.722278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:31.739658 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-360faf85-5fa1-452c-9e2e-b793f5bff88f tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1314 microversion: 2.1 time: 0.506654 Oct 03 10:37:31.740339 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 979/1934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:31 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:31.746534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a15d1454-4c62-494a-9403-ac78a09bcb60 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f07575635e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:31.777709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-a15d1454-4c62-494a-9403-ac78a09bcb60 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:31.778304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-a15d1454-4c62-494a-9403-ac78a09bcb60 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:37:31.778828 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-a15d1454-4c62-494a-9403-ac78a09bcb60 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:37:31.778828 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-e33a2ffd-9b02-4449-bf93-81d3e03c9004'] Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a15d1454-4c62-494a-9403-ac78a09bcb60 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b HTTP/1.1 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-e33a2ffd-9b02-4449-bf93-81d3e03c9004'] Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '88088f9f-e3d7-4cb5-938a-a8aed8e7f38b'} Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:31.782242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e33a2ffd-9b02-4449-bf93-81d3e03c9004'] Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e33a2ffd-9b02-4449-bf93-81d3e03c9004'] Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e33a2ffd-9b02-4449-bf93-81d3e03c9004'] Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e33a2ffd-9b02-4449-bf93-81d3e03c9004'] Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a15d1454-4c62-494a-9403-ac78a09bcb60 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-e33a2ffd-9b02-4449-bf93-81d3e03c9004'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a15d1454-4c62-494a-9403-ac78a09bcb60 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b" status: 404 len: 194 microversion: 2.1 time: 0.042572 Oct 03 10:37:31.787714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 980/1935] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:37:31 2022] GET /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:31.793934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:31.797155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] [instance: 2dd0ee96-4df2-4007-a07c-bf659b2b569f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:31.807928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:31.808448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:31.808915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:31.809875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:31.810329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:31.810783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:31.826427 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] HTTP exception thrown: Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f could not be found. Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Request method failure captured: Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f HTTP/1.1 Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroHFl553rfD6PBhgaINQV0ox9PYyI8sX8CyXZS5_9v7OlLH2Iz3JM4M24vYfY50gErsrk-ruK5HQCvEjxsPh-E1biGsGXuL_Jkjamg2PsdIYrQkNbVQszMn9TbP8ap8kQErU3Nv8QYZ3ClhpRX-44Pc642IMF9WbmHuXVEK89GwNZk Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/65c1c5f2ee554c8688e754dd17bf5adc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/65c1c5f2ee554c8688e754dd17bf5adc"}]}] Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 65c1c5f2ee554c8688e754dd17bf5adc Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MigrationsAdminTest-1246861606 Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: fa6ea468370b4bacb98dd5457b0e6aea Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MigrationsAdminTest-1246861606-project Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f could not be found. Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '2dd0ee96-4df2-4007-a07c-bf659b2b569f'} Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f could not be found. Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f could not be found. Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:31.828251 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.834108 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:31.834108 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:31.834108 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:31.834108 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:31.834108 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:31.834108 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f could not be found. Oct 03 10:37:31.834108 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:31.835908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] Returning 404 to user: Instance 2dd0ee96-4df2-4007-a07c-bf659b2b569f could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:31.836963 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-21c32d97-188e-49c2-a735-f9f9ee32bdf2 tempest-MigrationsAdminTest-1246861606 tempest-MigrationsAdminTest-1246861606-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f" status: 404 len: 111 microversion: 2.1 time: 0.050593 Oct 03 10:37:31.837748 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 981/1936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:31 2022] GET /compute/v2.1/servers/2dd0ee96-4df2-4007-a07c-bf659b2b569f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:31.852355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fad8c3e8-8b3c-4695-bc14-109663d0c696 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f07575638b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:32.181963 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fad8c3e8-8b3c-4695-bc14-109663d0c696 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39" status: 202 len: 0 microversion: 2.1 time: 0.342889 Oct 03 10:37:32.182549 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 982/1937] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:37:31 2022] DELETE /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:37:32.190963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-930c1035-3db4-4744-a7e7-96e51c310d7b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f0757565f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:32.229399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:37:32.229915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:37:32.230296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:37:32.230704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:37:32.231133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:37:32.248603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-930c1035-3db4-4744-a7e7-96e51c310d7b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:32.249775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-930c1035-3db4-4744-a7e7-96e51c310d7b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:37:32.250498 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-930c1035-3db4-4744-a7e7-96e51c310d7b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:37:32.250498 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-59681f59-7edd-421d-b155-35c0ef08bfcb'] Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-930c1035-3db4-4744-a7e7-96e51c310d7b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 HTTP/1.1 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-59681f59-7edd-421d-b155-35c0ef08bfcb'] Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39'} Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:32.254106 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59681f59-7edd-421d-b155-35c0ef08bfcb'] Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59681f59-7edd-421d-b155-35c0ef08bfcb'] Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59681f59-7edd-421d-b155-35c0ef08bfcb'] Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59681f59-7edd-421d-b155-35c0ef08bfcb'] Oct 03 10:37:32.260116 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:32.266603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-930c1035-3db4-4744-a7e7-96e51c310d7b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:37:32.266603 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-59681f59-7edd-421d-b155-35c0ef08bfcb'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:32.266603 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-930c1035-3db4-4744-a7e7-96e51c310d7b tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39" status: 404 len: 194 microversion: 2.1 time: 0.079422 Oct 03 10:37:32.266603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 983/1938] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:37:32 2022] GET /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:37:32.268105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:32.269611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:32.278717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:32.279724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:32.280223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:32.280664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:32.291769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acb0f0bd-7d24-472f-b0c2-86af4f4737bb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f07574eea60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:32.304345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:32.310172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Getting quotas for user 7b6d14fc83e74c34b2e6d5845f4ed9bf and project ef692cfceb0843ef91ac2e607b0cb237. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:32.402721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:37:32.405033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8fd9baa-d51a-413e-937a-2e800d6fd464',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:37:32.646664 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0ae4f41a-8498-4549-bcc8-ca7e4d484666 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.114267 Oct 03 10:37:32.647323 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 956/1939] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:37:32.665630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04106687-4cc6-4643-8400-98d9c84a6c3c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:32.667451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04106687-4cc6-4643-8400-98d9c84a6c3c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:32.792753 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-acb0f0bd-7d24-472f-b0c2-86af4f4737bb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4" status: 202 len: 0 microversion: 2.1 time: 0.521006 Oct 03 10:37:32.794709 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 984/1940] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:37:32 2022] DELETE /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:37:32.825884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:32.831384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:32.848288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04106687-4cc6-4643-8400-98d9c84a6c3c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:32.860068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:32.860589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:32.860889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04106687-4cc6-4643-8400-98d9c84a6c3c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:32.861638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:32.862379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:32.863667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04106687-4cc6-4643-8400-98d9c84a6c3c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:32.866730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:32.867395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:32.869797 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04106687-4cc6-4643-8400-98d9c84a6c3c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1104 microversion: 2.25 time: 0.211113 Oct 03 10:37:32.871842 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 957/1941] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:32 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1104 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:32.885097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58d0d6a6-6671-48e7-bf3a-4c3acde6d1d8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f07574d2b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:33.141292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-58d0d6a6-6671-48e7-bf3a-4c3acde6d1d8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:37:33.152863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.security_group_api [None req-58d0d6a6-6671-48e7-bf3a-4c3acde6d1d8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 not found {{(pid=122270) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:37:33.153891 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-58d0d6a6-6671-48e7-bf3a-4c3acde6d1d8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:37:33.153891 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-1ee8e96f-29a8-4b4f-94f8-08087f19a0bc'] Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58d0d6a6-6671-48e7-bf3a-4c3acde6d1d8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4 HTTP/1.1 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: exception: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-1ee8e96f-29a8-4b4f-94f8-08087f19a0bc'] Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '89229d02-d62f-4ed6-b688-706a00b3cfb4'} Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:37:33.159322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ee8e96f-29a8-4b4f-94f8-08087f19a0bc'] Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ee8e96f-29a8-4b4f-94f8-08087f19a0bc'] Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ee8e96f-29a8-4b4f-94f8-08087f19a0bc'] Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ee8e96f-29a8-4b4f-94f8-08087f19a0bc'] Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58d0d6a6-6671-48e7-bf3a-4c3acde6d1d8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-1ee8e96f-29a8-4b4f-94f8-08087f19a0bc'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58d0d6a6-6671-48e7-bf3a-4c3acde6d1d8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4" status: 404 len: 194 microversion: 2.1 time: 0.289787 Oct 03 10:37:33.164300 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 958/1942] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:37:32 2022] GET /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4 => generated 194 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:33.181124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ec5ad2ab-170c-4497-afa3-276b90ffe1bf tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074f0d9040>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:33.225025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:33.250925 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf0669ec-bcbb-4686-8adc-c176b4705ada tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1464 microversion: 2.1 time: 0.453996 Oct 03 10:37:33.252548 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 985/1943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:32 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1464 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:33.832179 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ec5ad2ab-170c-4497-afa3-276b90ffe1bf tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.661498 Oct 03 10:37:33.845035 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 959/1944] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:37:33 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:33.852916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a930da8-1fa3-44b9-81e8-d45e99b5fc12 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f07574c5280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1080197923", "description": "tempest-description-98534313"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:33.947206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Calling method '.version_select at 0x7f074f219280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:33.972184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:33.973649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:33.974693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.002087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.002579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.004448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.039376 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3a12e4d-ceaf-4901-bb6d-32222818349d tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/8127badec8d542a3834d3a1209daac27?start=2022-10-02T10%3A37%3A33.271667&end=2022-10-04T10%3A37%3A33.271667" status: 200 len: 647 microversion: 2.1 time: 0.758901 Oct 03 10:37:34.043229 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 986/1945] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 3 10:37:33 2022] GET /compute/v2.1/os-simple-tenant-usage/8127badec8d542a3834d3a1209daac27?start=2022-10-02T10%3A37%3A33.271667&end=2022-10-04T10%3A37%3A33.271667 => generated 647 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:37:34.049430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:34.050048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:34.070846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.075637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.078079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.079017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.079721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.081409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.183418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:34.200590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:34.206221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:34.209317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-346635a0-945b-4e36-ab32-19a264ac4d15 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1233 microversion: 2.25 time: 0.165034 Oct 03 10:37:34.221762 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 987/1946] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:34 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1233 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:34.240188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '.version_select at 0x7f07574ee160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:34.281040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.282065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.283298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.308477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.312399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.313034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.345897 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4befc63-f813-4e41-8efc-2e0a6c0e8945 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/8127badec8d542a3834d3a1209daac27?start=2022-10-02T10%3A37%3A33.271667&end=2022-10-04T10%3A37%3A33.271667" status: 200 len: 695 microversion: 2.1 time: 0.120604 Oct 03 10:37:34.346811 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 988/1947] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 3 10:37:34 2022] GET /compute/v2.1/os-simple-tenant-usage/8127badec8d542a3834d3a1209daac27?start=2022-10-02T10%3A37%3A33.271667&end=2022-10-04T10%3A37%3A33.271667 => generated 695 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:34.377973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Calling method '.version_select at 0x7f07574f2670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:34.397323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.401708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.402469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.433410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.434111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.435218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a930da8-1fa3-44b9-81e8-d45e99b5fc12 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.588169 Oct 03 10:37:34.435563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.436049 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 960/1948] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:37:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:34.454815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d36ab5f9-3d28-44ba-9cb2-f5bd74cf1c3d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f07574c7040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1084514232", "description": "tempest-description-199776626"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:34.524969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd27927a-a7ae-472b-9abe-dbfb619dc8f7 tempest-TenantUsagesTestJSON-617410414 tempest-TenantUsagesTestJSON-617410414-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T10%3A37%3A33.271667&end=2022-10-04T10%3A37%3A33.271667&detailed=1" status: 200 len: 17685 microversion: 2.1 time: 0.167355 Oct 03 10:37:34.539671 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 989/1949] 10.222.0.27 () {58 vars in 1335 bytes} [Mon Oct 3 10:37:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T10%3A37%3A33.271667&end=2022-10-04T10%3A37%3A33.271667&detailed=1 => generated 17685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:37:34.560301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:34.561189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:34.573128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.580429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.580429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.580429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.583368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.585784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.633709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:37:34.749233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d36ab5f9-3d28-44ba-9cb2-f5bd74cf1c3d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.302382 Oct 03 10:37:34.757054 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 961/1950] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:37:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:34.836225 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f356001-0086-4289-99bb-db26bd9811bd tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 204 len: 0 microversion: 2.1 time: 0.281136 Oct 03 10:37:34.837020 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 990/1951] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:37:34 2022] DELETE /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:37:34.846123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:34.846744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:34.858251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.859772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.860451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.861870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:34.862554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:34.863230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:34.964648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1328132616", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "0c772e2c-1a67-43b9-a52d-eb393d19b267"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:35.194688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:35.204438 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2880d5b6-cf99-4dbd-bbc3-3a2f19669ca2 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1470 microversion: 2.1 time: 0.362771 Oct 03 10:37:35.221286 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 962/1952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:34 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:35.243029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:35.244016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:35.251918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:35.252937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:35.253589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:35.254318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:35.254779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:35.255211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:35.344041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:35.359675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:35.362998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:35.368507 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c053c2d7-428b-42b7-b428-42753d2ce149 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1251 microversion: 2.25 time: 0.130208 Oct 03 10:37:35.381200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 963/1953] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:35 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1251 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:37:36.235812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:36.236426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:36.246856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:36.247809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:36.248588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:36.249601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:36.250481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:36.251358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:36.901016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:36.909333 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dd1aac3f-09ec-45ae-8d0f-cb62131bb00d tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1470 microversion: 2.1 time: 0.677809 Oct 03 10:37:36.914012 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 964/1954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:36 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1470 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:36.929512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:36.930317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:36.942828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:36.943616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:36.947061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:36.948034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:36.948674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:36.949581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:37.166234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:37.180531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:37.182771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:37.188305 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-239c27ca-c554-4a4d-98f2-8ea496665c2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1293 microversion: 2.25 time: 0.272557 Oct 03 10:37:37.205217 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 965/1955] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:36 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1293 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:37.609139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:37.612406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:37.613040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:37.613352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:37.616569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:37.617925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:37.619579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:37.718238 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-80deeff2-f9c5-476d-b4b1-93e19a5e96dc tempest-AZV2TestJSON-637037935 tempest-AZV2TestJSON-637037935-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.511181 Oct 03 10:37:37.719625 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 966/1956] 10.222.0.27 () {58 vars in 1164 bytes} [Mon Oct 3 10:37:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:37:37.847238 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de170109-29a4-4b08-8655-b18a98db4643 tempest-TenantUsagesNegativeTestJSON-454210119 tempest-TenantUsagesNegativeTestJSON-454210119-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-02T10%3A37%3A37.161587&end=2022-10-04T10%3A37%3A37.161587" status: 404 len: 112 microversion: - time: 0.125420 Oct 03 10:37:37.848980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 967/1957] 10.222.0.27 () {58 vars in 1316 bytes} [Mon Oct 3 10:37:37 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-02T10%3A37%3A37.161587&end=2022-10-04T10%3A37%3A37.161587 => generated 112 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 10:37:37.862902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5dac0193-039d-439b-ac64-9cc383d5cda7 req-a28a2ac4-c523-4674-8652-57753d5870b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190fc678-4443-461f-a07b-3a4ffd44f740", "name": "network-vif-deleted", "tag": "638cf30f-c6bd-4471-9622-caa065a6927d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:37.895879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5dac0193-039d-439b-ac64-9cc383d5cda7 req-a28a2ac4-c523-4674-8652-57753d5870b2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:37.897677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5dac0193-039d-439b-ac64-9cc383d5cda7 req-a28a2ac4-c523-4674-8652-57753d5870b2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:37.901352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5dac0193-039d-439b-ac64-9cc383d5cda7 req-a28a2ac4-c523-4674-8652-57753d5870b2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:37.926425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5dac0193-039d-439b-ac64-9cc383d5cda7 req-a28a2ac4-c523-4674-8652-57753d5870b2 service nova] Creating event network-vif-deleted:638cf30f-c6bd-4471-9622-caa065a6927d for instance 190fc678-4443-461f-a07b-3a4ffd44f740 on n-h2-858383-3 Oct 03 10:37:37.934218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5dac0193-039d-439b-ac64-9cc383d5cda7 req-a28a2ac4-c523-4674-8652-57753d5870b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082831 Oct 03 10:37:37.942577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 968/1958] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:37.949336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8b4b9e1b-3a7f-467c-85b8-f6dd0a40d78b tempest-TenantUsagesNegativeTestJSON-454210119 tempest-TenantUsagesNegativeTestJSON-454210119-project-admin] Calling method '.version_select at 0x7f07574d2160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:37.957892 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8b4b9e1b-3a7f-467c-85b8-f6dd0a40d78b tempest-TenantUsagesNegativeTestJSON-454210119 tempest-TenantUsagesNegativeTestJSON-454210119-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8b4b9e1b-3a7f-467c-85b8-f6dd0a40d78b tempest-TenantUsagesNegativeTestJSON-454210119 tempest-TenantUsagesNegativeTestJSON-454210119-project-admin] Request method failure captured: Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-simple-tenant-usage/cc0438a1b03a425388b7f183ee052ef8?start=2022-10-04T10%3A37%3A37.161587&end=2022-10-02T10%3A37%3A37.161587 HTTP/1.1 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtwRjvhW8gNPxtG4B5R3-6-rI86OaMocIfB8EsUAJ3K9U8i9nAEmVbp74sJb_rvbOthcHr1s1VhhwPuB7tOb6komcY9sCqe5r7_6Wouu9ogj4pAKK1owdOM6pjq9F87Ama9IEkYa0YVTjRuvx0_jcejRfY1lDyde4thhsNPzJZsgTw Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: c77a2afd15394952a9029a115d7b6e22 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-454210119 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c77a2afd15394952a9029a115d7b6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c77a2afd15394952a9029a115d7b6e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c77a2afd15394952a9029a115d7b6e22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c77a2afd15394952a9029a115d7b6e22"}]}] Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-454210119 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: c77a2afd15394952a9029a115d7b6e22 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-454210119 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TenantUsagesNegativeTestJSON-454210119-project-admin Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 075e43233b7b45888118dd5945bdc228 Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-454210119-project-admin Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid start time. The start time cannot occur after the end time. Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'cc0438a1b03a425388b7f183ee052ef8'} Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 03 10:37:37.972691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:37.980335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8b4b9e1b-3a7f-467c-85b8-f6dd0a40d78b tempest-TenantUsagesNegativeTestJSON-454210119 tempest-TenantUsagesNegativeTestJSON-454210119-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:37.980335 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8b4b9e1b-3a7f-467c-85b8-f6dd0a40d78b tempest-TenantUsagesNegativeTestJSON-454210119 tempest-TenantUsagesNegativeTestJSON-454210119-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/cc0438a1b03a425388b7f183ee052ef8?start=2022-10-04T10%3A37%3A37.161587&end=2022-10-02T10%3A37%3A37.161587" status: 400 len: 111 microversion: 2.1 time: 0.032661 Oct 03 10:37:37.980335 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 969/1959] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Oct 3 10:37:37 2022] GET /compute/v2.1/os-simple-tenant-usage/cc0438a1b03a425388b7f183ee052ef8?start=2022-10-04T10%3A37%3A37.161587&end=2022-10-02T10%3A37%3A37.161587 => generated 111 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:37:37.992704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:37.997269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:38.004281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:38.005941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:38.006389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:38.010251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:38.012192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:38.012994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:38.106017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:38.106525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:38.109277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:38.109755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lazy-loading 'fault' on Instance uuid 190fc678-4443-461f-a07b-3a4ffd44f740 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:37:38.227399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84a7e72cfe54bae9da6ffedd1e84992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8127badec8d542a3834d3a1209daac27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:38.243695 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-212c6eb1-742c-4726-bc68-dc88fb4c73a9 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 200 len: 1304 microversion: 2.1 time: 0.260893 Oct 03 10:37:38.244595 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 970/1960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:37 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 1304 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:38.683395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6269ff2a-71f1-4846-9964-19dd94d5196a tempest-TenantUsagesNegativeTestJSON-1982295309 tempest-TenantUsagesNegativeTestJSON-1982295309-project] Calling method '.version_select at 0x7f07574e9700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:38.688681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6269ff2a-71f1-4846-9964-19dd94d5196a tempest-TenantUsagesNegativeTestJSON-1982295309 tempest-TenantUsagesNegativeTestJSON-1982295309-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '64327a44c1cd42ef89062c79142e93ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0438a1b03a425388b7f183ee052ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6269ff2a-71f1-4846-9964-19dd94d5196a tempest-TenantUsagesNegativeTestJSON-1982295309 tempest-TenantUsagesNegativeTestJSON-1982295309-project] Request method failure captured: Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T10%3A37%3A37.161587&end=2022-10-04T10%3A37%3A37.161587&detailed=1 HTTP/1.1 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtvRN66-tjrYon3eY80fQsmu-dqbFVTdWxHm1P7lHO1OREtxniXpS0YeP9FiVncO7twSXRBcmmrUe2e-tsU9zdKGXAw93-bQ7bffsxH0lpYBRwWks8mTHunTHnS1mL-L_EcOvJ3PWivaa4nWESoCPsUEu0WyDSRFc1RDp7hhzkElHw Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cc0438a1b03a425388b7f183ee052ef8 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1982295309 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc0438a1b03a425388b7f183ee052ef8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc0438a1b03a425388b7f183ee052ef8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc0438a1b03a425388b7f183ee052ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc0438a1b03a425388b7f183ee052ef8"}]}] Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1982295309 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cc0438a1b03a425388b7f183ee052ef8 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1982295309 Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TenantUsagesNegativeTestJSON-1982295309-project Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 64327a44c1cd42ef89062c79142e93ba Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1982295309-project Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:37:38.690544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 03 10:37:38.695563 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:38.702041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6269ff2a-71f1-4846-9964-19dd94d5196a tempest-TenantUsagesNegativeTestJSON-1982295309 tempest-TenantUsagesNegativeTestJSON-1982295309-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:38.702991 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6269ff2a-71f1-4846-9964-19dd94d5196a tempest-TenantUsagesNegativeTestJSON-1982295309 tempest-TenantUsagesNegativeTestJSON-1982295309-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T10%3A37%3A37.161587&end=2022-10-04T10%3A37%3A37.161587&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.457196 Oct 03 10:37:38.708860 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 971/1961] 10.222.0.27 () {58 vars in 1335 bytes} [Mon Oct 3 10:37:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T10%3A37%3A37.161587&end=2022-10-04T10%3A37%3A37.161587&detailed=1 => generated 123 bytes in 463 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:38.722675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-aa356176-aaa8-40e7-bd64-63e36f99a04c req-3f9cfeee-e370-45f4-a897-eb7e33289e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877fab3d-7259-4cd4-9b2f-490437ad0db4", "tag": "b17700de-c4df-464f-b394-77ec4177e27d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:38.750484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-aa356176-aaa8-40e7-bd64-63e36f99a04c req-3f9cfeee-e370-45f4-a897-eb7e33289e3a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:38.750976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-aa356176-aaa8-40e7-bd64-63e36f99a04c req-3f9cfeee-e370-45f4-a897-eb7e33289e3a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:38.751404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-aa356176-aaa8-40e7-bd64-63e36f99a04c req-3f9cfeee-e370-45f4-a897-eb7e33289e3a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:38.792858 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-aa356176-aaa8-40e7-bd64-63e36f99a04c req-3f9cfeee-e370-45f4-a897-eb7e33289e3a service nova] Creating event network-changed:b17700de-c4df-464f-b394-77ec4177e27d for instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 on n-h1-858383-3 Oct 03 10:37:38.821630 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-aa356176-aaa8-40e7-bd64-63e36f99a04c req-3f9cfeee-e370-45f4-a897-eb7e33289e3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099898 Oct 03 10:37:38.826774 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 972/1962] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:38.837084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:38.840285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:38.850753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:38.851631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:38.852330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:38.853558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:38.854294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:38.854926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:39.331570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:39.340573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:39.347657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:39.349168 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c2d9c29f-c33b-4e64-96be-b27c5630e9a9 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1293 microversion: 2.25 time: 0.521129 Oct 03 10:37:39.349972 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 973/1963] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:38 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1293 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:39.363794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:39.364807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] [instance: 190fc678-4443-461f-a07b-3a4ffd44f740] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:39.374787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:39.375623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:39.376314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:39.380074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:39.381087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:39.381777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:39.413320 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] HTTP exception thrown: Instance 190fc678-4443-461f-a07b-3a4ffd44f740 could not be found. Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Request method failure captured: Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 HTTP/1.1 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtTUGBcFEF_ggCMvg207QbsTBtaEGVdu80BP4vua4W9pKIkwjk0KWjaIzjzMhyIyzRf2IMxTMews9iX5mA10DLQhqUCgq2mNVyG3_HWF3DsLc1-aYFat1QmC6s_v2uwsVBadsBJZO3vesaJCRiLorL0AmgYBiKw7oHyMShHWQ2KytA Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8127badec8d542a3834d3a1209daac27 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TenantUsagesTestJSON-797606573 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8127badec8d542a3834d3a1209daac27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8127badec8d542a3834d3a1209daac27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8127badec8d542a3834d3a1209daac27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8127badec8d542a3834d3a1209daac27"}]}] Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TenantUsagesTestJSON-797606573 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8127badec8d542a3834d3a1209daac27 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TenantUsagesTestJSON-797606573 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TenantUsagesTestJSON-797606573-project Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: b84a7e72cfe54bae9da6ffedd1e84992 Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TenantUsagesTestJSON-797606573-project Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 190fc678-4443-461f-a07b-3a4ffd44f740 could not be found. Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '190fc678-4443-461f-a07b-3a4ffd44f740'} Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 190fc678-4443-461f-a07b-3a4ffd44f740 could not be found. Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 190fc678-4443-461f-a07b-3a4ffd44f740 could not be found. Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:39.418552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:39.424246 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:39.424246 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:39.424246 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:39.424246 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:39.424246 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:39.424246 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 190fc678-4443-461f-a07b-3a4ffd44f740 could not be found. Oct 03 10:37:39.424246 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:39.427966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] Returning 404 to user: Instance 190fc678-4443-461f-a07b-3a4ffd44f740 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:39.430409 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d0f0258-68f7-471d-a41f-8496ba00a816 tempest-TenantUsagesTestJSON-797606573 tempest-TenantUsagesTestJSON-797606573-project] 10.222.0.27 "GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740" status: 404 len: 111 microversion: 2.1 time: 0.077481 Oct 03 10:37:39.432440 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 974/1964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:39 2022] GET /compute/v2.1/servers/190fc678-4443-461f-a07b-3a4ffd44f740 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:40.377035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:40.377035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:40.393000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:40.393529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:40.393978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:40.394710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:40.395168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:40.395601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:40.684011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:40.698852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:40.700667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:40.702583 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-15f0c046-ff97-4784-9d7e-80455645b726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1293 microversion: 2.25 time: 0.331012 Oct 03 10:37:40.704209 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 975/1965] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:40 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1293 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:41.730539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:41.731092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:41.741740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:41.742336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:41.742856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:41.743758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:41.744419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:41.744888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:42.184045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:42.204012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:42.209250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:42.213991 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5dc7f45c-7080-4bde-a514-6d9d0ef69726 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1293 microversion: 2.25 time: 0.487410 Oct 03 10:37:42.230050 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 976/1966] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:41 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1293 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:43.244264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:43.245113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:43.251874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:43.268239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:43.277140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:43.285260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:43.288515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:43.295143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:43.297414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:43.299008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:43.434336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] validate_networks() for [('0c772e2c-1a67-43b9-a52d-eb393d19b267', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:37:43.883459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:43.896043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:43.900184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:43.906755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52927be8-daef-4e4d-8c1d-117c468a6eaa tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1293 microversion: 2.25 time: 0.665539 Oct 03 10:37:43.907613 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 977/1967] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:43 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1293 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:44.284564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:37:44.285241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:37:44.285821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:37:44.286452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:37:44.286915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:37:44.294640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:44.315589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:44.315589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:44.315589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:44.315589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:44.315589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:44.315589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:44.319454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bfc0ca5-a299-46af-b1b2-d8839952737f tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Calling method '.version_select at 0x7f0757565430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:44.363087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9bfc0ca5-a299-46af-b1b2-d8839952737f tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] HTTP exception thrown: Image not found. Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bfc0ca5-a299-46af-b1b2-d8839952737f tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Request method failure captured: Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/0eed9227-2448-4690-80b9-4d8bcefb5a87/metadata/os_distro HTTP/1.1 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrt3pgHtc8zlXsbOVNbvF2kEc3fGG0mhIuW-OWxusdd7_-T7C6CR9Pyudjqn45R6622kxhKNjcTdo5327kQxqkiyfaofttwmfl9io4h1GWMbCOlUF570eEOCChQX5XQFcy2jDHNAq09WzxHB0JZAhAhUKL5IJmQVl4dpF-yF6VGySxo Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}] Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 056e809808cf40ef9f652b3f8b59022e Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'image_id': '0eed9227-2448-4690-80b9-4d8bcefb5a87', 'id': 'os_distro'} Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0eed9227-2448-4690-80b9-4d8bcefb5a87 Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:37:44.378571 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0eed9227-2448-4690-80b9-4d8bcefb5a87 could not be found. Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:37:44.383373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.390552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bfc0ca5-a299-46af-b1b2-d8839952737f tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:44.390552 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bfc0ca5-a299-46af-b1b2-d8839952737f tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] 10.222.0.27 "DELETE /compute/v2.1/images/0eed9227-2448-4690-80b9-4d8bcefb5a87/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.479416 Oct 03 10:37:44.396655 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 978/1968] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 3 10:37:43 2022] DELETE /compute/v2.1/images/0eed9227-2448-4690-80b9-4d8bcefb5a87/metadata/os_distro => generated 62 bytes in 488 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:37:44.406292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbd1e04c-b01f-4310-8f6d-ab0292b7f7e9"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:44.410196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:44.411204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Getting quotas for project 8758b690683b468393e1e884e6f76fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:44.422044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:44.422967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:44.423927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:44.424912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:44.425444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Getting quotas for user 60c925fc8e0b48f19f1ff0934adbf601 and project 8758b690683b468393e1e884e6f76fd3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:44.425733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:44.426451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:44.462173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:37:44.465830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:37:44.577487 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1012d70-6493-45ed-bb0d-7b4668115433 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.618027 Oct 03 10:37:44.585262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 991/1969] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:37:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 9626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:37:44.873396 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5fa86703-4150-44cb-bee1-8b9df4e153d7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "POST /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471719 Oct 03 10:37:44.875187 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 979/1970] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:37:44 2022] POST /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:44.904879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40042be5-5152-4915-94b9-fa7a3aa194ac tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Calling method '.version_select at 0x7f074f0e34c0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:44.937220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0baf5e7-c476-4949-a162-0c350ee2a0ec tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f07575103a0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9xnMA3hD0IRbyGnco3AOIzirOiGSb0J/7SHAtZ8UzbNCqmOexVU2E3bPBMSLfoP/88NC0GU8LyJ6p6/5AT4u1MvqMwDKorzOy4IIG1vTnOWyI2RAy9+ec/nRP4bdyScQ=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0baf5e7-c476-4949-a162-0c350ee2a0ec tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 257 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9xnMA3hD0IRbyGnco3AOIzirOiGSb0J/7SHAtZ8UzbNCqmOexVU2E3bPBMSLfoP/88NC0GU8LyJ6p6/5AT4u1MvqMwDKorzOy4IIG1vTnOWyI2RAy9+ec/nRP4bdyScQ=="}} Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9xnMA3hD0IRbyGnco3AOIzirOiGSb0J/7SHAtZ8UzbNCqmOexVU2E3bPBMSLfoP/88NC0GU8LyJ6p6/5AT4u1MvqMwDKorzOy4IIG1vTnOWyI2RAy9+ec/nRP4bdyScQ=='}}} Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 03 10:37:44.942538 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.949266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0baf5e7-c476-4949-a162-0c350ee2a0ec tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:44.958443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c0baf5e7-c476-4949-a162-0c350ee2a0ec tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.357633 Oct 03 10:37:44.958443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 992/1971] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:37:44 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:37:44.973781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8ed6ea1-351b-4081-b553-f1f1fc796051 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:44.974433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8ed6ea1-351b-4081-b553-f1f1fc796051 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:44.983307 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-40042be5-5152-4915-94b9-fa7a3aa194ac tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] HTTP exception thrown: Image not found. Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40042be5-5152-4915-94b9-fa7a3aa194ac tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Request method failure captured: Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/images/863d7a03-32e6-4858-984b-f932a26483dd/metadata/os_version HTTP/1.1 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrt3pgHtc8zlXsbOVNbvF2kEc3fGG0mhIuW-OWxusdd7_-T7C6CR9Pyudjqn45R6622kxhKNjcTdo5327kQxqkiyfaofttwmfl9io4h1GWMbCOlUF570eEOCChQX5XQFcy2jDHNAq09WzxHB0JZAhAhUKL5IJmQVl4dpF-yF6VGySxo Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}] Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 056e809808cf40ef9f652b3f8b59022e Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'image_id': '863d7a03-32e6-4858-984b-f932a26483dd', 'id': 'os_version'} Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 863d7a03-32e6-4858-984b-f932a26483dd Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:37:44.991824 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 863d7a03-32e6-4858-984b-f932a26483dd could not be found. Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40042be5-5152-4915-94b9-fa7a3aa194ac tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40042be5-5152-4915-94b9-fa7a3aa194ac tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] 10.222.0.27 "GET /compute/v2.1/images/863d7a03-32e6-4858-984b-f932a26483dd/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.117515 Oct 03 10:37:44.996185 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 980/1972] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 3 10:37:44 2022] GET /compute/v2.1/images/863d7a03-32e6-4858-984b-f932a26483dd/metadata/os_version => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:37:45.011258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:45.011996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:45.059604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:45.062710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:45.063379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:45.067053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:45.067711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:45.068363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:45.087630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8ed6ea1-351b-4081-b553-f1f1fc796051 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:45.094558 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8ed6ea1-351b-4081-b553-f1f1fc796051 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1216 microversion: 2.1 time: 0.141011 Oct 03 10:37:45.095138 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 993/1973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:44 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:45.130270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6986e0b-ea91-4673-887d-6a1efecac21a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f07574f2940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-353184982", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:45.173191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c6986e0b-ea91-4673-887d-6a1efecac21a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:45.185339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c6986e0b-ea91-4673-887d-6a1efecac21a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for user 7ce0155b7342459da266ea08bde71641 and project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:45.237550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c6986e0b-ea91-4673-887d-6a1efecac21a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6986e0b-ea91-4673-887d-6a1efecac21a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 2166 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-353184982", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:45.267745 n-d-858383-3 devstack@n-api.service[122269]: exception: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-353184982', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:45.278411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6986e0b-ea91-4673-887d-6a1efecac21a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c6986e0b-ea91-4673-887d-6a1efecac21a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.153047 Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 994/1974] 10.222.0.27 () {60 vars in 1160 bytes} [Mon Oct 3 10:37:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:37:45.284411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0946ed58-6ad8-42b7-a738-4a428452dc84 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Calling method '.version_select at 0x7f0757521700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:45.336834 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-0946ed58-6ad8-42b7-a738-4a428452dc84 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] HTTP exception thrown: Image not found. Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0946ed58-6ad8-42b7-a738-4a428452dc84 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Request method failure captured: Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/images/054abc3f-e912-4eea-b02d-ff09d9b5c620/metadata HTTP/1.1 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt3pgHtc8zlXsbOVNbvF2kEc3fGG0mhIuW-OWxusdd7_-T7C6CR9Pyudjqn45R6622kxhKNjcTdo5327kQxqkiyfaofttwmfl9io4h1GWMbCOlUF570eEOCChQX5XQFcy2jDHNAq09WzxHB0JZAhAhUKL5IJmQVl4dpF-yF6VGySxo Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}] Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 056e809808cf40ef9f652b3f8b59022e Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'image_id': '054abc3f-e912-4eea-b02d-ff09d9b5c620'} Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 054abc3f-e912-4eea-b02d-ff09d9b5c620 Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:37:45.339387 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 054abc3f-e912-4eea-b02d-ff09d9b5c620 could not be found. Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.346468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0946ed58-6ad8-42b7-a738-4a428452dc84 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:45.355925 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0946ed58-6ad8-42b7-a738-4a428452dc84 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] 10.222.0.27 "GET /compute/v2.1/images/054abc3f-e912-4eea-b02d-ff09d9b5c620/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070140 Oct 03 10:37:45.355925 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 995/1975] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:37:45 2022] GET /compute/v2.1/images/054abc3f-e912-4eea-b02d-ff09d9b5c620/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:37:45.367721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7515c90f-6b74-4a03-979e-f5a51905848f tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f0757501550>, body: {"keypair": {"name": "tempest-keypair-1944237779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjKCEUlYKh9B/DojN7BVY82yc3VZfHQvCDUyV8SZbm2drsA1QJ40suDoWJ3dVmUsp9gK9VrnxmSuxRUFSesPE1Hloohmlz1MDGMSUOW4dD0BEJmsmmuvpSX44SGu9H0MA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:45.453851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-7515c90f-6b74-4a03-979e-f5a51905848f tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:45.462912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-7515c90f-6b74-4a03-979e-f5a51905848f tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for user 7ce0155b7342459da266ea08bde71641 and project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:45.527710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7515c90f-6b74-4a03-979e-f5a51905848f tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177099 Oct 03 10:37:45.529289 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 996/1976] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:37:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:45.536348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5691269f-10f5-4129-8640-c336e184cc52 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Action: 'update_all', calling method: .version_select at 0x7f07575103a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:45.582497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5691269f-10f5-4129-8640-c336e184cc52 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] HTTP exception thrown: Image not found. Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5691269f-10f5-4129-8640-c336e184cc52 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Request method failure captured: Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/images/0d55c084-287d-4404-b50c-32040173371c/metadata HTTP/1.1 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 57 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt3pgHtc8zlXsbOVNbvF2kEc3fGG0mhIuW-OWxusdd7_-T7C6CR9Pyudjqn45R6622kxhKNjcTdo5327kQxqkiyfaofttwmfl9io4h1GWMbCOlUF570eEOCChQX5XQFcy2jDHNAq09WzxHB0JZAhAhUKL5IJmQVl4dpF-yF6VGySxo Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}] Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 056e809808cf40ef9f652b3f8b59022e Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'image_id': '0d55c084-287d-4404-b50c-32040173371c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0d55c084-287d-4404-b50c-32040173371c Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:37:45.588975 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0d55c084-287d-4404-b50c-32040173371c could not be found. Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:37:45.596893 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.604413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5691269f-10f5-4129-8640-c336e184cc52 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:45.605156 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5691269f-10f5-4129-8640-c336e184cc52 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] 10.222.0.27 "PUT /compute/v2.1/images/0d55c084-287d-4404-b50c-32040173371c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074541 Oct 03 10:37:45.606948 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 997/1977] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:37:45 2022] PUT /compute/v2.1/images/0d55c084-287d-4404-b50c-32040173371c/metadata => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:37:45.612831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b4d78ae-18d7-48fd-a407-5d97433dca4a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f07575b13a0>, body: {"keypair": {"name": "tempest-keypair-1944237779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn83ZUVcJ84qFwFfn09ZboloD4G5KjD0rp5Zy3k049wwHv2xohBpJiU0vy/gV89lruzyFChlrWcdKzmi/ZM7aeJ4O6tGVPK1U9rROYPeeU7Wad7M1x92FnYHROHRC0+jw=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:45.637034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5b4d78ae-18d7-48fd-a407-5d97433dca4a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:45.646876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5b4d78ae-18d7-48fd-a407-5d97433dca4a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for user 7ce0155b7342459da266ea08bde71641 and project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:45.690238 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5b4d78ae-18d7-48fd-a407-5d97433dca4a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] HTTP exception thrown: Key pair 'tempest-keypair-1944237779' already exists. Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b4d78ae-18d7-48fd-a407-5d97433dca4a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 273 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: {"keypair": {"name": "tempest-keypair-1944237779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn83ZUVcJ84qFwFfn09ZboloD4G5KjD0rp5Zy3k049wwHv2xohBpJiU0vy/gV89lruzyFChlrWcdKzmi/ZM7aeJ4O6tGVPK1U9rROYPeeU7Wad7M1x92FnYHROHRC0+jw=="}} Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: exception: Key pair 'tempest-keypair-1944237779' already exists. Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1944237779', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn83ZUVcJ84qFwFfn09ZboloD4G5KjD0rp5Zy3k049wwHv2xohBpJiU0vy/gV89lruzyFChlrWcdKzmi/ZM7aeJ4O6tGVPK1U9rROYPeeU7Wad7M1x92FnYHROHRC0+jw=='}}} Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result.read() Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7ce0155b7342459da266ea08bde71641-tempest-keypair-1944237779' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 03 10:37:45.733654 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi session.flush() Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result.read() Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 10:37:45.738847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7ce0155b7342459da266ea08bde71641-tempest-keypair-1944237779' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 3, 10, 37, 45, 675638), 'updated_at': None, 'name': 'tempest-keypair-1944237779', 'user_id': '7ce0155b7342459da266ea08bde71641', 'fingerprint': '7f:42:b1:92:8b:d1:c1:1b:78:db:20:11:c6:d8:d4:57', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn83ZUVcJ84qFwFfn09ZboloD4G5KjD0rp5Zy3k049wwHv2xohBpJiU0vy/gV89lruzyFChlrWcdKzmi/ZM7aeJ4O6tGVPK1U9rROYPeeU7Wad7M1x92FnYHROHRC0+jw==', 'type': 'ssh'}] Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6787, in import_key_pair Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi keypair.create() Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._create() Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1944237779' already exists. Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 03 10:37:45.748553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1944237779' already exists. Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1944237779' already exists. Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b4d78ae-18d7-48fd-a407-5d97433dca4a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 409 to user: Key pair 'tempest-keypair-1944237779' already exists. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b4d78ae-18d7-48fd-a407-5d97433dca4a tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.142740 Oct 03 10:37:45.758293 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 998/1978] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:37:45 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:37:45.763431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14224ddf-bd50-4086-a314-9c8d4dd0d962 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Action: 'update', calling method: .version_select at 0x7f074ec01e50>, body: {"meta": {"os_distro": "alt"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:45.803939 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-14224ddf-bd50-4086-a314-9c8d4dd0d962 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] HTTP exception thrown: Image not found. Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14224ddf-bd50-4086-a314-9c8d4dd0d962 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Request method failure captured: Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/images/f161bd9e-8918-4f85-90f0-b2217b27bad0/metadata/os_distro HTTP/1.1 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 30 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt3pgHtc8zlXsbOVNbvF2kEc3fGG0mhIuW-OWxusdd7_-T7C6CR9Pyudjqn45R6622kxhKNjcTdo5327kQxqkiyfaofttwmfl9io4h1GWMbCOlUF570eEOCChQX5XQFcy2jDHNAq09WzxHB0JZAhAhUKL5IJmQVl4dpF-yF6VGySxo Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}] Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 056e809808cf40ef9f652b3f8b59022e Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: {"meta": {"os_distro": "alt"}} Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'image_id': 'f161bd9e-8918-4f85-90f0-b2217b27bad0', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f161bd9e-8918-4f85-90f0-b2217b27bad0 Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:37:45.809181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f161bd9e-8918-4f85-90f0-b2217b27bad0 could not be found. Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:37:45.817491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.829048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14224ddf-bd50-4086-a314-9c8d4dd0d962 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:45.829048 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14224ddf-bd50-4086-a314-9c8d4dd0d962 tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] 10.222.0.27 "PUT /compute/v2.1/images/f161bd9e-8918-4f85-90f0-b2217b27bad0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.068436 Oct 03 10:37:45.833013 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 999/1979] 10.222.0.27 () {60 vars in 1310 bytes} [Mon Oct 3 10:37:45 2022] PUT /compute/v2.1/images/f161bd9e-8918-4f85-90f0-b2217b27bad0/metadata/os_distro => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:37:45.841843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3c88145-5487-47c2-abc5-da8512340ddb tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Calling method '.version_select at 0x7f0757565a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:45.894201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3c88145-5487-47c2-abc5-da8512340ddb tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944237779" status: 202 len: 0 microversion: 2.1 time: 0.059416 Oct 03 10:37:45.895685 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1000/1980] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944237779 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:37:45.902753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc466ecc-064d-424c-9bd3-c4fcda8c14fa tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Action: 'create', calling method: .version_select at 0x7f074ec0e8b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:45.913969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:45.917900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:45.941333 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-cc466ecc-064d-424c-9bd3-c4fcda8c14fa tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] HTTP exception thrown: Image not found. Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc466ecc-064d-424c-9bd3-c4fcda8c14fa tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Request method failure captured: Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/images/4a568628-d1d5-4128-9371-0417f386df93/metadata HTTP/1.1 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 57 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt3pgHtc8zlXsbOVNbvF2kEc3fGG0mhIuW-OWxusdd7_-T7C6CR9Pyudjqn45R6622kxhKNjcTdo5327kQxqkiyfaofttwmfl9io4h1GWMbCOlUF570eEOCChQX5XQFcy2jDHNAq09WzxHB0JZAhAhUKL5IJmQVl4dpF-yF6VGySxo Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5d800ab700ff4eddb5fbfcd2bc1ae710"}]}] Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 5d800ab700ff4eddb5fbfcd2bc1ae710 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 056e809808cf40ef9f652b3f8b59022e Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2084902990-project Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'image_id': '4a568628-d1d5-4128-9371-0417f386df93', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4a568628-d1d5-4128-9371-0417f386df93 Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:37:45.946363 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a568628-d1d5-4128-9371-0417f386df93 could not be found. Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:37:45.951389 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:45.960331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:45.960331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:45.960331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1656c585-1668-4419-8b38-a59974589647 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.953786 Oct 03 10:37:45.960331 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 981/1981] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:44 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:45.961790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc466ecc-064d-424c-9bd3-c4fcda8c14fa tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:45.962802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc466ecc-064d-424c-9bd3-c4fcda8c14fa tempest-ImagesMetadataNegativeTestJSON-2084902990 tempest-ImagesMetadataNegativeTestJSON-2084902990-project] 10.222.0.27 "POST /compute/v2.1/images/4a568628-d1d5-4128-9371-0417f386df93/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066158 Oct 03 10:37:45.969660 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1001/1982] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 3 10:37:45 2022] POST /compute/v2.1/images/4a568628-d1d5-4128-9371-0417f386df93/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:37:46.001470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71827278-3440-492a-914d-1f35cef578d6 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f07574e9790>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB6qnkyou36PerS6lKwlt8BUvMVlHb7lqnuuTye4SV7UXZlbKhcEQd1TMrO7piAohF/h15sMGWN3S7AfIHL/7wVPZVKv62FUoRU1J9arxXDp0PAiDObTfbG75/PRyYCvQ=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71827278-3440-492a-914d-1f35cef578d6 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 247 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB6qnkyou36PerS6lKwlt8BUvMVlHb7lqnuuTye4SV7UXZlbKhcEQd1TMrO7piAohF/h15sMGWN3S7AfIHL/7wVPZVKv62FUoRU1J9arxXDp0PAiDObTfbG75/PRyYCvQ=="}} Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB6qnkyou36PerS6lKwlt8BUvMVlHb7lqnuuTye4SV7UXZlbKhcEQd1TMrO7piAohF/h15sMGWN3S7AfIHL/7wVPZVKv62FUoRU1J9arxXDp0PAiDObTfbG75/PRyYCvQ=='}}} Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi '' Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:37:46.014741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71827278-3440-492a-914d-1f35cef578d6 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71827278-3440-492a-914d-1f35cef578d6 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.035171 Oct 03 10:37:46.021910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 982/1983] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:37:45 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:37:46.048300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-663b2d16-a77c-4360-ab11-cc6eccc24621 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f074ec0eaf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1733890817", "public_key": " "}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:46.074642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-663b2d16-a77c-4360-ab11-cc6eccc24621 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:46.080961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-663b2d16-a77c-4360-ab11-cc6eccc24621 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for user 7ce0155b7342459da266ea08bde71641 and project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:46.100837 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-663b2d16-a77c-4360-ab11-cc6eccc24621 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-663b2d16-a77c-4360-ab11-cc6eccc24621 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 95 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1733890817", "public_key": " "}} Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: exception: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1733890817', 'public_key': ' '}}} Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.105203 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.111505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.115349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-663b2d16-a77c-4360-ab11-cc6eccc24621 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:46.119470 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-663b2d16-a77c-4360-ab11-cc6eccc24621 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.092444 Oct 03 10:37:46.121552 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1002/1984] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Oct 3 10:37:46 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:37:46.132961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:46.134105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:46.168110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa2865d5-de9d-4b74-855c-32bb83398931 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f074f219d30>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj2cD5gcWmUgYA81YMV7a7fPqFPSEEm6mNaSjKw3CkvHAMm5aw0CpuX2rh5dB15WjuO0nFayRbVCkXIUEOtYU6Hy+Of2+9upf0+yk0vAa6uCa7gQf4mILf33HA6ibdv0Q=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa2865d5-de9d-4b74-855c-32bb83398931 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 507 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj2cD5gcWmUgYA81YMV7a7fPqFPSEEm6mNaSjKw3CkvHAMm5aw0CpuX2rh5dB15WjuO0nFayRbVCkXIUEOtYU6Hy+Of2+9upf0+yk0vAa6uCa7gQf4mILf33HA6ibdv0Q=="}} Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj2cD5gcWmUgYA81YMV7a7fPqFPSEEm6mNaSjKw3CkvHAMm5aw0CpuX2rh5dB15WjuO0nFayRbVCkXIUEOtYU6Hy+Of2+9upf0+yk0vAa6uCa7gQf4mILf33HA6ibdv0Q=='}}} Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 03 10:37:46.178796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa2865d5-de9d-4b74-855c-32bb83398931 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:46.187876 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa2865d5-de9d-4b74-855c-32bb83398931 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.050263 Oct 03 10:37:46.195871 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1003/1985] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:37:46 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:37:46.203863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acef6e34-4d2e-4e26-8414-ed27a52fa395 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Action: 'create', calling method: .version_select at 0x7f074ec0e5e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-173440497", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:46.225956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:46.227671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:46.229269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:46.230901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:46.232793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:46.233457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:46.246057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-acef6e34-4d2e-4e26-8414-ed27a52fa395 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:46.261834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-acef6e34-4d2e-4e26-8414-ed27a52fa395 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Getting quotas for user 7ce0155b7342459da266ea08bde71641 and project 86dd67534bd24184a04cf9da03f64879. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:46.329877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-acef6e34-4d2e-4e26-8414-ed27a52fa395 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acef6e34-4d2e-4e26-8414-ed27a52fa395 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 117 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-173440497", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: exception: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-173440497', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Oct 03 10:37:46.332964 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 03 10:37:46.340309 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.348422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acef6e34-4d2e-4e26-8414-ed27a52fa395 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:46.349606 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-acef6e34-4d2e-4e26-8414-ed27a52fa395 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.158106 Oct 03 10:37:46.352932 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1004/1986] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:37:46 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:37:46.363806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9650b82b-860d-4990-91e4-fd3a4a30a4d8 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Calling method '.version_select at 0x7f074ec0e1f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:46.380904 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-9650b82b-860d-4990-91e4-fd3a4a30a4d8 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1034854773 not found for user 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9650b82b-860d-4990-91e4-fd3a4a30a4d8 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Request method failure captured: Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1034854773 HTTP/1.1 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrt4P0jNl3YY3GIXo8O2MQAovv2nJ5PaTBlUwsFXpsDWaby_hOzhwVqHh3SlgcZ_WwflOTT_ijaYu9WvCpcHvN02fO5t0Z7yjfq7FvB2ynFFB4Jtx2nSfWUfLzXclfEdsehf2W2WjAv-G4xLCU-8enPxjex4T0z4owmSWSDSyH_P0ZE Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86dd67534bd24184a04cf9da03f64879"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86dd67534bd24184a04cf9da03f64879"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86dd67534bd24184a04cf9da03f64879"}]}] Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86dd67534bd24184a04cf9da03f64879 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-194147153 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-KeyPairsNegativeTestJSON-194147153-project Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: exception: Keypair tempest-keypair-non-existent-1034854773 not found for user 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'tempest-keypair-non-existent-1034854773'} Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6871, in delete_key_pair Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6892, in get_key_pair Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1034854773 not found for user 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.383005 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1034854773 not found for user 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1034854773 not found for user 7ce0155b7342459da266ea08bde71641 Oct 03 10:37:46.387562 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:37:46.393073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9650b82b-860d-4990-91e4-fd3a4a30a4d8 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1034854773 not found for user 7ce0155b7342459da266ea08bde71641 {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:37:46.395596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9650b82b-860d-4990-91e4-fd3a4a30a4d8 tempest-KeyPairsNegativeTestJSON-194147153 tempest-KeyPairsNegativeTestJSON-194147153-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1034854773" status: 404 len: 145 microversion: 2.1 time: 0.036714 Oct 03 10:37:46.403166 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1005/1987] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1034854773 => generated 145 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:37:46.448861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:46.458027 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf530e11-d161-4e0c-8a7e-ceaa6f2dc5e1 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1268 microversion: 2.1 time: 0.340044 Oct 03 10:37:46.459151 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 983/1988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:46 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1268 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:46.981229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:46.982012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:47.004582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:47.009393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:47.014553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:47.018426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:47.020608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:47.023250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:47.515303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:47.516085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:47.550141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:47.550646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:47.551090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:47.555513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:47.555996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:47.556454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:47.639940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:47.702348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:47.716853 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a200e41b-85c1-44f2-b4fd-d9b031329d3f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1274 microversion: 2.1 time: 0.206336 Oct 03 10:37:47.717468 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 984/1989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:47 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:48.620480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:48.637188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:48.646269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:48.648503 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-074f9cd7-39ac-4d38-8dd0-82d86b73ba2b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 1.672568 Oct 03 10:37:48.651549 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1006/1990] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:46 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:37:48.747192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:48.750638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:48.770360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:48.771070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:48.771694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:48.776695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:48.777871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:48.780740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:49.147128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:49.157156 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df6364e5-25f5-47e0-b8b1-a5cb0323d13d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1274 microversion: 2.1 time: 0.416045 Oct 03 10:37:49.176002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 985/1991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:48 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1274 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:49.679456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:49.680696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:49.695532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:49.697796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:49.701906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:49.705927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:49.707697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:49.708141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:50.203572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:50.204637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:50.224172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:50.229323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:50.230230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:50.233431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:50.233915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:50.234343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:50.432197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:50.447858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:50.452571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:50.454172 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2eb9e712-e373-497a-88b1-70a296dd5ff1 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.779073 Oct 03 10:37:50.456088 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1007/1992] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:49 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:50.587295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:50.601095 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-36199816-f249-4fcb-b75f-fe5f575a42c3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.401092 Oct 03 10:37:50.601711 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 986/1993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:50 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:51.482552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:51.483939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:51.519995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:51.523612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:51.525276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:51.529707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:51.530649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:51.531275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:51.626930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:51.628325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:51.640594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:51.641388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:51.645457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:51.646448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:51.649063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:51.656109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:52.168140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:52.179340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:52.182905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:52.184488 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5074d93b-b49d-49ad-aba1-f44d1d58a5fb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.707093 Oct 03 10:37:52.185832 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1008/1994] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:51 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:52.403281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:52.418985 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-39955f83-9d05-4d2a-aa57-84a1e0ce0666 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.796755 Oct 03 10:37:52.432811 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 987/1995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:51 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:37:52.499496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b901ffc4-d0ba-4f7c-bdbd-93ea486f8671 req-a548a301-2e03-4513-a2b5-4d3737f2d725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c82c03-27d1-4b64-b85c-06c6f90b3c65", "tag": "382e2b0c-b661-4d5a-9ce3-d3dcea386a4a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:52.533892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b901ffc4-d0ba-4f7c-bdbd-93ea486f8671 req-a548a301-2e03-4513-a2b5-4d3737f2d725 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:52.534427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b901ffc4-d0ba-4f7c-bdbd-93ea486f8671 req-a548a301-2e03-4513-a2b5-4d3737f2d725 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:52.534874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b901ffc4-d0ba-4f7c-bdbd-93ea486f8671 req-a548a301-2e03-4513-a2b5-4d3737f2d725 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:52.581293 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b901ffc4-d0ba-4f7c-bdbd-93ea486f8671 req-a548a301-2e03-4513-a2b5-4d3737f2d725 service nova] Creating event network-changed:382e2b0c-b661-4d5a-9ce3-d3dcea386a4a for instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 on n-h2-858383-3 Oct 03 10:37:52.591049 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b901ffc4-d0ba-4f7c-bdbd-93ea486f8671 req-a548a301-2e03-4513-a2b5-4d3737f2d725 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095821 Oct 03 10:37:52.594474 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1009/1996] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:53.210651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:53.211258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:53.230142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:53.230642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:53.231073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:53.244345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:53.246706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:53.248089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:53.448447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:53.449455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:53.464943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:53.465070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:53.468220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:53.471497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:53.471995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:53.472436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:53.774396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:53.792342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:53.798170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:53.802626 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-edde6bb8-6e98-4c13-8629-3fb75bff5d63 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.594468 Oct 03 10:37:53.804687 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 988/1997] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:53 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:54.343322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1683747658", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "4e18332c-4217-4c02-8787-9925155dba43"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:54.370535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:54.446913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:54.449930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:54.464728 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b879990-faed-4773-acdb-e80fd386ef65 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 1.016406 Oct 03 10:37:54.464922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] validate_networks() for [('4e18332c-4217-4c02-8787-9925155dba43', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:37:54.465410 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1010/1998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:53 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:54.832279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:54.833586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:54.858887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:54.861009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:54.861987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:54.865108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:54.866628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:54.868236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:55.439878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:37:55.445728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:37:55.450674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:37:55.451393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:37:55.455768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:37:55.473856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:55.475465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:55.476110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:55.477155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:55.477946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:55.479201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:55.522241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Getting quotas for project 39b2728af27949faaf2af813181e5128. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:37:55.536626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Getting quotas for user 10660d35b0c44afe9f4f4fd1dc08acf7 and project 39b2728af27949faaf2af813181e5128. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:37:55.554174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:55.570228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:55.573664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:55.580807 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6419080f-07e0-47a6-81db-2469aab69598 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.753035 Oct 03 10:37:55.592615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:37:55.602857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1011/1999] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:54 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:55.612212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:37:55.613943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:55.615795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:55.637198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:55.638299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:55.638978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:55.641687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:55.642155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:55.645673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:55.708981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3369d577-ce2e-4878-bec8-cb97c1b73675 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652478 Oct 03 10:37:55.719092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 989/2000] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:37:55.726135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-36e95961-cb36-44c1-940c-e3a6e08e6660 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:55.726955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-36e95961-cb36-44c1-940c-e3a6e08e6660 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:55.916088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36e95961-cb36-44c1-940c-e3a6e08e6660 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:55.932743 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-36e95961-cb36-44c1-940c-e3a6e08e6660 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1217 microversion: 2.1 time: 0.211851 Oct 03 10:37:55.943080 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 990/2001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:55 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1217 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:55.994852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:56.007469 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32840eb2-5d27-4d25-8ff4-de1718426432 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.402969 Oct 03 10:37:56.010350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1012/2002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:55 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:56.614611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:56.620355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:56.643984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:56.645146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:56.646072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:56.654828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:56.655913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:56.657314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:56.962077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=28 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:37:56.968017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c270c904-038f-47ca-8fe3-a511ca19651a tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:56.968640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c270c904-038f-47ca-8fe3-a511ca19651a tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:57.091465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:57.111841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:57.114780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:57.115889 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-02ef0cf0-040f-479a-b0b1-f6fbaf30be78 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.509402 Oct 03 10:37:57.117041 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 991/2003] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:56 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:57.158311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:57.158978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:57.181297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:57.182034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:57.183990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:57.187511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:57.188227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:57.188885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:57.354453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c270c904-038f-47ca-8fe3-a511ca19651a tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:57.367014 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c270c904-038f-47ca-8fe3-a511ca19651a tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1217 microversion: 2.1 time: 0.406015 Oct 03 10:37:57.368267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1013/2004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:56 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1217 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:57.469262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:57.479280 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-21dadda8-0870-4931-9553-ced5552557c5 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.334430 Oct 03 10:37:57.502714 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 992/2005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:57 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:58.144335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:58.145160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:58.168705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:58.181780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:58.183914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:58.187486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:58.188176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:58.190164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:58.395761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:58.396376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:58.414386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:58.414885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:58.417409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:58.418585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:58.419107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:58.427485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:58.936667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:58.984685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:58.993620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:58.998619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-83104653-6c78-499f-8d02-ea9bb6067e62 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.857479 Oct 03 10:37:59.000856 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1014/2006] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:37:58 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:37:59.029235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:37:59.033455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:37:59.046428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:59.049303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:59.053044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:59.054102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:59.054950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:59.055639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:59.280346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:59.293747 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-607c2993-3ce5-4e00-bd22-01aec75afc67 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1277 microversion: 2.1 time: 0.902185 Oct 03 10:37:59.296684 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 993/2007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:58 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1277 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:37:59.311016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-605dbd6c-27bc-4d25-b906-4051d652253c req-25bcd68f-1c1f-4ef4-9c61-6dfa66e221c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877fab3d-7259-4cd4-9b2f-490437ad0db4", "name": "network-vif-plugged", "status": "completed", "tag": "b17700de-c4df-464f-b394-77ec4177e27d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:59.345910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-605dbd6c-27bc-4d25-b906-4051d652253c req-25bcd68f-1c1f-4ef4-9c61-6dfa66e221c9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:37:59.346850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-605dbd6c-27bc-4d25-b906-4051d652253c req-25bcd68f-1c1f-4ef4-9c61-6dfa66e221c9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:37:59.347610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-605dbd6c-27bc-4d25-b906-4051d652253c req-25bcd68f-1c1f-4ef4-9c61-6dfa66e221c9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:37:59.426482 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-605dbd6c-27bc-4d25-b906-4051d652253c req-25bcd68f-1c1f-4ef4-9c61-6dfa66e221c9 service nova] Creating event network-vif-plugged:b17700de-c4df-464f-b394-77ec4177e27d for instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 on n-h1-858383-3 Oct 03 10:37:59.429206 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-605dbd6c-27bc-4d25-b906-4051d652253c req-25bcd68f-1c1f-4ef4-9c61-6dfa66e221c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126689 Oct 03 10:37:59.430025 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 994/2008] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:37:59.451624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1903927794", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4db9ee4f-9738-426b-8c9d-ee3d577cd4fc"}], "security_groups": [{"name": "tempest-securitygroup--977477188"}], "key_name": "tempest-keypair-1881983108", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ddf79e6c-4e6f-4788-85d0-1ae407676f1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:37:59.929730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:37:59.947740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a2586768-b09a-42bd-80be-394b7b041107 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.931773 Oct 03 10:37:59.957146 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1015/2009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:37:59 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:00.031349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:00.032107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:00.034681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:00.054871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:00.055825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:00.056705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:00.057851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:00.058822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:00.060489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:00.169277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] validate_networks() for [('4db9ee4f-9738-426b-8c9d-ee3d577cd4fc', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:38:00.477262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:00.489830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:00.492141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:00.493880 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd46ffd1-898f-4b5a-a6c5-e0fc6a25fdd5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1281 microversion: 2.25 time: 0.466595 Oct 03 10:38:00.514958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1016/2010] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:00 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1281 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:00.565447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:00.566096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:00.602460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:00.602978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:00.603420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:00.604360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:00.605021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:00.605626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:01.855653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:01.865974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3c7539a-f913-4b6d-a54a-542e0afb3eaf tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 1.349725 Oct 03 10:38:01.868064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1017/2011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:00 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:01.875356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:01.878548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:01.889933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:01.894350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:01.895070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:01.906560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:01.909201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:01.909954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:02.469333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:02.477916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a14e24b-f1d8-4d57-80bc-c2890a7e40f2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.607981 Oct 03 10:38:02.478499 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1018/2012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:01 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:02.495031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:02.502821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:02.520005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:02.520969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:02.521690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:02.522869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:02.523769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:02.526708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:02.748073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Getting quotas for project acfbece0c17544cd8b1fbc2854ad91ed. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:38:02.766073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Getting quotas for user d201f9e124f94e9dae804154df5f0cf5 and project acfbece0c17544cd8b1fbc2854ad91ed. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:38:02.806228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:38:02.806667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:38:02.813883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:38:02.814913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:38:02.815345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:38:02.850590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:02.851088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:02.851528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:02.852261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:02.852716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:02.853174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:02.915774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Getting quotas for project acfbece0c17544cd8b1fbc2854ad91ed. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:38:02.934253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Getting quotas for user d201f9e124f94e9dae804154df5f0cf5 and project acfbece0c17544cd8b1fbc2854ad91ed. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:38:03.012367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:03.028740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:03.034470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:03.043575 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-87ab345d-2455-426d-b1ad-4bdb84cd9832 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1477 microversion: 2.25 time: 0.552878 Oct 03 10:38:03.044294 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1019/2013] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:02 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1477 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:03.074895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:03.075766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:03.102250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:03.103204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:03.114497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:03.115293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:03.115777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:03.116219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:03.116709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:38:03.120243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddf79e6c-4e6f-4788-85d0-1ae407676f1f',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:38:03.442436 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f687920-4f39-4ce2-ae7d-83a062b7d584 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.001105 Oct 03 10:38:03.442961 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 995/2014] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:37:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 4013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:38:03.552604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:03.565765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c9a831d4-898e-4f36-8eb2-016c92fe4b71 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.510500 Oct 03 10:38:03.567972 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1020/2015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:03 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:03.581714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-628f5928-a60b-413d-ae4b-41f7ad5a1e7e tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:03.582351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-628f5928-a60b-413d-ae4b-41f7ad5a1e7e tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:03.686997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:03.687619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:03.697918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:03.701077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:03.702397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:03.704074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:03.706358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:03.706986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:03.731497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-628f5928-a60b-413d-ae4b-41f7ad5a1e7e tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:03.741515 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-628f5928-a60b-413d-ae4b-41f7ad5a1e7e tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1122 microversion: 2.1 time: 0.172286 Oct 03 10:38:03.747830 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1021/2016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:03 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1122 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:03.765194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:03.765823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:03.786102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:03.786604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:03.787046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:03.787764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:03.793792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:03.796996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:04.277637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:04.293158 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-409bac44-6ff5-4e5a-b4c0-2fe6528aa4e4 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.544019 Oct 03 10:38:04.296562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1022/2017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:03 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:04.558832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid 877fab3d-7259-4cd4-9b2f-490437ad0db4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:04.583636 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-af21af63-efc0-4fc5-9961-125195895a66 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1970 microversion: 2.25 time: 1.139343 Oct 03 10:38:04.586039 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 996/2018] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:03 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1970 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:04.603686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:04.607826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:04.623767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:04.626113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:04.635220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:04.635731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:04.636176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:04.640555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:04.641921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:04.643518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:04.644334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:04.645194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:04.645354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:04.645878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:04.646176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:04.646385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.076429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:05.089790 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e44e8d5b-e0d1-4f49-b6c9-7a64470dc273 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.505569 Oct 03 10:38:05.090930 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1023/2019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:04 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:38:05.101020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:05.102825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:05.122567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.122903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.123345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.124063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.124516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.133293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.313699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:05.325388 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39b25ae1-1cbc-4416-97b0-609b367b4789 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1220 microversion: 2.1 time: 0.231065 Oct 03 10:38:05.337145 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1024/2020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:05 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1220 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:05.349986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-46bd4fc3-dde3-497f-8690-fa170a76a499 req-def0b66c-6a38-497b-83fe-c4c139f5a07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c82c03-27d1-4b64-b85c-06c6f90b3c65", "name": "network-vif-plugged", "status": "completed", "tag": "382e2b0c-b661-4d5a-9ce3-d3dcea386a4a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:05.376290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-46bd4fc3-dde3-497f-8690-fa170a76a499 req-def0b66c-6a38-497b-83fe-c4c139f5a07e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.390224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-46bd4fc3-dde3-497f-8690-fa170a76a499 req-def0b66c-6a38-497b-83fe-c4c139f5a07e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.391158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-46bd4fc3-dde3-497f-8690-fa170a76a499 req-def0b66c-6a38-497b-83fe-c4c139f5a07e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.411200 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-46bd4fc3-dde3-497f-8690-fa170a76a499 req-def0b66c-6a38-497b-83fe-c4c139f5a07e service nova] Creating event network-vif-plugged:382e2b0c-b661-4d5a-9ce3-d3dcea386a4a for instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 on n-h2-858383-3 Oct 03 10:38:05.422351 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-46bd4fc3-dde3-497f-8690-fa170a76a499 req-def0b66c-6a38-497b-83fe-c4c139f5a07e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083548 Oct 03 10:38:05.423489 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1025/2021] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:05.429122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:05.436324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:05.445554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.446425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.447080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.448030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.448701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.449373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.581979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid 877fab3d-7259-4cd4-9b2f-490437ad0db4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:05.605250 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dec8532b-96e3-41c1-9c3b-a4f42ee3f893 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1970 microversion: 2.25 time: 0.987506 Oct 03 10:38:05.606154 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 997/2022] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:04 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1970 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:05.617057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-954c8a13-ef47-4b37-bc1f-03e1a9d85ec5 req-fc695a47-b216-41e5-8656-b670e988f352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b47cf93-2c13-4da2-a235-792b654ee50a", "tag": "805060f5-3b8f-4c0a-a9c7-728249247e7e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:05.646489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-954c8a13-ef47-4b37-bc1f-03e1a9d85ec5 req-fc695a47-b216-41e5-8656-b670e988f352 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.648474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-954c8a13-ef47-4b37-bc1f-03e1a9d85ec5 req-fc695a47-b216-41e5-8656-b670e988f352 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.649139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-954c8a13-ef47-4b37-bc1f-03e1a9d85ec5 req-fc695a47-b216-41e5-8656-b670e988f352 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.691804 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-954c8a13-ef47-4b37-bc1f-03e1a9d85ec5 req-fc695a47-b216-41e5-8656-b670e988f352 service nova] Creating event network-changed:805060f5-3b8f-4c0a-a9c7-728249247e7e for instance 0b47cf93-2c13-4da2-a235-792b654ee50a on n-h2-858383-3 Oct 03 10:38:05.703311 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-954c8a13-ef47-4b37-bc1f-03e1a9d85ec5 req-fc695a47-b216-41e5-8656-b670e988f352 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095668 Oct 03 10:38:05.706153 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 998/2023] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:05.716978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:05.722214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.727871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.728581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.736528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.737374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.738044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.763273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-05dda269-1d6a-432f-aff3-db462ff6ce77 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054710 Oct 03 10:38:05.764256 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 999/2024] 10.222.0.27 () {60 vars in 1217 bytes} [Mon Oct 3 10:38:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:38:05.947925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:05.960064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-211a46c8-23c7-4c44-bf74-a3f24495f82d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1316 microversion: 2.1 time: 0.534969 Oct 03 10:38:05.961270 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1026/2025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:05 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:05.966111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-3", "block_migration": "auto"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:05.968866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:05.978871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.980344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.980998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:05.981892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:05.982538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:05.983143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:06.026124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'flavor' on Instance uuid 877fab3d-7259-4cd4-9b2f-490437ad0db4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:06.029934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cfdcd47a-d942-4186-a717-384e54551e0b"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:06.034152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:06.089751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:06.093153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:06.097031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Going to try to live migrate instance to n-h2-858383-3 {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:38:06.097805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:06.101004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:06.104419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:06.106166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:06.519560 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] HTTP exception thrown: Volume cfdcd47a-d942-4186-a717-384e54551e0b could not be found. Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Request method failure captured: Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments/dbd1e04c-b01f-4310-8f6d-ab0292b7f7e9 HTTP/1.1 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 74 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrsw0-efM8d20Ed9W18u-_RkDuiM_BHfaDpKw1fTRS7_hCmW7vcpQj_O04rbQmlWlU-7BQiL4Cr_ZzRTpfwCfAcvfmnBwqYEA4OICTwB_TiyZYCq-9hD3D6xsvxtfg1S2rDHjWtjRfHjq1D_1TVJpNTvaTo4FOv6VvgBhu3uxKdw0X4 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: e1e5131ca29d4c8abce8473efe915393 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-VolumesAdminNegativeTest-1635210913 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1e5131ca29d4c8abce8473efe915393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1e5131ca29d4c8abce8473efe915393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1e5131ca29d4c8abce8473efe915393"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1e5131ca29d4c8abce8473efe915393"}]}] Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-VolumesAdminNegativeTest-1635210913 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: e1e5131ca29d4c8abce8473efe915393 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1635210913 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-VolumesAdminNegativeTest-1635210913-project-admin Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0e399097eafd41dca46c8ed3681a2701 Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-VolumesAdminNegativeTest-1635210913-project-admin Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: {"volumeAttachment": {"volumeId": "cfdcd47a-d942-4186-a717-384e54551e0b"}} Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: exception: Volume cfdcd47a-d942-4186-a717-384e54551e0b could not be found. Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': 'c71022b1-6680-4a39-941d-79472a4aa61f', 'id': 'dbd1e04c-b01f-4310-8f6d-ab0292b7f7e9', 'body': {'volumeAttachment': {'volumeId': 'cfdcd47a-d942-4186-a717-384e54551e0b'}}} Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cfdcd47a-d942-4186-a717-384e54551e0b could not be found. (HTTP 404) (Request-ID: req-bd7a42d8-10ed-4f2b-a7fb-bc3b10dca722) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:38:06.576431 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cfdcd47a-d942-4186-a717-384e54551e0b could not be found. Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume cfdcd47a-d942-4186-a717-384e54551e0b could not be found. Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cfdcd47a-d942-4186-a717-384e54551e0b could not be found. Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Returning 400 to user: Volume cfdcd47a-d942-4186-a717-384e54551e0b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7ee4b210-227e-4e15-b96c-d27a45ef430e tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments/dbd1e04c-b01f-4310-8f6d-ab0292b7f7e9" status: 400 len: 107 microversion: 2.1 time: 0.812272 Oct 03 10:38:06.582061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1000/2026] 10.222.0.27 () {60 vars in 1433 bytes} [Mon Oct 3 10:38:05 2022] PUT /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments/dbd1e04c-b01f-4310-8f6d-ab0292b7f7e9 => generated 107 bytes in 813 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:38:06.588317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:06.588968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:06.619196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:06.619991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:06.625982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:06.626888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:06.627376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:06.627816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:07.290464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:07.306878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c4148f3-a216-4778-8b08-cfd14683288c tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.722437 Oct 03 10:38:07.313161 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1001/2027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:06 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:07.334458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:07.336674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:07.360464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:07.360993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:07.362012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:07.362730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:07.369382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:07.369849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:07.587545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:07.604632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c737e95b-7381-45c9-bcd1-81ab9832e329 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1238 microversion: 2.1 time: 0.283327 Oct 03 10:38:07.605615 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1002/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:07 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1238 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:07.624217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:07.625115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:07.639118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:07.651809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:07.652454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:07.661739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:07.669135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:07.670085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:07.703270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:07.934839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lazy-loading 'services' on Instance uuid c71022b1-6680-4a39-941d-79472a4aa61f {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:08.143857 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8509b187-1cf1-4dde-a07f-819b165a060c tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments/dbd1e04c-b01f-4310-8f6d-ab0292b7f7e9" status: 202 len: 0 microversion: 2.1 time: 0.536492 Oct 03 10:38:08.145017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1003/2029] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:38:07 2022] DELETE /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments/dbd1e04c-b01f-4310-8f6d-ab0292b7f7e9 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:08.162453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:08.173407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:08.184024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:08.184957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:08.185841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:08.186837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:08.187569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:08.188290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:09.034346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:09.043739 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dabe0a0a-30c3-43b0-8d4d-70e01100ece8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1505 microversion: 2.1 time: 0.896861 Oct 03 10:38:09.045773 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1004/2030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:08 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1505 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:09.084221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:09.086992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:09.106715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:09.107508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:09.110969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:09.112048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:09.112794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:09.113579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:09.191118 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6695d81d-ea67-42cd-a1a3-49d20d653c53 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122352 Oct 03 10:38:09.192501 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1005/2031] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:09 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:09.309324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-770051807", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "7b015b41-fca2-4228-a077-924e6c5f6d40"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:09.473882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] validate_networks() for [('7b015b41-fca2-4228-a077-924e6c5f6d40', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:38:10.402964 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f193a3a-b276-4e20-b2cb-637321ef81ac tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4/action" status: 202 len: 0 microversion: 2.25 time: 4.440297 Oct 03 10:38:10.407918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1027/2032] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:38:05 2022] POST /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4/action => generated 0 bytes in 4446 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:38:10.417768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:10.421687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:10.447295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:10.448314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:10.448712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:10.449528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:10.449998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:10.450431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:10.486930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:10.928113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:10.945782 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d17874cf-0aab-4528-be23-c4a20a443105 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.536414 Oct 03 10:38:10.947071 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1028/2033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:10 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:10.952795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:10.953583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:10.977633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:10.978715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:10.979124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:10.979873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:10.982241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:10.985596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:11.776578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:11.794601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e48a467-0289-42ba-ac89-9f7b75e3a8eb tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1305 microversion: 2.1 time: 0.846011 Oct 03 10:38:11.796222 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1029/2034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:10 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1305 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:11.813168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1080197923"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:11.816121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:11.847869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:11.848364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:11.853684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:11.863350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:11.863881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:11.864428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:11.942961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:38:11.943520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:38:11.944295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:38:11.944862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:38:11.945386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:38:11.962312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:11.964665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:11.968560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:11.971275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:11.974053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:11.974763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:12.031196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Getting quotas for project 81b44c5ea7734a9dbb066ef1a6c9d077. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:38:12.037005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:12.047798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Getting quotas for user 4de72bcdaa0841038de43990892c7094 and project 81b44c5ea7734a9dbb066ef1a6c9d077. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:38:12.081339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:38:12.084231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:38:12.205514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b6d8a9a3-9679-4086-b3b2-d4ed4cd1ff00 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.011375 Oct 03 10:38:12.206560 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1006/2035] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:38:12.224664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:12.234118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:12.249949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:12.250843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:12.251569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:12.255317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:12.256081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:12.257774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:12.294470 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e769896d-99fd-4f22-a95e-7514781dc4de tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079519 Oct 03 10:38:12.295800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1007/2036] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:12 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:12.302088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:12.303287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:12.310939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:12.311661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:12.312420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:12.313446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:12.314388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:12.315640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:12.662029 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.network.security_group_api [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Adding security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 to port 382e2b0c-b661-4d5a-9ce3-d3dcea386a4a Oct 03 10:38:12.991222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:13.006427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:13.010665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:13.016684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f6fc7e3-5924-4316-96f9-580ffe25a424 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.715253 Oct 03 10:38:13.019306 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1008/2037] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:12 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:13.025153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:13.026181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:13.046727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:13.048425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:13.050200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:13.054355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:13.055125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:13.055982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:13.365330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:13.406793 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a36786c-ce6f-45b8-a3cc-b56819734b39 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.386002 Oct 03 10:38:13.408550 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1009/2038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:13 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:13.417673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:13.421548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:13.437417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:13.440696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:13.442371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:13.443395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:13.445813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:13.447548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:13.637693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:13.655424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c81cdd9-3f96-4ea7-9044-83ba1488599a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1211 microversion: 2.1 time: 0.244121 Oct 03 10:38:13.682638 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1010/2039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:13 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1211 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:13.693395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-28ea1d75-d8b4-41ce-8c98-573927cedc06 req-cee61978-6d95-444f-9046-9b7a90c73aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8884fae-5c49-408d-a73c-ac35eaa15f74", "tag": "8ef74993-db71-47ee-956d-b4546a98970f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:13.714733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-28ea1d75-d8b4-41ce-8c98-573927cedc06 req-cee61978-6d95-444f-9046-9b7a90c73aa7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:13.717638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-28ea1d75-d8b4-41ce-8c98-573927cedc06 req-cee61978-6d95-444f-9046-9b7a90c73aa7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:13.718876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-28ea1d75-d8b4-41ce-8c98-573927cedc06 req-cee61978-6d95-444f-9046-9b7a90c73aa7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:13.738551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:13.751641 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-28ea1d75-d8b4-41ce-8c98-573927cedc06 req-cee61978-6d95-444f-9046-9b7a90c73aa7 service nova] Creating event network-changed:8ef74993-db71-47ee-956d-b4546a98970f for instance f8884fae-5c49-408d-a73c-ac35eaa15f74 on n-h1-858383-3 Oct 03 10:38:13.765629 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-28ea1d75-d8b4-41ce-8c98-573927cedc06 req-cee61978-6d95-444f-9046-9b7a90c73aa7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081312 Oct 03 10:38:13.769289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1011/2040] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:13.779945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:13.784458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:13.802522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:13.803498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:13.804616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:13.805762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:13.806503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:13.807210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:14.122594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:14.140507 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-10b21ed7-7cd0-418e-89d6-afca93a0b322 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1305 microversion: 2.1 time: 0.361669 Oct 03 10:38:14.142066 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1012/2041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:13 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1305 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:14.152718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:14.159367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:14.172578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:14.173345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:14.174782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:14.175687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:14.176671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:14.179182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:14.227055 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9c42a86-74fa-4b59-99d5-cf114cd08771 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083348 Oct 03 10:38:14.227859 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1013/2042] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:14 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:14.233569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:14.234462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:14.242363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:14.243138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:14.243799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:14.244755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:14.245445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:14.246052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:14.342371 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6999dda3-e8f9-4ffe-a45d-4747e8d0fa80 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65/action" status: 202 len: 0 microversion: 2.1 time: 2.544274 Oct 03 10:38:14.344148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1030/2043] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:38:11 2022] POST /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65/action => generated 0 bytes in 2548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:14.356165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aaa666a1-52d8-480c-a473-6ccc286820eb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f07574ee820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:14.551375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:14.560903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:14.565472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:14.566714 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae46a246-479c-4479-b672-4a581d52551e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.337623 Oct 03 10:38:14.567290 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1014/2044] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:14 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:14.593382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ce799673-0bc5-4002-83f0-456e9a6725ec req-13a8ba3b-a7c2-4c4d-bd2c-2fc021576185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c82c03-27d1-4b64-b85c-06c6f90b3c65", "tag": "382e2b0c-b661-4d5a-9ce3-d3dcea386a4a"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:14.629812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce799673-0bc5-4002-83f0-456e9a6725ec req-13a8ba3b-a7c2-4c4d-bd2c-2fc021576185 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:14.634944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce799673-0bc5-4002-83f0-456e9a6725ec req-13a8ba3b-a7c2-4c4d-bd2c-2fc021576185 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:14.636186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce799673-0bc5-4002-83f0-456e9a6725ec req-13a8ba3b-a7c2-4c4d-bd2c-2fc021576185 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:14.667636 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ce799673-0bc5-4002-83f0-456e9a6725ec req-13a8ba3b-a7c2-4c4d-bd2c-2fc021576185 service nova] Creating event network-changed:382e2b0c-b661-4d5a-9ce3-d3dcea386a4a for instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 on n-h2-858383-3 Oct 03 10:38:14.684726 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ce799673-0bc5-4002-83f0-456e9a6725ec req-13a8ba3b-a7c2-4c4d-bd2c-2fc021576185 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091237 Oct 03 10:38:14.686087 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1015/2045] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:14.699218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:14.700529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:14.714925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:14.716863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:14.719528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:14.721435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:14.724516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:14.727000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.037683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:15.048032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b204b7a-598c-4b13-b2d1-a7fc8a6aea47 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.360208 Oct 03 10:38:15.066753 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1016/2046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:14 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:15.077193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:15.077957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:15.085077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.086400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.087097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.088330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.089052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.089707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.217152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:15.228005 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dafa42ad-cbb2-4713-916b-c3ed4842df02 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1273 microversion: 2.1 time: 0.156620 Oct 03 10:38:15.234158 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1017/2047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:15 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:15.247019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:15.248093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:15.265484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.267735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.269360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.272002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.272730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.276376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.379834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-aaa666a1-52d8-480c-a473-6ccc286820eb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use.", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:15.380540 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-aaa666a1-52d8-480c-a473-6ccc286820eb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use. Oct 03 10:38:15.380540 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-669dfcc5-092b-4833-bf6a-bbae28871422'] Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aaa666a1-52d8-480c-a473-6ccc286820eb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0 HTTP/1.1 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: exception: Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use. Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-669dfcc5-092b-4833-bf6a-bbae28871422'] Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '31d04bfa-3be1-41b8-807d-affcfd3cedc0'} Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:15.382560 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use. Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-669dfcc5-092b-4833-bf6a-bbae28871422'] Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use. Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-669dfcc5-092b-4833-bf6a-bbae28871422'] Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use. Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-669dfcc5-092b-4833-bf6a-bbae28871422'] Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use. Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-669dfcc5-092b-4833-bf6a-bbae28871422'] Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aaa666a1-52d8-480c-a473-6ccc286820eb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 400 to user: Security Group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 in use. Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-669dfcc5-092b-4833-bf6a-bbae28871422'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:15.387234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aaa666a1-52d8-480c-a473-6ccc286820eb tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0" status: 400 len: 185 microversion: 2.1 time: 1.035199 Oct 03 10:38:15.392279 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1031/2048] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:14 2022] DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0 => generated 185 bytes in 1040 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:38:15.397038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:15.408562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:15.432598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.438012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.439404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.442478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.442967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.443406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.493983 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e83f8de5-a65b-4bca-a1b7-0960d3b62d3f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103724 Oct 03 10:38:15.496214 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1032/2049] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:15 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:15.502661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:15.505707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:15.512382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.513302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.514147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.515110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.515920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.516702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.705166 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb656e9b-10e3-4b8b-97d7-b511e37c9b7c tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65/action" status: 202 len: 0 microversion: 2.1 time: 0.207288 Oct 03 10:38:15.706014 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1033/2050] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:38:15 2022] POST /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:15.714332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:15.715043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:15.737589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.738390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.741131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.748603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:15.749410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:15.750068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:15.995360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:16.005965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-67633695-3ad6-47c8-96cf-9ecea7e12b12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1305 microversion: 2.1 time: 0.770246 Oct 03 10:38:16.012280 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1018/2051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:15 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1305 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:16.018799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:16.019633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:16.042698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:16.045812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:16.046471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:16.054410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:16.056429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:16.057267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:16.586643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:16.598093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:16.609826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:16.616636 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb373cce-4cae-4d0a-992b-a84b214facc6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.904218 Oct 03 10:38:16.617941 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1034/2052] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:15 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:16.626551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:16.628787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:16.633837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:16.646486 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-450c4b93-5c56-41ad-a423-a3450434a2b3 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1576 microversion: 2.1 time: 0.632706 Oct 03 10:38:16.653660 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1019/2053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:16 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1576 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:16.659241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:16.664746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:16.665547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:16.666205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:16.667874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:16.669747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:16.673438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:16.675508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:16.694511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:16.695471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:16.696086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:16.697279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:16.697912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:16.698514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:16.964207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:16.975690 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d31ef934-ad87-4c65-9036-a1820df01b4f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1273 microversion: 2.1 time: 0.320696 Oct 03 10:38:16.993998 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1020/2054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:16 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:17.005533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:17.011774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:17.024993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.029899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.030495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.031468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.032407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.034048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.068561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:17.123584 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-733af7ca-18d6-423f-9f98-ed8ba14dbf4b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128305 Oct 03 10:38:17.128200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1021/2055] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:16 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:17.134193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-21b779f8-6cd1-40ee-a836-80dc53446ffb req-d903ea05-a6dc-48e9-aaeb-eed18336a5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b47cf93-2c13-4da2-a235-792b654ee50a", "name": "network-vif-plugged", "status": "completed", "tag": "805060f5-3b8f-4c0a-a9c7-728249247e7e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:17.149479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21b779f8-6cd1-40ee-a836-80dc53446ffb req-d903ea05-a6dc-48e9-aaeb-eed18336a5ae service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.150427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21b779f8-6cd1-40ee-a836-80dc53446ffb req-d903ea05-a6dc-48e9-aaeb-eed18336a5ae service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.151080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21b779f8-6cd1-40ee-a836-80dc53446ffb req-d903ea05-a6dc-48e9-aaeb-eed18336a5ae service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.201434 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-21b779f8-6cd1-40ee-a836-80dc53446ffb req-d903ea05-a6dc-48e9-aaeb-eed18336a5ae service nova] Creating event network-vif-plugged:805060f5-3b8f-4c0a-a9c7-728249247e7e for instance 0b47cf93-2c13-4da2-a235-792b654ee50a on n-h2-858383-3 Oct 03 10:38:17.219654 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-21b779f8-6cd1-40ee-a836-80dc53446ffb req-d903ea05-a6dc-48e9-aaeb-eed18336a5ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087565 Oct 03 10:38:17.238458 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1022/2056] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:17.256219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:17.257644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:17.279710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.280577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.286284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.287160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.287754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.288294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.405032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:17.419140 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f62db9d-5297-4f7d-9dad-71bebb71dc36 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.794597 Oct 03 10:38:17.420686 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1035/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:16 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:17.648402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:17.650288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:17.655508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:17.662290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.665334 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce83dab2-ce85-461a-a665-668018bf9fb7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1305 microversion: 2.1 time: 0.422671 Oct 03 10:38:17.666257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.667244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.667995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.668520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.669207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.670957 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1023/2058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:17 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1305 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:17.680631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:17.689216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:17.695669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.697479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.700993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:17.701963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:17.702605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:17.703229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.204691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:18.221799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:18.224604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:18.226138 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b57266a-7d4b-4113-8d2d-67b063369f67 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.581877 Oct 03 10:38:18.227391 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1036/2059] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:17 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:38:18.239462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:18.240306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:18.257845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.258627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.259743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.261611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.263683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.264555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.310366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:18.338888 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7eaa344-2e12-45ce-b2cb-320507a7ae19 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1576 microversion: 2.1 time: 0.662230 Oct 03 10:38:18.347255 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1024/2060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:17 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1576 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:18.356200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:18.366381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:18.373449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.374220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.374855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.375942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.376571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.377787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.417792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ead68a1-bc08-4845-9ec8-9be6fbf24389 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068537 Oct 03 10:38:18.424748 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1025/2061] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:18 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:18.452544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:18.458698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:18.477326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.480211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.481334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.483095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.485686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.486945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.603294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:18.622118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c5f39437-62d5-4c78-8796-17eada2923c2 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1315 microversion: 2.1 time: 0.393412 Oct 03 10:38:18.622730 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1037/2062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:18 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:18.692066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:18.694514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:18.706215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.707323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.707770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.708493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:18.708982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:18.709416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:18.856262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:18.871218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9fde37b2-3523-4d2c-b490-7e184e203b05 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1317 microversion: 2.1 time: 0.422400 Oct 03 10:38:18.872584 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1026/2063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:18 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:18.992666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:19.007507 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80aee0e3-9393-4780-a3d8-361e1c248bf1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1305 microversion: 2.1 time: 0.318012 Oct 03 10:38:19.018443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1038/2064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:18 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1305 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:38:19.081565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3c2a1209-4309-461f-996e-8fa5fc77d907 req-142d152e-b69d-43fd-a8fd-936c56897c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526ce62d-b9fd-4185-8c2d-53e834077570", "tag": "d610340f-d1d1-46a6-8ce4-cf4b05c0022b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:19.103177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c2a1209-4309-461f-996e-8fa5fc77d907 req-142d152e-b69d-43fd-a8fd-936c56897c4e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.105026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c2a1209-4309-461f-996e-8fa5fc77d907 req-142d152e-b69d-43fd-a8fd-936c56897c4e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.105484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c2a1209-4309-461f-996e-8fa5fc77d907 req-142d152e-b69d-43fd-a8fd-936c56897c4e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.163405 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3c2a1209-4309-461f-996e-8fa5fc77d907 req-142d152e-b69d-43fd-a8fd-936c56897c4e service nova] Creating event network-changed:d610340f-d1d1-46a6-8ce4-cf4b05c0022b for instance 526ce62d-b9fd-4185-8c2d-53e834077570 on n-h2-858383-3 Oct 03 10:38:19.189748 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3c2a1209-4309-461f-996e-8fa5fc77d907 req-142d152e-b69d-43fd-a8fd-936c56897c4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110493 Oct 03 10:38:19.190418 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1027/2065] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:38:19.258773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:19.259389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:19.273957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.274458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.274911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.275638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.276115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.276530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.371035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:19.371752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:19.383471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.383970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.384439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.394283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.395010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.395668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.780984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:19.800002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:19.803948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:19.810507 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40d0b5fc-5dc2-4cd6-a789-dbd90d89c92a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.556059 Oct 03 10:38:19.815292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1039/2066] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:19 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:19.828318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:19.831241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:19.839060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.839946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.840751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.841755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.842396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.842998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.884216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-367c2bc5-8333-455d-b842-a2c827a743bb tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066175 Oct 03 10:38:19.885506 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1040/2067] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:19 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:19.890782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:19.891841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:19.901175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.902036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.902670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:19.903616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:19.904261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:19.904903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.160249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:20.175794 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f77b5d8-4604-4217-989a-6d9bbb404d89 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1315 microversion: 2.1 time: 0.288708 Oct 03 10:38:20.189181 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1041/2068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:19 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:20.189181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:20.189181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:20.196021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.196021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.196021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.197259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.197721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.198275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.424806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:20.439231 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b282f10e-aa7c-47ba-8a1f-28863dace943 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1576 microversion: 2.1 time: 1.072709 Oct 03 10:38:20.460247 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1028/2069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:19 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1576 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:20.465247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:20.466034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:20.488800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.489373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.489816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.490537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.490989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.491418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.560841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:20.578117 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-738f030c-6e1a-4d47-b46a-a2dc5be4af22 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1506 microversion: 2.1 time: 0.399309 Oct 03 10:38:20.579076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1042/2070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:20 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:20.621387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:20.622446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:20.638880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.641765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.645973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.647586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.649142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.651693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.733456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:20.740592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-965da67a-9a37-4b70-bc6d-d7df07441b88 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a/ips" status: 200 len: 109 microversion: 2.1 time: 0.130300 Oct 03 10:38:20.744275 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1043/2071] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:38:20 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a/ips => generated 109 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:20.748737 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7ef396d-0f2e-4589-a168-c1e4565056b7 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1305 microversion: 2.1 time: 0.287245 Oct 03 10:38:20.749344 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1029/2072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:20 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:20.756465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:20.757212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:20.774841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.775398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.776515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.777334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.777926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.779328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.826486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb9b157a-be32-43a9-b4d1-5b4cc1e9e245 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a/ips" status: 200 len: 109 microversion: 2.1 time: 0.071722 Oct 03 10:38:20.830781 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1044/2073] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:38:20 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a/ips => generated 109 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:20.843989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:20.844583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:20.855738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.857300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:20.857794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.858262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.858983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.859356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:20.859482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.862915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.869154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.870200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.872491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.873514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.874443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.875104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.912078 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d87ee63-e8f2-4e31-aeb4-194e36fdc1bc tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a/ips/tempest-ServerAddressesTestJSON-317021940-network" status: 200 len: 94 microversion: 2.1 time: 0.072782 Oct 03 10:38:20.918590 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1030/2074] 10.222.0.27 () {58 vars in 1398 bytes} [Mon Oct 3 10:38:20 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a/ips/tempest-ServerAddressesTestJSON-317021940-network => generated 94 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:38:20.930963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:20.935413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:20.944562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.945855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.946270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:20.947098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:20.947693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:20.948280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.034586 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78b38fd4-a833-44ed-860b-b79f222756b9 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114063 Oct 03 10:38:21.035270 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1031/2075] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:20 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:21.042325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:21.043060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:21.077043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.078137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.078740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.079719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.081189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.081798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.115365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:38:21.345182 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c65a9c2-bfa6-419d-8405-56d47ae986a0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 204 len: 0 microversion: 2.1 time: 0.306371 Oct 03 10:38:21.351708 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1032/2076] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:38:21 2022] DELETE /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:38:21.363424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:21.364878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:21.374378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.375210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.376033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.378293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.379154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.379850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.466758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:21.474299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:21.490082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:21.495317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:21.499550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7e12daeb-7362-4039-bb64-687e3155f279 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.657123 Oct 03 10:38:21.500380 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1045/2077] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:20 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:21.510635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:21.512633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:21.530693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.531195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.534591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.535396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.535875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.543048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.669433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:21.683992 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64e3d980-d8b8-4188-bdb6-bb42689e0fe0 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1315 microversion: 2.1 time: 0.330442 Oct 03 10:38:21.685186 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1033/2078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:21 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:21.690537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:21.691717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:21.699101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.699867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.714436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.715774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:21.716865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:21.717479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:21.796177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:21.807303 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d19bd37-cbbf-45d3-a62e-2f96e744372e tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1512 microversion: 2.1 time: 0.304137 Oct 03 10:38:21.829373 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1046/2079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:21 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:21.837248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1437459225", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "d19d3674-fc0c-4b4b-8410-c5e5f492a262"}, {"uuid": "99588308-0766-48a9-a449-4e5fbd57bfef"}, {"uuid": "d19d3674-fc0c-4b4b-8410-c5e5f492a262"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:21.926137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] validate_networks() for [('d19d3674-fc0c-4b4b-8410-c5e5f492a262', None, None, None, None, None), ('99588308-0766-48a9-a449-4e5fbd57bfef', None, None, None, None, None), ('d19d3674-fc0c-4b4b-8410-c5e5f492a262', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:38:21.978202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:21.990904 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e441c238-8fdb-4654-9dff-053bc29342aa tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1581 microversion: 2.1 time: 0.304416 Oct 03 10:38:21.991963 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1034/2080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:21 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1581 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:21.996935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:21.998280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:22.010533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:22.013971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:22.014681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:22.015580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:22.016202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:22.017378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:22.020586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:22.076192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=24 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:22.240033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:22.251618 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f176eb3-079b-45bc-bf2f-71064da519f1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1305 microversion: 2.1 time: 0.256267 Oct 03 10:38:22.254666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1035/2081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:21 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1305 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:22.274998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1410921853", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f3f01fec-6192-4230-9d75-0f9c0fe4d3e8"}], "block_device_mapping_v2": [{"uuid": "949e1976-7ce9-40a2-9afb-d612382e0938", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:22.355079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] validate_networks() for [('f3f01fec-6192-4230-9d75-0f9c0fe4d3e8', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 03 10:38:22.524405 n-d-858383-3 devstack@n-api.service[122270]: ERROR sqlalchemy.pool.impl.QueuePool Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: Exception ignored in: . at 0x7f075747fb80> Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: Traceback (most recent call last): Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: connection_record.checkin() Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: pool.dispatch.checkin(connection, self) Oct 03 10:38:22.527759 n-d-858383-3 devstack@n-api.service[122270]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 03 10:38:22.529048 n-d-858383-3 devstack@n-api.service[122270]: fn(*args, **kw) Oct 03 10:38:22.529048 n-d-858383-3 devstack@n-api.service[122270]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 03 10:38:22.537869 n-d-858383-3 devstack@n-api.service[122270]: time.sleep(0) Oct 03 10:38:22.537869 n-d-858383-3 devstack@n-api.service[122270]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 03 10:38:22.541930 n-d-858383-3 devstack@n-api.service[122270]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 03 10:38:22.542744 n-d-858383-3 devstack@n-api.service[122270]: AssertionError: do not call blocking functions from the mainloop Oct 03 10:38:23.571182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:38:23.571775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:38:23.572071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:38:23.572481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:38:23.573016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:38:23.588045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:23.597757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:23.598496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:23.599484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:23.600114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:23.600701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:23.640725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:38:23.657726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Getting quotas for user 6f0eda1654514026b803bcf2a1b8f4f4 and project 336e8fee9a974d92b181d7a600cf0ede. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:38:24.192616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:38:24.193788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:38:24.194432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:38:24.195037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:38:24.195943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:38:24.223545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.226190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.227884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:24.229837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.230857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.231709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:24.259797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Getting quotas for project ef9c270a5d5343e690bf17c988e25115. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:38:24.268253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Getting quotas for user c8f07ab449064cfea68877b477f897ab and project ef9c270a5d5343e690bf17c988e25115. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:38:24.288178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:38:24.291624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:38:24.356663 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-adde2a9c-557d-4166-bfea-4c2e34672a1e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.525813 Oct 03 10:38:24.359124 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1047/2082] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:38:24.369629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:24.375902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:24.392460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.393034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.395685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:24.396453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.396955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.397390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:24.509966 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-731b4049-a883-4545-af91-6c52b6b65258 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149285 Oct 03 10:38:24.516605 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1048/2083] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:38:24 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:38:24.529949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:24.530821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:24.543453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.544870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.546860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:24.547730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.550970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.551596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:24.873379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:24.882408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:24.896197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:24.898391 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9efec63d-4d38-456f-bcd4-0d80bffce537 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.375976 Oct 03 10:38:24.901228 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1049/2084] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:24 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:24.930976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:24.932449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:24.949630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.952971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.953661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:24.955996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:24.957341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:24.958600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.226068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:38:25.229007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='949e1976-7ce9-40a2-9afb-d612382e0938',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:38:25.258674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:25.275108 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3734f00-dd28-4e65-9244-1f5b957a4f30 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1315 microversion: 2.1 time: 0.355417 Oct 03 10:38:25.276131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1050/2085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:24 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:25.284909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:25.285903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:25.295958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.296900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.297874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.299699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.300392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.301239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.366893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.366893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.367921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.368492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lazy-loading 'fault' on Instance uuid 0b47cf93-2c13-4da2-a235-792b654ee50a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:25.454988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10660d35b0c44afe9f4f4fd1dc08acf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b2728af27949faaf2af813181e5128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:25.473550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2cc43141-a57f-452b-8572-6c9026d490ea tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 200 len: 1307 microversion: 2.1 time: 0.196006 Oct 03 10:38:25.474985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1051/2086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:25 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:25.488833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:25.492303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:25.503021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.509217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.509733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.510525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.514693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.515432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.778330 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-689924c4-b5f9-4165-a33d-d81d0278a035 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.507856 Oct 03 10:38:25.780063 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1036/2087] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:38:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:38:25.793289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:25.796963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:25.816384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.817262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.819315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.821512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.822488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.824101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.858667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:25.872017 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b900642-aa4a-4f53-be2f-54340d67a411 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1574 microversion: 2.1 time: 0.395520 Oct 03 10:38:25.882426 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1052/2088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:25 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1574 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:25.898285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:25.898959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:25.915351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.916031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.916468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:25.917200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:25.917653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:25.918079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:26.022410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:26.034571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-93de1006-191e-4502-afad-64bab8537d28 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1265 microversion: 2.1 time: 0.150988 Oct 03 10:38:26.035476 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1053/2089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:25 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:26.040553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1158fe54-8449-4c6f-a505-0c9afea27671 req-0661992a-0c56-4802-a84d-8ea556256e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b47cf93-2c13-4da2-a235-792b654ee50a", "name": "network-vif-deleted", "tag": "805060f5-3b8f-4c0a-a9c7-728249247e7e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:26.052671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1158fe54-8449-4c6f-a505-0c9afea27671 req-0661992a-0c56-4802-a84d-8ea556256e72 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:26.053411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1158fe54-8449-4c6f-a505-0c9afea27671 req-0661992a-0c56-4802-a84d-8ea556256e72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:26.054007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1158fe54-8449-4c6f-a505-0c9afea27671 req-0661992a-0c56-4802-a84d-8ea556256e72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:26.068118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1158fe54-8449-4c6f-a505-0c9afea27671 req-0661992a-0c56-4802-a84d-8ea556256e72 service nova] Creating event network-vif-deleted:805060f5-3b8f-4c0a-a9c7-728249247e7e for instance 0b47cf93-2c13-4da2-a235-792b654ee50a on n-h2-858383-3 Oct 03 10:38:26.076399 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1158fe54-8449-4c6f-a505-0c9afea27671 req-0661992a-0c56-4802-a84d-8ea556256e72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039356 Oct 03 10:38:26.077037 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1054/2090] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:26.086726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-786702836", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "ce4be49c-f185-4618-9293-a32849acdd0d"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:26.130084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:26.150035 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86d3a239-1441-4b9f-b878-873a85542ab1 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.367560 Oct 03 10:38:26.151182 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1037/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:25 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:26.156526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4abc7616-e1f2-41b7-a552-5d1fd14f060a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:26.159393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4abc7616-e1f2-41b7-a552-5d1fd14f060a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:26.161069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] validate_networks() for [('ce4be49c-f185-4618-9293-a32849acdd0d', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:38:26.242292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4abc7616-e1f2-41b7-a552-5d1fd14f060a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:26.258870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4abc7616-e1f2-41b7-a552-5d1fd14f060a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1053 microversion: 2.1 time: 0.106124 Oct 03 10:38:26.275869 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1038/2092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:26 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1053 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:26.284537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1084514232"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:26.285477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:26.294870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:26.296932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:26.297617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:26.301434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:26.302258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:26.303826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:26.501061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.network.security_group_api [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Adding security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a to port 382e2b0c-b661-4d5a-9ce3-d3dcea386a4a Oct 03 10:38:26.968173 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff510280-24b8-40bd-82d3-d7702ab55ec8 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65/action" status: 202 len: 0 microversion: 2.1 time: 0.689426 Oct 03 10:38:26.968829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1039/2093] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:38:26 2022] POST /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:26.977971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:26.978588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:27.005892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.007190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.007646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.011051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.011569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.012019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.090874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:27.101507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:38:27.102630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:38:27.103317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:38:27.104073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:38:27.104661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:38:27.120702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.121236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.121676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.122420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.122885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.123308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.146592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:27.158931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Getting quotas for project 28ea44afdf844c3bbb6b47365689d17f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:38:27.167820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Getting quotas for user d1f1b0913e804b8ba305ce34ac8900a5 and project 28ea44afdf844c3bbb6b47365689d17f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:38:27.214962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:38:27.217511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:38:27.386186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6184ddbd-9a20-40e2-a700-4c67e4fb3d51 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303262 Oct 03 10:38:27.390954 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1055/2094] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:38:27.412853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-bbb99abb-45d2-4832-aa6d-2eab43af9e4b req-96255ffd-ce20-480c-ac16-94c9459d6953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526ce62d-b9fd-4185-8c2d-53e834077570", "name": "network-vif-plugged", "status": "completed", "tag": "d610340f-d1d1-46a6-8ce4-cf4b05c0022b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:27.433220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bbb99abb-45d2-4832-aa6d-2eab43af9e4b req-96255ffd-ce20-480c-ac16-94c9459d6953 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.434002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bbb99abb-45d2-4832-aa6d-2eab43af9e4b req-96255ffd-ce20-480c-ac16-94c9459d6953 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.434638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bbb99abb-45d2-4832-aa6d-2eab43af9e4b req-96255ffd-ce20-480c-ac16-94c9459d6953 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.451810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-bbb99abb-45d2-4832-aa6d-2eab43af9e4b req-96255ffd-ce20-480c-ac16-94c9459d6953 service nova] Creating event network-vif-plugged:d610340f-d1d1-46a6-8ce4-cf4b05c0022b for instance 526ce62d-b9fd-4185-8c2d-53e834077570 on n-h2-858383-3 Oct 03 10:38:27.459476 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-bbb99abb-45d2-4832-aa6d-2eab43af9e4b req-96255ffd-ce20-480c-ac16-94c9459d6953 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063977 Oct 03 10:38:27.460620 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1056/2095] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:27.465558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:27.475268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:27.476725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:27.477932 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f6cb4096-2573-4ab1-b810-5bb17a407684 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.504461 Oct 03 10:38:27.482526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:27.483805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:27.486283 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1040/2096] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:26 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:27.500016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:27.500639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] [instance: 0b47cf93-2c13-4da2-a235-792b654ee50a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:27.503203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:27.517221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.517764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.526049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.527663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.528755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.529750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.540007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.540534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.543618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.548361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.550561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.551010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.569824 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] HTTP exception thrown: Instance 0b47cf93-2c13-4da2-a235-792b654ee50a could not be found. Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Request method failure captured: Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a HTTP/1.1 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOruBcjQILQDpkphlO4hhxfpYA384YBKKuNMbCgz5F9vwul2gCVpXXN0eBYtm49VXHzJFlMDvk3UE1e855eyxvW-XJ7UisjG8hlrnF4Jk26CNBXMkvwCXKX8NABdPixcq-QYxoBbG5KZx3PtjiClAzIt69pn5C5xoPosM4Isbwkc-rAg Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 39b2728af27949faaf2af813181e5128 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerAddressesTestJSON-34538839 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39b2728af27949faaf2af813181e5128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39b2728af27949faaf2af813181e5128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39b2728af27949faaf2af813181e5128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39b2728af27949faaf2af813181e5128"}]}] Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerAddressesTestJSON-34538839 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 39b2728af27949faaf2af813181e5128 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerAddressesTestJSON-34538839 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerAddressesTestJSON-34538839-project Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 10660d35b0c44afe9f4f4fd1dc08acf7 Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerAddressesTestJSON-34538839-project Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 0b47cf93-2c13-4da2-a235-792b654ee50a could not be found. Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '0b47cf93-2c13-4da2-a235-792b654ee50a'} Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b47cf93-2c13-4da2-a235-792b654ee50a could not be found. Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b47cf93-2c13-4da2-a235-792b654ee50a could not be found. Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:27.572259 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:27.577092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:27.577092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:27.577092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:27.577092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:27.577092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:27.577092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b47cf93-2c13-4da2-a235-792b654ee50a could not be found. Oct 03 10:38:27.577092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:27.585387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] Returning 404 to user: Instance 0b47cf93-2c13-4da2-a235-792b654ee50a could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:27.587192 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce774397-ddfa-46ba-b5f8-d9ece3d849e0 tempest-ServerAddressesTestJSON-34538839 tempest-ServerAddressesTestJSON-34538839-project] 10.222.0.27 "GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a" status: 404 len: 111 microversion: 2.1 time: 0.099319 Oct 03 10:38:27.591149 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1041/2097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:27 2022] GET /compute/v2.1/servers/0b47cf93-2c13-4da2-a235-792b654ee50a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:27.602050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b58568f4-5451-40e7-b98d-3446389f0976 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f075736bdc0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:27.844001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:27.857149 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56e8e068-8e13-4328-b342-5882a99e77e5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1315 microversion: 2.1 time: 0.395088 Oct 03 10:38:27.887165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1057/2098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:27 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:27.909263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a03b5eb8-e9a0-41f1-8015-bc0a465d3b87 req-8580693d-ffed-4fd5-bb95-c6d6c7367aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c82c03-27d1-4b64-b85c-06c6f90b3c65", "tag": "382e2b0c-b661-4d5a-9ce3-d3dcea386a4a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:27.928837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a03b5eb8-e9a0-41f1-8015-bc0a465d3b87 req-8580693d-ffed-4fd5-bb95-c6d6c7367aa3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:27.929481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a03b5eb8-e9a0-41f1-8015-bc0a465d3b87 req-8580693d-ffed-4fd5-bb95-c6d6c7367aa3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:27.929913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a03b5eb8-e9a0-41f1-8015-bc0a465d3b87 req-8580693d-ffed-4fd5-bb95-c6d6c7367aa3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:27.952472 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a03b5eb8-e9a0-41f1-8015-bc0a465d3b87 req-8580693d-ffed-4fd5-bb95-c6d6c7367aa3 service nova] Creating event network-changed:382e2b0c-b661-4d5a-9ce3-d3dcea386a4a for instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 on n-h2-858383-3 Oct 03 10:38:27.969727 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a03b5eb8-e9a0-41f1-8015-bc0a465d3b87 req-8580693d-ffed-4fd5-bb95-c6d6c7367aa3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080863 Oct 03 10:38:27.971737 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1058/2099] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:27.977856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:27.987675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:27.998848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.010098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.010785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.011708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.012329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.013115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.285597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:28.303630 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-064e81b6-d5f6-44da-b0ae-cbfd54159a5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1283 microversion: 2.1 time: 0.330406 Oct 03 10:38:28.309182 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1059/2100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:27 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1283 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:28.334146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:28.334967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:28.351034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.357050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.357548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.360082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.363787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.365331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.390530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-b58568f4-5451-40e7-b98d-3446389f0976 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use.", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:28.391519 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b58568f4-5451-40e7-b98d-3446389f0976 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use. Oct 03 10:38:28.391519 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-39e8d65d-f05d-4bc2-bf04-ecea75089602'] Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b58568f4-5451-40e7-b98d-3446389f0976 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a HTTP/1.1 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: exception: Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use. Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-39e8d65d-f05d-4bc2-bf04-ecea75089602'] Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '9b0ff2f6-365b-4655-a6e8-2a32e32f849a'} Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:28.393993 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use. Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39e8d65d-f05d-4bc2-bf04-ecea75089602'] Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use. Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39e8d65d-f05d-4bc2-bf04-ecea75089602'] Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use. Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39e8d65d-f05d-4bc2-bf04-ecea75089602'] Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use. Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39e8d65d-f05d-4bc2-bf04-ecea75089602'] Oct 03 10:38:28.399409 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:28.404595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b58568f4-5451-40e7-b98d-3446389f0976 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 400 to user: Security Group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a in use. Oct 03 10:38:28.404595 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-39e8d65d-f05d-4bc2-bf04-ecea75089602'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:28.405975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b58568f4-5451-40e7-b98d-3446389f0976 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a" status: 400 len: 185 microversion: 2.1 time: 0.812626 Oct 03 10:38:28.406708 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1042/2101] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:27 2022] DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a => generated 185 bytes in 815 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:38:28.418724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:28.419865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:28.438968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.440790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.441945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.443520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.445659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.447294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.624124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:28.635913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:28.647519 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-986c0ab7-3a85-4e78-91f4-916467668f29 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.336596 Oct 03 10:38:28.648571 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1060/2102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:28 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:28.650954 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e569a939-8a33-469c-8b41-975b4e751dbd tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1095 microversion: 2.1 time: 0.242708 Oct 03 10:38:28.651631 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1043/2103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:28 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1095 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:28.657183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:28.657328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:28.658936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:28.664498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:28.670763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.671546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.671821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.672320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.672477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.673094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.673488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.674184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.674695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.685936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.687043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.687745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.740054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:38:28.744591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:28.754177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df3efc7b-c260-4a0f-8c64-ce437363b3cf tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1221 microversion: 2.1 time: 0.104152 Oct 03 10:38:28.764906 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1061/2104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:28 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:28.764906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:28.764906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:28.773464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.773464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.773464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.773464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.773464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.773464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.901474 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2497c78d-1522-4672-828a-1a6f11493312 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 204 len: 0 microversion: 2.1 time: 0.247751 Oct 03 10:38:28.906679 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1044/2105] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:38:28 2022] DELETE /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:38:28.932717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:28.934260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:28.949933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.950686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.951303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:28.952223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:28.953101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:28.953721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.168703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.178759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.180257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.181811 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed585e6a-31f9-424f-8d3d-952da0febba5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.425393 Oct 03 10:38:29.182535 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1062/2106] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:28 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:29.187148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:29.187968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:29.195647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.196399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.197045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.197935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.198560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.199152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.401608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.405355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.413768 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c939875c-f579-465f-ad3a-3396332fba78 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1649 microversion: 2.1 time: 0.229889 Oct 03 10:38:29.416301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8738103e-7e7f-49ca-930a-1d7394b53873 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1315 microversion: 2.1 time: 0.504028 Oct 03 10:38:29.430207 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1045/2107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:28 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:29.431316 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1063/2108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:29 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1649 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:29.442078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:29.443447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:29.451805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.452618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.453290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.454322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.454981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.455996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.550351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.558430 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-470ca143-8d9b-4457-940b-b5ed38caf361 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1271 microversion: 2.1 time: 0.126848 Oct 03 10:38:29.559200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1046/2109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:29 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:29.671337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:29.672354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:29.681188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:29.681755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.682237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.682681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.683365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:29.683951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.684411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.684874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.691666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.692522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.693397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.694376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.695091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.695756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.791052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.804355 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61756cd1-fc77-49db-9ff9-188dc082b8c0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1151 microversion: 2.1 time: 0.126798 Oct 03 10:38:29.806224 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1047/2110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:29 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1151 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:29.813143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:29.814058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:29.822132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.822954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.823650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.824621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:29.825352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:29.826699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:29.884193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.893124 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89f819ca-929c-4e09-97dc-1dc8764dad26 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.226089 Oct 03 10:38:29.894035 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1064/2111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:29 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:29.912288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:29.921686 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5741eb0d-205a-4fe4-a457-104aa2f8ba6e tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1213 microversion: 2.1 time: 0.113884 Oct 03 10:38:29.924830 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1048/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:29 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:30.208070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:30.209249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:30.216076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.216872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.217502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:30.218412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.219038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.219657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:30.236307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:30.443252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:30.444144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:30.459655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.462890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.463361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:30.464133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.468650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.469140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:30.488387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:30.506815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:30.508757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:30.510300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eaef30c7-7514-4efa-80e0-df1c69e9a389 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.306653 Oct 03 10:38:30.511649 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1065/2113] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:30 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:30.518695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:30.519731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:30.526740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.527765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.528490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:30.529616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.530250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.530950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:30.870316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:30.884504 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1d93bc1-8593-4292-b807-487e625b20a1 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1502 microversion: 2.1 time: 0.371399 Oct 03 10:38:30.896600 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1066/2114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:30 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1502 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:30.912450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:30.916326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:30.929165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.930833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.933306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:30.935370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:30.944541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:30.945500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.197267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:31.210380 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53483109-8d8a-48d7-8d42-ea1952bfde6d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1313 microversion: 2.1 time: 0.312236 Oct 03 10:38:31.211526 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1067/2115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:30 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:31.219223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:31.221046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:31.234950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.235754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.237388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.238673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.250067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.250991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.352313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:31.368839 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb0a16d3-b1ce-44c4-8b50-b6ded98fbd1e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1159 microversion: 2.1 time: 0.155712 Oct 03 10:38:31.379313 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1068/2116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:31 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1159 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:31.379313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:31.379313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:31.384872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.384872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.384872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.384872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.385316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.386073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.421149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:38:31.487551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:31.502241 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9d04f0f-675e-4721-9d6d-3ce6ee195359 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1649 microversion: 2.1 time: 1.063281 Oct 03 10:38:31.503659 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1049/2117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:30 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1649 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:31.509373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:31.510581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:31.519816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.520690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.521431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.522444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.523465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.524093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.534208 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a37ecb64-7e1d-4c58-9753-29f9ffa17bce tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "DELETE /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 204 len: 0 microversion: 2.1 time: 0.162154 Oct 03 10:38:31.540836 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1069/2118] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:38:31 2022] DELETE /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:38:31.550359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:31.551384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:31.559455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.560297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.560954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.561914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.562575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.564253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.647796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:31.657514 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4321297f-4366-4473-b25e-583769a37315 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1269 microversion: 2.1 time: 0.114912 Oct 03 10:38:31.659208 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1070/2119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:31 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:31.667478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:31.670095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:31.677603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.678102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.678537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.679292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.679781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.680188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.842016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:31.852846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:31.854305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:31.855824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81d21c2f-8402-462e-8247-e7989ce427e6 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.194033 Oct 03 10:38:31.856381 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1071/2120] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:31 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:31.861367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:31.862522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:31.869667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.870410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.871015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:31.871902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:31.872508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:31.873177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.029421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:32.039991 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f830ea2a-0318-49b1-b6d9-283d8fc4bace tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.534714 Oct 03 10:38:32.050738 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1050/2121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:31 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:32.053826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:32.071964 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e054cb47-6041-478c-aaaa-c079902095db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1508 microversion: 2.1 time: 0.214103 Oct 03 10:38:32.073003 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1072/2122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:31 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:32.235605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:32.236528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:32.243532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.244458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.245051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.246476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.247139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.247569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.404638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:32.408703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:32.421117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.422237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.423235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.425013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.426951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.427525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.589360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:32.617193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3cead9f4-e3c8-4316-83d8-a260a64aa0e0 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1169 microversion: 2.1 time: 0.221134 Oct 03 10:38:32.618642 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1073/2123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:32 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1169 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:32.630497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:32.633813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:32.666431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.669101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.671704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.674659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.676363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.677174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.905777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:32.918945 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-98a13840-a1f5-4bd3-b8f7-27544ca1d474 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 200 len: 1469 microversion: 2.1 time: 0.298810 Oct 03 10:38:32.921624 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1074/2124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:32 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:32.932541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:32.935605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:32.948830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.951444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.952754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:32.954632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:32.955889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:32.958562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:33.011960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:33.025302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33390f81-e4d1-41cf-aaad-4bf2aa74118f tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1334 microversion: 2.1 time: 0.795102 Oct 03 10:38:33.027506 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1051/2125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:32 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1334 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:33.041011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:33.041873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:33.053266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:33.056371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:33.057304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:33.060272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:33.061014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:33.062699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:33.121259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:33.133904 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0af7bce8-10b0-43e6-af26-3c34d2c59398 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1269 microversion: 2.1 time: 0.209476 Oct 03 10:38:33.137472 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1075/2126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:32 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:33.153541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-071f247c-4557-4516-bd33-b50a98e24158 req-2e10ff32-7778-44e1-a2ee-9d898afe0542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c82c03-27d1-4b64-b85c-06c6f90b3c65", "name": "network-vif-deleted", "tag": "382e2b0c-b661-4d5a-9ce3-d3dcea386a4a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:33.181210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-071f247c-4557-4516-bd33-b50a98e24158 req-2e10ff32-7778-44e1-a2ee-9d898afe0542 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:33.183211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-071f247c-4557-4516-bd33-b50a98e24158 req-2e10ff32-7778-44e1-a2ee-9d898afe0542 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:33.184257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-071f247c-4557-4516-bd33-b50a98e24158 req-2e10ff32-7778-44e1-a2ee-9d898afe0542 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:33.214783 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-071f247c-4557-4516-bd33-b50a98e24158 req-2e10ff32-7778-44e1-a2ee-9d898afe0542 service nova] Creating event network-vif-deleted:382e2b0c-b661-4d5a-9ce3-d3dcea386a4a for instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 on n-h2-858383-3 Oct 03 10:38:33.229888 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-071f247c-4557-4516-bd33-b50a98e24158 req-2e10ff32-7778-44e1-a2ee-9d898afe0542 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087912 Oct 03 10:38:33.230947 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1076/2127] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:33.248969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:33.256144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:33.277783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:33.279870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:33.280548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:33.283221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:33.284887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:33.288230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:33.555098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:33.565781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:33.596093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:33.597686 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e60af9bc-0953-4bb6-9c6b-2a0f8ba1606b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.566634 Oct 03 10:38:33.599221 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1052/2128] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:33 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:33.605968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:33.606575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:33.623074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:33.629296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:33.630419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:33.631047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:33.631972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:33.632595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:33.633213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.247942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:34.262033 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6ed7574d-4033-43ce-a416-5ade102636fc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 1.028570 Oct 03 10:38:34.262819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1077/2129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:33 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:34.268498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:34.274822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:34.286974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.287485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.288794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.290124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.290692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.291140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.485717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:34.498670 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2eee04ed-ba84-451e-b58c-84d8a0ce2f7c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1169 microversion: 2.1 time: 0.234157 Oct 03 10:38:34.528560 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1078/2130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:34 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1169 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:34.544827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:34.548014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:34.567462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.567811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.570822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.572087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.574177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.575065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.588972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:34.607489 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0efbe55-80c7-4e86-9ee0-fdb59ca42a5a tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1508 microversion: 2.1 time: 1.006914 Oct 03 10:38:34.610144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1053/2131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:33 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1508 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:34.611831 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 HTTP/1.1 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c0c82c03-27d1-4b64-b85c-06c6f90b3c65'} Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:34.615713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ebeeb473-782b-4d7e-a42e-5abe55b9955d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 404 len: 111 microversion: 2.1 time: 0.088244 Oct 03 10:38:34.623616 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1079/2132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:34 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:34.630339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:34.631128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:34.637174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:34.639341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.640040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.640745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.641254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:34.642229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.643499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.644506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.652014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.652570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.653137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.653917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:34.654566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:34.655067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:34.774469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:34.790823 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1395908-84bb-4d47-b188-c47d2fc39a3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1275 microversion: 2.1 time: 0.164475 Oct 03 10:38:34.808316 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1080/2133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:34 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:34.808316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b82d6de2-678a-4301-941f-269eaf68ff91 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074ebd1280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:35.225776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:35.234560 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6c245dc-4b08-408f-ab89-546e62783603 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1334 microversion: 2.1 time: 0.622802 Oct 03 10:38:35.235567 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1054/2134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:34 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1334 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:35.273316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:35.285310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:35.310362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:35.312067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:35.313244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:35.314249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:35.316697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:35.317458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:35.527349 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b82d6de2-678a-4301-941f-269eaf68ff91 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0" status: 202 len: 0 microversion: 2.1 time: 0.728070 Oct 03 10:38:35.528304 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1081/2135] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:34 2022] DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:35.536659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:35.537257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:35.553133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:35.557961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:35.558853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:35.559944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:35.560639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:35.561303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:35.841846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:35.846948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:35.867086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eeb026cb-6b99-4f28-a192-6303c80fac39 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.337570 Oct 03 10:38:35.868630 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1082/2136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:35 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:35.874460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5df5e23f-bd9a-4e80-911f-8f6653bbe57a req-70de016c-e5c6-4cea-ab13-8829c4305a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526ce62d-b9fd-4185-8c2d-53e834077570", "name": "network-vif-deleted", "tag": "d610340f-d1d1-46a6-8ce4-cf4b05c0022b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:35.887870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5df5e23f-bd9a-4e80-911f-8f6653bbe57a req-70de016c-e5c6-4cea-ab13-8829c4305a93 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:35.895543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5df5e23f-bd9a-4e80-911f-8f6653bbe57a req-70de016c-e5c6-4cea-ab13-8829c4305a93 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:35.896462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5df5e23f-bd9a-4e80-911f-8f6653bbe57a req-70de016c-e5c6-4cea-ab13-8829c4305a93 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:35.917199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5df5e23f-bd9a-4e80-911f-8f6653bbe57a req-70de016c-e5c6-4cea-ab13-8829c4305a93 service nova] Creating event network-vif-deleted:d610340f-d1d1-46a6-8ce4-cf4b05c0022b for instance 526ce62d-b9fd-4185-8c2d-53e834077570 on n-h2-858383-3 Oct 03 10:38:35.925437 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5df5e23f-bd9a-4e80-911f-8f6653bbe57a req-70de016c-e5c6-4cea-ab13-8829c4305a93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053951 Oct 03 10:38:35.930242 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1083/2137] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:35.938868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:35.940199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:35.949563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:35.950649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:35.952515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:35.953636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:35.957139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:35.958071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:36.156341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:36.175794 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d3257c23-9308-4c58-9f2d-5cdde408b193 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1211 microversion: 2.1 time: 0.243740 Oct 03 10:38:36.180129 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1084/2138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:35 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1211 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:36.194795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1b02635-b0f5-4225-9bca-1ba6dc0b82db tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074eb50af0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:36.250433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:36.562139 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1b02635-b0f5-4225-9bca-1ba6dc0b82db tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a" status: 202 len: 0 microversion: 2.1 time: 0.379313 Oct 03 10:38:36.563945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1085/2139] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:36 2022] DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:36.579745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:36.583159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:36.602032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:36.602539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:36.603039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:36.603780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:36.604307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:36.604710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:36.613876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:36.626472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:36.629133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:36.630739 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6717be9d-1075-4062-9e72-3f762e30e703 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 1.378356 Oct 03 10:38:36.652580 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1055/2140] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:35 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:36.668315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:36.672752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:36.682835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:36.683384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:36.683825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:36.684745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:36.686394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:36.686635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:36.686730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:36.686821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:36.686932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:36.686932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lazy-loading 'fault' on Instance uuid 526ce62d-b9fd-4185-8c2d-53e834077570 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:36.791517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de72bcdaa0841038de43990892c7094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b44c5ea7734a9dbb066ef1a6c9d077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:36.800502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75ce333d-c4ff-4284-a172-91236060b1a4 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 200 len: 1305 microversion: 2.1 time: 0.235364 Oct 03 10:38:36.801044 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1086/2141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:36 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 1305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:36.816753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:36.817475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:36.834392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:36.834919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:36.835368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:36.838557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:36.839049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:36.839723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:37.109476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:37.119043 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b4b3c37-bcaa-4954-a008-b930b238e5a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.316947 Oct 03 10:38:37.132791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1087/2142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:36 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:37.140434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0308531-dd5d-451c-bccd-bdd7fc40f4ab tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'create', calling method: .version_select at 0x7f074eb50550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-700230182", "description": "tempest-description-1665476988"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:37.146103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:37.194922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:37.343381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:37.346804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:37.363815 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06af97d4-ffc2-4c35-a847-e10387dd5b3b tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1275 microversion: 2.1 time: 0.708706 Oct 03 10:38:37.365088 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1056/2143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:36 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1275 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:37.369924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:37.374302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:37.390267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:37.390978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:37.391716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:37.392664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:37.393356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:37.393949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:37.763850 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c0308531-dd5d-451c-bccd-bdd7fc40f4ab tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.632792 Oct 03 10:38:37.765281 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1088/2144] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:38:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:37.771099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:37.771916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:37.788011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:37.788753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:37.793398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:37.794404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:37.795588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:37.796191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:38.075319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:38.088288 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a2a7be6-61a6-4481-9abb-1de0bfc9dec7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1211 microversion: 2.1 time: 0.321417 Oct 03 10:38:38.093652 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1089/2145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:37 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1211 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:38.103385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:38.104505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:38.114547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:38.115435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:38.116754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:38.118089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:38.118953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:38.120046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:38.136718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:38.148087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-286d588d-c134-438e-9a8d-9520918ac212 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.781181 Oct 03 10:38:38.153174 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1057/2146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:37 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:38.169897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98c888c0-5b3a-44a1-8c69-e464adce4921 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Action: 'update', calling method: .version_select at 0x7f075755db80>, body: {"security_group": {"name": "tempest-sg-hth-1612897272", "description": "tempest-description-hth-1805115023"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:38.519794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:38.543490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:38.546654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:38.553699 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e270bec-f531-4747-abef-36dd8f3e01e7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.456576 Oct 03 10:38:38.586764 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1090/2147] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:38 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:38.611618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:38.613648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:38.636637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:38.639097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:38.640761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:38.644001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:38.645238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:38.648937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:38.681174 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] HTTP exception thrown: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Request method failure captured: Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 HTTP/1.1 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruPc1ozHhvfjsbHDUF3MEdAaQbEg1anVG9ilNtvSEBBaYXnedm51xwhU8pU79H8HMTVtaCuRD-8O2_zsOJwCKl0Zr9gZVh9jEbfzf09wUeSb1DKrI8RVOFAP-hjtymALCKE3NudwfDnG-1B68-N13eser2Q6ER0wXz43AXWt22u13A Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}] Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4de72bcdaa0841038de43990892c7094 Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '526ce62d-b9fd-4185-8c2d-53e834077570'} Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:38.687995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Returning 404 to user: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc22da18-f1e2-43af-8e46-0564cfc50ca5 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 404 len: 111 microversion: 2.1 time: 0.102013 Oct 03 10:38:38.693936 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1091/2148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:38 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:38.696076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:38.696692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:38.704698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:38.705833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:38.706425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:38.707138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:38.708474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:38.713107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.044966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:39.061484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff783f04-4cef-406f-b6a1-1f55b5308f23 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.369395 Oct 03 10:38:39.063149 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1092/2149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:38 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:39.070524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:39.071774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:39.080022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.082534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.083440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.084184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.084675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.085230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.419340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:39.463720 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c863d45-a07b-4af0-b9df-8cad56bd075f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 0.393848 Oct 03 10:38:39.467982 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1093/2150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:39 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:39.472952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0a19c63b-71f0-48b8-849c-71c7af87d774 req-f53b20ff-7fd9-40e7-a4b4-70bf3c1262f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877fab3d-7259-4cd4-9b2f-490437ad0db4", "name": "network-vif-unplugged", "status": "completed", "tag": "b17700de-c4df-464f-b394-77ec4177e27d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:39.507136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0a19c63b-71f0-48b8-849c-71c7af87d774 req-f53b20ff-7fd9-40e7-a4b4-70bf3c1262f6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.509284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0a19c63b-71f0-48b8-849c-71c7af87d774 req-f53b20ff-7fd9-40e7-a4b4-70bf3c1262f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.511139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0a19c63b-71f0-48b8-849c-71c7af87d774 req-f53b20ff-7fd9-40e7-a4b4-70bf3c1262f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.537299 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-98c888c0-5b3a-44a1-8c69-e464adce4921 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/cba4888b-6132-45b0-b41d-5393d1b02303" status: 200 len: 218 microversion: 2.1 time: 1.382534 Oct 03 10:38:39.539657 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0a19c63b-71f0-48b8-849c-71c7af87d774 req-f53b20ff-7fd9-40e7-a4b4-70bf3c1262f6 service nova] Creating event network-vif-unplugged:b17700de-c4df-464f-b394-77ec4177e27d for instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 on n-h1-858383-3 Oct 03 10:38:39.542753 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1058/2151] 10.222.0.27 () {60 vars in 1290 bytes} [Mon Oct 3 10:38:38 2022] PUT /compute/v2.1/os-security-groups/cba4888b-6132-45b0-b41d-5393d1b02303 => generated 218 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:39.547128 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0a19c63b-71f0-48b8-849c-71c7af87d774 req-f53b20ff-7fd9-40e7-a4b4-70bf3c1262f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077604 Oct 03 10:38:39.548307 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1094/2152] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:39.555700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-243650084", "metadata": {"image_type": "test"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:39.556697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4b64f070-7c06-45d4-84f8-f225b526f3d3 req-2de8c1f7-0f71-485a-a041-7b446e42d1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8884fae-5c49-408d-a73c-ac35eaa15f74", "name": "network-vif-plugged", "status": "completed", "tag": "8ef74993-db71-47ee-956d-b4546a98970f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:39.558699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:39.566099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.566882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.567529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.568543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.569286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.569929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.592559 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] HTTP exception thrown: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Request method failure captured: Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570/action HTTP/1.1 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 111 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruPc1ozHhvfjsbHDUF3MEdAaQbEg1anVG9ilNtvSEBBaYXnedm51xwhU8pU79H8HMTVtaCuRD-8O2_zsOJwCKl0Zr9gZVh9jEbfzf09wUeSb1DKrI8RVOFAP-hjtymALCKE3NudwfDnG-1B68-N13eser2Q6ER0wXz43AXWt22u13A Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}] Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4de72bcdaa0841038de43990892c7094 Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-243650084", "metadata": {"image_type": "test"}}} Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '526ce62d-b9fd-4185-8c2d-53e834077570', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-243650084', 'metadata': {'image_type': 'test'}}}} Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 10:38:39.595181 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:39.602280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:39.605294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Returning 404 to user: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:39.606360 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd6c1ebc-f738-4e7d-b8f7-8923d95247eb tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "POST /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570/action" status: 404 len: 111 microversion: 2.1 time: 0.055548 Oct 03 10:38:39.607455 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1095/2153] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Oct 3 10:38:39 2022] POST /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:39.611052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4b64f070-7c06-45d4-84f8-f225b526f3d3 req-2de8c1f7-0f71-485a-a041-7b446e42d1b3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.611589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4b64f070-7c06-45d4-84f8-f225b526f3d3 req-2de8c1f7-0f71-485a-a041-7b446e42d1b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.612533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4b64f070-7c06-45d4-84f8-f225b526f3d3 req-2de8c1f7-0f71-485a-a041-7b446e42d1b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.614406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:39.615034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:39.625120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.625782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.626543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.627491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.628204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.629449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.650582 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4b64f070-7c06-45d4-84f8-f225b526f3d3 req-2de8c1f7-0f71-485a-a041-7b446e42d1b3 service nova] Creating event network-vif-plugged:8ef74993-db71-47ee-956d-b4546a98970f for instance f8884fae-5c49-408d-a73c-ac35eaa15f74 on n-h1-858383-3 Oct 03 10:38:39.667264 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4b64f070-7c06-45d4-84f8-f225b526f3d3 req-2de8c1f7-0f71-485a-a041-7b446e42d1b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120838 Oct 03 10:38:39.670312 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1059/2154] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:39.680599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:39.681701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:39.689067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.691108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.691772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.692711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.693435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.694091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.867885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:39.877676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3474c460-847c-4963-9630-4a233e69f1c8 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1211 microversion: 2.1 time: 0.268764 Oct 03 10:38:39.889358 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1096/2155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:39 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1211 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:39.895112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3267c5c7-e42e-4eef-a5a7-eee518b9d4ee tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074eb94550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:39.962103 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3267c5c7-e42e-4eef-a5a7-eee518b9d4ee tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/cba4888b-6132-45b0-b41d-5393d1b02303" status: 200 len: 218 microversion: 2.1 time: 0.071555 Oct 03 10:38:39.962699 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1097/2156] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:38:39 2022] GET /compute/v2.1/os-security-groups/cba4888b-6132-45b0-b41d-5393d1b02303 => generated 218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:39.970834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:39.973652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:39.980255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.981275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.982009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:39.983004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:39.983864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:39.984531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.182865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:40.194044 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d877ee20-56ce-440c-9b31-777a9575bb12 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.522255 Oct 03 10:38:40.195796 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1060/2157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:39 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:40.202599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1b8be76-f44b-4235-b9ce-875cafa90b98 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-72842108", "metadata": {"image_type": "test"}}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:40.205200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f1b8be76-f44b-4235-b9ce-875cafa90b98 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Failed to fetch instance by id tempest-invalid-1949748141 {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 10:38:40.206482 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f1b8be76-f44b-4235-b9ce-875cafa90b98 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] HTTP exception thrown: Instance tempest-invalid-1949748141 could not be found. Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1b8be76-f44b-4235-b9ce-875cafa90b98 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Request method failure captured: Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/tempest-invalid-1949748141/action HTTP/1.1 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 110 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOruPc1ozHhvfjsbHDUF3MEdAaQbEg1anVG9ilNtvSEBBaYXnedm51xwhU8pU79H8HMTVtaCuRD-8O2_zsOJwCKl0Zr9gZVh9jEbfzf09wUeSb1DKrI8RVOFAP-hjtymALCKE3NudwfDnG-1B68-N13eser2Q6ER0wXz43AXWt22u13A Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}] Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 4de72bcdaa0841038de43990892c7094 Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-72842108", "metadata": {"image_type": "test"}}} Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance tempest-invalid-1949748141 could not be found. Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'tempest-invalid-1949748141', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-72842108', 'metadata': {'image_type': 'test'}}}} Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1949748141 could not be found. Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:40.208714 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1949748141 could not be found. Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1949748141 could not be found. Oct 03 10:38:40.214115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.217521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1b8be76-f44b-4235-b9ce-875cafa90b98 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Returning 404 to user: Instance tempest-invalid-1949748141 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:40.218636 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f1b8be76-f44b-4235-b9ce-875cafa90b98 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-1949748141/action" status: 404 len: 101 microversion: 2.1 time: 0.021624 Oct 03 10:38:40.230184 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1061/2158] 10.222.0.27 () {60 vars in 1249 bytes} [Mon Oct 3 10:38:40 2022] POST /compute/v2.1/servers/tempest-invalid-1949748141/action => generated 101 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:40.230928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:40.242947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e941341a-d236-495c-881a-0a58fa77a036 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f0757567280>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:40.245429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:40.250890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:40.252347 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf6de03f-57f6-4597-881b-ab9579d20c86 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.288646 Oct 03 10:38:40.253342 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1098/2159] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:39 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:40.260110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:40.261542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:40.272055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.272594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.273059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.273762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.274217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.274691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.441879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:40.452233 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-70fdf457-e99d-49b0-b5fb-7cebd5843e9c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.196352 Oct 03 10:38:40.452233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1099/2160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:40 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:40.457436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96f617e8-4e40-46ec-8772-07302694e3ab tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1984563192"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:40.459936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96f617e8-4e40-46ec-8772-07302694e3ab tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 10:38:40.460465 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-96f617e8-4e40-46ec-8772-07302694e3ab tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96f617e8-4e40-46ec-8772-07302694e3ab tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Request method failure captured: Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 57 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruPc1ozHhvfjsbHDUF3MEdAaQbEg1anVG9ilNtvSEBBaYXnedm51xwhU8pU79H8HMTVtaCuRD-8O2_zsOJwCKl0Zr9gZVh9jEbfzf09wUeSb1DKrI8RVOFAP-hjtymALCKE3NudwfDnG-1B68-N13eser2Q6ER0wXz43AXWt22u13A Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}] Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4de72bcdaa0841038de43990892c7094 Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: {"createImage": {"name": "tempest-test-snap-1984563192"}} Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1984563192'}}} Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.462812 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96f617e8-4e40-46ec-8772-07302694e3ab tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:40.467903 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96f617e8-4e40-46ec-8772-07302694e3ab tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011631 Oct 03 10:38:40.480068 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1100/2161] 10.222.0.27 () {60 vars in 1275 bytes} [Mon Oct 3 10:38:40 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:40.487415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54914619-f5c2-4f1f-81ab-95b5be8eda09 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1688944640"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:40.490323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54914619-f5c2-4f1f-81ab-95b5be8eda09 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 10:38:40.491186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-54914619-f5c2-4f1f-81ab-95b5be8eda09 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54914619-f5c2-4f1f-81ab-95b5be8eda09 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Request method failure captured: Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 57 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruPc1ozHhvfjsbHDUF3MEdAaQbEg1anVG9ilNtvSEBBaYXnedm51xwhU8pU79H8HMTVtaCuRD-8O2_zsOJwCKl0Zr9gZVh9jEbfzf09wUeSb1DKrI8RVOFAP-hjtymALCKE3NudwfDnG-1B68-N13eser2Q6ER0wXz43AXWt22u13A Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}] Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4de72bcdaa0841038de43990892c7094 Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: {"createImage": {"name": "tempest-test-snap-1688944640"}} Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1688944640'}}} Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.493319 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 10:38:40.499565 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.501167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54914619-f5c2-4f1f-81ab-95b5be8eda09 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:40.504175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54914619-f5c2-4f1f-81ab-95b5be8eda09 tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.022968 Oct 03 10:38:40.509245 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1101/2162] 10.222.0.27 () {60 vars in 1281 bytes} [Mon Oct 3 10:38:40 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:40.515722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:40.516328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:40.518996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:40.525406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.525911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.526433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.527151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.527599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.528033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.723189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:40.731814 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c39d8d2-4304-46bb-a3df-194fd684b637 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 0.221464 Oct 03 10:38:40.740447 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1102/2163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:40 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:40.740447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:40.740447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:40.745027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.745610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.745809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.746503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.747069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.747359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.763492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] HTTP exception thrown: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Request method failure captured: Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 HTTP/1.1 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruPc1ozHhvfjsbHDUF3MEdAaQbEg1anVG9ilNtvSEBBaYXnedm51xwhU8pU79H8HMTVtaCuRD-8O2_zsOJwCKl0Zr9gZVh9jEbfzf09wUeSb1DKrI8RVOFAP-hjtymALCKE3NudwfDnG-1B68-N13eser2Q6ER0wXz43AXWt22u13A Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}] Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4de72bcdaa0841038de43990892c7094 Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '526ce62d-b9fd-4185-8c2d-53e834077570'} Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:40.764715 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Returning 404 to user: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1bf2870c-a4b1-4fd9-a2d5-78ee3deaf39f tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "DELETE /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 404 len: 111 microversion: 2.1 time: 0.032419 Oct 03 10:38:40.770179 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1103/2164] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:38:40 2022] DELETE /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:40.775717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:40.776956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] [instance: 526ce62d-b9fd-4185-8c2d-53e834077570] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:40.782880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.784024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.784024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.784594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.785072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.785520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.800480 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] HTTP exception thrown: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Request method failure captured: Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 HTTP/1.1 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruPc1ozHhvfjsbHDUF3MEdAaQbEg1anVG9ilNtvSEBBaYXnedm51xwhU8pU79H8HMTVtaCuRD-8O2_zsOJwCKl0Zr9gZVh9jEbfzf09wUeSb1DKrI8RVOFAP-hjtymALCKE3NudwfDnG-1B68-N13eser2Q6ER0wXz43AXWt22u13A Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81b44c5ea7734a9dbb066ef1a6c9d077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81b44c5ea7734a9dbb066ef1a6c9d077"}]}] Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 81b44c5ea7734a9dbb066ef1a6c9d077 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1134070936 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4de72bcdaa0841038de43990892c7094 Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesNegativeTestJSON-1134070936-project Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '526ce62d-b9fd-4185-8c2d-53e834077570'} Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:40.802046 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] Returning 404 to user: Instance 526ce62d-b9fd-4185-8c2d-53e834077570 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02c858bf-750f-4e96-bae9-c4714f4ef3db tempest-ImagesNegativeTestJSON-1134070936 tempest-ImagesNegativeTestJSON-1134070936-project] 10.222.0.27 "GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570" status: 404 len: 111 microversion: 2.1 time: 0.032053 Oct 03 10:38:40.809378 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1104/2165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:40 2022] GET /compute/v2.1/servers/526ce62d-b9fd-4185-8c2d-53e834077570 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:40.825083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e93ae360-e84c-4a0b-b904-ea63ea95472e req-bec2c262-a120-4c48-967a-5103419aded6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "tag": "c0597b04-dfe9-44c2-9b40-9e095aa8a87c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:40.835236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e93ae360-e84c-4a0b-b904-ea63ea95472e req-bec2c262-a120-4c48-967a-5103419aded6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.835729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e93ae360-e84c-4a0b-b904-ea63ea95472e req-bec2c262-a120-4c48-967a-5103419aded6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.836466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e93ae360-e84c-4a0b-b904-ea63ea95472e req-bec2c262-a120-4c48-967a-5103419aded6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.848021 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e93ae360-e84c-4a0b-b904-ea63ea95472e req-bec2c262-a120-4c48-967a-5103419aded6 service nova] Creating event network-changed:c0597b04-dfe9-44c2-9b40-9e095aa8a87c for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:38:40.852824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e93ae360-e84c-4a0b-b904-ea63ea95472e req-bec2c262-a120-4c48-967a-5103419aded6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031610 Oct 03 10:38:40.853762 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1105/2166] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:40.904372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:40.905666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:40.913331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.914112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.914776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:40.915856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:40.916552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:40.917270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.148361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e941341a-d236-495c-881a-0a58fa77a036 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/cba4888b-6132-45b0-b41d-5393d1b02303" status: 202 len: 0 microversion: 2.1 time: 0.915864 Oct 03 10:38:41.149627 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1062/2167] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:40 2022] DELETE /compute/v2.1/os-security-groups/cba4888b-6132-45b0-b41d-5393d1b02303 => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:41.160323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.161887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:41.168523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.169045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.169511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.170468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.170969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.171674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.186665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 HTTP/1.1 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'c0c82c03-27d1-4b64-b85c-06c6f90b3c65'} Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:41.188215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:41.195284 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-98fcb2ba-9171-4287-b11a-1f9a42693477 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 404 len: 111 microversion: 2.1 time: 0.035800 Oct 03 10:38:41.196551 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1063/2168] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:38:41 2022] DELETE /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:41.200377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.201013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: c0c82c03-27d1-4b64-b85c-06c6f90b3c65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:41.207913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.208986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.209688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.210307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.210756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.211366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.241139 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 HTTP/1.1 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'c0c82c03-27d1-4b64-b85c-06c6f90b3c65'} Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.243395 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Instance c0c82c03-27d1-4b64-b85c-06c6f90b3c65 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-304d193d-352d-4f5e-bc90-739613c88c07 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65" status: 404 len: 111 microversion: 2.1 time: 0.048294 Oct 03 10:38:41.250172 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1064/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:41 2022] GET /compute/v2.1/servers/c0c82c03-27d1-4b64-b85c-06c6f90b3c65 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:41.257568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.258191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:41.265239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.265677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.266115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.266821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.267269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.267691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.295774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:41.320425 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8303c1b8-c13f-4786-915f-c24ccf9f7036 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.421046 Oct 03 10:38:41.321155 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1106/2170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:40 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:38:41.348582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5620e530-1e2b-4324-9d01-6dc129ca78fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074ebd1040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.388851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-5620e530-1e2b-4324-9d01-6dc129ca78fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:41.389504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-5620e530-1e2b-4324-9d01-6dc129ca78fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:38:41.390042 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5620e530-1e2b-4324-9d01-6dc129ca78fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist Oct 03 10:38:41.390042 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-91be469c-4d50-48d1-870f-e96de586eb1b'] Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5620e530-1e2b-4324-9d01-6dc129ca78fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a HTTP/1.1 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-91be469c-4d50-48d1-870f-e96de586eb1b'] Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '9b0ff2f6-365b-4655-a6e8-2a32e32f849a'} Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:41.400871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91be469c-4d50-48d1-870f-e96de586eb1b'] Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91be469c-4d50-48d1-870f-e96de586eb1b'] Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91be469c-4d50-48d1-870f-e96de586eb1b'] Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91be469c-4d50-48d1-870f-e96de586eb1b'] Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5620e530-1e2b-4324-9d01-6dc129ca78fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group 9b0ff2f6-365b-4655-a6e8-2a32e32f849a does not exist Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-91be469c-4d50-48d1-870f-e96de586eb1b'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5620e530-1e2b-4324-9d01-6dc129ca78fe tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a" status: 404 len: 194 microversion: 2.1 time: 0.072834 Oct 03 10:38:41.406127 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1107/2171] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:41 2022] DELETE /compute/v2.1/os-security-groups/9b0ff2f6-365b-4655-a6e8-2a32e32f849a => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:41.418497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.419365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:41.431222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.432412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.433266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.434454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.435076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.435623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.821114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:41.832138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:41.833747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:41.834985 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a71d89a5-4f4e-45c0-a8d5-4f56f3eceb9e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.430312 Oct 03 10:38:41.835610 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1108/2172] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:41 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:41.840743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee5b056a-b6f1-4e9b-bf15-ddb2863053e6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074eb941f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.867696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:41.876099 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2770a2f-e42a-4675-b0bd-f78cee6f8075 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1293 microversion: 2.1 time: 0.626076 Oct 03 10:38:41.876682 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1065/2173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:41 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1293 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:41.882244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.883194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:41.889657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.890562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.892357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.893182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.893663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.894071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.902857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-ee5b056a-b6f1-4e9b-bf15-ddb2863053e6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:41.908260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-ee5b056a-b6f1-4e9b-bf15-ddb2863053e6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:38:41.912113 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ee5b056a-b6f1-4e9b-bf15-ddb2863053e6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist Oct 03 10:38:41.912113 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-3fab57c3-d166-4f37-84ba-f3e00a87d0d3'] Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee5b056a-b6f1-4e9b-bf15-ddb2863053e6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0 HTTP/1.1 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-3fab57c3-d166-4f37-84ba-f3e00a87d0d3'] Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '31d04bfa-3be1-41b8-807d-affcfd3cedc0'} Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:41.916495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fab57c3-d166-4f37-84ba-f3e00a87d0d3'] Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fab57c3-d166-4f37-84ba-f3e00a87d0d3'] Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fab57c3-d166-4f37-84ba-f3e00a87d0d3'] Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fab57c3-d166-4f37-84ba-f3e00a87d0d3'] Oct 03 10:38:41.922338 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:41.930590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee5b056a-b6f1-4e9b-bf15-ddb2863053e6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group 31d04bfa-3be1-41b8-807d-affcfd3cedc0 does not exist Oct 03 10:38:41.930590 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-3fab57c3-d166-4f37-84ba-f3e00a87d0d3'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:41.930590 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee5b056a-b6f1-4e9b-bf15-ddb2863053e6 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0" status: 404 len: 194 microversion: 2.1 time: 0.092673 Oct 03 10:38:41.930590 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1109/2174] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:41 2022] DELETE /compute/v2.1/os-security-groups/31d04bfa-3be1-41b8-807d-affcfd3cedc0 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:41.935977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-32892aee-c252-4edf-8586-18938f890629 req-decfc7c5-1534-456f-a21a-cf961f0ef35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877fab3d-7259-4cd4-9b2f-490437ad0db4", "tag": "b17700de-c4df-464f-b394-77ec4177e27d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:41.950902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-32892aee-c252-4edf-8586-18938f890629 req-decfc7c5-1534-456f-a21a-cf961f0ef35a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:41.951887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-32892aee-c252-4edf-8586-18938f890629 req-decfc7c5-1534-456f-a21a-cf961f0ef35a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:41.952728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-32892aee-c252-4edf-8586-18938f890629 req-decfc7c5-1534-456f-a21a-cf961f0ef35a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:41.969449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-32892aee-c252-4edf-8586-18938f890629 req-decfc7c5-1534-456f-a21a-cf961f0ef35a service nova] Creating event network-changed:b17700de-c4df-464f-b394-77ec4177e27d for instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 on n-h1-858383-3 Oct 03 10:38:41.976369 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-32892aee-c252-4edf-8586-18938f890629 req-decfc7c5-1534-456f-a21a-cf961f0ef35a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045276 Oct 03 10:38:41.977960 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1110/2175] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:41.986328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:41.990119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:42.000429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:42.001145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:42.001633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:42.002703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:42.003352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:42.004029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:42.037043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:42.322735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:42.331985 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a5bf84f-a9bf-4569-9a57-3ab0de0b789a tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 0.350937 Oct 03 10:38:42.333215 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1111/2176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:41 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:42.338576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b85b9c4-39e0-42eb-90a6-c0ec266f8ebd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f0757565700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:42.418981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-3b85b9c4-39e0-42eb-90a6-c0ec266f8ebd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:42.420036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-3b85b9c4-39e0-42eb-90a6-c0ec266f8ebd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:38:42.420873 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-3b85b9c4-39e0-42eb-90a6-c0ec266f8ebd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:38:42.420873 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-d903bf88-5f11-4af7-9b3b-6f5cc4c136fe'] Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b85b9c4-39e0-42eb-90a6-c0ec266f8ebd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4 HTTP/1.1 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-d903bf88-5f11-4af7-9b3b-6f5cc4c136fe'] Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '89229d02-d62f-4ed6-b688-706a00b3cfb4'} Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:42.423162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d903bf88-5f11-4af7-9b3b-6f5cc4c136fe'] Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d903bf88-5f11-4af7-9b3b-6f5cc4c136fe'] Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d903bf88-5f11-4af7-9b3b-6f5cc4c136fe'] Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d903bf88-5f11-4af7-9b3b-6f5cc4c136fe'] Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b85b9c4-39e0-42eb-90a6-c0ec266f8ebd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group 89229d02-d62f-4ed6-b688-706a00b3cfb4 does not exist Oct 03 10:38:42.429250 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-d903bf88-5f11-4af7-9b3b-6f5cc4c136fe'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:42.432683 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b85b9c4-39e0-42eb-90a6-c0ec266f8ebd tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4" status: 404 len: 194 microversion: 2.1 time: 0.094481 Oct 03 10:38:42.432683 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1112/2177] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:42 2022] DELETE /compute/v2.1/os-security-groups/89229d02-d62f-4ed6-b688-706a00b3cfb4 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:42.437732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:42.438455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:42.447782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:42.448270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:42.449904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:42.450706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:42.451226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:42.451652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.077049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:43.086174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04a9b45c-cd98-4012-9e71-c66748f143c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 1.207910 Oct 03 10:38:43.108888 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1066/2178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:41 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:43.112196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:43.116725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64e01320-2e2a-4849-9479-2e2d2128283d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f07573704c0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:43.124837 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-25e2e9e2-7bab-4c4b-bcc7-825343e5d089 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.691356 Oct 03 10:38:43.126104 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1113/2179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:42 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:43.131734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:43.132418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:43.140120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.140893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.141556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.142479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.143138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.143759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.258179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-64e01320-2e2a-4849-9479-2e2d2128283d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:43.258796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.security_group_api [None req-64e01320-2e2a-4849-9479-2e2d2128283d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 not found {{(pid=122270) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:38:43.259348 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-64e01320-2e2a-4849-9479-2e2d2128283d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:38:43.259348 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-0046ffd1-0fd7-4830-b69b-240cfbc17992'] Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64e01320-2e2a-4849-9479-2e2d2128283d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 HTTP/1.1 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: exception: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-0046ffd1-0fd7-4830-b69b-240cfbc17992'] Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39'} Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:43.261203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0046ffd1-0fd7-4830-b69b-240cfbc17992'] Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0046ffd1-0fd7-4830-b69b-240cfbc17992'] Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0046ffd1-0fd7-4830-b69b-240cfbc17992'] Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0046ffd1-0fd7-4830-b69b-240cfbc17992'] Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64e01320-2e2a-4849-9479-2e2d2128283d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 does not exist Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-0046ffd1-0fd7-4830-b69b-240cfbc17992'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64e01320-2e2a-4849-9479-2e2d2128283d tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39" status: 404 len: 194 microversion: 2.1 time: 0.152727 Oct 03 10:38:43.266404 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1067/2180] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:43 2022] DELETE /compute/v2.1/os-security-groups/dd2ec14d-ea0b-49ba-9ca3-74fe4a684c39 => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:43.283320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-329cc3b3-b3f9-4f10-a85f-aa2f4de1a9da req-d4bb0983-1867-4bc5-ad99-5e4fda214633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264a278e-b061-43fa-aa91-2d63d5b2259e", "tag": "e55d96a5-ad44-4d69-95f8-6fbdbf096f6e"}, {"name": "network-changed", "server_uuid": "f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7", "tag": "72cfa501-34ec-4b22-be41-7ce301a2d964"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:43.296225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-329cc3b3-b3f9-4f10-a85f-aa2f4de1a9da req-d4bb0983-1867-4bc5-ad99-5e4fda214633 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.296723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-329cc3b3-b3f9-4f10-a85f-aa2f4de1a9da req-d4bb0983-1867-4bc5-ad99-5e4fda214633 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.297308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-329cc3b3-b3f9-4f10-a85f-aa2f4de1a9da req-d4bb0983-1867-4bc5-ad99-5e4fda214633 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.311913 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-329cc3b3-b3f9-4f10-a85f-aa2f4de1a9da req-d4bb0983-1867-4bc5-ad99-5e4fda214633 service nova] Creating event network-changed:e55d96a5-ad44-4d69-95f8-6fbdbf096f6e for instance 264a278e-b061-43fa-aa91-2d63d5b2259e on n-h2-858383-3 Oct 03 10:38:43.312437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-329cc3b3-b3f9-4f10-a85f-aa2f4de1a9da req-d4bb0983-1867-4bc5-ad99-5e4fda214633 service nova] Creating event network-changed:72cfa501-34ec-4b22-be41-7ce301a2d964 for instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 on n-h2-858383-3 Oct 03 10:38:43.320610 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-329cc3b3-b3f9-4f10-a85f-aa2f4de1a9da req-d4bb0983-1867-4bc5-ad99-5e4fda214633 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053338 Oct 03 10:38:43.321569 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1068/2181] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:43.327884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:43.328611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:43.336276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.336791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.337379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.338221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.338769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.339245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.405546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:43.416024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:43.418854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:43.420976 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ebb0a7be-ce47-459c-a92b-96d97f4c59ef tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.293717 Oct 03 10:38:43.447013 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1114/2182] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:43 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:43.454527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad0224c9-0d81-4761-9073-421183944db0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f075751e4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:43.499242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-ad0224c9-0d81-4761-9073-421183944db0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:43.500212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-ad0224c9-0d81-4761-9073-421183944db0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:38:43.501438 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ad0224c9-0d81-4761-9073-421183944db0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:38:43.501438 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-506ccea0-c028-40ab-89cc-9ba7647e47d9'] Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad0224c9-0d81-4761-9073-421183944db0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b HTTP/1.1 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-506ccea0-c028-40ab-89cc-9ba7647e47d9'] Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '88088f9f-e3d7-4cb5-938a-a8aed8e7f38b'} Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:43.503684 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-506ccea0-c028-40ab-89cc-9ba7647e47d9'] Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-506ccea0-c028-40ab-89cc-9ba7647e47d9'] Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-506ccea0-c028-40ab-89cc-9ba7647e47d9'] Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-506ccea0-c028-40ab-89cc-9ba7647e47d9'] Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad0224c9-0d81-4761-9073-421183944db0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group 88088f9f-e3d7-4cb5-938a-a8aed8e7f38b does not exist Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-506ccea0-c028-40ab-89cc-9ba7647e47d9'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad0224c9-0d81-4761-9073-421183944db0 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b" status: 404 len: 194 microversion: 2.1 time: 0.056193 Oct 03 10:38:43.509414 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1115/2183] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:43 2022] DELETE /compute/v2.1/os-security-groups/88088f9f-e3d7-4cb5-938a-a8aed8e7f38b => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:43.516009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:43.516009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:43.523260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.523760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.524207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.524973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.525465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.525884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.777023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:43.794732 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6ad77c89-514c-4d04-9aa7-1989c036ca83 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 0.284006 Oct 03 10:38:43.796474 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1116/2184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:43 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:43.807505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8de99d3d-2153-48bd-9427-22990d3ab27e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f0757501b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:43.870013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-8de99d3d-2153-48bd-9427-22990d3ab27e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:38:43.876805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-8de99d3d-2153-48bd-9427-22990d3ab27e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Neutron security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:38:43.879598 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-8de99d3d-2153-48bd-9427-22990d3ab27e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:38:43.879598 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-fb4e57d8-8e6e-4ce8-87e4-972073385f93'] Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8de99d3d-2153-48bd-9427-22990d3ab27e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578 HTTP/1.1 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-fb4e57d8-8e6e-4ce8-87e4-972073385f93'] Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd71c3577-a3f0-4cb4-985f-6e98c4e23578'} Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:38:43.881979 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4e57d8-8e6e-4ce8-87e4-972073385f93'] Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4e57d8-8e6e-4ce8-87e4-972073385f93'] Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4e57d8-8e6e-4ce8-87e4-972073385f93'] Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb4e57d8-8e6e-4ce8-87e4-972073385f93'] Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8de99d3d-2153-48bd-9427-22990d3ab27e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Security group d71c3577-a3f0-4cb4-985f-6e98c4e23578 does not exist Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-fb4e57d8-8e6e-4ce8-87e4-972073385f93'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8de99d3d-2153-48bd-9427-22990d3ab27e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578" status: 404 len: 194 microversion: 2.1 time: 0.085097 Oct 03 10:38:43.888465 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1117/2185] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:43 2022] DELETE /compute/v2.1/os-security-groups/d71c3577-a3f0-4cb4-985f-6e98c4e23578 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:43.897572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:43.898065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:43.917485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.917979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.918415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.919120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:43.919572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:43.920269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:43.958835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:38:44.099475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1805362e-7e50-4128-bf3f-4a7eb5190dd7 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 204 len: 0 microversion: 2.1 time: 0.205414 Oct 03 10:38:44.100678 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1118/2186] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:38:43 2022] DELETE /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:38:44.114034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:44.114860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:44.117470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:44.131943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.133056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.137187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.138197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.139451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.139606 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4294dbd9-c5f8-4a8c-80ac-d9bac5e190a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1485 microversion: 2.1 time: 0.815259 Oct 03 10:38:44.141347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.169525 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1069/2187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:43 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1485 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:44.179289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:44.180533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:44.192288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.194358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.195391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.196460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.197291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.197897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.574951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:44.586990 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c3fd4fc-0059-4878-9091-9f892500f483 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.414590 Oct 03 10:38:44.601652 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1070/2188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:44 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:44.609301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:44.610173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:44.617355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.618145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.618822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.619710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.620440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.621057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.827909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:44.838195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:44.844718 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f502848c-dd92-4ed1-a2c7-1834f951ee8c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.240821 Oct 03 10:38:44.846960 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b0d08c1-c686-4a65-b139-76a5ddb68cd2 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1647 microversion: 2.1 time: 0.740679 Oct 03 10:38:44.859912 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1071/2189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:44 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:44.866123 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1119/2190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:44 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1647 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:44.872265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:44.873033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:44.873156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:44.873754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:44.882369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.882624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.882962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.883451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.883878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.884324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.884804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.886373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.886373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:44.886622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:44.886622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:44.887101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:45.006769 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61e7492b-06bd-45cc-8d5c-d00c456e6997 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139441 Oct 03 10:38:45.011808 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1072/2191] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:38:44 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:45.027797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:45.028656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:45.056600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:45.057426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:45.058072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:45.059013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:45.059644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:45.061798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:45.215873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:45.225049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:45.226812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:45.228553 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0120d727-c9bf-4f9d-ba78-3ca3f6843b7b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.361051 Oct 03 10:38:45.229325 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1120/2192] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:44 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:45.615529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:45.616378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:45.626489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:45.626986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:45.627685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:45.628669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:45.629215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:45.629652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:45.776997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:45.786204 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c06b781-88f2-4971-a393-2898ffb1ef2f tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 0.774705 Oct 03 10:38:45.786848 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1073/2193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:45 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:45.791964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ac463163-b097-4b8d-ab42-9dd2e6ee6ac4 req-3d448088-05a9-42e7-99f8-c8ba622d8bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "tag": "10beca7d-45d6-4ecc-a33d-df74dd720057"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:45.804406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ac463163-b097-4b8d-ab42-9dd2e6ee6ac4 req-3d448088-05a9-42e7-99f8-c8ba622d8bb9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:45.804923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ac463163-b097-4b8d-ab42-9dd2e6ee6ac4 req-3d448088-05a9-42e7-99f8-c8ba622d8bb9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:45.805357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ac463163-b097-4b8d-ab42-9dd2e6ee6ac4 req-3d448088-05a9-42e7-99f8-c8ba622d8bb9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:45.818155 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ac463163-b097-4b8d-ab42-9dd2e6ee6ac4 req-3d448088-05a9-42e7-99f8-c8ba622d8bb9 service nova] Creating event network-changed:10beca7d-45d6-4ecc-a33d-df74dd720057 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:38:45.823113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ac463163-b097-4b8d-ab42-9dd2e6ee6ac4 req-3d448088-05a9-42e7-99f8-c8ba622d8bb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034645 Oct 03 10:38:45.823716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1074/2194] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:45.874356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:45.875309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:45.886826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:45.887926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:45.890350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:45.891812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:45.892575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:45.893897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:46.101702 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 10:38:46.102145 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 10:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 (ip 10.222.0.27) !!! Oct 03 10:38:46.484653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:46.498054 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-118e5b70-87fb-4287-8c3e-9e6ba0f459e6 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.888081 Oct 03 10:38:46.499219 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1121/2195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:45 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:38:46.505731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:46.506588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:46.516125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:46.525658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:46.527229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:46.528018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:46.528618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:46.528955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:46.940736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:46.953750 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3365c1d3-2d72-479b-b5ae-c9dfd66ff805 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1647 microversion: 2.1 time: 1.084129 Oct 03 10:38:46.954886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1075/2196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:45 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1647 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:46.959858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:46.960750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:46.977569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:46.978290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:46.978857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:46.979758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:46.980809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:46.981271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:46.996151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:47.012423 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba895fd9-28da-4677-8797-bf8aeace3c74 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.511771 Oct 03 10:38:47.014242 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1122/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:46 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:47.022202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:47.028035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:47.045313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:47.046081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:47.046617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:47.048502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:47.051671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:47.055673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:47.432116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:47.454029 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e0c0d06-f19c-4b9c-8161-39cba667bfe4 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 0.436983 Oct 03 10:38:47.481604 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1123/2198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:47 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:47.527072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:47.528123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:47.539633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:47.540600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:47.541675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:47.542562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:47.543375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:47.545356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:47.916359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:47.929986 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff8a5889-f58c-4cfe-af71-fa24860ac84b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.407645 Oct 03 10:38:47.953110 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1124/2199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:47 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:47.960306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-553c6157-8084-4a5f-9326-9264818b0224 req-e42173ef-fc7d-4b08-aa6a-add2cf710016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6694c5f-d423-4df4-ad03-88474f2a0d65", "name": "network-vif-deleted", "tag": "df81ef11-7a29-4aa2-a522-0e7de13b42e8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:47.980681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-553c6157-8084-4a5f-9326-9264818b0224 req-e42173ef-fc7d-4b08-aa6a-add2cf710016 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:47.981989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-553c6157-8084-4a5f-9326-9264818b0224 req-e42173ef-fc7d-4b08-aa6a-add2cf710016 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:47.982534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-553c6157-8084-4a5f-9326-9264818b0224 req-e42173ef-fc7d-4b08-aa6a-add2cf710016 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.038924 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-553c6157-8084-4a5f-9326-9264818b0224 req-e42173ef-fc7d-4b08-aa6a-add2cf710016 service nova] Creating event network-vif-deleted:df81ef11-7a29-4aa2-a522-0e7de13b42e8 for instance d6694c5f-d423-4df4-ad03-88474f2a0d65 on n-h1-858383-3 Oct 03 10:38:48.051538 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-553c6157-8084-4a5f-9326-9264818b0224 req-e42173ef-fc7d-4b08-aa6a-add2cf710016 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098233 Oct 03 10:38:48.052189 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1125/2200] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:48.085785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:48.086524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:48.104722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.106389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.106854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.110553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.112860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.113332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.203553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.204042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.204479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.204961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lazy-loading 'fault' on Instance uuid d6694c5f-d423-4df4-ad03-88474f2a0d65 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:48.279987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c925fc8e0b48f19f1ff0934adbf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8758b690683b468393e1e884e6f76fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:48.285794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:48.290189 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5246076b-5e60-4032-bfc4-36fe3b2cb78e tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 200 len: 1306 microversion: 2.1 time: 0.232664 Oct 03 10:38:48.291995 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1126/2201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:48 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 1306 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:48.295724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:48.297447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:48.299332 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-07878841-6d95-4b21-a4e8-c35fa4c9851c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 1.342741 Oct 03 10:38:48.300435 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1076/2202] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:46 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:48.301143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:48.302299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:48.310052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.311936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.314423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.317184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.318293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.319562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.506429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:48.507203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:48.535390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.538238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.538986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.541017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:48.541525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.543946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.545074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.555899 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43342aab-112a-4959-98f6-3af81c7fb990 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.262340 Oct 03 10:38:48.557131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1127/2203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:48 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:48.960552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:48.961660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:48.975121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.979020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.983102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:48.985227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:48.987105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:48.989214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:49.292930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:49.306115 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b9325c1-40cb-4ef8-a17a-d3f11d5540e8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.351001 Oct 03 10:38:49.308467 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1128/2204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:48 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:38:49.324108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:49.325583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] [instance: d6694c5f-d423-4df4-ad03-88474f2a0d65] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:49.344086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:49.344927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:49.346456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:49.348990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:49.353403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:49.354150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:49.356093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:49.374831 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e948d57-ebf7-4617-8ed7-bc902e102dd6 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 0.881460 Oct 03 10:38:49.376017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1077/2205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:48 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:49.393508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:49.394606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:49.398651 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] HTTP exception thrown: Instance d6694c5f-d423-4df4-ad03-88474f2a0d65 could not be found. Oct 03 10:38:49.402640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Request method failure captured: Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 HTTP/1.1 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrtBjK8OM0rncdVnatOv0gXjv82dJ-Omw_sPufwlL_Mya9tADipzErRIBKWEep5i5LntE0jE7orH2lfco9deCln8QZqIViqvuA9fwY0NDDsAigBKnAFP5KJMaIvVwFgKAjAUmbgjw_-xJUrO4eaRhsYG_NugZ_zVAUpgBm77oAGz6Ok Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8758b690683b468393e1e884e6f76fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8758b690683b468393e1e884e6f76fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8758b690683b468393e1e884e6f76fd3"}]}] Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8758b690683b468393e1e884e6f76fd3 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-316770998 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 60c925fc8e0b48f19f1ff0934adbf601 Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupsTestJSON-316770998-project Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance d6694c5f-d423-4df4-ad03-88474f2a0d65 could not be found. Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd6694c5f-d423-4df4-ad03-88474f2a0d65'} Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6694c5f-d423-4df4-ad03-88474f2a0d65 could not be found. Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6694c5f-d423-4df4-ad03-88474f2a0d65 could not be found. Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:49.404615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6694c5f-d423-4df4-ad03-88474f2a0d65 could not be found. Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:38:49.409861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Returning 404 to user: Instance d6694c5f-d423-4df4-ad03-88474f2a0d65 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:49.410990 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c1db3cd0-5a81-431e-84ad-7078b04f3b1f tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65" status: 404 len: 111 microversion: 2.1 time: 0.090822 Oct 03 10:38:49.411510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:49.412141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:49.412887 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1129/2206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:49 2022] GET /compute/v2.1/servers/d6694c5f-d423-4df4-ad03-88474f2a0d65 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:49.413779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:49.416514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:49.417225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:49.421652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d4940358-7b3b-45ab-909a-50e1dd1e3b44 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074eb75160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:49.876889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d4940358-7b3b-45ab-909a-50e1dd1e3b44 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/fe22f468-2152-4f3d-a323-90ff9d3f41e7" status: 202 len: 0 microversion: 2.1 time: 0.458934 Oct 03 10:38:49.881444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1130/2207] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:49 2022] DELETE /compute/v2.1/os-security-groups/fe22f468-2152-4f3d-a323-90ff9d3f41e7 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:49.883752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:49.887313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:49.899837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:49.901739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:49.902812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:49.904488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:49.905199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:49.907048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:49.939016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:50.129788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:50.139519 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e31a458-7ef9-410c-a1e9-610a19fdf88e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.259512 Oct 03 10:38:50.153399 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1131/2208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:49 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:50.163735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22c90503-edc3-4958-9dd5-1ab064664f89 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] Calling method '.version_select at 0x7f074eb680d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:50.518714 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22c90503-edc3-4958-9dd5-1ab064664f89 tempest-SecurityGroupsTestJSON-316770998 tempest-SecurityGroupsTestJSON-316770998-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0561242a-6152-44be-bca9-3257f318c5aa" status: 202 len: 0 microversion: 2.1 time: 0.361916 Oct 03 10:38:50.520089 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1132/2209] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:38:50 2022] DELETE /compute/v2.1/os-security-groups/0561242a-6152-44be-bca9-3257f318c5aa => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:38:50.526300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-00d7425d-ccbc-4b58-aaa5-94dda557533d req-37430a69-4097-45d7-8380-6aae8ef5e005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7", "name": "network-vif-plugged", "status": "completed", "tag": "72cfa501-34ec-4b22-be41-7ce301a2d964"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:50.539123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-00d7425d-ccbc-4b58-aaa5-94dda557533d req-37430a69-4097-45d7-8380-6aae8ef5e005 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:50.539756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-00d7425d-ccbc-4b58-aaa5-94dda557533d req-37430a69-4097-45d7-8380-6aae8ef5e005 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:50.540383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-00d7425d-ccbc-4b58-aaa5-94dda557533d req-37430a69-4097-45d7-8380-6aae8ef5e005 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:50.557129 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-00d7425d-ccbc-4b58-aaa5-94dda557533d req-37430a69-4097-45d7-8380-6aae8ef5e005 service nova] Creating event network-vif-plugged:72cfa501-34ec-4b22-be41-7ce301a2d964 for instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 on n-h2-858383-3 Oct 03 10:38:50.563819 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-00d7425d-ccbc-4b58-aaa5-94dda557533d req-37430a69-4097-45d7-8380-6aae8ef5e005 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041749 Oct 03 10:38:50.565256 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1133/2210] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:50.571487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:50.572610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:50.602212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:50.603143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:50.603872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:50.609513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:50.629282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:50.630388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:50.646633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:50.666437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:50.669490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:50.672879 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24187629-5eb8-4cc9-8435-133a7e2792fd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 1.295594 Oct 03 10:38:50.689003 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1078/2211] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:49 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:50.689003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:50.689003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:50.689003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:50.689003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:50.689003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:50.690347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:50.698176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:50.698750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:51.542063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:51.563673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ab953a8-0e9d-45d7-a0ca-80bd7ece3ed7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.995485 Oct 03 10:38:51.576061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1134/2212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:50 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:51.590493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:51.591041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:51.615977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:51.616481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:51.618365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:51.621817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:51.625613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:51.627649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:51.886978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:51.899548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-85eeaa7d-4dec-4351-8f8a-b111cc4ace09 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1317 microversion: 2.1 time: 1.223072 Oct 03 10:38:51.902348 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1079/2213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:50 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1317 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:51.915925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:51.916437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:51.937575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:51.938082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:51.938521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:51.939277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:51.939738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:51.940167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:52.127895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:52.137649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-deed5fd9-5a58-4658-af46-421abe0f6c4f tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.555806 Oct 03 10:38:52.142959 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1135/2214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:51 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:52.162457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:52.163094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:52.186915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:52.189989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:52.190178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:52.190771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:52.191244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:52.199614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:52.524996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:52.538005 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dff080dd-2df0-40c0-9584-f9bc183b0277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1485 microversion: 2.1 time: 0.393133 Oct 03 10:38:52.538884 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1136/2215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:52 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1485 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:52.564615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-19d1e67f-d1f3-4b3d-9217-74ccbbf7590a req-9a4f3bf5-0847-45a6-9e0d-9bb853b982f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8884fae-5c49-408d-a73c-ac35eaa15f74", "tag": "8ef74993-db71-47ee-956d-b4546a98970f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:52.608657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-19d1e67f-d1f3-4b3d-9217-74ccbbf7590a req-9a4f3bf5-0847-45a6-9e0d-9bb853b982f4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:52.609609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-19d1e67f-d1f3-4b3d-9217-74ccbbf7590a req-9a4f3bf5-0847-45a6-9e0d-9bb853b982f4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:52.611601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-19d1e67f-d1f3-4b3d-9217-74ccbbf7590a req-9a4f3bf5-0847-45a6-9e0d-9bb853b982f4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:52.624452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:52.643385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:52.653492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:52.655148 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7af6dfe1-6ac2-4005-8204-d84fe87c8a6d tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.750686 Oct 03 10:38:52.657442 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1080/2216] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:51 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:52.674381 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-19d1e67f-d1f3-4b3d-9217-74ccbbf7590a req-9a4f3bf5-0847-45a6-9e0d-9bb853b982f4 service nova] Creating event network-changed:8ef74993-db71-47ee-956d-b4546a98970f for instance f8884fae-5c49-408d-a73c-ac35eaa15f74 on n-h1-858383-3 Oct 03 10:38:52.702773 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-19d1e67f-d1f3-4b3d-9217-74ccbbf7590a req-9a4f3bf5-0847-45a6-9e0d-9bb853b982f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144883 Oct 03 10:38:52.707721 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1137/2217] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:52.724998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:52.727675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:52.749912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:52.750485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:52.750987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:52.752282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:52.756307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:52.756796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:52.948466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f645072-864c-4834-8fcb-f63957060ca2 tempest-ListImageFiltersNegativeTestJSON-648786490 tempest-ListImageFiltersNegativeTestJSON-648786490-project] Calling method '.version_select at 0x7f074ea45c10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:52.982933 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1f645072-864c-4834-8fcb-f63957060ca2 tempest-ListImageFiltersNegativeTestJSON-648786490 tempest-ListImageFiltersNegativeTestJSON-648786490-project] HTTP exception thrown: Image not found. Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f645072-864c-4834-8fcb-f63957060ca2 tempest-ListImageFiltersNegativeTestJSON-648786490 tempest-ListImageFiltersNegativeTestJSON-648786490-project] Request method failure captured: Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/images/f3b679e2-cc35-4067-ad46-20105ae4bf37 HTTP/1.1 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOru86fZbHCPw2FTbzVmYR34jITIIw9jJT_T5pn054cZct-8PiKg_hlja6KmH_ev9-MY5unN6MVZTmKX4jUbFGmd4v_qDl3YSF9AE_c7E1W3hHEyka1_vNRgkvZEr2DNzjda756F0bd6Ck11yv4whTPX32elnI18__gUiTDXIZCSy8kI Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4b6642ee57d445d5ab125e7485212cfa Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-648786490 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b6642ee57d445d5ab125e7485212cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b6642ee57d445d5ab125e7485212cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b6642ee57d445d5ab125e7485212cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b6642ee57d445d5ab125e7485212cfa"}]}] Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-648786490 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4b6642ee57d445d5ab125e7485212cfa Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-648786490 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ListImageFiltersNegativeTestJSON-648786490-project Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 914b36a81bde4ae9bb6de9b903aac3d0 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-648786490-project Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f3b679e2-cc35-4067-ad46-20105ae4bf37'} Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f3b679e2-cc35-4067-ad46-20105ae4bf37 Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:38:52.985658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f3b679e2-cc35-4067-ad46-20105ae4bf37 could not be found. Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f645072-864c-4834-8fcb-f63957060ca2 tempest-ListImageFiltersNegativeTestJSON-648786490 tempest-ListImageFiltersNegativeTestJSON-648786490-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f645072-864c-4834-8fcb-f63957060ca2 tempest-ListImageFiltersNegativeTestJSON-648786490 tempest-ListImageFiltersNegativeTestJSON-648786490-project] 10.222.0.27 "GET /compute/v2.1/images/f3b679e2-cc35-4067-ad46-20105ae4bf37" status: 404 len: 62 microversion: 2.1 time: 0.328619 Oct 03 10:38:52.992358 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1081/2218] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:38:52 2022] GET /compute/v2.1/images/f3b679e2-cc35-4067-ad46-20105ae4bf37 => generated 62 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:38:53.004452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:53.006963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:53.027491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:53.028163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:53.029230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:53.031695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:53.033985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:53.035343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:53.090468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:53.457529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:53.471267 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ce7f11d-70d1-4723-b4fb-a0ffe59b86e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.759904 Oct 03 10:38:53.471888 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1138/2219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:52 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:53.491051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:53.491969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:53.511729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:53.512265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:53.513754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:53.515458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:53.515936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:53.519916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:53.882634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:53.890273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:53.892798 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-790aa327-07e0-4c8a-a11b-690f4122af59 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1507 microversion: 2.1 time: 0.900445 Oct 03 10:38:53.898895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8545cc68-13a7-47c3-8306-4e021c2f59e7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.425951 Oct 03 10:38:53.906393 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1139/2220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:53 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:53.909475 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1082/2221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:52 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1507 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:53.928095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:53.928980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:53.944277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:53.944867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:53.945296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:53.946032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:53.949524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:53.950297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:54.089990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a365edae-d720-4b40-b7c1-fc9454805a12 req-3630594d-db73-4ace-a038-b4ad1809ae05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264a278e-b061-43fa-aa91-2d63d5b2259e", "name": "network-vif-plugged", "status": "completed", "tag": "e55d96a5-ad44-4d69-95f8-6fbdbf096f6e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:54.112018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a365edae-d720-4b40-b7c1-fc9454805a12 req-3630594d-db73-4ace-a038-b4ad1809ae05 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:54.112904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a365edae-d720-4b40-b7c1-fc9454805a12 req-3630594d-db73-4ace-a038-b4ad1809ae05 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:54.114290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a365edae-d720-4b40-b7c1-fc9454805a12 req-3630594d-db73-4ace-a038-b4ad1809ae05 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:54.134818 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a365edae-d720-4b40-b7c1-fc9454805a12 req-3630594d-db73-4ace-a038-b4ad1809ae05 service nova] Creating event network-vif-plugged:e55d96a5-ad44-4d69-95f8-6fbdbf096f6e for instance 264a278e-b061-43fa-aa91-2d63d5b2259e on n-h2-858383-3 Oct 03 10:38:54.152976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a365edae-d720-4b40-b7c1-fc9454805a12 req-3630594d-db73-4ace-a038-b4ad1809ae05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067079 Oct 03 10:38:54.157179 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1083/2222] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:54.327420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:54.337069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:54.339221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:54.340650 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-73fd6814-1598-4acb-a471-a6a1cded0be4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1487 microversion: 2.25 time: 0.432893 Oct 03 10:38:54.357205 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1140/2223] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:53 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1487 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:54.498520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:54.499538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:54.522440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:54.523062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:54.523571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:54.526833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:54.529196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:54.529982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:54.933247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:54.934444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:54.948200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:54.950844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:54.951451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:54.953143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:54.955874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:54.956472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:55.228151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:55.238713 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec71e216-4645-445e-a0c2-efe5977be052 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1199 microversion: 2.1 time: 0.309102 Oct 03 10:38:55.241124 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1141/2224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:54 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1199 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:38:55.246680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7cc08264-b065-480e-bc64-ea34dec417e3 req-8c365f89-247a-4d61-82d2-2ca3f2c7dbfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "tag": "27c7c442-89cf-4803-a228-429a76e1bf21"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:55.268014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cc08264-b065-480e-bc64-ea34dec417e3 req-8c365f89-247a-4d61-82d2-2ca3f2c7dbfb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:55.273101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cc08264-b065-480e-bc64-ea34dec417e3 req-8c365f89-247a-4d61-82d2-2ca3f2c7dbfb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:55.275351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cc08264-b065-480e-bc64-ea34dec417e3 req-8c365f89-247a-4d61-82d2-2ca3f2c7dbfb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:55.296581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7cc08264-b065-480e-bc64-ea34dec417e3 req-8c365f89-247a-4d61-82d2-2ca3f2c7dbfb service nova] Creating event network-changed:27c7c442-89cf-4803-a228-429a76e1bf21 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:38:55.312862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7cc08264-b065-480e-bc64-ea34dec417e3 req-8c365f89-247a-4d61-82d2-2ca3f2c7dbfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069587 Oct 03 10:38:55.313751 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1142/2225] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:55.369236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:55.370131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:55.378791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:55.379562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:55.380172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:55.381120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:55.381987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:55.382996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:55.822150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:55.840930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:55.844409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:55.846002 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-73dd1773-e3e7-4794-b391-39cb0d31e7ce tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1477 microversion: 2.25 time: 0.482229 Oct 03 10:38:55.853333 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1143/2226] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:55 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1477 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:38:55.881251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9a40169-18ee-4ab9-a66c-b4d6ae07f4f5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '.version_select at 0x7f074eb75ca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:55.886020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9a40169-18ee-4ab9-a66c-b4d6ae07f4f5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:55.888401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9a40169-18ee-4ab9-a66c-b4d6ae07f4f5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:55.888891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9a40169-18ee-4ab9-a66c-b4d6ae07f4f5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:55.916599 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9a40169-18ee-4ab9-a66c-b4d6ae07f4f5 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.041210 Oct 03 10:38:55.917718 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1144/2227] 10.222.0.27 () {60 vars in 1184 bytes} [Mon Oct 3 10:38:55 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:56.114566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] Calling method '.version_select at 0x7f074ebcf3a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:56.135813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.136459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.136925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.137881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.138401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.138920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.160206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4d7ec90-aeb2-497f-9048-d4a5c0165811 tempest-AbsoluteLimitsTestJSON-211194382 tempest-AbsoluteLimitsTestJSON-211194382-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.241316 Oct 03 10:38:56.169153 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1145/2228] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Oct 3 10:38:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:38:56.177019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:56.177633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:56.181575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:56.184187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.184749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.185418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.186089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.186676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.187269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.190938 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-759f7192-2683-439b-8ba7-e5631caa5032 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 1.697231 Oct 03 10:38:56.191524 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1084/2229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:54 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:56.267527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:56.268150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:56.279078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.279583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.280026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.280746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.281231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.281660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.401843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] Lazy-loading 'services' on Instance uuid 877fab3d-7259-4cd4-9b2f-490437ad0db4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:38:56.419975 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43f27530-6153-4200-a747-ae20e5d73b05 tempest-LiveAutoBlockMigrationV225Test-515039524 tempest-LiveAutoBlockMigrationV225Test-515039524-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1970 microversion: 2.25 time: 0.246840 Oct 03 10:38:56.420629 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1146/2230] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:56 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1970 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:56.464843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:56.465503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:56.472554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.473066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.473499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.474204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.474653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.475246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.501167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:38:56.627607 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9bbab41-c7c0-4306-bace-3a96b07020a2 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "DELETE /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 204 len: 0 microversion: 2.25 time: 0.166876 Oct 03 10:38:56.629213 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1147/2231] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:38:56 2022] DELETE /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:38:56.639604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:56.640459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:56.648262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.648777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.649231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.649934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.650432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.650906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.762586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:56.771467 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de366e11-e235-454f-bdc4-8c1c8e419c9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1382 microversion: 2.1 time: 0.508573 Oct 03 10:38:56.779916 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1085/2232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:56 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1382 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:38:56.785690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8fc47f-9803-470d-81b0-490329512f45"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:56.788031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:56.820428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.821209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.821876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.822611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:56.823217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:56.823653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:56.910692 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] HTTP exception thrown: Volume 2398c59a-1751-43e6-9c31-7afff53fa03c could not be found. Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Request method failure captured: Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7/os-volume_attachments/2398c59a-1751-43e6-9c31-7afff53fa03c HTTP/1.1 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 74 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrsw0-efM8d20Ed9W18u-_RkDuiM_BHfaDpKw1fTRS7_hCmW7vcpQj_O04rbQmlWlU-7BQiL4Cr_ZzRTpfwCfAcvfmnBwqYEA4OICTwB_TiyZYCq-9hD3D6xsvxtfg1S2rDHjWtjRfHjq1D_1TVJpNTvaTo4FOv6VvgBhu3uxKdw0X4 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: e1e5131ca29d4c8abce8473efe915393 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-VolumesAdminNegativeTest-1635210913 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1e5131ca29d4c8abce8473efe915393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e1e5131ca29d4c8abce8473efe915393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e1e5131ca29d4c8abce8473efe915393"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e1e5131ca29d4c8abce8473efe915393"}]}] Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-VolumesAdminNegativeTest-1635210913 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: e1e5131ca29d4c8abce8473efe915393 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1635210913 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-VolumesAdminNegativeTest-1635210913-project-admin Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0e399097eafd41dca46c8ed3681a2701 Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-VolumesAdminNegativeTest-1635210913-project-admin Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: {"volumeAttachment": {"volumeId": "4f8fc47f-9803-470d-81b0-490329512f45"}} Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: exception: Volume 2398c59a-1751-43e6-9c31-7afff53fa03c could not be found. Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': 'f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7', 'id': '2398c59a-1751-43e6-9c31-7afff53fa03c', 'body': {'volumeAttachment': {'volumeId': '4f8fc47f-9803-470d-81b0-490329512f45'}}} Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2398c59a-1751-43e6-9c31-7afff53fa03c could not be found. (HTTP 404) (Request-ID: req-fb1f3e21-0149-4207-b584-d0fe87252feb) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:38:56.912997 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2398c59a-1751-43e6-9c31-7afff53fa03c could not be found. Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2398c59a-1751-43e6-9c31-7afff53fa03c could not be found. Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2398c59a-1751-43e6-9c31-7afff53fa03c could not be found. Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] Returning 404 to user: Volume 2398c59a-1751-43e6-9c31-7afff53fa03c could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00aac90f-ee45-4fdb-9586-bfb3ee803915 tempest-VolumesAdminNegativeTest-1635210913 tempest-VolumesAdminNegativeTest-1635210913-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7/os-volume_attachments/2398c59a-1751-43e6-9c31-7afff53fa03c" status: 404 len: 109 microversion: 2.1 time: 0.133368 Oct 03 10:38:56.916447 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1086/2233] 10.222.0.27 () {60 vars in 1433 bytes} [Mon Oct 3 10:38:56 2022] PUT /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7/os-volume_attachments/2398c59a-1751-43e6-9c31-7afff53fa03c => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:38:56.981874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:56.993900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:57.002827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:57.004259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a3681d52-8be1-4279-87b9-595531792a33 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1483 microversion: 2.25 time: 0.369243 Oct 03 10:38:57.009382 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1148/2234] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:56 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1483 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:57.222602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:57.224217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:57.241665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:57.247568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:57.248291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:57.253433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:57.254808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:57.255932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:57.386356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:57.386974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:57.394814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:57.396800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:57.397400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:57.398365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:57.399018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:57.399652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:57.517901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:57.531872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d05902b1-3d4d-42df-95a0-ee5c4e4bb515 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.319780 Oct 03 10:38:57.534473 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1149/2235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:57 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:58.259304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-440447339", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:38:58.348665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] validate_networks() for [('1d932e5a-b01d-44d6-aeb7-910446df43ba', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:38:58.375983 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eec8475f-e800-4c5e-8d71-bec6da9a0628 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1533 microversion: 2.1 time: 1.459882 Oct 03 10:38:58.395989 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1087/2236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:56 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1533 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:58.408012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:58.414783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:58.429138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:58.432330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:58.436246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:58.437029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:58.438604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:58.440895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:58.443044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:58.917369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:58.938282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:58.954107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:58.956437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:38:58.959138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:38:58.961573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:38:58.962177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:38:58.962307 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db08cea2-2369-4af7-becd-17eca59c4a20 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1483 microversion: 2.25 time: 0.561198 Oct 03 10:38:58.962924 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1088/2237] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:38:58 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1483 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:38:58.964408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:38:58.970134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:58.971001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:58.971545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:58.997674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:58.998172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:58.998772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:58.999425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:58.999878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:59.000304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:59.007936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:59.008584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:59.009460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:59.011960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:59.015212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:59.015813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:59.056759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Getting quotas for project 56d17bf642e4452dae776dcfc8db017b. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:38:59.065966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Getting quotas for user d8dccddd449842ef93e99bf417372776 and project 56d17bf642e4452dae776dcfc8db017b. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:38:59.081093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:38:59.090081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:38:59.214035 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42911cc6-7422-44b2-8382-abf31240a0ab tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.217077 Oct 03 10:38:59.215018 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1150/2238] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:38:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:38:59.242325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:59.245390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:59.258963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:59.259632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:59.264832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:59.265716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:38:59.266064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:38:59.266503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:38:59.269544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:38:59.424032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-333e28df-ff46-434e-acbc-999670df7e13 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1533 microversion: 2.1 time: 0.453652 Oct 03 10:38:59.430421 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1089/2239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:58 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1533 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:59.437541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e85e8af8-996a-43e6-a158-15cf8e0285c1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:38:59.441185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e85e8af8-996a-43e6-a158-15cf8e0285c1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:38:59.929725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:38:59.944679 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e82889e-3f21-4cf0-ac19-f99f8ff2e666 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.727049 Oct 03 10:38:59.948143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1151/2240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:59 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:38:59.966241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-10677fbd-bc67-43ea-9461-3e498296f611 req-4174575f-18d3-400e-af1c-c0955abffebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877fab3d-7259-4cd4-9b2f-490437ad0db4", "name": "network-vif-deleted", "tag": "b17700de-c4df-464f-b394-77ec4177e27d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:00.008408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-10677fbd-bc67-43ea-9461-3e498296f611 req-4174575f-18d3-400e-af1c-c0955abffebe service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:00.012539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-10677fbd-bc67-43ea-9461-3e498296f611 req-4174575f-18d3-400e-af1c-c0955abffebe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:00.014679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-10677fbd-bc67-43ea-9461-3e498296f611 req-4174575f-18d3-400e-af1c-c0955abffebe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:00.031116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e85e8af8-996a-43e6-a158-15cf8e0285c1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:00.045365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e85e8af8-996a-43e6-a158-15cf8e0285c1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1222 microversion: 2.1 time: 0.613646 Oct 03 10:39:00.046317 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1090/2241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:38:59 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1222 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:00.056000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:00.062042 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-10677fbd-bc67-43ea-9461-3e498296f611 req-4174575f-18d3-400e-af1c-c0955abffebe service nova] Creating event network-vif-deleted:b17700de-c4df-464f-b394-77ec4177e27d for instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 on n-h2-858383-3 Oct 03 10:39:00.075441 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-10677fbd-bc67-43ea-9461-3e498296f611 req-4174575f-18d3-400e-af1c-c0955abffebe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125442 Oct 03 10:39:00.076003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:00.076589 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1152/2242] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:00.077028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:00.077686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:00.078724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:00.080647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:00.093194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:00.094028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:00.097909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:00.113487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:00.115154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:00.116513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:00.120474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:00.121214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:00.121878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:00.141209 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8f6b5102-40af-4cc1-bf6b-27f3866cce25 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093534 Oct 03 10:39:00.143333 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1091/2243] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:39:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:00.156244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-3", "block_migration": false, "disk_over_commit": false}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:00.161163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:00.179595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:00.180380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:00.181188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:00.186995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:00.189686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:00.190297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:00.247005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lazy-loading 'flavor' on Instance uuid 264a278e-b061-43fa-aa91-2d63d5b2259e {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:00.267036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Going to try to live migrate instance to n-h1-858383-3 {{(pid=122270) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 10:39:00.422935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:00.446762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:00.448461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:00.449676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3875cf76-bb09-45ee-a298-caae1518bdcd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1266 microversion: 2.25 time: 0.367259 Oct 03 10:39:00.457806 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1153/2244] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:00 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:00.974366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:00.974990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:01.007374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.007880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.008328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.009131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.009600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.010413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.385440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:01.402915 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b344f9f-7d53-4234-b295-4cfc0a6a2a49 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.434076 Oct 03 10:39:01.412888 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1154/2245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:00 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:01.413838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:01.416107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:01.431137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.434320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.435194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.438189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.438876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.439640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.633881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:01.649099 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec6778c8-6bd7-4ec6-81e2-2fbb00269067 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1226 microversion: 2.1 time: 0.243855 Oct 03 10:39:01.649736 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1155/2246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:01 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:01.663856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:01.669912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:01.692922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.693709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.694316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.697295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.699154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.700043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.870804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:01.881139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:01.888804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:01.890215 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d96bd508-1e47-4e2d-92ee-77b74d81ffb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1266 microversion: 2.25 time: 0.230435 Oct 03 10:39:01.891326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1156/2247] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:01 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:01.911436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:01.912235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:01.928133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.929007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.930095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.931068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:01.931745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:01.933624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:01.992243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:39:02.233385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-070d3c11-e2c5-4b95-805c-a58dc2d50159 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 204 len: 0 microversion: 2.1 time: 0.339968 Oct 03 10:39:02.234790 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1157/2248] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:39:01 2022] DELETE /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:39:02.243156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:02.244196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:02.278198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:02.281263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:02.285165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:02.286236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:02.289033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:02.289692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:02.584926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:02.595719 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0445bdc1-81d9-448e-b47f-d05547512c72 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1513 microversion: 2.1 time: 0.356899 Oct 03 10:39:02.600825 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1158/2249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:02 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:02.609312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:02.610921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:02.619257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:02.620028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:02.621093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:02.622155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:02.622808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:02.623432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:02.944941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:02.954987 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfb1c275-39ef-49c8-affc-5919dc499e27 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.352381 Oct 03 10:39:02.957762 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1159/2250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:02 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:03.436122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1954562645", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "5ce5132e-e22c-4330-8a4a-d8b378f53e34"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:03.575530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] validate_networks() for [('5ce5132e-e22c-4330-8a4a-d8b378f53e34', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:39:04.916762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:39:04.917402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:39:04.917694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:39:04.918106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:39:04.918561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:39:04.936529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:04.937138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:04.937749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:04.938759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:04.948227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:04.948758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.018428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Getting quotas for project 8ad227b0026b4a00a99371cb695d27d3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:39:05.026242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Getting quotas for user 7bdb35f4990d4ef28f95c7547ade54c0 and project 8ad227b0026b4a00a99371cb695d27d3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:39:05.068740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:39:05.072477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:39:05.171609 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5daf9dbd-ac9e-4beb-88b0-da06c6d12af6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.212491 Oct 03 10:39:05.189340 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1160/2251] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:39:05.204890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:05.205846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:05.215710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.216613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.217390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.218349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.222069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.222820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.277368 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a205716-8df6-485e-8c01-c0c47112f524 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e/action" status: 202 len: 0 microversion: 2.1 time: 5.120107 Oct 03 10:39:05.284556 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1092/2252] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:39:00 2022] POST /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e/action => generated 0 bytes in 5133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:39:05.290994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:05.296958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:05.365203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.370819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.374182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.375694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.381549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.387285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.673206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:05.684270 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-672541c7-9981-411e-ab5b-0877c44b5ebb tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1280 microversion: 2.1 time: 0.493349 Oct 03 10:39:05.685532 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1161/2253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:05 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1280 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:05.715091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:05.715091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:05.728614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.729108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.729551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.732364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.732961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.736461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.823236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.825106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.826795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.828141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lazy-loading 'fault' on Instance uuid f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:05.857651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:05.884066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:05.889944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:05.896781 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cfddb94-7a74-4b75-a671-741aef271641 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1266 microversion: 2.25 time: 0.609395 Oct 03 10:39:05.916035 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1093/2254] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:05 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1266 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:05.932534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:05.935447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:05.959551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:05.966011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.966513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.966956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.967680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:05.971818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fff8f292-1852-45f6-b3fa-8c84e8f6ea03 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 200 len: 1307 microversion: 2.1 time: 0.284013 Oct 03 10:39:05.974544 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1162/2255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:05 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 1307 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:05.976580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:05.977162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:05.981683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:05.982552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:05.998459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:06.020486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:06.022847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:06.023872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:06.027281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:06.027759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:06.619913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:06.649584 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17afef7e-8d26-4304-bda4-6e40e31792a3 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.672267 Oct 03 10:39:06.653376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:06.665344 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42999858-cb94-49bf-994e-8206fb20e0de tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.745701 Oct 03 10:39:06.667194 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1094/2256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:05 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:06.671163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1163/2257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:05 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:06.679215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1707674770", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "5ce5132e-e22c-4330-8a4a-d8b378f53e34"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:06.695697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fb009198-4c70-4de7-99a3-90e8fe560870 req-4ee7169e-a883-496d-a2e4-84c84ae7d008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7", "name": "network-vif-deleted", "tag": "72cfa501-34ec-4b22-be41-7ce301a2d964"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:06.745111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fb009198-4c70-4de7-99a3-90e8fe560870 req-4ee7169e-a883-496d-a2e4-84c84ae7d008 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:06.754354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fb009198-4c70-4de7-99a3-90e8fe560870 req-4ee7169e-a883-496d-a2e4-84c84ae7d008 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:06.756258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fb009198-4c70-4de7-99a3-90e8fe560870 req-4ee7169e-a883-496d-a2e4-84c84ae7d008 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:06.861414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] validate_networks() for [('5ce5132e-e22c-4330-8a4a-d8b378f53e34', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:39:06.868577 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fb009198-4c70-4de7-99a3-90e8fe560870 req-4ee7169e-a883-496d-a2e4-84c84ae7d008 service nova] Creating event network-vif-deleted:72cfa501-34ec-4b22-be41-7ce301a2d964 for instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 on n-h2-858383-3 Oct 03 10:39:06.897366 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fb009198-4c70-4de7-99a3-90e8fe560870 req-4ee7169e-a883-496d-a2e4-84c84ae7d008 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222856 Oct 03 10:39:06.899680 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1164/2258] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:06.931252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:06.931975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:06.951502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:06.952001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:06.952435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:06.973030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:06.979632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:06.980583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.562632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:07.591997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-87b22e1a-5a5b-47cd-8cfb-dca5f4014922 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 0.688824 Oct 03 10:39:07.593386 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1165/2259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:06 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:07.607196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:07.608366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:07.620917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.623647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.625118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.627786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.629379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.630426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.747276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:07.763266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:07.768245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:07.770946 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f16151e3-19ac-4cca-a71f-78b60a28f75b tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1266 microversion: 2.25 time: 0.175166 Oct 03 10:39:07.774541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1166/2260] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:07 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:07.784386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:07.785462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:07.804558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.807332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.808001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.808976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.810606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.812828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.847073 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] HTTP exception thrown: Instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 could not be found. Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Request method failure captured: Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 HTTP/1.1 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrsgU23G68nvhrn-dNYd4oVH5MmU3LW2CF9AVcfrtvF2LauJyZarNOp0KhUplSAnNn93Oin0ZHqr8mvDuIN_igp0myWo680CUa48MHf-zFB5ihL-970q2Tr_urMEBzLRxbDf-uUWw1-KOD0wgs8gcbsfQnot0Q5GducON3GYo2JUEQ4 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 28ea44afdf844c3bbb6b47365689d17f Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesAdminNegativeTest-1824811398 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/28ea44afdf844c3bbb6b47365689d17f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_28ea44afdf844c3bbb6b47365689d17f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/28ea44afdf844c3bbb6b47365689d17f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/28ea44afdf844c3bbb6b47365689d17f"}]}] Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesAdminNegativeTest-1824811398 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 28ea44afdf844c3bbb6b47365689d17f Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1824811398 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesAdminNegativeTest-1824811398-project Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d1f1b0913e804b8ba305ce34ac8900a5 Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesAdminNegativeTest-1824811398-project Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 could not be found. Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7'} Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 could not be found. Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 could not be found. Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:07.854556 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:07.858793 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:07.858793 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:07.858793 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:07.858793 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:07.858793 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:07.858793 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 could not be found. Oct 03 10:39:07.858793 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:07.859631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:39:07.859631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:39:07.859631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:39:07.859631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:39:07.859631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:39:07.864059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Returning 404 to user: Instance f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:07.865330 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e7c10dcc-480d-40d1-91c4-720d6f4085c7 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7" status: 404 len: 111 microversion: 2.1 time: 0.089648 Oct 03 10:39:07.867612 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1167/2261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:07 2022] GET /compute/v2.1/servers/f6d5c2d4-b26a-4c5b-8784-ab39e1912bb7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:39:07.881370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:07.882338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:07.885729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.886233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.886674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.887467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.887959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.888411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.896634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.903811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.905041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.906158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:07.907520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:07.908266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:07.944724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:08.010765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Getting quotas for project 8ad227b0026b4a00a99371cb695d27d3. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:39:08.034379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Getting quotas for user 7bdb35f4990d4ef28f95c7547ade54c0 and project 8ad227b0026b4a00a99371cb695d27d3. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:39:08.109905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:39:08.130666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:39:08.230875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:08.245909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d4b1ad30-6a83-4a9a-86cf-7ab795e17e58 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.374732 Oct 03 10:39:08.248457 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1168/2262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:07 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:08.259259 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e93bd9d-d5f2-4402-944e-a20a18d21586 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590856 Oct 03 10:39:08.261718 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1095/2263] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:39:08.280026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:08.280917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:08.287858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:08.288747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:08.289464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:08.290685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:08.291689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:08.292394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:08.344110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-606191864", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "451", "networks": [{"uuid": "5ce5132e-e22c-4330-8a4a-d8b378f53e34"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:08.467311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] validate_networks() for [('5ce5132e-e22c-4330-8a4a-d8b378f53e34', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:39:08.718432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:08.732054 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-932a72c5-0da2-40b5-9fc9-65922a444772 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.481067 Oct 03 10:39:08.733166 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1169/2264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:08 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:08.742436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:08.743374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:08.754380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:08.755410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:08.756035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:08.757070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:08.757848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:08.758450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:09.175792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:09.199535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-338a5cd1-baf7-4e31-b204-33a5f66f7655 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 0.460414 Oct 03 10:39:09.213453 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1170/2265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:08 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:09.222107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:09.222107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:09.239825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:09.240918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:09.242672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:09.244751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:09.247840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:09.249539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:09.449672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:09.477274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:09.482027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:09.490920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f03f2173-2762-4e5b-95b3-fff6b76181f4 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 200 len: 1266 microversion: 2.25 time: 0.284794 Oct 03 10:39:09.496647 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1171/2266] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:09 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:09.513184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:09.514092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:09.538725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:09.539625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:09.540286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:09.541291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:09.541954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:09.542601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:10.113404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:10.138791 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba918be7-0e3b-4cf6-b92f-fc23f4b3d554 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.640572 Oct 03 10:39:10.156662 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1172/2267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:09 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:10.163629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:10.169972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:10.181785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:10.197569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:10.198343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:10.204290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:10.205174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:10.205845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:10.863147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:10.875220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a3311e88-f897-4245-ad38-693e61484d88 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.716362 Oct 03 10:39:10.888331 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1173/2268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:10 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:10.894705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:10.897352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:10.904451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:10.905427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:10.906123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:10.907135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:10.911367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:10.913412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:10.973591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:39:10.974296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:39:10.975212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:39:10.975664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:39:10.976040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:39:10.993254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:10.993691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:10.994125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:10.996634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:10.997274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.001787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:11.048726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Getting quotas for project 8ad227b0026b4a00a99371cb695d27d3. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:39:11.056647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Getting quotas for user 7bdb35f4990d4ef28f95c7547ade54c0 and project 8ad227b0026b4a00a99371cb695d27d3. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:39:11.090552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:39:11.093302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:39:11.158123 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8004d22a-1ee2-4eed-87dd-b2e4b11a98cb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.817710 Oct 03 10:39:11.165523 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1096/2269] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:39:11.167377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:11.168090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 877fab3d-7259-4cd4-9b2f-490437ad0db4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:11.180589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:11.181901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.182531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:11.183487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:11.184149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.184851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:11.223290 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] HTTP exception thrown: Instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 could not be found. Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Request method failure captured: Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 HTTP/1.1 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroug6f7Jxm7mcb9pE8ho7AH3nwQAwDB3DeNr7lvOuptzAqGlVi1m8QasD8d9685Qjr7fiAZBCsRG58cuhZHiWbL_Yg1jJetkBphr99vXBTkCIkPe1rsWL66IIbnF3IhM64P7UwJfjiyr_f0YGx7QSsrmBgD-REIwBw_C3LuRhSHhzA Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}] Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 7b6d14fc83e74c34b2e6d5845f4ed9bf Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 could not be found. Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '877fab3d-7259-4cd4-9b2f-490437ad0db4'} Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 could not be found. Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 could not be found. Oct 03 10:39:11.225595 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 could not be found. Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Returning 404 to user: Instance 877fab3d-7259-4cd4-9b2f-490437ad0db4 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:11.228816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-900ea56a-41da-4420-834d-76b14bf1ea66 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4" status: 404 len: 111 microversion: 2.25 time: 0.065535 Oct 03 10:39:11.229449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:11.229531 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1097/2270] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:11 2022] GET /compute/v2.1/servers/877fab3d-7259-4cd4-9b2f-490437ad0db4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:39:11.234720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e6264c5-991b-49f5-908b-6cbdf8446cd0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:11.236126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e6264c5-991b-49f5-908b-6cbdf8446cd0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:11.239338 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e63e427a-5273-46b3-abff-6d9320beab5b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 0.360191 Oct 03 10:39:11.253589 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1174/2271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:10 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:11.260351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:11.261639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:11.268219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:11.269041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.269715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:11.270655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:11.271445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.272146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:11.590253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e6264c5-991b-49f5-908b-6cbdf8446cd0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:11.620759 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e6264c5-991b-49f5-908b-6cbdf8446cd0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1220 microversion: 2.1 time: 0.389868 Oct 03 10:39:11.651531 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1098/2272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:11 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1220 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:11.669378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-73507049-ed08-4e09-8275-da1aa452f786 req-b14a1db3-f63b-4144-9205-6f501113bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830f019f-1794-42cc-a7c4-e626d66592f5", "tag": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:11.692411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-73507049-ed08-4e09-8275-da1aa452f786 req-b14a1db3-f63b-4144-9205-6f501113bca9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:11.694716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-73507049-ed08-4e09-8275-da1aa452f786 req-b14a1db3-f63b-4144-9205-6f501113bca9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.697027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-73507049-ed08-4e09-8275-da1aa452f786 req-b14a1db3-f63b-4144-9205-6f501113bca9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:11.729545 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-73507049-ed08-4e09-8275-da1aa452f786 req-b14a1db3-f63b-4144-9205-6f501113bca9 service nova] Creating event network-changed:3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 for instance 830f019f-1794-42cc-a7c4-e626d66592f5 on n-h1-858383-3 Oct 03 10:39:11.744072 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-73507049-ed08-4e09-8275-da1aa452f786 req-b14a1db3-f63b-4144-9205-6f501113bca9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081523 Oct 03 10:39:11.747279 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1099/2273] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:11.903855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:11.904984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:11.917551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:11.919244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.922794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:11.924904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:11.926240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:11.929046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:12.713789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:12.723261 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3f3ce1c2-53cc-4801-89d1-558e70d09969 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.823920 Oct 03 10:39:12.729198 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1100/2274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:11 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:12.753912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1f4c8d33-387e-4d36-a3e2-a72e2a4a5125 req-dc25ce19-9cae-42e7-a5e6-e6bf28f6e6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-plugged", "status": "completed", "tag": "27c7c442-89cf-4803-a228-429a76e1bf21"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:12.783843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1f4c8d33-387e-4d36-a3e2-a72e2a4a5125 req-dc25ce19-9cae-42e7-a5e6-e6bf28f6e6e2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:12.784586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1f4c8d33-387e-4d36-a3e2-a72e2a4a5125 req-dc25ce19-9cae-42e7-a5e6-e6bf28f6e6e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:12.785353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1f4c8d33-387e-4d36-a3e2-a72e2a4a5125 req-dc25ce19-9cae-42e7-a5e6-e6bf28f6e6e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:12.811727 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1f4c8d33-387e-4d36-a3e2-a72e2a4a5125 req-dc25ce19-9cae-42e7-a5e6-e6bf28f6e6e2 service nova] Creating event network-vif-plugged:27c7c442-89cf-4803-a228-429a76e1bf21 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:12.829621 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1f4c8d33-387e-4d36-a3e2-a72e2a4a5125 req-dc25ce19-9cae-42e7-a5e6-e6bf28f6e6e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098920 Oct 03 10:39:12.830784 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1101/2275] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:12.836026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:12.840333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:12.842448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:12.858749 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5cd1b92b-040d-4ada-a0d0-70e8b28a9343 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 1.603915 Oct 03 10:39:12.860837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:12.861501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:12.862285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:12.862698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1175/2276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:11 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:12.863429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:12.864034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:12.864602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:12.879736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:12.882402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:12.907774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:12.908596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:12.911233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:12.912140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:12.913497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:12.914043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:13.083638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:13.106156 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7faea7f7-6642-4625-bdf5-0f0719855a68 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1272 microversion: 2.1 time: 0.240958 Oct 03 10:39:13.108230 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1176/2277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:12 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:13.755998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:13.756667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:13.765769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:13.769607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:13.771415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:13.773731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:13.774427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:13.778322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:14.367188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:14.382712 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3170193f-1ffe-4162-9938-1cca253dd6f6 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 1.550555 Oct 03 10:39:14.387179 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1102/2278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:12 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:14.393991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:14.405818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:14.430181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:14.430828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:14.431380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:14.432319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:14.439381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:14.440275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:14.662739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:14.681560 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-633f71a6-d715-40a2-bb30-64cbd35fe498 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.923407 Oct 03 10:39:14.682541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1177/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:13 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:14.698559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:14.699200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:14.722647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:14.740839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:14.741574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:14.742581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:14.743280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:14.744910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:14.970040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:15.010293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:15.020696 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e135766a-9537-4c43-9c0d-d1c0021731b3 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1278 microversion: 2.1 time: 0.336909 Oct 03 10:39:15.029081 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1178/2280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:14 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1278 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:15.041588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-803dcea2-c76d-441c-9c0f-87aa55abfea9 req-5f0ed1dc-65b7-49f1-93b6-6ee6dfbcc41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-plugged", "status": "completed", "tag": "c0597b04-dfe9-44c2-9b40-9e095aa8a87c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:15.103524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:15.110581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-803dcea2-c76d-441c-9c0f-87aa55abfea9 req-5f0ed1dc-65b7-49f1-93b6-6ee6dfbcc41a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:15.112755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-803dcea2-c76d-441c-9c0f-87aa55abfea9 req-5f0ed1dc-65b7-49f1-93b6-6ee6dfbcc41a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:15.113495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-803dcea2-c76d-441c-9c0f-87aa55abfea9 req-5f0ed1dc-65b7-49f1-93b6-6ee6dfbcc41a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:15.146685 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-803dcea2-c76d-441c-9c0f-87aa55abfea9 req-5f0ed1dc-65b7-49f1-93b6-6ee6dfbcc41a service nova] Creating event network-vif-plugged:c0597b04-dfe9-44c2-9b40-9e095aa8a87c for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:15.160328 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-803dcea2-c76d-441c-9c0f-87aa55abfea9 req-5f0ed1dc-65b7-49f1-93b6-6ee6dfbcc41a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129321 Oct 03 10:39:15.163877 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1179/2281] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:15.227865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:15.230689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:15.245500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f89fcf5-7a41-4ed5-b9ce-3f4a34f3769b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.855831 Oct 03 10:39:15.248913 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1103/2282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:14 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:15.415819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:15.416971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:15.431324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:15.432566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:15.433683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:15.438854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:15.439583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:15.441433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:15.736742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:15.739143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:15.772403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:15.788585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:15.789233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:15.800038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:15.803472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:15.805429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:16.738575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:16.756514 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77ec1417-1e97-428c-be96-5992574a0c05 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 1.343095 Oct 03 10:39:16.757187 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1180/2283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:15 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:16.771034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:16.775230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:16.807687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:16.811523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:16.814765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:16.816065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:16.818597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:16.819199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:16.882506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:16.898500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2113107f-ca95-47c4-ab53-90ca135e6afb tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 1.185922 Oct 03 10:39:16.906886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1104/2284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:15 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:16.923956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:16.925684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:16.949986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:16.953714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:16.954971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:16.965828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:16.969022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:16.972316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:16.993843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:17.012677 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e59dbf3c-9c33-463d-9cb7-6dd8f318cd82 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1278 microversion: 2.1 time: 0.251688 Oct 03 10:39:17.015464 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1181/2285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:16 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:17.256129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c5687e21-05cd-44a6-bd89-17ad86e6ab93 req-2c648f2c-6b86-479a-82d2-ce6512d8555f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-plugged", "status": "completed", "tag": "10beca7d-45d6-4ecc-a33d-df74dd720057"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:17.284148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c5687e21-05cd-44a6-bd89-17ad86e6ab93 req-2c648f2c-6b86-479a-82d2-ce6512d8555f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:17.292552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c5687e21-05cd-44a6-bd89-17ad86e6ab93 req-2c648f2c-6b86-479a-82d2-ce6512d8555f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:17.294727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c5687e21-05cd-44a6-bd89-17ad86e6ab93 req-2c648f2c-6b86-479a-82d2-ce6512d8555f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:17.342628 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c5687e21-05cd-44a6-bd89-17ad86e6ab93 req-2c648f2c-6b86-479a-82d2-ce6512d8555f service nova] Creating event network-vif-plugged:10beca7d-45d6-4ecc-a33d-df74dd720057 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:17.360604 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c5687e21-05cd-44a6-bd89-17ad86e6ab93 req-2c648f2c-6b86-479a-82d2-ce6512d8555f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108671 Oct 03 10:39:17.365389 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1182/2286] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:39:17.788294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:17.788294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:17.799133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:17.804467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:17.806258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:17.813929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:17.813929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:17.813929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:17.814180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:17.886375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:17.899684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-783ac7a4-b3fd-492c-831e-5f687f1eb26b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.990765 Oct 03 10:39:17.905885 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1105/2287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:16 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:17.915132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:17.916227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:17.946513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:17.951917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:17.952739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:17.956488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:17.957287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:17.957937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.038623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:39:18.204077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:18.213084 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1b4cb90-02ab-429a-b210-0bfdaaeb7326 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 0.431190 Oct 03 10:39:18.216851 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1183/2288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:17 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:18.227610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:18.228234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:18.243028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.243543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.243985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.244701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.245199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.245599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.317712 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9948ed68-fd21-4de5-9556-9090cdf9564d tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 204 len: 0 microversion: 2.1 time: 0.409643 Oct 03 10:39:18.319091 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1106/2289] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:39:17 2022] DELETE /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:39:18.324666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:18.334137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:18.347520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.348514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.349209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.350149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.350846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.351598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.641025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:18.661699 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff630ce8-6597-4bcd-a1aa-8a9d815a739e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1278 microversion: 2.1 time: 0.338794 Oct 03 10:39:18.663125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1107/2290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:18 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1278 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:18.676520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:18.677390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:18.699660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.703099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.703519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.705574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.706072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.710561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.845514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:18.856537 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e496eebb-9e04-4ecb-a130-e9a51b4341fc tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1355 microversion: 2.1 time: 0.638516 Oct 03 10:39:18.863319 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1184/2291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:18 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1355 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:18.932866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:18.933777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:18.944121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.948651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.949450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:18.950359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:18.952631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:18.958689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:19.246579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:19.261902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bafe73ec-9f5e-42f3-aef8-9516b5141629 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1682 microversion: 2.1 time: 0.596604 Oct 03 10:39:19.285933 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1108/2292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:18 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1682 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:19.297664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:19.302681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:19.321661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:19.325803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:19.326671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:19.327623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:19.328250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:19.328890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:19.456936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:19.471730 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30856e76-6255-45c5-957d-cc5c8321ec6a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.543123 Oct 03 10:39:19.472331 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1185/2293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:18 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:19.694149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:19.694978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:19.708569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:19.709102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:19.709540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:19.710249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:19.710700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:19.711128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:19.751403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:20.300229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:20.310558 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41f66ce8-3db6-47d8-9fbf-bb737842d2d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 1.023114 Oct 03 10:39:20.313360 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1109/2294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:19 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:20.322748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:20.323711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:20.338933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:20.339428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:20.339863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:20.343438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:20.344318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:20.345651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:20.664362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:20.677617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-20bf50d9-09a4-486f-b65d-49e868c0a63d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.988400 Oct 03 10:39:20.681781 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1186/2295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:19 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:20.691262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d47fbd2c-650f-4fbe-b7d4-3df683ac7943 req-3fd3734d-d759-4763-9fc0-9f15bf821e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a475675-4f2d-4bf8-9dd0-cbbd01a078bb", "tag": "e0a9aefc-0f66-4c96-85ba-80cb5d45693b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:20.702054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d47fbd2c-650f-4fbe-b7d4-3df683ac7943 req-3fd3734d-d759-4763-9fc0-9f15bf821e64 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:20.703589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d47fbd2c-650f-4fbe-b7d4-3df683ac7943 req-3fd3734d-d759-4763-9fc0-9f15bf821e64 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:20.704268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d47fbd2c-650f-4fbe-b7d4-3df683ac7943 req-3fd3734d-d759-4763-9fc0-9f15bf821e64 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:20.718207 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d47fbd2c-650f-4fbe-b7d4-3df683ac7943 req-3fd3734d-d759-4763-9fc0-9f15bf821e64 service nova] Creating event network-changed:e0a9aefc-0f66-4c96-85ba-80cb5d45693b for instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb on n-h1-858383-3 Oct 03 10:39:20.731190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d47fbd2c-650f-4fbe-b7d4-3df683ac7943 req-3fd3734d-d759-4763-9fc0-9f15bf821e64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045846 Oct 03 10:39:20.732352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:20.735515 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1187/2296] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:20.742105 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b8db9f1-09ec-4df8-a47c-eeb83c572936 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1804 microversion: 2.1 time: 0.427664 Oct 03 10:39:20.745880 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1110/2297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:20 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1804 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:20.748310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:20.752199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:20.761030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:20.761943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:20.769865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:20.771640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:20.772242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:20.773555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:20.774302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:20.774953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:20.776122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:20.776975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:20.781591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:20.782848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:20.783474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:20.784271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.028898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:21.269453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:21.287380 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-51d28750-a87d-49a5-9baa-e73f4b4d5c65 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.538886 Oct 03 10:39:21.291260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1111/2298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:20 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:21.307970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:21.309232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:21.320173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.321396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.322406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.323485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.325573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.326231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.346457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:21.361557 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3df839e7-310b-4f83-98bc-bdfb723f2448 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1682 microversion: 2.1 time: 0.623185 Oct 03 10:39:21.365478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1188/2299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:20 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1682 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:21.376467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:21.391348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:21.402042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.402545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.402984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.403703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.404203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.404631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.413812 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-895fcb17-b36b-414a-998f-959bb23b1881 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a/ips" status: 200 len: 217 microversion: 2.1 time: 0.116088 Oct 03 10:39:21.421831 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1112/2300] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:39:21 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a/ips => generated 217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:21.427323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:21.428085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:21.443859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.444367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.444825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.445549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.446005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.446430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.508229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:39:21.620448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=16 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:21.693022 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fefee3c7-f24c-4378-8fda-4d75d01d06a1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 204 len: 0 microversion: 2.1 time: 0.269017 Oct 03 10:39:21.694175 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1113/2301] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:39:21 2022] DELETE /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:39:21.713564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:21.714600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:21.720316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:21.722684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.725276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.729175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.730087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:21.730705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:21.731503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:21.997682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:22.018763 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d53fade3-525e-46a0-b8fd-ab1f3d4bee1b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 0.651793 Oct 03 10:39:22.019373 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1189/2302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:21 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:22.030191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:22.034735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:22.047604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:22.048169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:22.048514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:22.050780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:22.051245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:22.051679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:23.018172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:23.048968 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f604651-e995-4256-bec0-cf187af6a9c1 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1810 microversion: 2.1 time: 1.348706 Oct 03 10:39:23.075335 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1114/2303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:21 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1810 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:23.088479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:23.091295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:23.112374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:23.114844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:23.116876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:23.122163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:23.124290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:23.126013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:23.555486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:23.568377 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38ea8215-f2c3-41ac-9fec-c75bfea8460d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 1.546048 Oct 03 10:39:23.573296 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1190/2304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:22 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:23.603641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4c1369ef-ed8d-448f-8458-2cde86820642 req-51dee372-97cf-4c38-8623-2688f1394ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830f019f-1794-42cc-a7c4-e626d66592f5", "name": "network-vif-plugged", "status": "completed", "tag": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:23.646189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4c1369ef-ed8d-448f-8458-2cde86820642 req-51dee372-97cf-4c38-8623-2688f1394ac7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:23.651750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4c1369ef-ed8d-448f-8458-2cde86820642 req-51dee372-97cf-4c38-8623-2688f1394ac7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:23.652404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4c1369ef-ed8d-448f-8458-2cde86820642 req-51dee372-97cf-4c38-8623-2688f1394ac7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:23.698546 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4c1369ef-ed8d-448f-8458-2cde86820642 req-51dee372-97cf-4c38-8623-2688f1394ac7 service nova] Creating event network-vif-plugged:3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 for instance 830f019f-1794-42cc-a7c4-e626d66592f5 on n-h1-858383-3 Oct 03 10:39:23.706630 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4c1369ef-ed8d-448f-8458-2cde86820642 req-51dee372-97cf-4c38-8623-2688f1394ac7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131860 Oct 03 10:39:23.710722 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1191/2305] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:23.740417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:23.745166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:23.769454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:23.770019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:23.770515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:23.771259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:23.771713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:23.772137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:23.894406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:23.923373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f4f116c-48a6-4c38-9b58-fe4e479c9f9a tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.846568 Oct 03 10:39:23.925191 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1115/2306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:23 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:23.941594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:23.942581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:23.953695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:23.954209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:23.954650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:23.955459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:23.955921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:23.959519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:24.031745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f1b0913e804b8ba305ce34ac8900a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ea44afdf844c3bbb6b47365689d17f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:24.060292 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caa502a5-049d-41ef-834e-035a93aff550 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 200 len: 1614 microversion: 2.1 time: 0.336173 Oct 03 10:39:24.066055 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1192/2307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:23 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 1614 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:24.089712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fc996804-ae0c-45be-ac2b-44ba124ae9c8 req-2189aeff-0a6d-4798-a16f-5018ece684e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7b9ce9-a85d-44d3-ab3b-b45d79124f56", "tag": "ed3605c6-e8bf-492a-a631-92cdad844cdf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:24.117155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fc996804-ae0c-45be-ac2b-44ba124ae9c8 req-2189aeff-0a6d-4798-a16f-5018ece684e7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:24.117900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fc996804-ae0c-45be-ac2b-44ba124ae9c8 req-2189aeff-0a6d-4798-a16f-5018ece684e7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:24.119724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fc996804-ae0c-45be-ac2b-44ba124ae9c8 req-2189aeff-0a6d-4798-a16f-5018ece684e7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:24.152475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fc996804-ae0c-45be-ac2b-44ba124ae9c8 req-2189aeff-0a6d-4798-a16f-5018ece684e7 service nova] Creating event network-changed:ed3605c6-e8bf-492a-a631-92cdad844cdf for instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 on n-h2-858383-3 Oct 03 10:39:24.167395 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fc996804-ae0c-45be-ac2b-44ba124ae9c8 req-2189aeff-0a6d-4798-a16f-5018ece684e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099928 Oct 03 10:39:24.170885 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1193/2308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:24.209988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:24.213705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:24.248123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:24.283068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:24.286779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:24.287963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:24.288666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:24.289456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:24.825089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:24.843302 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bd7a4312-dece-4cd6-804a-58bcf0f0af21 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1810 microversion: 2.1 time: 0.662839 Oct 03 10:39:24.852635 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1194/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:24 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1810 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:24.864247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c6cf7b4a-d128-46ab-b5fd-59b0dea01d6d req-49790bcb-b62b-4dc5-b69d-4730bcc8d146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71022b1-6680-4a39-941d-79472a4aa61f", "name": "network-vif-deleted", "tag": "e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:24.888657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6cf7b4a-d128-46ab-b5fd-59b0dea01d6d req-49790bcb-b62b-4dc5-b69d-4730bcc8d146 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:24.889506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6cf7b4a-d128-46ab-b5fd-59b0dea01d6d req-49790bcb-b62b-4dc5-b69d-4730bcc8d146 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:24.890876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6cf7b4a-d128-46ab-b5fd-59b0dea01d6d req-49790bcb-b62b-4dc5-b69d-4730bcc8d146 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:24.917677 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c6cf7b4a-d128-46ab-b5fd-59b0dea01d6d req-49790bcb-b62b-4dc5-b69d-4730bcc8d146 service nova] Creating event network-vif-deleted:e23fd3b7-f25d-4d91-a51e-8dd5cf3a87a7 for instance c71022b1-6680-4a39-941d-79472a4aa61f on n-h2-858383-3 Oct 03 10:39:24.929770 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c6cf7b4a-d128-46ab-b5fd-59b0dea01d6d req-49790bcb-b62b-4dc5-b69d-4730bcc8d146 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075437 Oct 03 10:39:24.932218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1195/2310] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:24.941633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:24.942533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:24.958021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:24.958933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:24.959376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:24.960259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:24.960711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:24.961159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:25.494347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:25.505298 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a8bd74c-c0cf-4e1c-8330-50fb617df85e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 1.577023 Oct 03 10:39:25.522601 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1116/2311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:23 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:25.541019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:25.541997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:25.553594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:25.554382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:25.555049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:25.556113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:25.556918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:25.557568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:25.576622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:25.585375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9e575bb-fe93-4aac-a5fa-f5447ae9eecf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.651596 Oct 03 10:39:25.605104 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1196/2312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:24 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:25.622658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:25.623178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:25.623805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] [instance: c71022b1-6680-4a39-941d-79472a4aa61f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:25.661227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:25.662030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:25.662644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:25.663592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:25.667689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:25.668375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:25.738360 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] HTTP exception thrown: Instance c71022b1-6680-4a39-941d-79472a4aa61f could not be found. Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Request method failure captured: Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f HTTP/1.1 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrsgU23G68nvhrn-dNYd4oVH5MmU3LW2CF9AVcfrtvF2LauJyZarNOp0KhUplSAnNn93Oin0ZHqr8mvDuIN_igp0myWo680CUa48MHf-zFB5ihL-970q2Tr_urMEBzLRxbDf-uUWw1-KOD0wgs8gcbsfQnot0Q5GducON3GYo2JUEQ4 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 28ea44afdf844c3bbb6b47365689d17f Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesAdminNegativeTest-1824811398 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/28ea44afdf844c3bbb6b47365689d17f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_28ea44afdf844c3bbb6b47365689d17f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/28ea44afdf844c3bbb6b47365689d17f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/28ea44afdf844c3bbb6b47365689d17f"}]}] Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesAdminNegativeTest-1824811398 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 28ea44afdf844c3bbb6b47365689d17f Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1824811398 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesAdminNegativeTest-1824811398-project Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d1f1b0913e804b8ba305ce34ac8900a5 Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesAdminNegativeTest-1824811398-project Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c71022b1-6680-4a39-941d-79472a4aa61f could not be found. Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c71022b1-6680-4a39-941d-79472a4aa61f'} Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71022b1-6680-4a39-941d-79472a4aa61f could not be found. Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71022b1-6680-4a39-941d-79472a4aa61f could not be found. Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:25.749284 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71022b1-6680-4a39-941d-79472a4aa61f could not be found. Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Returning 404 to user: Instance c71022b1-6680-4a39-941d-79472a4aa61f could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:25.757509 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d726f237-47d5-498f-be37-4ef59c4d3808 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f" status: 404 len: 111 microversion: 2.1 time: 0.143509 Oct 03 10:39:25.759179 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1197/2313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:25 2022] GET /compute/v2.1/servers/c71022b1-6680-4a39-941d-79472a4aa61f => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:39:25.779678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7cbc3d03-87ac-48cd-8690-5429279b7ea8 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] Calling method '.version_select at 0x7f074ea8fb80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:25.857461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7cbc3d03-87ac-48cd-8690-5429279b7ea8 tempest-VolumesAdminNegativeTest-1824811398 tempest-VolumesAdminNegativeTest-1824811398-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-686220556" status: 202 len: 0 microversion: 2.1 time: 0.097863 Oct 03 10:39:25.861413 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1198/2314] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:39:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-686220556 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:39:25.873836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:25.874924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:25.884625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:25.885666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:25.886188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:25.888136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:25.890158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:25.890963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:26.548710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:26.567291 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc901ddd-2631-4923-9a87-e0e5b8b87166 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1810 microversion: 2.1 time: 0.699576 Oct 03 10:39:26.581104 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1199/2315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:25 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1810 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:26.592072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:26.592965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:26.613608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:26.614414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:26.615913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:26.617642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:26.618987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:26.621925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:26.971972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:26.986847 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2801ba8-e5f4-4089-9f9b-314bf5c3401a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 0.404114 Oct 03 10:39:26.992229 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1200/2316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:26 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:27.002635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:27.003599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:27.014694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.015776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.017246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.018212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.018954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.019489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.299976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:27.316450 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ab000df9-7754-4ca7-8205-ef95b3064be1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.322330 Oct 03 10:39:27.321336 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1201/2317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:26 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:27.327879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:27.362831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:27.364676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Searching by: {'deleted': False, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:27.378302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.379287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.379882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.380834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.381597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.384355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.462617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:27.476905 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fbc32625-dbf7-47ab-ad3c-a7e2f124535b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 1.952790 Oct 03 10:39:27.478583 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1117/2318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:25 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:27.501420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:27.575176 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-efaac12f-7725-4f44-ac8a-57c737d7dddf tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.252268 Oct 03 10:39:27.584129 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1202/2319] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:39:27 2022] GET /compute/v2.1/servers => generated 344 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:27.589993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:27.595920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:27.596806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Searching by: {'deleted': False, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:27.604739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.609831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.610352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.611445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:27.612083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.612468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:27.612691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.614136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.619667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.620277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.620833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.621652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.622213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.622785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:27.658741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:27.709211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:27.718288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:27.719525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:27.720204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.100217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:28.112222 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6873c7d9-0d21-4f4f-8258-74e9fa935bc7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1810 microversion: 2.1 time: 0.505207 Oct 03 10:39:28.132272 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1203/2320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:27 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1810 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:28.139160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:28.141552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:28.149464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.151818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.152531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.153589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.154290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.155125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.391595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:28.403369 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8c1cef3-fd17-418c-964f-50980295a696 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1322 microversion: 2.1 time: 0.268842 Oct 03 10:39:28.415190 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1204/2321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:28 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:28.429630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8fbbf73b-ed38-4cc8-8a7e-4eb42be6efd8 req-9d56e29c-ee34-407d-811f-3b9b5e379701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-unplugged", "status": "completed", "tag": "27c7c442-89cf-4803-a228-429a76e1bf21"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:28.450760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8fbbf73b-ed38-4cc8-8a7e-4eb42be6efd8 req-9d56e29c-ee34-407d-811f-3b9b5e379701 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.454138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8fbbf73b-ed38-4cc8-8a7e-4eb42be6efd8 req-9d56e29c-ee34-407d-811f-3b9b5e379701 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.454843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8fbbf73b-ed38-4cc8-8a7e-4eb42be6efd8 req-9d56e29c-ee34-407d-811f-3b9b5e379701 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.474646 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8fbbf73b-ed38-4cc8-8a7e-4eb42be6efd8 req-9d56e29c-ee34-407d-811f-3b9b5e379701 service nova] Creating event network-vif-unplugged:27c7c442-89cf-4803-a228-429a76e1bf21 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:28.481689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8fbbf73b-ed38-4cc8-8a7e-4eb42be6efd8 req-9d56e29c-ee34-407d-811f-3b9b5e379701 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056831 Oct 03 10:39:28.483043 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1205/2322] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:28.490841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:28.491667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:28.499860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.500661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.501304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.502316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.502990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.503564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.539678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:39:28.599701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:28.674512 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8594a6c0-b989-4439-a3e0-00ed40e976b7 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 204 len: 0 microversion: 2.25 time: 0.188970 Oct 03 10:39:28.676021 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1206/2323] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:39:28 2022] DELETE /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:39:28.690263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:28.691517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:28.699872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.701296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.702191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.704981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.705671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.706250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.710260 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d846e7f-882e-4080-9232-89a048651b30 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 1.124782 Oct 03 10:39:28.710931 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1118/2324] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:39:27 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:28.716917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:28.718714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:28.734552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.735091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.736466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.737267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:28.739843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:28.740382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:28.935483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:28.969459 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df37c9e9-8114-4df0-b367-f567ddbc5c10 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.283709 Oct 03 10:39:28.981214 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1207/2325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:28 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:28.992737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:29.001724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:29.011850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.014711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.015249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.017761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.018236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.018674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.279919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:29.290481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:29.291989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:29.293233 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4165f88e-6ef4-4ac7-a536-a4eafabc1cf5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1728 microversion: 2.25 time: 0.310724 Oct 03 10:39:29.294102 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1208/2326] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:28 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:29.298607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-578602b2-8c22-40a9-835e-2f8e460662be tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:29.307589 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-578602b2-8c22-40a9-835e-2f8e460662be tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012450 Oct 03 10:39:29.308440 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1209/2327] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:39:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:29.314751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8bf74253-c27d-43a0-b0eb-4c9c1069d5e2 req-722fcd1b-e9d3-482b-8f27-c0c818344dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa13c46-564f-4171-b88e-645319196ca2", "tag": "d4f82b42-444c-4306-8faa-abf365d14deb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:29.330726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8bf74253-c27d-43a0-b0eb-4c9c1069d5e2 req-722fcd1b-e9d3-482b-8f27-c0c818344dbd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.331308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8bf74253-c27d-43a0-b0eb-4c9c1069d5e2 req-722fcd1b-e9d3-482b-8f27-c0c818344dbd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.331735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8bf74253-c27d-43a0-b0eb-4c9c1069d5e2 req-722fcd1b-e9d3-482b-8f27-c0c818344dbd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.345007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8bf74253-c27d-43a0-b0eb-4c9c1069d5e2 req-722fcd1b-e9d3-482b-8f27-c0c818344dbd service nova] Creating event network-changed:d4f82b42-444c-4306-8faa-abf365d14deb for instance 9aa13c46-564f-4171-b88e-645319196ca2 on n-h2-858383-3 Oct 03 10:39:29.350974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8bf74253-c27d-43a0-b0eb-4c9c1069d5e2 req-722fcd1b-e9d3-482b-8f27-c0c818344dbd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040544 Oct 03 10:39:29.351568 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1210/2328] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:29.356511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:29.357226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:29.363869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.364670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.365140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.365940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.366446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.367828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.470584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:29.479962 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-495d2914-46c9-49b8-b582-4e0bf5dc8d19 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.767691 Oct 03 10:39:29.480547 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1119/2329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:28 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:29.485889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:29.486958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:29.493216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.493913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.495149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.496082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.496855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.497521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.600745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:29.609900 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-891ec9b0-15b5-482c-bb9b-ead23393b787 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1789 microversion: 2.1 time: 0.257047 Oct 03 10:39:29.610842 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1211/2330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:29 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1789 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:29.757702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:29.758257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:29.769034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.769754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.770212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.771835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.775576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.776320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.814304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:39:29.905694 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-978663d7-819b-4e98-8ac4-ad3b2c5d5af9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 204 len: 0 microversion: 2.1 time: 0.154292 Oct 03 10:39:29.907036 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1212/2331] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:39:29 2022] DELETE /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:39:29.917048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:29.918524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:29.925162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.925751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.926401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:29.928468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:29.928996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:29.929506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.090707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:30.102603 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-739399f7-c36c-4646-bd92-a968985a0941 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1610 microversion: 2.1 time: 0.191033 Oct 03 10:39:30.103624 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1213/2332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:29 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1610 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:30.127228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:30.127868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:30.134566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.134566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.135018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.135801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.136202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.137063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.289203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:30.302770 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e18c4597-fbfb-4dcd-b5b5-4b4f00c04ef3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1516 microversion: 2.1 time: 0.820708 Oct 03 10:39:30.327249 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1120/2333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:29 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1516 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:30.335357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:30.337462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:30.347227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.347947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.348590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.349790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.350398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.351411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.438391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:30.456414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99da3ff3-28c7-4927-ac12-8e14df4501e0 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.338609 Oct 03 10:39:30.466653 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1214/2334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:30 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:30.482948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:30.491060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:30.509282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.509996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.510463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.511701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.512434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.512913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.561682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lazy-loading 'flavor' on Instance uuid 830f019f-1794-42cc-a7c4-e626d66592f5 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:30.704067 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2eb6a8f6-0b4d-447d-b85f-e5a019d55d57 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action" status: 200 len: 32 microversion: 2.1 time: 0.233289 Oct 03 10:39:30.710062 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1215/2335] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:39:30 2022] POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:39:30.710461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:30.711175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:30.719222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.719879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.720328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.721086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.721580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.722252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.972270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:30.981013 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-be257e1e-acec-45aa-9aad-d3aade003f2e tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.274917 Oct 03 10:39:30.981922 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1216/2336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:30 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:30.986771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:30.987568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:30.994302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.995258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.995932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:30.996994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:30.997684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:30.998325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.274530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:31.285931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:31.290389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:31.299145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:31.300820 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9211816-d416-448e-86a0-24c8a0c93e00 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1728 microversion: 2.25 time: 0.971034 Oct 03 10:39:31.318217 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba926908-ce7e-42f1-a311-c11b27a9a746 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1789 microversion: 2.1 time: 0.334985 Oct 03 10:39:31.319012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1217/2337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:30 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1789 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:31.319609 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1121/2338] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:30 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1728 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:31.324812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:31.325607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:31.326844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-unplugged", "status": "completed", "tag": "c0597b04-dfe9-44c2-9b40-9e095aa8a87c"}, {"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-unplugged", "status": "completed", "tag": "10beca7d-45d6-4ecc-a33d-df74dd720057"}, {"server_uuid": "7a475675-4f2d-4bf8-9dd0-cbbd01a078bb", "name": "network-vif-plugged", "status": "completed", "tag": "e0a9aefc-0f66-4c96-85ba-80cb5d45693b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:31.342788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.343352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.343975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.344246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.344725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.345246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.345825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.346359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.347025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.370034 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] Creating event network-vif-unplugged:c0597b04-dfe9-44c2-9b40-9e095aa8a87c for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:31.371018 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] Creating event network-vif-unplugged:10beca7d-45d6-4ecc-a33d-df74dd720057 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:31.371621 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] Creating event network-vif-plugged:e0a9aefc-0f66-4c96-85ba-80cb5d45693b for instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb on n-h1-858383-3 Oct 03 10:39:31.383690 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3b711d6f-a046-4b69-ac5d-e4f7b389e69e req-658db8ab-00ca-416a-8a50-1a94b7b9756f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.060262 Oct 03 10:39:31.388400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1218/2339] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:31.396602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:31.398002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:31.405516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.406088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.406836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.407541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.408649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.409358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.721186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:31.733379 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-144e75e6-1470-4d54-88af-43060d45ac15 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1610 microversion: 2.1 time: 0.342657 Oct 03 10:39:31.734603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1219/2340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:31 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1610 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:31.745555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-55129747-d1bc-4533-8d58-16657ff3faad req-cd5bf0f2-6ce4-490a-a6e8-4d4c6a2226a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-deleted", "tag": "c0597b04-dfe9-44c2-9b40-9e095aa8a87c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:31.757363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55129747-d1bc-4533-8d58-16657ff3faad req-cd5bf0f2-6ce4-490a-a6e8-4d4c6a2226a5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.757851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55129747-d1bc-4533-8d58-16657ff3faad req-cd5bf0f2-6ce4-490a-a6e8-4d4c6a2226a5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.758464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55129747-d1bc-4533-8d58-16657ff3faad req-cd5bf0f2-6ce4-490a-a6e8-4d4c6a2226a5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.781483 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-55129747-d1bc-4533-8d58-16657ff3faad req-cd5bf0f2-6ce4-490a-a6e8-4d4c6a2226a5 service nova] Creating event network-vif-deleted:c0597b04-dfe9-44c2-9b40-9e095aa8a87c for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:31.788953 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-55129747-d1bc-4533-8d58-16657ff3faad req-cd5bf0f2-6ce4-490a-a6e8-4d4c6a2226a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046776 Oct 03 10:39:31.792002 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1220/2341] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:31.800849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:31.802845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:31.815065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.815722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.825554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.826394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:31.827133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:31.827721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:31.903514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:31.915007 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb853660-63b9-499f-a56d-c2ad96e7222e tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.594074 Oct 03 10:39:31.916236 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1122/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:31 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:32.018644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:32.019528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:32.025747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:32.026459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:32.027040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:32.027917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:32.028522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:32.029129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:32.582418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:32.590941 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17be4412-194f-4b7f-8478-eb553e6077f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.796551 Oct 03 10:39:32.591983 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1221/2343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:31 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:32.596930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:32.597546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:32.607092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:32.607590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:32.609177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:32.609889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:32.610396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:32.611572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:32.618196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:32.622648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:32.630158 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f4ea20a9-2d16-4002-bed3-e6184072a523 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.614812 Oct 03 10:39:32.632913 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1123/2344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:32 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:32.644530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:32.645442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:32.653308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:32.654299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:32.654889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:32.655786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:32.656384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:32.656978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:32.969900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:32.980074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:32.982080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:32.984139 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0df467ee-ec1f-4398-b42a-64cf3e3ac7bb tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1728 microversion: 2.25 time: 0.390439 Oct 03 10:39:32.984957 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1222/2345] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:32 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1728 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:33.006608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:33.006843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:33.012981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.013477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.013919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.014625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.015084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.015512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.265705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:33.278091 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27757a35-0413-430a-8be6-54baf9917277 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1610 microversion: 2.1 time: 0.271682 Oct 03 10:39:33.300478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1223/2346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:32 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1610 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:33.320103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:33.320873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:33.334537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.335195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.335791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.336595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.338090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.340968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.594450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:33.604854 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c2810599-2dca-48dc-9419-1384b2daa8f7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1653 microversion: 2.1 time: 0.970454 Oct 03 10:39:33.609917 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1124/2347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:32 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1653 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:33.620136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c3464f77-2438-486f-88c2-7b68f0bd2da9 req-2b082b19-d47c-4df2-afef-60cb1aa28674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7b9ce9-a85d-44d3-ab3b-b45d79124f56", "name": "network-vif-plugged", "status": "completed", "tag": "ed3605c6-e8bf-492a-a631-92cdad844cdf"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:33.631787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:33.641483 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f02de74-b86c-4f36-8287-e74423608d34 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.330835 Oct 03 10:39:33.642475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c3464f77-2438-486f-88c2-7b68f0bd2da9 req-2b082b19-d47c-4df2-afef-60cb1aa28674 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.642953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c3464f77-2438-486f-88c2-7b68f0bd2da9 req-2b082b19-d47c-4df2-afef-60cb1aa28674 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.643378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c3464f77-2438-486f-88c2-7b68f0bd2da9 req-2b082b19-d47c-4df2-afef-60cb1aa28674 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.644099 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1224/2348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:33 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:33.652413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:33.653208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:33.662637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.663456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.670040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.673234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.675838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.678023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.679562 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c3464f77-2438-486f-88c2-7b68f0bd2da9 req-2b082b19-d47c-4df2-afef-60cb1aa28674 service nova] Creating event network-vif-plugged:ed3605c6-e8bf-492a-a631-92cdad844cdf for instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 on n-h2-858383-3 Oct 03 10:39:33.688072 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c3464f77-2438-486f-88c2-7b68f0bd2da9 req-2b082b19-d47c-4df2-afef-60cb1aa28674 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072518 Oct 03 10:39:33.689610 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1125/2349] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:33.695327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:33.722313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:33.731005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.731793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.732904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:33.734865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:33.736587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:33.737073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.026704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:34.038980 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2e70481e-36b9-4e17-bd90-0c715e7ef1b2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.390147 Oct 03 10:39:34.054911 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1225/2350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:33 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:34.060275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-146838c2-c8c9-46cd-b7dd-d90e0b432d3d req-aa8a911b-682e-4daf-a3b1-3aaafcfe54ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-deleted", "tag": "10beca7d-45d6-4ecc-a33d-df74dd720057"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:34.081097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:34.083954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-146838c2-c8c9-46cd-b7dd-d90e0b432d3d req-aa8a911b-682e-4daf-a3b1-3aaafcfe54ef service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.084689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-146838c2-c8c9-46cd-b7dd-d90e0b432d3d req-aa8a911b-682e-4daf-a3b1-3aaafcfe54ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.085885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-146838c2-c8c9-46cd-b7dd-d90e0b432d3d req-aa8a911b-682e-4daf-a3b1-3aaafcfe54ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.110341 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-146838c2-c8c9-46cd-b7dd-d90e0b432d3d req-aa8a911b-682e-4daf-a3b1-3aaafcfe54ef service nova] Creating event network-vif-deleted:10beca7d-45d6-4ecc-a33d-df74dd720057 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:34.115875 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-146838c2-c8c9-46cd-b7dd-d90e0b432d3d req-aa8a911b-682e-4daf-a3b1-3aaafcfe54ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059426 Oct 03 10:39:34.117262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1226/2351] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:34.122780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:34.124888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:34.132617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.133587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.134217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.135116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.135746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.136504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.383753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:34.394460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:34.396848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:34.398735 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e978b27f-2431-4fc7-b099-4fc97b9b8de5 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1728 microversion: 2.25 time: 0.279928 Oct 03 10:39:34.420310 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1227/2352] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:34 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:34.429876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:34.431964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:34.440701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.441367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.441915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.442753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.443490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.444056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.829962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:34.838424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86342525-a8ce-4e71-bdae-9da027915c20 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 1.147266 Oct 03 10:39:34.839574 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1126/2353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:33 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:34.844356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:34.845177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:34.851302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.851993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.852583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.853464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.854066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.854822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.869261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:34.894450 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6810fbf-e6f4-4c52-b3b1-0fa3d25b980f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1543 microversion: 2.1 time: 0.469901 Oct 03 10:39:34.908948 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1228/2354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:34 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1543 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:34.914059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:34.914631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:34.933907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.934399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.934843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:34.935666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:34.936241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:34.949618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:35.320148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:35.332640 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86950c25-aa64-4c5b-8d16-563446b15396 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1496 microversion: 2.1 time: 0.491845 Oct 03 10:39:35.348793 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1127/2355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:34 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1496 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:35.369657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:35.370342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:35.390710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:35.391260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:35.391777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:35.392700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:35.397349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:35.398131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:35.824492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:35.841821 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0cbc829c-f036-409f-a903-847c967d78ed tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.931411 Oct 03 10:39:35.843694 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1229/2356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:34 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:35.849065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:35.850963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:35.862637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:35.863519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:35.864517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:35.865590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:35.866259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:35.866865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:36.027233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:36.086833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:36.097185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:36.105292 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b177e4a-a130-440f-9fe1-04aa9964bfbd tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1661 microversion: 2.25 time: 0.256805 Oct 03 10:39:36.106965 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1230/2357] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:35 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1661 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:36.121379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:36.141659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:36.177289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:36.177854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:36.178302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:36.179052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:36.179500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:36.181342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:36.667902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:36.724249 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc1e358d-cb58-441b-add2-4f65134bb182 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 1.362896 Oct 03 10:39:36.729792 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1128/2358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:35 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:36.757490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:36.758108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:36.777547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:36.778692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:36.779395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:36.783375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:36.784137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:36.784860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:36.902309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:36.911195 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aed57086-1814-4a29-b646-6d205c5d03a3 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1253 microversion: 2.1 time: 0.176705 Oct 03 10:39:36.912884 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1129/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:36 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1253 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:36.921947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0d75fad7-0bc9-41fe-a6e3-67902f06fa91 req-1005b2fb-3c3e-4275-9024-b541c269b33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa13c46-564f-4171-b88e-645319196ca2", "name": "network-vif-plugged", "status": "completed", "tag": "d4f82b42-444c-4306-8faa-abf365d14deb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:36.956258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0d75fad7-0bc9-41fe-a6e3-67902f06fa91 req-1005b2fb-3c3e-4275-9024-b541c269b33d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:36.956859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0d75fad7-0bc9-41fe-a6e3-67902f06fa91 req-1005b2fb-3c3e-4275-9024-b541c269b33d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:36.957352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0d75fad7-0bc9-41fe-a6e3-67902f06fa91 req-1005b2fb-3c3e-4275-9024-b541c269b33d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.352088 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0d75fad7-0bc9-41fe-a6e3-67902f06fa91 req-1005b2fb-3c3e-4275-9024-b541c269b33d service nova] Creating event network-vif-plugged:d4f82b42-444c-4306-8faa-abf365d14deb for instance 9aa13c46-564f-4171-b88e-645319196ca2 on n-h2-858383-3 Oct 03 10:39:37.364218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0d75fad7-0bc9-41fe-a6e3-67902f06fa91 req-1005b2fb-3c3e-4275-9024-b541c269b33d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.446840 Oct 03 10:39:37.368993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1130/2360] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:37.375011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:37.376085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:37.387980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.391849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.392562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.396264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.397042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.397846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.438878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:37.444534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:37.462526 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3cb356a0-a2eb-4666-b329-f49b100a6d25 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 1.352890 Oct 03 10:39:37.474568 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1231/2361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:36 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:37.494621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b68394d4-6cb1-46a1-aa48-48f4d1d8a2fd req-c366c413-913d-4e56-8db3-f704eb2222e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8884fae-5c49-408d-a73c-ac35eaa15f74", "name": "network-vif-deleted", "tag": "8ef74993-db71-47ee-956d-b4546a98970f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:37.515336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.515827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.516260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.516704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lazy-loading 'fault' on Instance uuid 65228375-8a44-40af-a10c-8326bdf1ca1a {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:37.535262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b68394d4-6cb1-46a1-aa48-48f4d1d8a2fd req-c366c413-913d-4e56-8db3-f704eb2222e0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.543523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b68394d4-6cb1-46a1-aa48-48f4d1d8a2fd req-c366c413-913d-4e56-8db3-f704eb2222e0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.543692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b68394d4-6cb1-46a1-aa48-48f4d1d8a2fd req-c366c413-913d-4e56-8db3-f704eb2222e0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.596198 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b68394d4-6cb1-46a1-aa48-48f4d1d8a2fd req-c366c413-913d-4e56-8db3-f704eb2222e0 service nova] Creating event network-vif-deleted:8ef74993-db71-47ee-956d-b4546a98970f for instance f8884fae-5c49-408d-a73c-ac35eaa15f74 on n-h1-858383-3 Oct 03 10:39:37.608662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b68394d4-6cb1-46a1-aa48-48f4d1d8a2fd req-c366c413-913d-4e56-8db3-f704eb2222e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123055 Oct 03 10:39:37.609553 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1232/2362] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:37.620737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:37.621472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:37.625987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:37.645477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.645977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.646417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.647190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.647574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.648002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.684963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:37.697098 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-77221cb5-ac41-45bc-a109-c6d50f351132 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 200 len: 1303 microversion: 2.1 time: 0.326370 Oct 03 10:39:37.704932 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1131/2363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:37 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 1303 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:37.731969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:37.732671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:37.754754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:37.759566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.761997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.763347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.763347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.766007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.766528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.872570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:37.875625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:37.876347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:37.877841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lazy-loading 'fault' on Instance uuid 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:37.962794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:37.975654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:37.977333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:37.983154 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-07c3a78b-6aeb-4eee-a19c-ef62ae641cb3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 200 len: 1374 microversion: 2.25 time: 0.262959 Oct 03 10:39:37.989296 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1132/2364] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:37 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 1374 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:38.006836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4cf4d661-b8eb-476a-9913-c8a032bec981 req-c2a48538-b904-43b1-8857-0ea7f1727275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264a278e-b061-43fa-aa91-2d63d5b2259e", "name": "network-vif-unplugged", "status": "completed", "tag": "e55d96a5-ad44-4d69-95f8-6fbdbf096f6e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:38.047449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4cf4d661-b8eb-476a-9913-c8a032bec981 req-c2a48538-b904-43b1-8857-0ea7f1727275 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:38.049598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4cf4d661-b8eb-476a-9913-c8a032bec981 req-c2a48538-b904-43b1-8857-0ea7f1727275 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:38.050325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4cf4d661-b8eb-476a-9913-c8a032bec981 req-c2a48538-b904-43b1-8857-0ea7f1727275 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:38.097771 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4cf4d661-b8eb-476a-9913-c8a032bec981 req-c2a48538-b904-43b1-8857-0ea7f1727275 service nova] Creating event network-vif-unplugged:e55d96a5-ad44-4d69-95f8-6fbdbf096f6e for instance 264a278e-b061-43fa-aa91-2d63d5b2259e on n-h2-858383-3 Oct 03 10:39:38.115753 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4cf4d661-b8eb-476a-9913-c8a032bec981 req-c2a48538-b904-43b1-8857-0ea7f1727275 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125154 Oct 03 10:39:38.116580 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1133/2365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:38.121841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:38.122779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:38.141033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:38.141876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:38.142328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:38.143052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:38.143517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:38.143946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:38.423193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:38.426241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:38.436408 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22b7d852-230c-475d-a005-837ce6b8b579 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1320 microversion: 2.1 time: 0.318343 Oct 03 10:39:38.456723 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1134/2366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:38 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:38.464486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:38.472310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:38.486904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:38.487421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:38.487870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:38.496417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:38.496966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:38.497428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:38.667289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:38.684142 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c90d836a-fa46-4962-a085-9c7b9b275cfc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1253 microversion: 2.1 time: 0.226057 Oct 03 10:39:38.703210 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1135/2367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:38 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1253 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:38.721626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:38.722806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:38.734331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:38.735082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:38.735713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:38.736796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:38.737497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:38.738078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.111042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:39.123163 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f847d25a-7480-445e-8291-a7c8d5939dbe tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.416253 Oct 03 10:39:39.124324 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1136/2368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:38 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:39.148407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:39.149567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:39.157627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.158324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.159344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.160359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.161003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.162897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.189788 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] HTTP exception thrown: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Request method failure captured: Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a HTTP/1.1 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOruX3gRCOO1Ktf3ezPiwxPc844BFXdIoLLRLBeyywCw1C71UInUGGwvclmJWyyuvWV18AKfrfxpyY7H-J2J5VzJw1sqBAfmNf0VXn9zJsongdkcU45Rta_bkhFgyFOwct9iucwr_FsXr8WXGkSl-xXRVOT-Z449v7zBTftktrsQcvBM Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}] Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestMultiNic-108752752 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestMultiNic-108752752-project Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: c8f07ab449064cfea68877b477f897ab Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestMultiNic-108752752-project Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '65228375-8a44-40af-a10c-8326bdf1ca1a'} Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:39.191544 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Returning 404 to user: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:39.195851 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7ef5d35f-ebd0-47c1-8e70-fbeef680627d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 404 len: 111 microversion: 2.1 time: 0.050201 Oct 03 10:39:39.211193 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1137/2369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:39 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:39:39.225889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:39.227991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:39.244818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.249604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.250070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.252219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.254234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.254891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.296535 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] HTTP exception thrown: Instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 could not be found. Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Request method failure captured: Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 HTTP/1.1 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroug6f7Jxm7mcb9pE8ho7AH3nwQAwDB3DeNr7lvOuptzAqGlVi1m8QasD8d9685Qjr7fiAZBCsRG58cuhZHiWbL_Yg1jJetkBphr99vXBTkCIkPe1rsWL66IIbnF3IhM64P7UwJfjiyr_f0YGx7QSsrmBgD-REIwBw_C3LuRhSHhzA Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}] Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 7b6d14fc83e74c34b2e6d5845f4ed9bf Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 could not be found. Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17'} Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 could not be found. Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 could not be found. Oct 03 10:39:39.303436 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 could not be found. Oct 03 10:39:39.307511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:39.311959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Returning 404 to user: Instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:39.313177 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-37d27fc3-342d-4920-9e3e-f4a9c0c0cea8 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17" status: 404 len: 111 microversion: 2.25 time: 0.100834 Oct 03 10:39:39.318730 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1138/2370] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:39 2022] GET /compute/v2.1/servers/3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:39:39.326366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2407e975-6306-4fb7-b8a6-15e320d3367a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '.version_select at 0x7f074ea3e280>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:39.392973 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2407e975-6306-4fb7-b8a6-15e320d3367a tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695582331" status: 204 len: 0 microversion: 2.25 time: 0.072566 Oct 03 10:39:39.397194 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1139/2371] 10.222.0.27 () {60 vars in 1259 bytes} [Mon Oct 3 10:39:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695582331 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:39:39.461004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:39.461641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:39.478109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.480359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.481303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.484192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.484406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.484873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.613701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:39.635308 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed78cd63-58bf-44c8-9f9a-54d657c0dcc3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 2.016840 Oct 03 10:39:39.639602 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1233/2372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:37 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:39.706787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f861fcdc-fdff-4fc9-b84c-d25ed3903433 req-f66a5e47-a9fd-4cde-a346-4f1666c6de7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17", "name": "network-vif-deleted", "tag": "bf72179b-5688-4e66-81af-f082edc266f4"}, {"server_uuid": "65228375-8a44-40af-a10c-8326bdf1ca1a", "name": "network-vif-deleted", "tag": "27c7c442-89cf-4803-a228-429a76e1bf21"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:39.741761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f861fcdc-fdff-4fc9-b84c-d25ed3903433 req-f66a5e47-a9fd-4cde-a346-4f1666c6de7e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.742268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f861fcdc-fdff-4fc9-b84c-d25ed3903433 req-f66a5e47-a9fd-4cde-a346-4f1666c6de7e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.742708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f861fcdc-fdff-4fc9-b84c-d25ed3903433 req-f66a5e47-a9fd-4cde-a346-4f1666c6de7e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.779440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f861fcdc-fdff-4fc9-b84c-d25ed3903433 req-f66a5e47-a9fd-4cde-a346-4f1666c6de7e service nova] Creating event network-vif-deleted:bf72179b-5688-4e66-81af-f082edc266f4 for instance 3d61a90c-4c0c-4b9b-99bc-c7cc071c9e17 on n-h1-858383-3 Oct 03 10:39:39.781067 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f861fcdc-fdff-4fc9-b84c-d25ed3903433 req-f66a5e47-a9fd-4cde-a346-4f1666c6de7e service nova] Creating event network-vif-deleted:27c7c442-89cf-4803-a228-429a76e1bf21 for instance 65228375-8a44-40af-a10c-8326bdf1ca1a on n-h1-858383-3 Oct 03 10:39:39.792662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f861fcdc-fdff-4fc9-b84c-d25ed3903433 req-f66a5e47-a9fd-4cde-a346-4f1666c6de7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090911 Oct 03 10:39:39.794516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1234/2373] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:39.801366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:39.802792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:39.812644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.813500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.814720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.815657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:39.816537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:39.817227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:39.963359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:39.978420 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2ef1d05-065c-4db3-9c77-6c193c8fcb21 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1253 microversion: 2.1 time: 0.182043 Oct 03 10:39:39.979400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1235/2374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:39 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1253 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:39.995795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:40.013917 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-483e4b10-f15e-4ccd-ac6e-2b4c51a71eeb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1511 microversion: 2.1 time: 0.557738 Oct 03 10:39:40.015526 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1140/2375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:39 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1511 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:40.036996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:40.037725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:40.052822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:40.056264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:40.056909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:40.059441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:40.065416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:40.066032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:40.150086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:40.151308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:40.160540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:40.164327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:40.164917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:40.165733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:40.166201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:40.167836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:40.794611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:40.813140 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a759df70-c777-4a63-a4c4-9a7aab9c7d7b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1512 microversion: 2.1 time: 0.779950 Oct 03 10:39:40.814053 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1236/2376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:40 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1512 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:40.818550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0ea7c673-a401-49a4-a405-9444a6b4539f req-f49af929-5bd6-4532-a8d6-1590df3f7f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264a278e-b061-43fa-aa91-2d63d5b2259e", "tag": "e55d96a5-ad44-4d69-95f8-6fbdbf096f6e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:40.839472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0ea7c673-a401-49a4-a405-9444a6b4539f req-f49af929-5bd6-4532-a8d6-1590df3f7f7c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:40.840101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0ea7c673-a401-49a4-a405-9444a6b4539f req-f49af929-5bd6-4532-a8d6-1590df3f7f7c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:40.841396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0ea7c673-a401-49a4-a405-9444a6b4539f req-f49af929-5bd6-4532-a8d6-1590df3f7f7c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:40.874236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0ea7c673-a401-49a4-a405-9444a6b4539f req-f49af929-5bd6-4532-a8d6-1590df3f7f7c service nova] Creating event network-changed:e55d96a5-ad44-4d69-95f8-6fbdbf096f6e for instance 264a278e-b061-43fa-aa91-2d63d5b2259e on n-h2-858383-3 Oct 03 10:39:40.888553 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0ea7c673-a401-49a4-a405-9444a6b4539f req-f49af929-5bd6-4532-a8d6-1590df3f7f7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073083 Oct 03 10:39:40.892031 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1237/2377] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:40.906021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:40.914409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:40.922453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:40.933939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:40.935810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:40.936925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:40.937597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:40.938770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.144904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:41.158178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-125b2238-7390-4180-9c33-48de09745050 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 1.013308 Oct 03 10:39:41.159661 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1141/2378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:40 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:41.177584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:41.178666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:41.192909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.194176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.194824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.195756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.196900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.197898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.236961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:41.246029 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ae3dd1c8-9c19-47be-8166-3f78cc662521 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.352039 Oct 03 10:39:41.257918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1238/2379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:40 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:41.287559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:41.290408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:41.299515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.300175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.300710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.301554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.302108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.302635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.394867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:41.403246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b82d49bf-47b1-4c92-ba23-8eae9d23a3b5 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1253 microversion: 2.1 time: 0.127295 Oct 03 10:39:41.404901 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1239/2380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:41 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1253 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:41.769679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:41.770249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:41.776623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.777446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.778133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.779041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.779696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.780352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.811857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:39:41.874876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:41.919628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:41.940483 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15f0d840-c7eb-46bf-85ab-843c6866e854 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 204 len: 0 microversion: 2.25 time: 0.174047 Oct 03 10:39:41.941974 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d22243a-b266-4454-91b5-f3b5c9f4cda9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 200 len: 1512 microversion: 2.1 time: 0.779694 Oct 03 10:39:41.942754 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1240/2381] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:39:41 2022] DELETE /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:39:41.958762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:41.959792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:41.961542 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1142/2382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:41 2022] GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 1512 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:41.973432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:41.978604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.981142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.981678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:41.982099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:41.984093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:41.984200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:41.984670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:41.985150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:42.001045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:42.001827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:42.003179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:42.004671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:42.005370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:42.005987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:42.150329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:42.314176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:42.323625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:42.324663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:42.325534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:42.658600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:42.685552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:42.712312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:42.713940 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75127fde-a12e-45c9-893d-25bdce81775c tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1549 microversion: 2.25 time: 0.767046 Oct 03 10:39:42.724425 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1241/2383] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:41 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1549 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:42.729008 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2c9263e-1152-4115-b232-09de902f7491 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.763181 Oct 03 10:39:42.729718 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1143/2384] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 3 10:39:41 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:42.745667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:42.746293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:42.752525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:42.753040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:42.753572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:42.753816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:42.754276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:42.754432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:42.754781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:42.755206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:42.762845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:42.763346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:42.763793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:42.765086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:42.765567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:42.765982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:43.406379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:43.418182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ffc716b-e5c4-4af0-8919-d08c138f68de tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.689471 Oct 03 10:39:43.420084 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1242/2385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:42 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:43.435495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:43.437035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:43.449060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:43.449917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:43.450909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:43.451910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:43.453405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:43.454223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:43.644791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:43.658004 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f4b0b6f9-8db7-4ab3-a0b5-9ea96ac43701 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1253 microversion: 2.1 time: 0.235151 Oct 03 10:39:43.662530 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1243/2386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:43 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1253 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:43.679422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:43.696451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:43.697880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1954562645', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:43.711639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:43.712259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:43.713037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:43.714516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:43.715116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:43.717906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:43.929418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:43.976729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:43.996010 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee0b04bc-36cd-4d87-8cfb-7d86c88cc455 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 1.265085 Oct 03 10:39:44.008189 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1144/2387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:42 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:44.028668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:44.029476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:44.058267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.059280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.062804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.064309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.064713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.065169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.142737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:44.176392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.176991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.177624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.266674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:44.278121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:44.281962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:44.284602 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d3f30b8-e040-4abc-8613-f3e1d7efb470 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1507 microversion: 2.25 time: 0.274849 Oct 03 10:39:44.300208 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1145/2388] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:44 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:44.357561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-37a500c5-88f9-4506-90db-20d5ff5becb3 req-f07e5668-8989-4b0b-8420-258343201779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4", "name": "network-vif-deleted", "tag": "a89a8059-2a12-495e-b540-36d4fb268a64"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:44.383684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-37a500c5-88f9-4506-90db-20d5ff5becb3 req-f07e5668-8989-4b0b-8420-258343201779 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.384177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-37a500c5-88f9-4506-90db-20d5ff5becb3 req-f07e5668-8989-4b0b-8420-258343201779 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.384611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-37a500c5-88f9-4506-90db-20d5ff5becb3 req-f07e5668-8989-4b0b-8420-258343201779 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.409483 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-37a500c5-88f9-4506-90db-20d5ff5becb3 req-f07e5668-8989-4b0b-8420-258343201779 service nova] Creating event network-vif-deleted:a89a8059-2a12-495e-b540-36d4fb268a64 for instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 on n-h1-858383-3 Oct 03 10:39:44.417436 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-37a500c5-88f9-4506-90db-20d5ff5becb3 req-f07e5668-8989-4b0b-8420-258343201779 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064555 Oct 03 10:39:44.421222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1146/2389] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:44.446253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:44.446955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:44.463575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.465038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.465542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.466442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.466904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.467462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.644144 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7aa5e178-a7c3-4053-aacc-e0dba4fff604 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1954562645" status: 200 len: 1515 microversion: 2.1 time: 0.980226 Oct 03 10:39:44.645566 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1244/2390] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:39:43 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1954562645 => generated 1515 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:44.679791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:44.690705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:44.691882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:44.715049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.715840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.716572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.717624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:44.719006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:44.720396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:44.974492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:45.190890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:45.225000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.228740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.230163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:45.310878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:45.330835 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a828ba4-ffa7-4c3a-ae0d-f68cc807eb03 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.889193 Oct 03 10:39:45.335192 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1147/2391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:44 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:45.340383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:45.341364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:45.359649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.362043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.369515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:45.370789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.372110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.374618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:45.481477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.486173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.489071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:45.489777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lazy-loading 'fault' on Instance uuid f8884fae-5c49-408d-a73c-ac35eaa15f74 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:45.629055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd201f9e124f94e9dae804154df5f0cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfbece0c17544cd8b1fbc2854ad91ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:45.646320 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a085f78d-7c07-4505-bcc4-251db61fd7cc tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 200 len: 1258 microversion: 2.1 time: 0.309801 Oct 03 10:39:45.648630 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1148/2392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:45 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 1258 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:45.680682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:45.685775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:45.704931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.708482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.709181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:45.711234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.712470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.713260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:45.886433 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b4339f8-f133-4f2e-90e7-f80305567bea tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.212816 Oct 03 10:39:45.887761 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1245/2393] 10.222.0.27 () {58 vars in 1173 bytes} [Mon Oct 3 10:39:44 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:45.894288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:45.895540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:45.911693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.923856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.924400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:45.925204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:45.925677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:45.927406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:46.003813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:46.004996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:46.005664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:46.006645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lazy-loading 'fault' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:46.099793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:46.112447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:46.116669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:46.118460 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40072dca-4648-47de-be44-a927b9cf2f13 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1352 microversion: 2.25 time: 0.229117 Oct 03 10:39:46.120559 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1246/2394] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:45 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1352 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:46.129120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:46.135332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:46.136113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.servers [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Removing options 'limit' from query {{(pid=122269) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 10:39:46.137197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:46.146493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:46.147217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:46.147957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:46.148979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:46.149645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:46.150288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:46.211939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:46.223016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:46.223886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:46.224534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:46.259735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:46.272819 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1bff9eef-e3dc-4992-b067-7211b57b002b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.618442 Oct 03 10:39:46.292728 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1149/2395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:45 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:46.356322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:46.357623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:46.369998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:46.371131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:46.372095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:46.373883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:46.375704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:46.376947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:46.924209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:46.940707 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb187475-c882-4ed1-8ee8-51af51009310 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.585077 Oct 03 10:39:46.944161 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1150/2396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:46 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:46.953699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:46.961217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] [instance: f8884fae-5c49-408d-a73c-ac35eaa15f74] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:46.967245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b9b902d-21d8-4990-8bc7-37db2a67348d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.845197 Oct 03 10:39:46.969082 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1247/2397] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:39:46 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:46.993946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:47.006476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.008414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.009385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:47.010980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:47.011131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.012370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.015668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.018525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.030138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.031574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.035705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.037364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.038734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.041074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.072004 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] HTTP exception thrown: Instance f8884fae-5c49-408d-a73c-ac35eaa15f74 could not be found. Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Request method failure captured: Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 HTTP/1.1 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrtYVALlXSvesJYMltbzfhHMAV58qTBMsOGmYbMSoCqRHO6udlV0tkI6b3ZnoMMtQxXzfEkvngnklTXRs_aRUgUuDYQUoxdi-ALCtBalAw-nlnIfMy92SHFjTW-g_iMa39QeKGDlxVcHpW6GAqp5qlt_W5EassmEKV-AxC0iRdrnBRw Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: acfbece0c17544cd8b1fbc2854ad91ed Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestBootFromVolume-1129432284 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acfbece0c17544cd8b1fbc2854ad91ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_acfbece0c17544cd8b1fbc2854ad91ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/acfbece0c17544cd8b1fbc2854ad91ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/acfbece0c17544cd8b1fbc2854ad91ed"}]}] Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestBootFromVolume-1129432284 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: acfbece0c17544cd8b1fbc2854ad91ed Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1129432284 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestBootFromVolume-1129432284-project Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d201f9e124f94e9dae804154df5f0cf5 Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestBootFromVolume-1129432284-project Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance f8884fae-5c49-408d-a73c-ac35eaa15f74 could not be found. Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f8884fae-5c49-408d-a73c-ac35eaa15f74'} Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8884fae-5c49-408d-a73c-ac35eaa15f74 could not be found. Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8884fae-5c49-408d-a73c-ac35eaa15f74 could not be found. Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:47.074161 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:47.078777 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:47.078777 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:47.078777 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:47.078777 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:47.078777 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:47.078777 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8884fae-5c49-408d-a73c-ac35eaa15f74 could not be found. Oct 03 10:39:47.078777 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:39:47.083061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Returning 404 to user: Instance f8884fae-5c49-408d-a73c-ac35eaa15f74 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:47.084146 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0381668c-7698-4a28-9edb-b8b71cc1a47f tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74" status: 404 len: 111 microversion: 2.1 time: 0.138857 Oct 03 10:39:47.086924 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1151/2398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:46 2022] GET /compute/v2.1/servers/f8884fae-5c49-408d-a73c-ac35eaa15f74 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:39:47.096460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1e3f188-44d8-4c93-b1c5-799ec7da71c9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] Calling method '.version_select at 0x7f0757481430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:47.141904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:47.162096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1e3f188-44d8-4c93-b1c5-799ec7da71c9 tempest-ServersTestBootFromVolume-1129432284 tempest-ServersTestBootFromVolume-1129432284-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881983108" status: 202 len: 0 microversion: 2.1 time: 0.067952 Oct 03 10:39:47.164759 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1152/2399] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881983108 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:39:47.191643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:47.194418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:47.225887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.227351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.227823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.235943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.269248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.270410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.323438 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ceb52a7c-0629-4f1b-b20c-8fced97ef9a9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.333137 Oct 03 10:39:47.324267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1248/2400] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:39:46 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:47.363018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:47.364035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:47.386277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.390624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.391790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.393401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.398322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.399141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.446729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.450121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.450878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.453680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lazy-loading 'fault' on Instance uuid d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:39:47.561316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:47.589211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:47.591314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:47.596332 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d27b6142-fb8c-48c5-85c3-779d310b4ab3 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 200 len: 1352 microversion: 2.25 time: 0.430470 Oct 03 10:39:47.620965 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1153/2401] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:47 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 1352 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:47.632142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:47.638215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:47.639603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.servers [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Removing options 'limit' from query {{(pid=122270) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 10:39:47.640672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:47.651496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.656521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.662616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.665419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:47.669454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:47.670364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:47.919233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:47.938043 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-813df9e8-bf2d-49e5-99c2-a8bc1f79e324 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.602370 Oct 03 10:39:47.953986 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1249/2402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:47 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:47.954237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:47.967668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:47.973323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:47.976798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:48.008671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.009219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.009719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.010452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.021169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.022318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.113406 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6bb3c04-bdfd-4dfc-b364-0cc8624e82b5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.489426 Oct 03 10:39:48.114686 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1154/2403] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 3 10:39:47 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:48.138707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:48.161405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:48.164709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:48.171871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:48.184683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.186416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.187623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.190316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.190887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.194951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.287053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:48.377435 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dd926c47-50e3-4922-9e7e-7ab5fe19a9cf tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.251779 Oct 03 10:39:48.380720 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1155/2404] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:39:48 2022] GET /compute/v2.1/servers => generated 1011 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:48.394510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:48.412869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:48.414299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:48.493764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.493764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.496469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.501317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.501894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.507665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.774243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:48.788601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d3fe114-ff4b-4b0f-951c-2e13d2e6293c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.824651 Oct 03 10:39:48.790222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:48.791860 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1250/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:47 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:48.820225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:48.820960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:48.839182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.839684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.840202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.845267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.845839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.846286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.893550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] HTTP exception thrown: Instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 could not be found. Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Request method failure captured: Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 HTTP/1.1 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroug6f7Jxm7mcb9pE8ho7AH3nwQAwDB3DeNr7lvOuptzAqGlVi1m8QasD8d9685Qjr7fiAZBCsRG58cuhZHiWbL_Yg1jJetkBphr99vXBTkCIkPe1rsWL66IIbnF3IhM64P7UwJfjiyr_f0YGx7QSsrmBgD-REIwBw_C3LuRhSHhzA Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}] Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7b6d14fc83e74c34b2e6d5845f4ed9bf Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 could not be found. Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4'} Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 could not be found. Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 could not be found. Oct 03 10:39:48.899872 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 could not be found. Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:48.903847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Returning 404 to user: Instance d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:48.905443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1acef5e3-1a6f-430d-9908-1eaa18c2eb26 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4" status: 404 len: 111 microversion: 2.25 time: 0.093245 Oct 03 10:39:48.907659 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1251/2406] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:48 2022] GET /compute/v2.1/servers/d97379c0-f6ac-4dfd-bdb2-adbd8ae70dd4 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:39:48.932126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:48.933290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:48.959378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.959916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.960373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.964053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:48.964608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:48.966121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:48.977818 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc75fbd7-f653-49e8-afa0-07d173650d2f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.588018 Oct 03 10:39:48.981080 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1156/2407] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:39:48 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:48.986588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:48.989829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:49.010490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.011588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.012052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:49.013034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.020211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.020689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:49.049935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:39:49.223474 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-50245252-becd-4acd-a5fb-19fcbc42065f tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 204 len: 0 microversion: 2.25 time: 0.308477 Oct 03 10:39:49.229068 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1252/2408] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:39:48 2022] DELETE /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:39:49.237526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:49.244002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:49.244611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.servers [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Removing options 'limit' from query {{(pid=122269) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 10:39:49.246351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:49.278886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.280226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.282406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:49.283451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.284225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.284897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:49.327415 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1085b8c-6402-4161-9ba9-548b703b0a81 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.095537 Oct 03 10:39:49.327415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1253/2409] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 3 10:39:49 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:49.337035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:49.337813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:49.346391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.346890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.347487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:49.348563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.349047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.349481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:49.382815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:49.597927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:49.627715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a0e91fd-c055-4d56-bd62-69293e869c9b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.645372 Oct 03 10:39:49.658540 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1157/2410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:48 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:49.686962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:49.705914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:49.708318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1954562645', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:39:49.725450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.725966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.726397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:49.727150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:49.727974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:49.728085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:50.092399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:39:50.153865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:50.171489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:50.178975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:50.180509 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2c9e658-e66c-4ea8-9abc-f409eabc694e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1564 microversion: 2.25 time: 0.852204 Oct 03 10:39:50.184089 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1254/2411] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:49 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1564 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:50.238050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:50.240667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:50.265824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:50.271717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:50.273362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:50.277820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:50.282837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:50.283903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:50.294427 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e36661e-fcc0-46cc-be18-af5def04090a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1954562645" status: 200 len: 346 microversion: 2.1 time: 0.634211 Oct 03 10:39:50.296837 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1158/2412] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 10:39:49 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1954562645 => generated 346 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:50.316470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db7ea7c1-338c-465e-8bf3-9ac69ae6d75f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:50.334578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db7ea7c1-338c-465e-8bf3-9ac69ae6d75f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:50.337133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db7ea7c1-338c-465e-8bf3-9ac69ae6d75f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:50.337876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db7ea7c1-338c-465e-8bf3-9ac69ae6d75f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:50.447777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db7ea7c1-338c-465e-8bf3-9ac69ae6d75f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 10:39:50.564752 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db7ea7c1-338c-465e-8bf3-9ac69ae6d75f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "POST /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb/action" status: 202 len: 0 microversion: 2.1 time: 0.254267 Oct 03 10:39:50.566179 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1159/2413] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:39:50 2022] POST /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:39:50.582276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:50.583904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:50.598166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:50.598844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:50.599101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:50.599826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:50.601017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:50.601017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:51.134334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:51.148671 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8392e43-bd02-4ed3-8f0b-d0d5c68fe146 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.935042 Oct 03 10:39:51.149378 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1255/2414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:50 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:51.160098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:51.162281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:51.180713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:51.183255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:51.183914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:51.184921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:51.187126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:51.188007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:51.630036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:51.639503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:51.642598 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-78f4c5b9-f78d-4498-ad32-c12218b48c1c tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.491331 Oct 03 10:39:51.656798 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1256/2415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:51 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:51.656798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:51.656798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:51.662564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:51.662840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:51.663359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:51.664098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:51.664618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:51.665100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:51.699276 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-180065ef-7168-4fe9-aaa4-f341d186fe6f tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 1.126417 Oct 03 10:39:51.711862 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1160/2416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:50 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:51.744908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-67a003bc-1197-4ac6-9885-ae6564a676e3 req-fd088850-9c2d-49ee-8e2a-a24e3d1720ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c8e57a-87eb-4726-a78c-8846b874f46a", "name": "network-vif-deleted", "tag": "6c14f12e-0f43-479d-9a1a-3653984609d0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:51.773637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-67a003bc-1197-4ac6-9885-ae6564a676e3 req-fd088850-9c2d-49ee-8e2a-a24e3d1720ce service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:51.774355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-67a003bc-1197-4ac6-9885-ae6564a676e3 req-fd088850-9c2d-49ee-8e2a-a24e3d1720ce service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:51.774934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-67a003bc-1197-4ac6-9885-ae6564a676e3 req-fd088850-9c2d-49ee-8e2a-a24e3d1720ce service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:51.781264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:51.793799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:51.795330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6d14fc83e74c34b2e6d5845f4ed9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef692cfceb0843ef91ac2e607b0cb237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:51.796524 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b1816d9-0453-475d-a4a4-cd3ee7af822e tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 200 len: 1347 microversion: 2.25 time: 0.151931 Oct 03 10:39:51.814050 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1257/2417] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:51 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 1347 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:39:51.815266 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-67a003bc-1197-4ac6-9885-ae6564a676e3 req-fd088850-9c2d-49ee-8e2a-a24e3d1720ce service nova] Creating event network-vif-deleted:6c14f12e-0f43-479d-9a1a-3653984609d0 for instance f4c8e57a-87eb-4726-a78c-8846b874f46a on n-h1-858383-3 Oct 03 10:39:51.830027 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-67a003bc-1197-4ac6-9885-ae6564a676e3 req-fd088850-9c2d-49ee-8e2a-a24e3d1720ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114648 Oct 03 10:39:51.832406 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1161/2418] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:39:52.177633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:52.178944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:52.192517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:52.194667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:52.195728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:52.197115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:52.197892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:52.198536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:52.434505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:52.454339 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-67d22ee3-398e-4785-988f-324959fb663b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.281297 Oct 03 10:39:52.458067 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1258/2419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:52 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:52.672504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:52.674195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:52.680684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:52.684172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:52.684939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:52.685610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:52.687190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:52.688076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:52.697701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:52.738075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:52.738948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:52.754289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:52.754828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:52.755285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:52.756022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:52.756485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:52.756991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:53.039667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:53.048693 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a6971e7-b5ce-468c-85c4-821405a3a34a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 0.314295 Oct 03 10:39:53.051821 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1259/2420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:52 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:53.059959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:53.061440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] [instance: f4c8e57a-87eb-4726-a78c-8846b874f46a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:53.069135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:53.069645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:53.070086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:53.070813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:53.071273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:53.071712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:53.095768 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] HTTP exception thrown: Instance f4c8e57a-87eb-4726-a78c-8846b874f46a could not be found. Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Request method failure captured: Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a HTTP/1.1 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroug6f7Jxm7mcb9pE8ho7AH3nwQAwDB3DeNr7lvOuptzAqGlVi1m8QasD8d9685Qjr7fiAZBCsRG58cuhZHiWbL_Yg1jJetkBphr99vXBTkCIkPe1rsWL66IIbnF3IhM64P7UwJfjiyr_f0YGx7QSsrmBgD-REIwBw_C3LuRhSHhzA Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef692cfceb0843ef91ac2e607b0cb237"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef692cfceb0843ef91ac2e607b0cb237"}]}] Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ef692cfceb0843ef91ac2e607b0cb237 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067 Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7b6d14fc83e74c34b2e6d5845f4ed9bf Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1397410067-project Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance f4c8e57a-87eb-4726-a78c-8846b874f46a could not be found. Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f4c8e57a-87eb-4726-a78c-8846b874f46a'} Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c8e57a-87eb-4726-a78c-8846b874f46a could not be found. Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c8e57a-87eb-4726-a78c-8846b874f46a could not be found. Oct 03 10:39:53.097498 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c8e57a-87eb-4726-a78c-8846b874f46a could not be found. Oct 03 10:39:53.100920 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:39:53.103607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] Returning 404 to user: Instance f4c8e57a-87eb-4726-a78c-8846b874f46a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:39:53.104555 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-547f18df-5b7e-4f44-ad41-ecf73b34ad81 tempest-LiveAutoBlockMigrationV225Test-1397410067 tempest-LiveAutoBlockMigrationV225Test-1397410067-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a" status: 404 len: 111 microversion: 2.25 time: 0.051564 Oct 03 10:39:53.105884 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1260/2421] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:39:53 2022] GET /compute/v2.1/servers/f4c8e57a-87eb-4726-a78c-8846b874f46a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:39:53.111771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1585386838", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "8dfab15d-c95b-4438-8a22-5899a500e061"}, {"uuid": "2f6f7966-7bf5-4d0d-a24e-eea26db93f55"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:39:53.204658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] validate_networks() for [('8dfab15d-c95b-4438-8a22-5899a500e061', None, None, None, None, None), ('2f6f7966-7bf5-4d0d-a24e-eea26db93f55', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:39:53.474084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:53.485997 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5069eec5-4714-4ab2-b386-f9c96d47fa04 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.819242 Oct 03 10:39:53.499803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1162/2422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:52 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:53.504992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:53.505881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:53.512933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:53.514194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:53.514795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:53.515989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:53.516672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:53.517274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:54.141821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:54.158088 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0ceed5a-858c-46a6-86f1-414dfb0c14e5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.656783 Oct 03 10:39:54.168798 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1163/2423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:53 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:54.168798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:54.168798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:54.182282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:54.182781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:54.183220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:54.183934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:54.184393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:54.184845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:54.429559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:54.442346 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b1ac4c8-b0f1-4070-90d1-4396bbc6dd9c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 0.279466 Oct 03 10:39:54.442998 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1164/2424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:54 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:54.531054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:54.532843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:54.548008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:54.555336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:54.558674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:54.559607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:54.560233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:54.560989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:54.922774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:54.932089 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a1519c1-0a71-41ac-8ea7-dc5ef5129af5 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.408821 Oct 03 10:39:54.938427 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1165/2425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:54 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:55.188924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:55.194630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:55.203229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:55.204379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:55.205039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:55.212089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:55.212643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:55.213211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:55.568059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:55.584084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f1b1900-2e51-42da-bfc4-f5c2c6f5e632 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.399758 Oct 03 10:39:55.585438 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1166/2426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:55 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:55.591373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:55.594139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:55.602084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:55.602746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:55.603490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:55.604500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:55.607141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:55.607783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:55.918918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:55.930871 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bac1d6cd-730e-4dba-acaf-271f746a3676 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 0.343948 Oct 03 10:39:55.931488 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1167/2427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:55 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:55.964001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:55.964564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:55.974920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:55.975435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:55.975881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:55.976604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:55.977092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:55.977521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:56.209610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:56.436701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:39:56.437458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:39:56.438087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:39:56.438663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:39:56.439242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:39:56.465007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:56.465910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:56.467033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:56.468068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:56.468682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:56.469428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:56.472062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:56.487260 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab53c909-45b9-4ad9-a4c2-ba5621a09ec1 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.521234 Oct 03 10:39:56.489639 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1168/2428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:55 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:56.520199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Getting quotas for project ef9c270a5d5343e690bf17c988e25115. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:39:56.532098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Getting quotas for user c8f07ab449064cfea68877b477f897ab and project ef9c270a5d5343e690bf17c988e25115. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:39:56.572415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:56.574909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:39:56.577854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:39:56.612945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:56.613860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:56.638759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:56.643453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:56.647348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:56.650159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:56.652023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:56.655067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:56.699060 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d782a3c7-a758-4cb7-9465-25e22d6cf10d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.591810 Oct 03 10:39:56.709505 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1261/2429] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:39:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:39:56.714629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f90707eb-ab6f-4fef-a70e-906b09433c7b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:56.715246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f90707eb-ab6f-4fef-a70e-906b09433c7b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:56.939412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f90707eb-ab6f-4fef-a70e-906b09433c7b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:56.946973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f90707eb-ab6f-4fef-a70e-906b09433c7b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1213 microversion: 2.1 time: 0.236110 Oct 03 10:39:56.947846 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1262/2430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:56 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1213 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:56.967417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:56.969802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:56.988080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:57.001024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:57.001737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:57.002719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:57.003394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:57.004029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:57.250642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:57.256825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:57.267953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8fb59a4f-0c14-4bf5-8a5f-45cd2b412e1d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.660789 Oct 03 10:39:57.278253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1169/2431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:56 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:57.515915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:57.517769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:57.534140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:57.535463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:57.536163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:57.537086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:57.537665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:57.578952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:57.842707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:57.852973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-04c8669a-3e2d-4dc6-9e34-bc0470546bd6 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 0.890927 Oct 03 10:39:57.882892 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1263/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:56 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:57.977927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:57.978568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:58.007900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:58.015856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:58.016428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:58.022463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:58.022968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:58.027712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:58.229772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:58.251879 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f37ec18d-cefd-4b7b-b3d1-483e7d722cdd tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.734588 Oct 03 10:39:58.252949 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1170/2433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:57 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:58.303854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:58.304618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:58.318188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:58.318683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:58.319121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:58.335931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:58.338202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:58.338838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:58.489561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:58.507490 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4e1de58-feb9-4a5a-bad9-c6fe166c2ef2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1209 microversion: 2.1 time: 0.539225 Oct 03 10:39:58.511435 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1264/2434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:57 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1209 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:58.762598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:58.772856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c128e42f-2894-4f8c-b102-d205a62271b4 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1392 microversion: 2.1 time: 0.473040 Oct 03 10:39:58.773783 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1171/2435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:58 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1392 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:39:58.880485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:58.885689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:58.903573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:58.905432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:58.905952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:58.906686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:58.910936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:58.912247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:59.279690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:59.280541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:59.301431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:59.302189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:59.302796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:59.303687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:59.304321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:59.304932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:59.824662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:39:59.855264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:59.874939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-012f8fcc-4149-4e64-b382-b0d7353dfbe0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.594053 Oct 03 10:39:59.875312 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1172/2436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:59 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:59.881283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:59.882063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:39:59.907534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:59.910469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:59.923556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:39:59.926556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:59.930812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:39:59.933348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:39:59.934192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:39:59.938280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1501866a-70ec-4082-a221-ac9f7ac5c48a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 1.061116 Oct 03 10:39:59.940249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1265/2437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:58 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:39:59.973064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:39:59.976280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:00.017425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.017425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.017425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.018085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.023321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.024275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.136123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:00.167058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64a9a76d-4bca-429c-99d2-b06985a5b93b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1271 microversion: 2.1 time: 0.290641 Oct 03 10:40:00.168115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1173/2438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:59 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:00.299564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:00.313499 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee7dc20a-912e-4f5b-b9fb-f8c9cf35202c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1382 microversion: 2.1 time: 0.368283 Oct 03 10:40:00.314884 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1266/2439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:39:59 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1382 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:00.344539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-880a0ea7-a6b6-4540-be04-9c574f7f0e7c tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '.version_select at 0x7f074fad6160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:00.350629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-880a0ea7-a6b6-4540-be04-9c574f7f0e7c tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.351774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-880a0ea7-a6b6-4540-be04-9c574f7f0e7c tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.352404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-880a0ea7-a6b6-4540-be04-9c574f7f0e7c tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.367087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-880a0ea7-a6b6-4540-be04-9c574f7f0e7c tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.028158 Oct 03 10:40:00.368237 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1174/2440] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 10:40:00 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:00.385186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:00.386133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:00.398730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.399505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.400133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.402102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.402784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.403416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.806947 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a2fa036-b7d7-4279-a65e-db675aaee058 tempest-LiveMigrationTest-829566208 tempest-LiveMigrationTest-829566208-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1533 microversion: 2.1 time: 0.425279 Oct 03 10:40:00.807693 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1267/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:00 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1533 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:00.859652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:00.861079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:00.871771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.872710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.873414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.874356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.875336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.876183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.905281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:00.906865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:00.922901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.924873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.926984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.929188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:00.930646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:00.933041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:00.963712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:01.200225 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-163803df-f79c-4df1-b3e6-4f570d3f8eb2 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 204 len: 0 microversion: 2.1 time: 0.344127 Oct 03 10:40:01.203668 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1175/2442] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:00 2022] DELETE /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:01.218173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:01.221620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:01.244179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:01.245078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:01.245761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:01.248101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:01.251570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:01.252274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:01.550858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:01.597117 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-29d6359b-49d6-44ab-b194-06125630b271 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.700214 Oct 03 10:40:01.611488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1268/2443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:00 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:01.627459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:01.634973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:01.656481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:01.657051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:01.657504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:01.663395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:01.663825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:01.667201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:01.900235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:01.918580 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-45b62987-3b59-44b0-88cb-7b609ec8cf3b tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 0.707400 Oct 03 10:40:01.932826 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1176/2444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:01 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:01.942501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:01.945356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:01.986156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:01.987275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:01.989918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:01.994465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:01.997062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:02.002491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:02.376679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:02.385182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-347b60b8-3310-4e48-85c9-2ff77f39ce11 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1313 microversion: 2.1 time: 0.765306 Oct 03 10:40:02.394667 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1269/2445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:01 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1313 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:02.582553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:02.596540 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce10a5f0-df75-469d-b4fa-aa7c32914862 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1388 microversion: 2.1 time: 0.672820 Oct 03 10:40:02.616356 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1177/2446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:01 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1388 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:02.636125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:02.636782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:02.653172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:02.655258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:02.657498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:02.659860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:02.660478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:02.661927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:02.796796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6edc45ec-6af9-46df-b577-9897a334024f tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:02.820071 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6edc45ec-6af9-46df-b577-9897a334024f tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.355729 Oct 03 10:40:02.821507 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1270/2447] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:02.847326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3f8d370-d511-4f50-bd57-70df0915ad9d tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:02.914633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3f8d370-d511-4f50-bd57-70df0915ad9d tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.076117 Oct 03 10:40:02.915433 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1271/2448] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:40:02 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:02.941946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02aecb7d-9fad-45cc-bccd-a5945f72be9f tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:02.956127 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02aecb7d-9fad-45cc-bccd-a5945f72be9f tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023641 Oct 03 10:40:02.956941 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1272/2449] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:02.988160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:02.988838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:03.004284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:03.004799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:03.005258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:03.005962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:03.006414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:03.016903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:03.093932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:03.104330 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9fd9b1fb-a709-4494-841f-dc0c971bc4d3 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1522 microversion: 2.1 time: 0.473121 Oct 03 10:40:03.117370 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1178/2450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:02 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1522 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:03.130984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-08a731d5-fb38-41c4-a4f5-1adf1b7adf4a tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:03.161184 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-08a731d5-fb38-41c4-a4f5-1adf1b7adf4a tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037120 Oct 03 10:40:03.168746 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1179/2451] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:03.192757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfd35ed5-e75e-4051-a445-d579a9d5c5cc tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:03.349593 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bfd35ed5-e75e-4051-a445-d579a9d5c5cc tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.173768 Oct 03 10:40:03.351509 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1180/2452] 10.222.0.27 () {58 vars in 1165 bytes} [Mon Oct 3 10:40:03 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:03.374290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4180bb4-dfa9-443e-9a7c-ef15bd6e7cd6 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:03.382952 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4180bb4-dfa9-443e-9a7c-ef15bd6e7cd6 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015358 Oct 03 10:40:03.392264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1181/2453] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:03.399555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e2d6729-1a61-4975-a1d0-62fb0477a72b tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:03.433197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e2d6729-1a61-4975-a1d0-62fb0477a72b tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.039177 Oct 03 10:40:03.449427 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1182/2454] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Oct 3 10:40:03 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:03.477609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:03.479902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:03.501775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:03.504108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:03.505977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:03.508461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:03.509131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:03.511867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:03.691729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:03.700359 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea410301-ffb0-4bef-a0c1-535bd2ce76dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 0.722380 Oct 03 10:40:03.701013 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1273/2455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:02 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:03.713581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5382b968-de5a-490a-91f5-7d7e96b77d3a tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:03.759193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5382b968-de5a-490a-91f5-7d7e96b77d3a tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.057124 Oct 03 10:40:03.765635 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1274/2456] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 10:40:03 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:03.779854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:03.792886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:03.821849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:03.824015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:03.828624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:03.830070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:03.832292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:03.832864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:03.987503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:04.004184 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-85e7d5f8-f8ea-4bbc-ae9b-d1fbdd060de5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.551502 Oct 03 10:40:04.016793 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1183/2457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:03 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:04.017241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba6bd74e-7ff9-4577-9b35-212feb3e220d tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.025997 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba6bd74e-7ff9-4577-9b35-212feb3e220d tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019299 Oct 03 10:40:04.026585 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1184/2458] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:04.056609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33a02c5a-d7ca-4407-9386-088d9f343dac tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.150765 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33a02c5a-d7ca-4407-9386-088d9f343dac tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.106651 Oct 03 10:40:04.152125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1185/2459] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:04.180367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.181345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:04.195548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:04.199375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:04.200066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:04.201087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:04.202542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:04.203229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:04.271720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:04.283640 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fdff6801-08d8-46f2-827e-79e7dd33fc66 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1388 microversion: 2.1 time: 0.516673 Oct 03 10:40:04.285238 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1275/2460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:03 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1388 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:04.300023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6fb6f750-dc40-4edf-8a85-69080ab46a06 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.316613 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6fb6f750-dc40-4edf-8a85-69080ab46a06 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029542 Oct 03 10:40:04.317555 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1276/2461] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:04.330660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e2a307b-7ef7-4dfa-b070-67faba840544 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.367603 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7e2a307b-7ef7-4dfa-b070-67faba840544 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.041986 Oct 03 10:40:04.384969 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1277/2462] 10.222.0.27 () {58 vars in 1144 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:04.390640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-788f35ff-2d01-4353-8afa-2045892e70cd tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.405938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-788f35ff-2d01-4353-8afa-2045892e70cd tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019543 Oct 03 10:40:04.426563 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1278/2463] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:04.431610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-23476fac-18a6-45fb-8efc-f75c55695c56 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.478385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-23476fac-18a6-45fb-8efc-f75c55695c56 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.050435 Oct 03 10:40:04.478984 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1279/2464] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:04.494409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6389db1a-ccd7-4a32-8313-4985f3658f51 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.518524 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6389db1a-ccd7-4a32-8313-4985f3658f51 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.027786 Oct 03 10:40:04.522143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1280/2465] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:04.546963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b983f8a-cb7e-4094-85b4-e38b20c99c0e tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.558410 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b983f8a-cb7e-4094-85b4-e38b20c99c0e tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026844 Oct 03 10:40:04.559252 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1281/2466] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:04.571401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bf8a785-fde0-4bb1-a679-b75efd47f864 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.654848 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bf8a785-fde0-4bb1-a679-b75efd47f864 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.087150 Oct 03 10:40:04.655760 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1282/2467] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:04.672436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8c5fc18-0b16-4850-a8af-53bacae46e31 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.710239 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8c5fc18-0b16-4850-a8af-53bacae46e31 tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041994 Oct 03 10:40:04.738558 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1283/2468] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:04.745867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:04.751873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.752516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:04.755034 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a6d0c67a-49d7-48c0-959f-7d6b9e52ebac tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1502 microversion: 2.1 time: 0.601350 Oct 03 10:40:04.766553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:04.767503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:04.768095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:04.769170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:04.769771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:04.770340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:04.773772 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1186/2469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1502 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:04.787160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-063c715d-3648-46c3-9080-7652cfe06a9f tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:04.811684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-063c715d-3648-46c3-9080-7652cfe06a9f tempest-FlavorsV2TestJSON-1485213931 tempest-FlavorsV2TestJSON-1485213931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035871 Oct 03 10:40:04.813008 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1187/2470] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:04.824595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b42f3cb9-54d6-47e1-a41a-d83e61bf479a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'create', calling method: .version_select at 0x7f074f5a9160>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-597683453", "description": "tempest-description-690667223"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:05.366019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:05.384236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72d1a38e-64ff-4d62-b34a-7c02c881c01d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1522 microversion: 2.1 time: 0.639164 Oct 03 10:40:05.388075 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1284/2471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:04 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:05.408095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-85d70cf8-db11-4efd-b7fb-b62c6380146a req-8622b9de-f4f0-4365-924d-2cc947f141d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264a278e-b061-43fa-aa91-2d63d5b2259e", "name": "network-vif-deleted", "tag": "e55d96a5-ad44-4d69-95f8-6fbdbf096f6e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:05.430080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-85d70cf8-db11-4efd-b7fb-b62c6380146a req-8622b9de-f4f0-4365-924d-2cc947f141d0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:05.436262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-85d70cf8-db11-4efd-b7fb-b62c6380146a req-8622b9de-f4f0-4365-924d-2cc947f141d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:05.437025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-85d70cf8-db11-4efd-b7fb-b62c6380146a req-8622b9de-f4f0-4365-924d-2cc947f141d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:05.445466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:05.461444 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-85d70cf8-db11-4efd-b7fb-b62c6380146a req-8622b9de-f4f0-4365-924d-2cc947f141d0 service nova] Creating event network-vif-deleted:e55d96a5-ad44-4d69-95f8-6fbdbf096f6e for instance 264a278e-b061-43fa-aa91-2d63d5b2259e on n-h1-858383-3 Oct 03 10:40:05.478578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-85d70cf8-db11-4efd-b7fb-b62c6380146a req-8622b9de-f4f0-4365-924d-2cc947f141d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085425 Oct 03 10:40:05.480792 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1285/2472] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:05.495957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:05.497972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:05.515090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:05.515836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:05.516496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:05.517689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:05.518343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:05.519074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:05.652382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b42f3cb9-54d6-47e1-a41a-d83e61bf479a tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.837916 Oct 03 10:40:05.653154 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1188/2473] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:40:04 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:05.658321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:05.659491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:05.674200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:05.674696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:05.675139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:05.675855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:05.676315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:05.676740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:05.806688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:05.821919 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d604b9c7-f9b4-4548-b649-044e29842d10 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1184 microversion: 2.1 time: 0.167042 Oct 03 10:40:05.837169 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1189/2474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:05 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1184 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:05.855245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-597683453"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:05.858270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:05.875122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:05.877088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:05.878678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:05.880304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:05.882149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:05.882876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:06.058910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:06.067592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3c7ac4d-ad44-4642-a96d-52fe0dd74a93 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.582161 Oct 03 10:40:06.068719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1286/2475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:05 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:06.074035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3aa4b419-b650-4e79-8643-d2b5ef022e82 req-3084e7cf-071e-4bb5-9389-046cbc23be97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262b89ff-86ce-42e8-b4a1-b0f36e540142", "tag": "056e2a84-db6e-4bbd-a7fd-27749dcf8303"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:06.085194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3aa4b419-b650-4e79-8643-d2b5ef022e82 req-3084e7cf-071e-4bb5-9389-046cbc23be97 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:06.085915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3aa4b419-b650-4e79-8643-d2b5ef022e82 req-3084e7cf-071e-4bb5-9389-046cbc23be97 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:06.086548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3aa4b419-b650-4e79-8643-d2b5ef022e82 req-3084e7cf-071e-4bb5-9389-046cbc23be97 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:06.100527 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3aa4b419-b650-4e79-8643-d2b5ef022e82 req-3084e7cf-071e-4bb5-9389-046cbc23be97 service nova] Creating event network-changed:056e2a84-db6e-4bbd-a7fd-27749dcf8303 for instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 on n-h1-858383-3 Oct 03 10:40:06.107457 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3aa4b419-b650-4e79-8643-d2b5ef022e82 req-3084e7cf-071e-4bb5-9389-046cbc23be97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036516 Oct 03 10:40:06.109977 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1287/2476] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:06.334954 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.network.security_group_api [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Adding security group 8822406f-9a86-4184-8124-4f8c91e51dac to port 3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 Oct 03 10:40:06.410435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:06.412359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:06.440140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:06.441524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:06.442372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:06.443742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:06.447614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:06.448073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:06.508042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:06.947314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:07.270137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:07.300350 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ac0838a-447c-4cb3-aa53-8198f61c3a61 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1499 microversion: 2.1 time: 0.894474 Oct 03 10:40:07.303516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1288/2477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:06 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1499 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:07.317637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:07.318261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:07.338798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:07.341900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:07.342414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:07.345998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:07.348761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:07.349139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:07.724701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:07.732818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-efb36d68-05c4-45d9-8116-ed9239c92332 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1184 microversion: 2.1 time: 0.426322 Oct 03 10:40:07.735815 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1289/2478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:07 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1184 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:07.744793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:07.759347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:07.780701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:07.786955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:07.787529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:07.788292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:07.788752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:07.793248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:08.157741 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3c6c0b7a-b1c0-437c-b0a1-9ab5e9fe277d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action" status: 202 len: 0 microversion: 2.1 time: 2.318828 Oct 03 10:40:08.161389 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1190/2479] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:40:05 2022] POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action => generated 0 bytes in 2321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:40:08.163219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:08.168468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:08.177494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:08.188350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:08.188858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:08.189296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:08.201877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:08.202616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:08.205179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:08.340480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:08.348387 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7e60e1ab-7f50-4c19-ae69-1f2aab272f2c tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.611251 Oct 03 10:40:08.348931 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1290/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:07 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:08.366360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-597683453"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:08.366892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:08.384917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:08.387198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:08.390871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:08.391847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:08.392615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:08.394671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:08.425027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:08.624245 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-059f4758-99bc-446f-94ae-75c064cd12f7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.464018 Oct 03 10:40:08.632049 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1191/2481] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 3 10:40:08 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:08.637080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-738bfa21-db15-4fce-94c7-15bea12ea78f req-c8d9ca89-a6d0-422a-8262-cd11593217ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830f019f-1794-42cc-a7c4-e626d66592f5", "tag": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:08.682995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-738bfa21-db15-4fce-94c7-15bea12ea78f req-c8d9ca89-a6d0-422a-8262-cd11593217ec service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:08.683758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-738bfa21-db15-4fce-94c7-15bea12ea78f req-c8d9ca89-a6d0-422a-8262-cd11593217ec service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:08.685117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-738bfa21-db15-4fce-94c7-15bea12ea78f req-c8d9ca89-a6d0-422a-8262-cd11593217ec service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:08.726713 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-738bfa21-db15-4fce-94c7-15bea12ea78f req-c8d9ca89-a6d0-422a-8262-cd11593217ec service nova] Creating event network-changed:3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 for instance 830f019f-1794-42cc-a7c4-e626d66592f5 on n-h1-858383-3 Oct 03 10:40:08.739698 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-738bfa21-db15-4fce-94c7-15bea12ea78f req-c8d9ca89-a6d0-422a-8262-cd11593217ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106205 Oct 03 10:40:08.744150 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1192/2482] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:08.774242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dbad594e-9006-4f1b-bc36-3a2c0233a5dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:08.785719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbad594e-9006-4f1b-bc36-3a2c0233a5dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:08.795361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbad594e-9006-4f1b-bc36-3a2c0233a5dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:08.797313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbad594e-9006-4f1b-bc36-3a2c0233a5dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:08.864150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dbad594e-9006-4f1b-bc36-3a2c0233a5dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Going to try to start instance {{(pid=122270) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 10:40:08.903057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:08.976554 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dbad594e-9006-4f1b-bc36-3a2c0233a5dc tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "POST /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb/action" status: 202 len: 0 microversion: 2.1 time: 0.230222 Oct 03 10:40:08.980559 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1193/2483] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:40:08 2022] POST /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:40:08.997638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:08.998940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:09.010720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:09.011565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:09.012204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:09.015159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:09.016059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:09.016686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:09.193406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:09.205919 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-236ee5c9-62b6-4dc9-89d2-e176b7e6d10c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1184 microversion: 2.1 time: 0.223391 Oct 03 10:40:09.209837 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1194/2484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:08 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1184 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:09.228191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:09.229785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:09.246566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:09.247697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:09.248367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:09.249324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:09.257515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:09.258342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:09.716545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:09.733938 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2fa4ae42-d2db-4449-abd4-dde88037ff64 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1508 microversion: 2.1 time: 0.521531 Oct 03 10:40:09.738514 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1195/2485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:09 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:10.060905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ffed3de6-0be4-4d4d-b285-bf04785d7051 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:10.073919 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ffed3de6-0be4-4d4d-b285-bf04785d7051 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.330077 Oct 03 10:40:10.075795 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1196/2486] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:40:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:10.085667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:10.086650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:10.104578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:10.105610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:10.106295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:10.107237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:10.107917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:10.109529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:10.188705 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.network.security_group_api [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Removing security group 8822406f-9a86-4184-8124-4f8c91e51dac from port 3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 Oct 03 10:40:10.845389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:10.854032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-10c1a330-bdc8-4ff0-a693-1445b12bdfe2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.772128 Oct 03 10:40:10.867162 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1197/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:10 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:10.876901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:10.880954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:10.907988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:10.918442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:10.919809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:10.920973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:10.923805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:10.924359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:11.133416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:11.156968 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4be000e5-4071-49c3-9f5c-b979c4405ffa tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1184 microversion: 2.1 time: 0.297756 Oct 03 10:40:11.165659 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1198/2488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:10 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1184 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:11.184542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:11.187972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:11.201358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:11.202006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:11.202659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:11.203497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:11.207545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:11.208285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:11.557999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:11.567437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc370987-9c56-4b60-a192-cb44ed53e3f1 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1508 microversion: 2.1 time: 0.397829 Oct 03 10:40:11.588993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1199/2489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:11 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:11.599270 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3151654d-33ef-4ad9-ad9a-6d40616e1d28 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action" status: 202 len: 0 microversion: 2.1 time: 3.249278 Oct 03 10:40:11.601456 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1291/2490] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:40:08 2022] POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action => generated 0 bytes in 3252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:40:11.604718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a5b36a45-de5d-4c4b-b82d-3a78bd9a2f1b req-0bad5b4d-6b8d-4d93-bd52-7ea7a1e52af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262b89ff-86ce-42e8-b4a1-b0f36e540142", "tag": "4037c86d-0c81-454a-8a7d-dd544d25df9d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:11.607883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b5e608d-a232-4152-aa0b-7e98be2a0c17 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-79477930", "imageRef": "1237140a-670c-45c2-95ba-6b27053aca45", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:11.626758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a5b36a45-de5d-4c4b-b82d-3a78bd9a2f1b req-0bad5b4d-6b8d-4d93-bd52-7ea7a1e52af4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:11.627573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a5b36a45-de5d-4c4b-b82d-3a78bd9a2f1b req-0bad5b4d-6b8d-4d93-bd52-7ea7a1e52af4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:11.629321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a5b36a45-de5d-4c4b-b82d-3a78bd9a2f1b req-0bad5b4d-6b8d-4d93-bd52-7ea7a1e52af4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:11.699998 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a5b36a45-de5d-4c4b-b82d-3a78bd9a2f1b req-0bad5b4d-6b8d-4d93-bd52-7ea7a1e52af4 service nova] Creating event network-changed:4037c86d-0c81-454a-8a7d-dd544d25df9d for instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 on n-h1-858383-3 Oct 03 10:40:11.723075 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a5b36a45-de5d-4c4b-b82d-3a78bd9a2f1b req-0bad5b4d-6b8d-4d93-bd52-7ea7a1e52af4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130646 Oct 03 10:40:11.743798 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1200/2491] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:11.747987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-6b5e608d-a232-4152-aa0b-7e98be2a0c17 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:40:11.778594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-adc2cd4c-04a9-4263-a249-ec972a6f6644 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'create', calling method: .version_select at 0x7f074f183c10>, body: {"pool": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:13.094059 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6b5e608d-a232-4152-aa0b-7e98be2a0c17 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b5e608d-a232-4152-aa0b-7e98be2a0c17 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] Request method failure captured: Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 141 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrwI2W5bTwMhC6QYJ_w9qYM-OXbiGgoR9qJiE2UcP7XvDenjC2GGkvYVJ0x0OWlknmVbL_IiQR8hKsK-FCAxqvAcCcu9PBSE4U5khiwAqYv733oGpcFOqQnWZHrtz-Mdh93DES9yam3aKhFcPQYWH-fE5o2UVA_HGi-FJlbEqE1T7vY Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7f6470bf4d744ff4bf5cb540b27308d8 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FlavorsV2NegativeTest-1924673080 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6470bf4d744ff4bf5cb540b27308d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6470bf4d744ff4bf5cb540b27308d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6470bf4d744ff4bf5cb540b27308d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6470bf4d744ff4bf5cb540b27308d8"}]}] Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FlavorsV2NegativeTest-1924673080 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7f6470bf4d744ff4bf5cb540b27308d8 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1924673080 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FlavorsV2NegativeTest-1924673080-project Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 48029fc2dd414550afb71a5ead74fe19 Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FlavorsV2NegativeTest-1924673080-project Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-79477930", "imageRef": "1237140a-670c-45c2-95ba-6b27053aca45", "flavorRef": "452"}} Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: exception: Flavor's memory is too small for requested image. Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-79477930', 'imageRef': '1237140a-670c-45c2-95ba-6b27053aca45', 'flavorRef': '452'}}} Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:40:13.096475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 03 10:40:13.102120 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:13.113665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b5e608d-a232-4152-aa0b-7e98be2a0c17 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:13.116756 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b5e608d-a232-4152-aa0b-7e98be2a0c17 tempest-FlavorsV2NegativeTest-1924673080 tempest-FlavorsV2NegativeTest-1924673080-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.514117 Oct 03 10:40:13.121166 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1292/2492] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:40:11 2022] POST /compute/v2.1/servers => generated 93 bytes in 1519 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:40:13.129507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-657a64d2-97c9-4951-afeb-1f7c346d613f req-572fa558-370d-4110-9f53-2ef2f56d7a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830f019f-1794-42cc-a7c4-e626d66592f5", "tag": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:13.159396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-657a64d2-97c9-4951-afeb-1f7c346d613f req-572fa558-370d-4110-9f53-2ef2f56d7a85 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:13.161535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-657a64d2-97c9-4951-afeb-1f7c346d613f req-572fa558-370d-4110-9f53-2ef2f56d7a85 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:13.165336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-657a64d2-97c9-4951-afeb-1f7c346d613f req-572fa558-370d-4110-9f53-2ef2f56d7a85 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:13.209141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-657a64d2-97c9-4951-afeb-1f7c346d613f req-572fa558-370d-4110-9f53-2ef2f56d7a85 service nova] Creating event network-changed:3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 for instance 830f019f-1794-42cc-a7c4-e626d66592f5 on n-h1-858383-3 Oct 03 10:40:13.226158 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-657a64d2-97c9-4951-afeb-1f7c346d613f req-572fa558-370d-4110-9f53-2ef2f56d7a85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096209 Oct 03 10:40:13.227225 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1293/2493] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:13.233923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:13.247528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:13.266239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:13.267218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:13.269597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:13.270342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:13.270815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:13.272092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:14.053081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:14.063537 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-adc2cd4c-04a9-4263-a249-ec972a6f6644 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.316814 Oct 03 10:40:14.064077 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1201/2494] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:40:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:14.070010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:14.071255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:14.079375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3c09df10-1757-4833-9cb4-982df574c9d7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.850461 Oct 03 10:40:14.082507 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1294/2495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:13 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:14.111046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:14.111549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:14.111991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:14.112701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:14.113220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:14.114808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:14.117454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:14.118454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:14.130909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:14.134962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:14.135765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:14.138660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:14.139769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:14.141761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:14.297511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:14.313437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-79411734-5d4b-4d82-a1d0-ecadfcbb114b tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 200 len: 1184 microversion: 2.1 time: 0.247582 Oct 03 10:40:14.318387 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1202/2496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:14 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 1184 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:14.332096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'action', calling method: .version_select at 0x7f0754e51b80>, body: {"addFloatingIp": {"address": "172.25.2.35"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:14.353669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:14.367045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:14.370631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:14.371311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:14.371794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:14.373173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:14.373689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:14.374126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:14.495221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "refresh_cache-830f019f-1794-42cc-a7c4-e626d66592f5" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:40:14.497230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquired lock "refresh_cache-830f019f-1794-42cc-a7c4-e626d66592f5" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:40:15.090482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:15.103920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb9ff8c8-8701-4ae0-ae4a-328c69e34935 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1512 microversion: 2.1 time: 1.004045 Oct 03 10:40:15.104832 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1295/2497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:14 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1512 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:15.140866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:15.142403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:15.160389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:15.160953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:15.161405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:15.162144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:15.162748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:15.163362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.004350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:16.016393 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c608a0e0-64eb-49b7-859b-2d83b8a1a4e5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.886820 Oct 03 10:40:16.017744 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1296/2498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:15 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:16.044731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:16.063940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:16.064650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.servers [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Removing options 'limit' from query {{(pid=122269) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 10:40:16.065474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:16.081699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.082313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.082916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.083684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.084151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.084584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.086307 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8fd1fff3-53f7-4dd0-956e-854e28623287 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.051116 Oct 03 10:40:16.086895 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1297/2499] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 3 10:40:16 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:40:16.099370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:16.099997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 264a278e-b061-43fa-aa91-2d63d5b2259e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:16.116340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.117115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.117741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.118617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.119234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.119820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.140689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] HTTP exception thrown: Instance 264a278e-b061-43fa-aa91-2d63d5b2259e could not be found. Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Request method failure captured: Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e HTTP/1.1 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroSNV29QB2t_7wufbcZ8WzP0cWa3hY17SrS4BcrrO65Xjt4BEXxTcyFndGlIRrnf70Y47JDp-AS-nGA93Ce2-7g6ywQ0rGkyyyaZtoK3IZvVLCACE83dSYva_CZi9SdUEnL2f5dgYr3aTj1YQjNpakbCFG63joQyZ3Vb70l0hdLdRc Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}] Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-LiveMigrationTest-167149645 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 6f0eda1654514026b803bcf2a1b8f4f4 Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 264a278e-b061-43fa-aa91-2d63d5b2259e could not be found. Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '264a278e-b061-43fa-aa91-2d63d5b2259e'} Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264a278e-b061-43fa-aa91-2d63d5b2259e could not be found. Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264a278e-b061-43fa-aa91-2d63d5b2259e could not be found. Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:16.142413 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264a278e-b061-43fa-aa91-2d63d5b2259e could not be found. Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Returning 404 to user: Instance 264a278e-b061-43fa-aa91-2d63d5b2259e could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7e27f51-94d3-429c-9e40-8621d69aac72 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e" status: 404 len: 111 microversion: 2.1 time: 0.055864 Oct 03 10:40:16.146831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1298/2500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:16 2022] GET /compute/v2.1/servers/264a278e-b061-43fa-aa91-2d63d5b2259e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:16.158152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:16.166419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:16.175934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.176443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.176921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.177645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.178109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.178541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.847933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:16.870698 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-461dbf88-b1ec-4a4e-b808-b8d50b5070d9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1512 microversion: 2.1 time: 0.718564 Oct 03 10:40:16.871311 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1299/2501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:16 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1512 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:16.897947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:16.898915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:16.913063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.913894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.914511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:16.916529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:16.918957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:16.919847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:17.643180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:17.651192 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-778b867e-3b43-4de0-bcbb-78b01372b45e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 200 len: 1512 microversion: 2.1 time: 0.757921 Oct 03 10:40:17.668112 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1300/2502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:16 2022] GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 1512 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:17.670807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:17.671436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:17.677701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:17.678610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:17.678610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:17.679331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:17.679786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:17.680519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:17.929900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Building network info cache for instance {{(pid=122270) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:40:18.273848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:19.544110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:19.567574 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba7ab0d6-9070-4299-be9d-d6e3fc29e3a8 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 1.900704 Oct 03 10:40:19.589078 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1301/2503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:17 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:19.606529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:19.611860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:19.626014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:19.628643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:19.629613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:19.631377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:19.633192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:19.635052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:19.960051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Updating instance_info_cache with network_info: [{"id": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8", "address": "fa:16:3e:87:3d:15", "network": {"id": "1d932e5a-b01d-44d6-aeb7-910446df43ba", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-777626022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56d17bf642e4452dae776dcfc8db017b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3ac66ed9-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122270) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:40:19.986838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Releasing lock "refresh_cache-830f019f-1794-42cc-a7c4-e626d66592f5" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:40:19.987884 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fc60fde-71d3-45cd-925d-d70a8a939383 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action" status: 202 len: 0 microversion: 2.1 time: 5.668026 Oct 03 10:40:19.994543 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1203/2504] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:40:14 2022] POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action => generated 0 bytes in 5675 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:40:20.013402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3b83804c-f4b7-4524-bb2e-cabe608d7f25 req-d6f71954-4880-4a75-bc3d-50c351bb179f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830f019f-1794-42cc-a7c4-e626d66592f5", "tag": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:20.050779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3b83804c-f4b7-4524-bb2e-cabe608d7f25 req-d6f71954-4880-4a75-bc3d-50c351bb179f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:20.052642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3b83804c-f4b7-4524-bb2e-cabe608d7f25 req-d6f71954-4880-4a75-bc3d-50c351bb179f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:20.053684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3b83804c-f4b7-4524-bb2e-cabe608d7f25 req-d6f71954-4880-4a75-bc3d-50c351bb179f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:20.084903 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3b83804c-f4b7-4524-bb2e-cabe608d7f25 req-d6f71954-4880-4a75-bc3d-50c351bb179f service nova] Creating event network-changed:3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 for instance 830f019f-1794-42cc-a7c4-e626d66592f5 on n-h1-858383-3 Oct 03 10:40:20.096172 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3b83804c-f4b7-4524-bb2e-cabe608d7f25 req-d6f71954-4880-4a75-bc3d-50c351bb179f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095364 Oct 03 10:40:20.099109 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1204/2505] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:20.112304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Action: 'action', calling method: .version_select at 0x7f07558dba60>, body: {"removeFloatingIp": {"address": "172.25.2.35"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:20.377853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:20.388582 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9bc1856-2d22-48e7-86e4-a9e21e4b6ea2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1511 microversion: 2.1 time: 0.798317 Oct 03 10:40:20.393208 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1302/2506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:19 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1511 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:20.417668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:20.425834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:20.427702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'ip': '172.20.0.7', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:20.903359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:20.912403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:20.913658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:20.916450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:20.919042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:20.921497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:20.926280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:21.419213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:21.419827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:21.420523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:21.422168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:21.422761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:21.423302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:21.609720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:21.688276 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-78710dfb-7ae4-4ffd-af4f-dea12c411434 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.7" status: 200 len: 346 microversion: 2.1 time: 1.276874 Oct 03 10:40:21.689987 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1303/2507] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:40:20 2022] GET /compute/v2.1/servers?ip=172.20.0.7 => generated 346 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:40:21.698869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:21.702069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:21.718750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:21.719324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:21.719779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:21.720564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:21.721046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:21.721476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:22.280318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:22.288570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "refresh_cache-830f019f-1794-42cc-a7c4-e626d66592f5" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:40:22.289218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquired lock "refresh_cache-830f019f-1794-42cc-a7c4-e626d66592f5" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:40:22.312571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-faace084-1e9b-442c-b514-221505869e5a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.621446 Oct 03 10:40:22.316482 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1304/2508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:21 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:22.335332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:22.336884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:22.353909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:22.354768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:22.357583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:22.359745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:22.361364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:22.362061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:22.800780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:22.811451 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-52eb0c6d-c84d-43e3-80b8-4d4b74f67b0d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1512 microversion: 2.1 time: 0.492679 Oct 03 10:40:22.812511 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1305/2509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:22 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:22.846006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:22.850642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:22.871835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:22.876692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:22.877395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:22.878362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:22.878975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:22.879631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:22.900856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:23.067287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:23.079251 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65f1790c-905e-47fd-8971-735c1481a8fe tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 200 len: 1512 microversion: 2.1 time: 0.246290 Oct 03 10:40:23.079936 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1306/2510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:22 2022] GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:23.281203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1100317241", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "19fafd07-9a97-4e03-b4e2-1d09963b3097"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:23.365332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] validate_networks() for [('19fafd07-9a97-4e03-b4e2-1d09963b3097', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:40:24.447156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:40:24.447744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:40:24.448119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:40:24.448696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:40:24.450806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:40:24.480396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Building network info cache for instance {{(pid=122270) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:40:24.493714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:24.497498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:24.498720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:24.504803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:24.506639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:24.508067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:24.561559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:24.576172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Getting quotas for project a66f39dd2e184e50b5531ef369d2455c. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:40:24.614073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Getting quotas for user ad027da90cc247a8ad9ba953b39d19b1 and project a66f39dd2e184e50b5531ef369d2455c. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:40:24.688876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:40:24.692353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:40:24.786776 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e91d1368-6cb4-4958-bdfa-3260ae8ec245 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705157 Oct 03 10:40:24.787781 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1307/2511] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:40:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:40:24.800304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:24.801128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:24.809932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:24.810948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:24.811643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:24.812565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:24.826363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:24.826863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:24.886124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:25.085576 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80c88eec-68f4-46d5-81cc-0993aed1ddca tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 204 len: 0 microversion: 2.1 time: 0.288322 Oct 03 10:40:25.086497 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1308/2512] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:24 2022] DELETE /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:25.093109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:25.094807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:25.108801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.113555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.114013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:25.115178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.117032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.117544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:25.565924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:25.581468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1ecb80ec-19e5-42fe-b633-7c3c970d5193 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1511 microversion: 2.1 time: 0.492985 Oct 03 10:40:25.586569 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1309/2513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:25 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:25.597366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:25.597995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:25.616603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.618278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.618758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:25.619559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.620029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.620492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:25.724513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Updating instance_info_cache with network_info: [{"id": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8", "address": "fa:16:3e:87:3d:15", "network": {"id": "1d932e5a-b01d-44d6-aeb7-910446df43ba", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-777626022-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "56d17bf642e4452dae776dcfc8db017b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3ac66ed9-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122270) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:40:25.741730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Releasing lock "refresh_cache-830f019f-1794-42cc-a7c4-e626d66592f5" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:40:25.743315 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81602e93-3687-434f-8626-416a017a86a9 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action" status: 202 len: 0 microversion: 2.1 time: 5.641874 Oct 03 10:40:25.744424 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1205/2514] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:40:20 2022] POST /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5/action => generated 0 bytes in 5645 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:40:25.754161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-88c7f833-d722-4a89-b905-6163176259df req-5ee9ef57-20d3-4448-b056-a1e5c0dd3caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262b89ff-86ce-42e8-b4a1-b0f36e540142", "name": "network-vif-plugged", "status": "completed", "tag": "056e2a84-db6e-4bbd-a7fd-27749dcf8303"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:25.783680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-88c7f833-d722-4a89-b905-6163176259df req-5ee9ef57-20d3-4448-b056-a1e5c0dd3caf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.784469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-88c7f833-d722-4a89-b905-6163176259df req-5ee9ef57-20d3-4448-b056-a1e5c0dd3caf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.785164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-88c7f833-d722-4a89-b905-6163176259df req-5ee9ef57-20d3-4448-b056-a1e5c0dd3caf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:25.819801 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-88c7f833-d722-4a89-b905-6163176259df req-5ee9ef57-20d3-4448-b056-a1e5c0dd3caf service nova] Creating event network-vif-plugged:056e2a84-db6e-4bbd-a7fd-27749dcf8303 for instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 on n-h1-858383-3 Oct 03 10:40:25.830908 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-88c7f833-d722-4a89-b905-6163176259df req-5ee9ef57-20d3-4448-b056-a1e5c0dd3caf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084609 Oct 03 10:40:25.834308 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1206/2515] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:25.855761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-cf0ec778-598e-4943-a516-24265f9be1bb req-5ba69ab4-eabb-48de-844a-efccf9e63e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830f019f-1794-42cc-a7c4-e626d66592f5", "tag": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:25.879007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cf0ec778-598e-4943-a516-24265f9be1bb req-5ba69ab4-eabb-48de-844a-efccf9e63e85 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.886275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cf0ec778-598e-4943-a516-24265f9be1bb req-5ba69ab4-eabb-48de-844a-efccf9e63e85 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.887435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cf0ec778-598e-4943-a516-24265f9be1bb req-5ba69ab4-eabb-48de-844a-efccf9e63e85 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:25.924963 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-cf0ec778-598e-4943-a516-24265f9be1bb req-5ba69ab4-eabb-48de-844a-efccf9e63e85 service nova] Creating event network-changed:3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 for instance 830f019f-1794-42cc-a7c4-e626d66592f5 on n-h1-858383-3 Oct 03 10:40:25.936490 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-cf0ec778-598e-4943-a516-24265f9be1bb req-5ba69ab4-eabb-48de-844a-efccf9e63e85 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100647 Oct 03 10:40:25.939255 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1207/2516] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:25.953567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:25.954307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:25.968475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.969020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.969469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:25.970200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:25.970659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:25.971093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:26.758477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:26.770725 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0fd45292-fe4e-40b0-9bd3-057c3c4d6ff6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1214 microversion: 2.1 time: 0.829467 Oct 03 10:40:26.774694 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1208/2517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:25 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1214 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:26.812523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:26.814639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:26.834328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:26.837670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:26.841061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:26.842365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:26.844161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:26.844780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:27.387372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:27.401237 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6ee46047-c85c-4285-8770-f3bd852aaf8e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 1.813401 Oct 03 10:40:27.403090 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1310/2518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:25 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:27.410303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:27.420234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:27.421936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:27.436239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:27.437906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:27.438848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:27.441950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:27.445471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:27.446642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:27.537824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:27.677518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:27.686270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:27.687021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:27.687657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:27.767520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:27.898678 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b34abc95-2ce4-4dff-9822-68d15a267219 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1668 microversion: 2.1 time: 1.095349 Oct 03 10:40:27.907287 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1209/2519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:26 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1668 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:27.937346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eaa430f9-1fd3-400c-8e21-473a7088693d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '.version_select at 0x7f074f11e8b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:28.434863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc5b92db-fafc-4aba-ac61-0bffe248c73a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.029189 Oct 03 10:40:28.435453 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1311/2520] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:40:27 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:28.440330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:28.441257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:28.460625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:28.461412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:28.462026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:28.463243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:28.464345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:28.465007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:28.888745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:28.901284 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ceb23d9d-dcee-4fc5-8df9-1fcee0d0be01 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1276 microversion: 2.1 time: 0.461536 Oct 03 10:40:28.904164 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1312/2521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:28 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1276 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:28.917147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d8877de3-87bd-4b6d-9ed1-4b5405641ef1 req-275c2c5a-0555-4854-ab9f-62bf6e265868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262b89ff-86ce-42e8-b4a1-b0f36e540142", "name": "network-vif-plugged", "status": "completed", "tag": "4037c86d-0c81-454a-8a7d-dd544d25df9d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:28.942526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8877de3-87bd-4b6d-9ed1-4b5405641ef1 req-275c2c5a-0555-4854-ab9f-62bf6e265868 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:28.943063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8877de3-87bd-4b6d-9ed1-4b5405641ef1 req-275c2c5a-0555-4854-ab9f-62bf6e265868 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:28.944313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8877de3-87bd-4b6d-9ed1-4b5405641ef1 req-275c2c5a-0555-4854-ab9f-62bf6e265868 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:28.992501 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d8877de3-87bd-4b6d-9ed1-4b5405641ef1 req-275c2c5a-0555-4854-ab9f-62bf6e265868 service nova] Creating event network-vif-plugged:4037c86d-0c81-454a-8a7d-dd544d25df9d for instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 on n-h1-858383-3 Oct 03 10:40:29.002656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d8877de3-87bd-4b6d-9ed1-4b5405641ef1 req-275c2c5a-0555-4854-ab9f-62bf6e265868 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096979 Oct 03 10:40:29.003309 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1313/2522] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:29.015451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:29.016178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:29.033171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:29.037758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:29.038534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:29.040000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:29.041127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:29.042090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:29.994162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:30.005094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ae44498f-83c3-4ab0-a614-9f167229c733 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.994453 Oct 03 10:40:30.005882 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1314/2523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:29 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:30.040685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:30.064471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:30.065552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:30.151521 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eaa430f9-1fd3-400c-8e21-473a7088693d tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/cdff0551-14e7-44f3-8692-ba7d16d22d18" status: 202 len: 0 microversion: 2.1 time: 2.240996 Oct 03 10:40:30.152937 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1210/2524] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:40:27 2022] DELETE /compute/v2.1/os-floating-ips/cdff0551-14e7-44f3-8692-ba7d16d22d18 => generated 0 bytes in 2245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:40:30.169754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:30.171410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:30.185449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.185449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.188874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.191251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.191864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.192414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.245125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.246131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.246752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.247359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lazy-loading 'fault' on Instance uuid af81a64b-4ea6-48b9-80fd-a0b4659d39e4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:40:30.318489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:30.329934 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-74fda25c-f735-4e8e-a61d-484b0fd52101 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 200 len: 1324 microversion: 2.1 time: 0.169013 Oct 03 10:40:30.332432 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1211/2525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:30 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 1324 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:30.340403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:30.341516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:30.353795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.354578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.355850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.356816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.357485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.358275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.488858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:30.506532 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-51bebda5-c30d-4d6c-bafd-45991179d9f1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1276 microversion: 2.1 time: 0.172364 Oct 03 10:40:30.507449 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1212/2526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:30 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:30.512452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-66f41f51-e9d5-4ff0-8b19-471fd5693e64 req-8fa8a47a-3a36-498e-999e-b3d7f7ef5c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af81a64b-4ea6-48b9-80fd-a0b4659d39e4", "name": "network-vif-deleted", "tag": "5f6d0bfe-3323-40af-8755-76910c1d237e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:30.528014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.528498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.529014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.529741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.530191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.530612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.531619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-66f41f51-e9d5-4ff0-8b19-471fd5693e64 req-8fa8a47a-3a36-498e-999e-b3d7f7ef5c48 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.533286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-66f41f51-e9d5-4ff0-8b19-471fd5693e64 req-8fa8a47a-3a36-498e-999e-b3d7f7ef5c48 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.535488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-66f41f51-e9d5-4ff0-8b19-471fd5693e64 req-8fa8a47a-3a36-498e-999e-b3d7f7ef5c48 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.557856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-66f41f51-e9d5-4ff0-8b19-471fd5693e64 req-8fa8a47a-3a36-498e-999e-b3d7f7ef5c48 service nova] Creating event network-vif-deleted:5f6d0bfe-3323-40af-8755-76910c1d237e for instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 on n-h2-858383-3 Oct 03 10:40:30.564409 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-66f41f51-e9d5-4ff0-8b19-471fd5693e64 req-8fa8a47a-3a36-498e-999e-b3d7f7ef5c48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055465 Oct 03 10:40:30.569577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:30.571392 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1213/2527] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:30.578148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a9297d16-8856-46e7-b151-714723da078b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '.version_select at 0x7f074f0f1160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:30.654962 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b624c69-2a15-46e4-b5df-d7a96a1b1047 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.620854 Oct 03 10:40:30.656368 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1315/2528] 10.222.0.27 () {58 vars in 1150 bytes} [Mon Oct 3 10:40:30 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:30.675250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:30.682610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:30.683706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:30.692027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.692877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.693527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.694491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.695093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.695686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:30.857783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:30.951595 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b22bbfce-2f87-4651-9195-6564952104bb tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.277735 Oct 03 10:40:30.952557 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1316/2529] 10.222.0.27 () {58 vars in 1212 bytes} [Mon Oct 3 10:40:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:30.967236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:30.980499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:30.982440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:30.997042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:30.997646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:30.998067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.001213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.001791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.003228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.104996 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a9297d16-8856-46e7-b151-714723da078b tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8822406f-9a86-4184-8124-4f8c91e51dac" status: 202 len: 0 microversion: 2.1 time: 0.531813 Oct 03 10:40:31.105622 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1214/2530] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:40:30 2022] DELETE /compute/v2.1/os-security-groups/8822406f-9a86-4184-8124-4f8c91e51dac => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:40:31.111624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:31.112356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:31.142182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.143246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.143850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.144594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.145082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.158856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.162297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:31.195551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:31.364729 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a94820dd-2752-4f64-b8ef-0a007c84467d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.401210 Oct 03 10:40:31.367350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1317/2531] 10.222.0.27 () {58 vars in 1196 bytes} [Mon Oct 3 10:40:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:31.383834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:31.385102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:31.413831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.415353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.418329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.419291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.422059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.422713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.483626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:31.501788 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fca5ef33-f2d1-44a6-be61-32670dd42dab tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1334 microversion: 2.1 time: 0.395068 Oct 03 10:40:31.503867 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1215/2532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:31 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1334 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:31.506638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:31.514092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:31.515886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: af81a64b-4ea6-48b9-80fd-a0b4659d39e4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:31.532052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.532841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.533564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.536578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.537890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.539077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.572655 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] HTTP exception thrown: Instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 could not be found. Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Request method failure captured: Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 HTTP/1.1 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOroSNV29QB2t_7wufbcZ8WzP0cWa3hY17SrS4BcrrO65Xjt4BEXxTcyFndGlIRrnf70Y47JDp-AS-nGA93Ce2-7g6ywQ0rGkyyyaZtoK3IZvVLCACE83dSYva_CZi9SdUEnL2f5dgYr3aTj1YQjNpakbCFG63joQyZ3Vb70l0hdLdRc Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}] Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-LiveMigrationTest-167149645 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 6f0eda1654514026b803bcf2a1b8f4f4 Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 could not be found. Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'af81a64b-4ea6-48b9-80fd-a0b4659d39e4'} Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 could not be found. Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 could not be found. Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:31.578402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:31.582497 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:31.582497 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:31.582497 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:31.582497 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:31.582497 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:31.582497 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 could not be found. Oct 03 10:40:31.582497 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:31.586607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Returning 404 to user: Instance af81a64b-4ea6-48b9-80fd-a0b4659d39e4 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:31.587773 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0b99cf40-a2df-430b-a3ec-b095e2b44ab9 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4" status: 404 len: 111 microversion: 2.1 time: 0.082542 Oct 03 10:40:31.591704 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1216/2533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:31 2022] GET /compute/v2.1/servers/af81a64b-4ea6-48b9-80fd-a0b4659d39e4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:31.601887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:31.621498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:31.624752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'name': '1954562645', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:31.643098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.649716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.650511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.651333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:31.658469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:31.659115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:31.693914 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3355ef9e-feb7-4711-9747-f09d289b173f tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "DELETE /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 204 len: 0 microversion: 2.1 time: 0.324324 Oct 03 10:40:31.694560 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1318/2534] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:31 2022] DELETE /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:31.910728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:31.931019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06455fcd-3b06-4ac9-83a3-c43e0317581a tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] Calling method '.version_select at 0x7f074f1b5940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:31.972291 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06455fcd-3b06-4ac9-83a3-c43e0317581a tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.276325 Oct 03 10:40:31.972956 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1319/2535] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 3 10:40:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:31.984419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:31.990326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:32.010855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:32.012092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:32.012682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:32.013655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:32.014299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:32.014767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:32.069437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:32.082262 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-426c5eb1-54c1-4eed-863f-56cb0c3c4c4d tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?name=1954562645" status: 200 len: 346 microversion: 2.1 time: 0.489116 Oct 03 10:40:32.085472 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1217/2536] 10.222.0.27 () {58 vars in 1156 bytes} [Mon Oct 3 10:40:31 2022] GET /compute/v2.1/servers?name=1954562645 => generated 346 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:32.094602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5b3de61c-dc8e-4f15-b599-c492c2b30b4d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '.version_select at 0x7f074f1f8d30>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:32.139806 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5b3de61c-dc8e-4f15-b599-c492c2b30b4d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907746691" status: 202 len: 0 microversion: 2.1 time: 0.053118 Oct 03 10:40:32.140453 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1218/2537] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907746691 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:40:32.148735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:32.150438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:32.168980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:32.170103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:32.170900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:32.171790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:32.172571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:32.174129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:32.599870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:32.610476 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a8f1832c-8252-44d5-b708-80eeac0613b4 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1508 microversion: 2.1 time: 0.465481 Oct 03 10:40:32.612444 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1219/2538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:32 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1508 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:32.639061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c755d3e1-f6a7-4805-b27d-f24d94a0de60 tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] Action: 'update', calling method: .version_select at 0x7f074f0b0280>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:32.697451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:32.708445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57a900d7-6c86-4d44-85df-2d66ffcb6e43 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.734466 Oct 03 10:40:32.717102 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1320/2539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:31 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:32.722074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:32.731641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:32.742712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:32.760151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:32.760720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:32.761253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:32.762625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:32.766089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:32.766089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:32.867561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:33.031855 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-feed66c0-db6f-4a7a-ac21-abeebec54d77 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.313321 Oct 03 10:40:33.037524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1321/2540] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Oct 3 10:40:32 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:33.051923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:33.053354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:33.068437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.071235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.071858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.072800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.074672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.075285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.110744 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c755d3e1-f6a7-4805-b27d-f24d94a0de60 tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.483937 Oct 03 10:40:33.112598 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1220/2541] 10.222.0.27 () {60 vars in 1206 bytes} [Mon Oct 3 10:40:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:33.128008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:33.136682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:33.148153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-195456264', 'deleted': False, 'project_id': '8ad227b0026b4a00a99371cb695d27d3'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:40:33.158157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.158865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.159476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.160484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.161103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.161671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.306275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:40:33.402820 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-60568e39-f948-46d5-a3b3-175ddd252b7a tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195456264" status: 200 len: 346 microversion: 2.1 time: 0.277826 Oct 03 10:40:33.403799 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1221/2542] 10.222.0.27 () {58 vars in 1228 bytes} [Mon Oct 3 10:40:33 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-195456264 => generated 346 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:33.409360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f6a0659-b365-41ab-a53c-c48e43598068 tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] Calling method '.version_select at 0x7f074f1451f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:33.427229 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f6a0659-b365-41ab-a53c-c48e43598068 tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.022139 Oct 03 10:40:33.428534 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1222/2543] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 3 10:40:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:33.434391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:33.435887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:33.443907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.444623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.446006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.447156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.447899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.448559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.498108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:33.579587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:33.597858 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f27c7e22-8947-4ca3-a509-e2c01af43ac7 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1668 microversion: 2.1 time: 0.558897 Oct 03 10:40:33.599346 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1322/2544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:33 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1668 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:33.606333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ffffe85e-6b8d-41e2-9bad-9d7407ee98d8 tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] Action: 'update', calling method: .version_select at 0x7f074f7511f0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:33.664183 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9632212a-39c8-443d-a38b-dcee37f427a5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 204 len: 0 microversion: 2.1 time: 0.233892 Oct 03 10:40:33.665996 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1223/2545] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:33 2022] DELETE /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:33.674921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:33.675511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:33.697761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.700568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.701095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.701847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.702309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.702941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.755658 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4cbf008c-77c3-4b8f-921b-88d5c2b591c5 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142/ips" status: 200 len: 178 microversion: 2.1 time: 0.087619 Oct 03 10:40:33.757312 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1224/2546] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:40:33 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142/ips => generated 178 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:33.765463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:33.766754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:33.776082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.777788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.778815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.779743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.780577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.781273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.821787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ffffe85e-6b8d-41e2-9bad-9d7407ee98d8 tempest-QuotaClassesAdminTestJSON-1351728108 tempest-QuotaClassesAdminTestJSON-1351728108-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.220301 Oct 03 10:40:33.829106 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1323/2547] 10.222.0.27 () {60 vars in 1206 bytes} [Mon Oct 3 10:40:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:33.834433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:33.835234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:33.859094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.859935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.860543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:33.861510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:33.864458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:33.865145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:34.154423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:34.177146 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5cd6e0f1-39e6-47ce-82ef-5bd6de53c8b0 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1508 microversion: 2.1 time: 0.415224 Oct 03 10:40:34.179417 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1225/2548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:33 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:34.193624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:34.194274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:34.208972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:34.214222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:34.218393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:34.221230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:34.223491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:34.225421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:34.288956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:34.522369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=13,nova_api:INSERT=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:34.529454 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0c660a97-d9e2-41d7-95ad-f55b1110f97d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 204 len: 0 microversion: 2.1 time: 0.346999 Oct 03 10:40:34.536615 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1226/2549] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:34 2022] DELETE /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:34.561788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:34.567002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:34.594533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:34.595158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:34.595647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:34.596359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:34.597009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:34.597450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:34.945647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:34.960122 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cac17bc8-d528-45f2-a0fa-f063c0537690 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1517 microversion: 2.1 time: 1.129365 Oct 03 10:40:34.962796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1324/2550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:33 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1517 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:34.974288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:34.980624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:34.998786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:34.999389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:34.999952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:35.001072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:35.001750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:35.005180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:35.047455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:35.192648 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-63571618-63ef-4cc5-b187-ed1fe5479a0b tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 204 len: 0 microversion: 2.1 time: 0.228206 Oct 03 10:40:35.193741 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1325/2551] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:34 2022] DELETE /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:35.196827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:35.207680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:35.207879 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-478bf150-80b0-4c13-bdf4-dba62933d6bf tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.672560 Oct 03 10:40:35.208587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:35.216434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:35.217207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:35.218092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:35.219014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:35.219674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:35.220465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:35.238201 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1227/2552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:34 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:35.244072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:35.255679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:35.280386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:35.280906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:35.281342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:35.282047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:35.282660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:35.283084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:36.148277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:36.169574 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0ee68d7b-9c2b-4439-866b-e8c81d981417 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1485 microversion: 2.1 time: 0.974217 Oct 03 10:40:36.171160 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1326/2553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:35 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1485 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:36.176558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:36.177583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:36.195371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:36.196288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:36.196954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:36.198073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:36.199021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:36.199683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:36.499863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8dccddd449842ef93e99bf417372776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d17bf642e4452dae776dcfc8db017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:36.510916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-874d7559-fc73-4108-84cb-afa7d96fa344 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 200 len: 1466 microversion: 2.1 time: 0.338404 Oct 03 10:40:36.514822 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1327/2554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:36 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 1466 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:36.528122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c508b43e-fb20-4fd4-a97e-06603dc52b84 req-2cc7d923-529d-4e21-b7f8-d04c74d7c332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e613f2-3f15-40d6-9b03-57a819120ebf", "tag": "5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:36.549663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c508b43e-fb20-4fd4-a97e-06603dc52b84 req-2cc7d923-529d-4e21-b7f8-d04c74d7c332 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:36.550498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c508b43e-fb20-4fd4-a97e-06603dc52b84 req-2cc7d923-529d-4e21-b7f8-d04c74d7c332 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:36.551248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c508b43e-fb20-4fd4-a97e-06603dc52b84 req-2cc7d923-529d-4e21-b7f8-d04c74d7c332 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:36.580694 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c508b43e-fb20-4fd4-a97e-06603dc52b84 req-2cc7d923-529d-4e21-b7f8-d04c74d7c332 service nova] Creating event network-changed:5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab for instance 41e613f2-3f15-40d6-9b03-57a819120ebf on n-h2-858383-3 Oct 03 10:40:36.602278 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c508b43e-fb20-4fd4-a97e-06603dc52b84 req-2cc7d923-529d-4e21-b7f8-d04c74d7c332 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085458 Oct 03 10:40:36.603400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1328/2555] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:36.611337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:36.618489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:36.639458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:36.640216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:36.641811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:36.642758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:36.644710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:36.647162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:36.857226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:36.868299 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a063271b-ddd9-494b-8e2d-ee9f99002831 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1674 microversion: 2.1 time: 1.627920 Oct 03 10:40:36.873613 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1228/2556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:35 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1674 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:36.907543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:36.908649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:36.918067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:36.918721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:36.919378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:36.921134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:36.921134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:36.930002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:37.481296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:37.493154 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f63d3bd-7a50-432d-abed-bd1f6b683035 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.601578 Oct 03 10:40:37.494116 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1229/2557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:36 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:37.502210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8e011bd-e929-465e-a530-12b29ef67a58 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Action: 'create', calling method: .version_select at 0x7f074f0e38b0>, body: {"keypair": {"name": "tempest-keypair-1080641269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmOjuGkxfdJl9GO8ph9IiZ1DCrumCWvY0TWQHBp3g5REztNPexoXA63Mk+EdHj5adaIPPY3FKd+d3PUVKn3m7F3NQvgnkObeFAxwWNuz6XkD967K2gbvqYFpM8cVYF3FA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:37.547477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f8e011bd-e929-465e-a530-12b29ef67a58 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Getting quotas for project 307b309d45e147b4ad14412e1266217e. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:40:37.561393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f8e011bd-e929-465e-a530-12b29ef67a58 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Getting quotas for user 9836fe6921cc4c5cb042178421a3fa00 and project 307b309d45e147b4ad14412e1266217e. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:40:37.629839 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8e011bd-e929-465e-a530-12b29ef67a58 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.131836 Oct 03 10:40:37.636974 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1230/2558] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:40:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:40:37.642367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:37.652695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:37.662610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:37.670554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:37.671277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:37.672191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:37.675832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:37.676546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:37.745038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:37.755224 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-efe774a1-076d-489a-a343-f18e58665457 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1517 microversion: 2.1 time: 1.150209 Oct 03 10:40:37.761660 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1329/2559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:36 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1517 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:37.780399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:37.781469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] [instance: 830f019f-1794-42cc-a7c4-e626d66592f5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:37.793699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:37.800451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:37.801148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:37.804291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:37.804877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:37.805510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:37.842337 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] HTTP exception thrown: Instance 830f019f-1794-42cc-a7c4-e626d66592f5 could not be found. Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Request method failure captured: Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 HTTP/1.1 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrvBNZgtsCiSniUko_vmkQcNTCYfmy0wxjdalU-bqNSnRAH1dWiLoyULma98vINvqAAFPvoy4NajeEKnpNW4bLWrsEgi7FwHjgOOCiv5dgm-PQ8eWPrz2QiSQhLVSO_WAiE4ob0lOuppXORiJiLLDpa3f1iTkxjdC37N4kAKTC9FqG4 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 56d17bf642e4452dae776dcfc8db017b Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2069173290 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56d17bf642e4452dae776dcfc8db017b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56d17bf642e4452dae776dcfc8db017b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56d17bf642e4452dae776dcfc8db017b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56d17bf642e4452dae776dcfc8db017b"}]}] Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2069173290 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 56d17bf642e4452dae776dcfc8db017b Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2069173290 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerRescueTestJSONUnderV235-2069173290-project Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d8dccddd449842ef93e99bf417372776 Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2069173290-project Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 830f019f-1794-42cc-a7c4-e626d66592f5 could not be found. Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '830f019f-1794-42cc-a7c4-e626d66592f5'} Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 830f019f-1794-42cc-a7c4-e626d66592f5 could not be found. Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 830f019f-1794-42cc-a7c4-e626d66592f5 could not be found. Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:37.843998 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 830f019f-1794-42cc-a7c4-e626d66592f5 could not be found. Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] Returning 404 to user: Instance 830f019f-1794-42cc-a7c4-e626d66592f5 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8fd38ba3-5394-41c4-9265-8383f8fbf892 tempest-ServerRescueTestJSONUnderV235-2069173290 tempest-ServerRescueTestJSONUnderV235-2069173290-project] 10.222.0.27 "GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5" status: 404 len: 111 microversion: 2.1 time: 0.083043 Oct 03 10:40:37.847895 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1330/2560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:37 2022] GET /compute/v2.1/servers/830f019f-1794-42cc-a7c4-e626d66592f5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:37.903705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:37.904448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:37.907532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=15 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:37.922856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:37.923352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:37.923787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:37.924495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:37.924981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:37.925407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:38.206477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:38.237545 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-764e97ee-8f6d-471e-91d6-b30aec9826f5 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1443 microversion: 2.1 time: 0.599133 Oct 03 10:40:38.238262 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1231/2561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:37 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1443 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:38.778001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:38.790721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-35bf1419-fff1-4029-ab91-c16e363571aa tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1674 microversion: 2.1 time: 0.888916 Oct 03 10:40:38.797512 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1331/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:37 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1674 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:38.803230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:38.809861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:38.821087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:38.821803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:38.822398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:38.825222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:38.830159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:38.830815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:38.865515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-43fd73fa-2621-41f8-963f-8f2ec418b190 req-c11fdde1-a0f2-4820-be0a-f73cad7dfa53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa13c46-564f-4171-b88e-645319196ca2", "name": "network-vif-deleted", "tag": "d4f82b42-444c-4306-8faa-abf365d14deb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:38.875580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-43fd73fa-2621-41f8-963f-8f2ec418b190 req-c11fdde1-a0f2-4820-be0a-f73cad7dfa53 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:38.876058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-43fd73fa-2621-41f8-963f-8f2ec418b190 req-c11fdde1-a0f2-4820-be0a-f73cad7dfa53 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:38.876488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-43fd73fa-2621-41f8-963f-8f2ec418b190 req-c11fdde1-a0f2-4820-be0a-f73cad7dfa53 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:38.891359 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-43fd73fa-2621-41f8-963f-8f2ec418b190 req-c11fdde1-a0f2-4820-be0a-f73cad7dfa53 service nova] Creating event network-vif-deleted:d4f82b42-444c-4306-8faa-abf365d14deb for instance 9aa13c46-564f-4171-b88e-645319196ca2 on n-h2-858383-3 Oct 03 10:40:38.896396 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-43fd73fa-2621-41f8-963f-8f2ec418b190 req-c11fdde1-a0f2-4820-be0a-f73cad7dfa53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.571424 Oct 03 10:40:38.897555 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1232/2563] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:40:38.902742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1789e4c9-7770-4e81-9ad0-a600905f6e0d req-dddb3ec6-05e2-4c5e-a624-a743d350826a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830f019f-1794-42cc-a7c4-e626d66592f5", "name": "network-vif-deleted", "tag": "3ac66ed9-f563-4dcd-a50d-ea745a9e36e8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:38.913096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1789e4c9-7770-4e81-9ad0-a600905f6e0d req-dddb3ec6-05e2-4c5e-a624-a743d350826a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:38.913846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1789e4c9-7770-4e81-9ad0-a600905f6e0d req-dddb3ec6-05e2-4c5e-a624-a743d350826a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:38.914424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1789e4c9-7770-4e81-9ad0-a600905f6e0d req-dddb3ec6-05e2-4c5e-a624-a743d350826a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:38.929098 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1789e4c9-7770-4e81-9ad0-a600905f6e0d req-dddb3ec6-05e2-4c5e-a624-a743d350826a service nova] Creating event network-vif-deleted:3ac66ed9-f563-4dcd-a50d-ea745a9e36e8 for instance 830f019f-1794-42cc-a7c4-e626d66592f5 on n-h1-858383-3 Oct 03 10:40:38.935502 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1789e4c9-7770-4e81-9ad0-a600905f6e0d req-dddb3ec6-05e2-4c5e-a624-a743d350826a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Oct 03 10:40:38.936462 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1233/2564] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:38.941859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:38.942939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:38.953744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:38.954644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:38.955277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:38.957253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:38.957890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:38.958637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:38.961893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:39.008839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:39.010024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:39.012057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:39.012688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lazy-loading 'fault' on Instance uuid 9aa13c46-564f-4171-b88e-645319196ca2 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:40:39.141660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:39.154083 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c29937dc-d083-4a49-8f8c-3cc21db01f3e tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 200 len: 1310 microversion: 2.1 time: 0.215604 Oct 03 10:40:39.156916 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1234/2565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:38 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 1310 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:39.268076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:39.269749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:39.278707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:39.279842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:39.280635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:39.281756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:39.282487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:39.283180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:39.325339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:39.327183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:39.327879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:39.330645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lazy-loading 'fault' on Instance uuid 0654af6f-0bf5-409f-aff3-fedeec38a352 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:40:39.397811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:39.430253 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-582e4d44-b600-4354-98ce-cd8643b46110 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1301 microversion: 2.1 time: 0.167257 Oct 03 10:40:39.431260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1235/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:39 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:39.443238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:39.453631 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-87244bf7-7b0e-4b49-a615-29d0bb186e94 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.654539 Oct 03 10:40:39.454610 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1332/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:38 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:39.825544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:39.826279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:39.842058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:39.842570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:39.843008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:39.851164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:39.852025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:39.852972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:39.891611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4342ce30-8906-47a8-8375-27a57cbf1905 req-f3c8a041-49e7-465a-b98d-dfb1745385a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262b89ff-86ce-42e8-b4a1-b0f36e540142", "name": "network-vif-unplugged", "status": "completed", "tag": "4037c86d-0c81-454a-8a7d-dd544d25df9d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:39.912494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4342ce30-8906-47a8-8375-27a57cbf1905 req-f3c8a041-49e7-465a-b98d-dfb1745385a8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:39.915551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4342ce30-8906-47a8-8375-27a57cbf1905 req-f3c8a041-49e7-465a-b98d-dfb1745385a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:39.916392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4342ce30-8906-47a8-8375-27a57cbf1905 req-f3c8a041-49e7-465a-b98d-dfb1745385a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:39.945327 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4342ce30-8906-47a8-8375-27a57cbf1905 req-f3c8a041-49e7-465a-b98d-dfb1745385a8 service nova] Creating event network-vif-unplugged:4037c86d-0c81-454a-8a7d-dd544d25df9d for instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 on n-h1-858383-3 Oct 03 10:40:39.959521 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4342ce30-8906-47a8-8375-27a57cbf1905 req-f3c8a041-49e7-465a-b98d-dfb1745385a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071718 Oct 03 10:40:39.962364 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1333/2568] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:40:40.184237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:40.188694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 9aa13c46-564f-4171-b88e-645319196ca2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:40.203277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.206138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.207121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.209204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.210219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.211238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.249401 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] HTTP exception thrown: Instance 9aa13c46-564f-4171-b88e-645319196ca2 could not be found. Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Request method failure captured: Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 HTTP/1.1 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrvFqKXuDy98ags3CnJ2_8Y9fAb2t2UgBXU4xiOKPTLEl4mhhABig__ckiXFLijufFP92BrXRC0qY__9ngSnHTazuL-RotHYEw-HO4wl1JbJSeAoCnEEaXGlKJP0axxj-oOzFoaMkrJR3i4cluXPy1ThrcomsbChpQhhjOE7HLDK7-M Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8ad227b0026b4a00a99371cb695d27d3 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ad227b0026b4a00a99371cb695d27d3"}]}] Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8ad227b0026b4a00a99371cb695d27d3 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListServerFiltersTestJSON-659967730-project Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7bdb35f4990d4ef28f95c7547ade54c0 Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListServerFiltersTestJSON-659967730-project Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 9aa13c46-564f-4171-b88e-645319196ca2 could not be found. Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '9aa13c46-564f-4171-b88e-645319196ca2'} Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa13c46-564f-4171-b88e-645319196ca2 could not be found. Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa13c46-564f-4171-b88e-645319196ca2 could not be found. Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:40.251126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa13c46-564f-4171-b88e-645319196ca2 could not be found. Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Returning 404 to user: Instance 9aa13c46-564f-4171-b88e-645319196ca2 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cdc2d7ef-9c26-4ac5-8c6f-de787448a2ec tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2" status: 404 len: 111 microversion: 2.1 time: 0.077444 Oct 03 10:40:40.258513 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1334/2569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:40 2022] GET /compute/v2.1/servers/9aa13c46-564f-4171-b88e-645319196ca2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:40.266676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:40.267617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:40.278800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.280633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.281153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.284468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.284986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.286314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.321355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:40.443409 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bd9d4a77-0c10-44b9-a39c-71e53f9103d5 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 204 len: 0 microversion: 2.1 time: 0.181975 Oct 03 10:40:40.447975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1335/2570] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:40 2022] DELETE /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:40.459532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:40.463624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:40.502255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.502918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.505142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.505913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.507572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.508025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.517310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:40.530500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5abaf3f0-049c-4fc3-9527-83693c8523dd tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1653 microversion: 2.1 time: 0.709252 Oct 03 10:40:40.534253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1236/2571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:39 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1653 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:40.546436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:40.548269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:40.558438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.566616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.567315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.585786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.586432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.587848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.590548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.590709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.591328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.593015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lazy-loading 'fault' on Instance uuid 0654af6f-0bf5-409f-aff3-fedeec38a352 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:40:40.854336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:40.859230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:40.865134 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-879f7d11-35c4-405f-baa7-e9b78f62adcc tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 200 len: 1301 microversion: 2.1 time: 0.414685 Oct 03 10:40:40.865710 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1336/2572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:40 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 1301 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:40.882377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:40.889756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:40.896805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.907047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.907517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:40.908264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:40.908726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:40.909177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:41.001367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:41.010025 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a1f6888-5806-4a2d-9c4a-c7c0332a8f48 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 200 len: 1518 microversion: 2.1 time: 0.474488 Oct 03 10:40:41.025646 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1237/2573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:40 2022] GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 1518 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:41.219875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-354613035", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "fb857a83-42b3-4a53-b589-5a253a5b0340"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:41.294262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] validate_networks() for [('fb857a83-42b3-4a53-b589-5a253a5b0340', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:40:41.599440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:41.617664 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4512e487-cbc6-4337-b40e-3565653c7676 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.743279 Oct 03 10:40:41.618702 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1337/2574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:40 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:41.623547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-195a11ff-3b5e-4377-a893-2d7fe2c7b63a req-6bfbaf8f-8374-4e5a-b1bd-45e5f5093939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0654af6f-0bf5-409f-aff3-fedeec38a352", "name": "network-vif-deleted", "tag": "fff89d8c-bb3a-4906-8c8b-c7845f09ec8c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:41.661040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-195a11ff-3b5e-4377-a893-2d7fe2c7b63a req-6bfbaf8f-8374-4e5a-b1bd-45e5f5093939 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:41.661532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-195a11ff-3b5e-4377-a893-2d7fe2c7b63a req-6bfbaf8f-8374-4e5a-b1bd-45e5f5093939 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:41.666990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-195a11ff-3b5e-4377-a893-2d7fe2c7b63a req-6bfbaf8f-8374-4e5a-b1bd-45e5f5093939 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:41.696046 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-195a11ff-3b5e-4377-a893-2d7fe2c7b63a req-6bfbaf8f-8374-4e5a-b1bd-45e5f5093939 service nova] Creating event network-vif-deleted:fff89d8c-bb3a-4906-8c8b-c7845f09ec8c for instance 0654af6f-0bf5-409f-aff3-fedeec38a352 on n-h2-858383-3 Oct 03 10:40:41.722169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-195a11ff-3b5e-4377-a893-2d7fe2c7b63a req-6bfbaf8f-8374-4e5a-b1bd-45e5f5093939 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102685 Oct 03 10:40:41.723200 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1338/2575] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:41.728707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5f95c56b-38f5-4868-94bf-0ef0e4420bee req-6e1218fe-1ee7-411c-bf72-48d718fc3a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262b89ff-86ce-42e8-b4a1-b0f36e540142", "name": "network-vif-deleted", "tag": "056e2a84-db6e-4bbd-a7fd-27749dcf8303"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:41.738708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5f95c56b-38f5-4868-94bf-0ef0e4420bee req-6e1218fe-1ee7-411c-bf72-48d718fc3a10 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:41.739801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5f95c56b-38f5-4868-94bf-0ef0e4420bee req-6e1218fe-1ee7-411c-bf72-48d718fc3a10 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:41.740426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5f95c56b-38f5-4868-94bf-0ef0e4420bee req-6e1218fe-1ee7-411c-bf72-48d718fc3a10 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:41.773443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5f95c56b-38f5-4868-94bf-0ef0e4420bee req-6e1218fe-1ee7-411c-bf72-48d718fc3a10 service nova] Creating event network-vif-deleted:056e2a84-db6e-4bbd-a7fd-27749dcf8303 for instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 on n-h1-858383-3 Oct 03 10:40:41.780099 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5f95c56b-38f5-4868-94bf-0ef0e4420bee req-6e1218fe-1ee7-411c-bf72-48d718fc3a10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055041 Oct 03 10:40:41.782222 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1339/2576] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:41.798526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:41.799589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:41.814673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:41.817393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:41.821146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:41.821873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:41.822330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:41.822764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:41.931732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:41.932385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:41.932648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:41.933690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lazy-loading 'fault' on Instance uuid 262b89ff-86ce-42e8-b4a1-b0f36e540142 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:40:42.065061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8f07ab449064cfea68877b477f897ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9c270a5d5343e690bf17c988e25115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:42.077819 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1551db3e-a5b5-4915-b446-288e5c1332d2 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 200 len: 1303 microversion: 2.1 time: 0.293637 Oct 03 10:40:42.078745 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1340/2577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:41 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:42.101137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:42.106293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: 0654af6f-0bf5-409f-aff3-fedeec38a352] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:42.127167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:42.130620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:42.133171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:42.133924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:42.134409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:42.134833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:42.188317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] HTTP exception thrown: Instance 0654af6f-0bf5-409f-aff3-fedeec38a352 could not be found. Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Request method failure captured: Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 HTTP/1.1 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroSNV29QB2t_7wufbcZ8WzP0cWa3hY17SrS4BcrrO65Xjt4BEXxTcyFndGlIRrnf70Y47JDp-AS-nGA93Ce2-7g6ywQ0rGkyyyaZtoK3IZvVLCACE83dSYva_CZi9SdUEnL2f5dgYr3aTj1YQjNpakbCFG63joQyZ3Vb70l0hdLdRc Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}] Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-LiveMigrationTest-167149645 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 6f0eda1654514026b803bcf2a1b8f4f4 Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 0654af6f-0bf5-409f-aff3-fedeec38a352 could not be found. Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '0654af6f-0bf5-409f-aff3-fedeec38a352'} Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0654af6f-0bf5-409f-aff3-fedeec38a352 could not be found. Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0654af6f-0bf5-409f-aff3-fedeec38a352 could not be found. Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:42.192967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:42.197179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:42.197179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:42.197179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:42.197179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:42.197179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:42.197179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0654af6f-0bf5-409f-aff3-fedeec38a352 could not be found. Oct 03 10:40:42.197179 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:42.198979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Returning 404 to user: Instance 0654af6f-0bf5-409f-aff3-fedeec38a352 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:42.200731 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0ed6800e-7bc4-4c1d-afa7-3dac336cb2a7 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352" status: 404 len: 111 microversion: 2.1 time: 0.120938 Oct 03 10:40:42.209587 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1341/2578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:42 2022] GET /compute/v2.1/servers/0654af6f-0bf5-409f-aff3-fedeec38a352 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:42.222401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:42.223395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:42.270605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:42.271134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:42.271580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:42.274468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:42.275175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:42.276246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:42.812622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:42.947480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:40:42.948558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:40:42.949452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:40:42.950036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:40:42.954945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:40:42.966012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:42.966631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:42.967166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:42.968000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:42.968565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:42.969115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:42.997491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Getting quotas for project b286477b323a4b88adf18567d28f55e9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:40:43.011570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Getting quotas for user 05e2261e6524462e982a747d4ab5bc4a and project b286477b323a4b88adf18567d28f55e9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:40:43.049380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:40:43.052115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:40:43.060062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:43.069774 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c07a6cc8-84a2-4ff3-9abe-27d8c28cdd0c tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 200 len: 1518 microversion: 2.1 time: 0.858744 Oct 03 10:40:43.074004 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1342/2579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:42 2022] GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 1518 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:43.086559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:43.094478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:43.110402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.114277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.115037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:43.116575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.119289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.119928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:43.158865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:43.159731 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf0e8ff6-f710-44db-af19-87af84697783 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144002 Oct 03 10:40:43.164410 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1238/2580] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:40:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:40:43.170304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:43.185578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:43.191993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.192482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.192949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:43.193653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.194110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.210724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:43.305569 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1489b72f-9b8a-45c4-9ff5-f8cbbb85f855 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 204 len: 0 microversion: 2.1 time: 0.229820 Oct 03 10:40:43.306601 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1343/2581] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:43 2022] DELETE /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:40:43.506580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1525683550", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:43.599866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:40:43.721843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:43.732493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d67c1494-d9d8-48cc-94b5-8b4f1bb08811 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.566710 Oct 03 10:40:43.733119 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1239/2582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:43 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:43.753063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:43.753929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:43.761935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.762774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.763796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:43.766880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.767963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.768895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:43.795986 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] HTTP exception thrown: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Request method failure captured: Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 HTTP/1.1 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOruX3gRCOO1Ktf3ezPiwxPc844BFXdIoLLRLBeyywCw1C71UInUGGwvclmJWyyuvWV18AKfrfxpyY7H-J2J5VzJw1sqBAfmNf0VXn9zJsongdkcU45Rta_bkhFgyFOwct9iucwr_FsXr8WXGkSl-xXRVOT-Z449v7zBTftktrsQcvBM Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}] Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: c8f07ab449064cfea68877b477f897ab Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '262b89ff-86ce-42e8-b4a1-b0f36e540142'} Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:43.801088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:43.806504 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:43.806504 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:43.806504 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:43.806504 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:43.806504 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:43.806504 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:43.806504 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:40:43.809066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Returning 404 to user: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:43.810148 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-87a6a9af-2495-46ee-b640-a469de7bbe3d tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 404 len: 111 microversion: 2.1 time: 0.075305 Oct 03 10:40:43.814489 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1240/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:43 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:43.820300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c49f6e6d-7c69-48a6-9d23-3720c68a38df tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:43.821321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:43.821557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c49f6e6d-7c69-48a6-9d23-3720c68a38df tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:43.914520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c49f6e6d-7c69-48a6-9d23-3720c68a38df tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:43.930849 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c49f6e6d-7c69-48a6-9d23-3720c68a38df tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1223 microversion: 2.1 time: 0.112374 Oct 03 10:40:43.933513 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1241/2584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:43 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:43.949314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:43.950954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:43.980000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.981219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.982827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:43.984340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:43.985528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:43.986191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:44.501276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:40:44.501801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:40:44.502450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:40:44.503032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:40:44.503598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:40:44.519211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:44.521006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:44.522753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:44.524374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:44.525539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:44.526217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:44.590702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Getting quotas for project 86bccbbcf37a4c299ecbfeba861b7909. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:40:44.605890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Getting quotas for user 66e7764f52f8460087c09c44ab7401fd and project 86bccbbcf37a4c299ecbfeba861b7909. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:40:44.634916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:40:44.650873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:40:44.778180 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c763cc7a-5e4c-478c-bb46-518ff6ed1467 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470049 Oct 03 10:40:44.778851 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1344/2585] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:40:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:40:44.826354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-636291d9-d765-4b9c-a6cf-7a724327dd83 req-bf80621e-c360-4994-88d7-babf2d63b397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262b89ff-86ce-42e8-b4a1-b0f36e540142", "name": "network-vif-deleted", "tag": "4037c86d-0c81-454a-8a7d-dd544d25df9d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:44.855511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-636291d9-d765-4b9c-a6cf-7a724327dd83 req-bf80621e-c360-4994-88d7-babf2d63b397 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:44.864951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-636291d9-d765-4b9c-a6cf-7a724327dd83 req-bf80621e-c360-4994-88d7-babf2d63b397 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:44.865762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-636291d9-d765-4b9c-a6cf-7a724327dd83 req-bf80621e-c360-4994-88d7-babf2d63b397 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:44.905705 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-636291d9-d765-4b9c-a6cf-7a724327dd83 req-bf80621e-c360-4994-88d7-babf2d63b397 service nova] Creating event network-vif-deleted:4037c86d-0c81-454a-8a7d-dd544d25df9d for instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 on n-h1-858383-3 Oct 03 10:40:44.924862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-636291d9-d765-4b9c-a6cf-7a724327dd83 req-bf80621e-c360-4994-88d7-babf2d63b397 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132037 Oct 03 10:40:44.929097 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1345/2586] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:44.946959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:44.952225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:44.968873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:44.969595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:44.970377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:44.971271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:44.971732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:44.972165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:45.156457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:45.172676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2525c740-c05d-485b-9e6a-938c33562633 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 200 len: 1476 microversion: 2.1 time: 0.242263 Oct 03 10:40:45.179905 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1346/2587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:44 2022] GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 1476 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:45.205986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7c4ff88a-03a9-46f6-9c3d-eae846e82a07 req-642f4681-3d2a-4ca6-ac6a-2d92c7d28a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e613f2-3f15-40d6-9b03-57a819120ebf", "name": "network-vif-plugged", "status": "completed", "tag": "5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:45.226524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c4ff88a-03a9-46f6-9c3d-eae846e82a07 req-642f4681-3d2a-4ca6-ac6a-2d92c7d28a57 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:45.231553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c4ff88a-03a9-46f6-9c3d-eae846e82a07 req-642f4681-3d2a-4ca6-ac6a-2d92c7d28a57 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:45.232380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c4ff88a-03a9-46f6-9c3d-eae846e82a07 req-642f4681-3d2a-4ca6-ac6a-2d92c7d28a57 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:45.253238 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7c4ff88a-03a9-46f6-9c3d-eae846e82a07 req-642f4681-3d2a-4ca6-ac6a-2d92c7d28a57 service nova] Creating event network-vif-plugged:5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab for instance 41e613f2-3f15-40d6-9b03-57a819120ebf on n-h2-858383-3 Oct 03 10:40:45.269909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7c4ff88a-03a9-46f6-9c3d-eae846e82a07 req-642f4681-3d2a-4ca6-ac6a-2d92c7d28a57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073507 Oct 03 10:40:45.272137 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1347/2588] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:45.294088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:45.312697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:45.340570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:45.352176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:45.359356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:45.361776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:45.364556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:45.365077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:45.505758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:45.522502 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dfff1ab5-f93b-475b-9042-304972af458d tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1500 microversion: 2.1 time: 1.584302 Oct 03 10:40:45.528570 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1242/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:43 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1500 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:45.534406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f598e27b-896b-42b8-aebc-411bb371eac9 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:45.543226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f598e27b-896b-42b8-aebc-411bb371eac9 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:45.659212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:45.669607 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c66d07f8-fad1-4d91-83ac-6dfd66be76b4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.394079 Oct 03 10:40:45.670341 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1348/2590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:45 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:45.675095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:45.677603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:45.691478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:45.692417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:45.692966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:45.694046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:45.694571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:45.695007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:45.741340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f598e27b-896b-42b8-aebc-411bb371eac9 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:45.748382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f598e27b-896b-42b8-aebc-411bb371eac9 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1223 microversion: 2.1 time: 0.217628 Oct 03 10:40:45.761839 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1243/2591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:45 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1223 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:45.774759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1013588776", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e25be3c5-9ccd-4c28-8dd9-9422d0d23acd"}, {"port": "dd030f06-746b-4332-9eeb-6288043d49b6", "tag": "port-1"}, {"port": "dc02198d-727d-4273-b628-c9809a55a651", "tag": "port-2"}, {"uuid": "bce7acc6-c14d-487c-b2e3-35fd204386be", "tag": "net-1"}, {"uuid": "bce7acc6-c14d-487c-b2e3-35fd204386be"}, {"uuid": "cd425c58-3bba-42c0-9f28-75f031930ceb", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cd425c58-3bba-42c0-9f28-75f031930ceb", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "db0da838-41da-48aa-afae-3fe0d70ad31a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "494eebb2-5a74-4f7c-9d3f-d7eb364cb3e7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3814ae59-5f60-4c3d-a1c0-0a93ff3ad02e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--616786013"}], "key_name": "tempest-keypair-1080641269", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:45.814376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:45.826420 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b079dae8-2555-497d-9ebf-3a023d6c1ede tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1283 microversion: 2.1 time: 0.154765 Oct 03 10:40:45.844902 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1349/2592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:45 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:45.851490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3766c216-cac8-4f2a-b7fe-92f906aca03f req-10587e51-f5b1-403e-8d1f-6cd42e7963c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7b9ce9-a85d-44d3-ab3b-b45d79124f56", "name": "network-vif-deleted", "tag": "ed3605c6-e8bf-492a-a631-92cdad844cdf"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:45.861532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3766c216-cac8-4f2a-b7fe-92f906aca03f req-10587e51-f5b1-403e-8d1f-6cd42e7963c3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:45.862730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3766c216-cac8-4f2a-b7fe-92f906aca03f req-10587e51-f5b1-403e-8d1f-6cd42e7963c3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:45.863393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3766c216-cac8-4f2a-b7fe-92f906aca03f req-10587e51-f5b1-403e-8d1f-6cd42e7963c3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:45.882892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3766c216-cac8-4f2a-b7fe-92f906aca03f req-10587e51-f5b1-403e-8d1f-6cd42e7963c3 service nova] Creating event network-vif-deleted:ed3605c6-e8bf-492a-a631-92cdad844cdf for instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 on n-h2-858383-3 Oct 03 10:40:45.889736 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3766c216-cac8-4f2a-b7fe-92f906aca03f req-10587e51-f5b1-403e-8d1f-6cd42e7963c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043059 Oct 03 10:40:45.890491 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1350/2593] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:46.203597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:46.204301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:46.211259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.211924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.212409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:46.213273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.213752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.214179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:46.228022 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] HTTP exception thrown: Instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 could not be found. Oct 03 10:40:46.231399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] validate_networks() for [('e25be3c5-9ccd-4c28-8dd9-9422d0d23acd', None, None, None, None, None), (None, None, 'dd030f06-746b-4332-9eeb-6288043d49b6', None, None, None), (None, None, 'dc02198d-727d-4273-b628-c9809a55a651', None, None, None), ('bce7acc6-c14d-487c-b2e3-35fd204386be', None, None, None, None, None), ('bce7acc6-c14d-487c-b2e3-35fd204386be', None, None, None, None, None), ('cd425c58-3bba-42c0-9f28-75f031930ceb', '10.2.2.100', None, None, None, None), ('cd425c58-3bba-42c0-9f28-75f031930ceb', '10.2.2.200', None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Request method failure captured: Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 HTTP/1.1 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrvFqKXuDy98ags3CnJ2_8Y9fAb2t2UgBXU4xiOKPTLEl4mhhABig__ckiXFLijufFP92BrXRC0qY__9ngSnHTazuL-RotHYEw-HO4wl1JbJSeAoCnEEaXGlKJP0axxj-oOzFoaMkrJR3i4cluXPy1ThrcomsbChpQhhjOE7HLDK7-M Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8ad227b0026b4a00a99371cb695d27d3 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ad227b0026b4a00a99371cb695d27d3"}]}] Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8ad227b0026b4a00a99371cb695d27d3 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListServerFiltersTestJSON-659967730-project Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7bdb35f4990d4ef28f95c7547ade54c0 Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListServerFiltersTestJSON-659967730-project Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 could not be found. Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3d7b9ce9-a85d-44d3-ab3b-b45d79124f56'} Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 could not be found. Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 could not be found. Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:46.235830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 could not be found. Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Returning 404 to user: Instance 3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b70a48fd-34fe-43f5-a4b9-da5ec1c172a2 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56" status: 404 len: 111 microversion: 2.1 time: 0.037945 Oct 03 10:40:46.240543 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1351/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:46 2022] GET /compute/v2.1/servers/3d7b9ce9-a85d-44d3-ab3b-b45d79124f56 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:40:46.247816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:46.248705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:46.257671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.258785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.259294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:46.260681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.261769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.262273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:46.299154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:40:46.484501 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8bb3357f-0c53-4d53-b3b6-61544ab55be7 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 204 len: 0 microversion: 2.1 time: 0.240661 Oct 03 10:40:46.485152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1352/2595] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:46 2022] DELETE /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:40:46.496002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:46.497521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:46.511121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.511626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.514898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:46.518502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.518742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.519218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:46.782789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:46.790632 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0d014f99-724b-411f-9ebb-0ef83d6274ad tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1518 microversion: 2.1 time: 0.300515 Oct 03 10:40:46.791675 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1353/2596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:46 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1518 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:46.798244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:46.801032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:46.813542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.814061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.814459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:46.815160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:46.815664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:46.816020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:47.143198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0eda1654514026b803bcf2a1b8f4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '336e8fee9a974d92b181d7a600cf0ede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:47.158184 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d3749b2-a2f9-4e9f-8e9f-bf8d0e18f851 tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 200 len: 1458 microversion: 2.1 time: 0.364558 Oct 03 10:40:47.163808 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1354/2597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:46 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 1458 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:47.182135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:47.184535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:47.201636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:47.202162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:47.202621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:47.203987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:47.204630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:47.205389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:47.209351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:47.614987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:47.633327 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2e0113be-ab18-4ea6-a738-6fee46b2e850 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1318 microversion: 2.1 time: 0.467757 Oct 03 10:40:47.636484 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1355/2598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:47 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:47.661038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:47.662590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:47.672761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:47.673702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:47.674418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:47.675410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:47.676961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:47.677935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:47.855848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:47.872088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d38c89bf-cb51-4107-9db9-ae566f3d757e tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1275 microversion: 2.1 time: 0.219949 Oct 03 10:40:47.885308 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1356/2599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:47 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:47.895775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:47.896830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:47.904624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:47.905466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:47.906227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:47.907166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:47.908491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:47.909174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:48.256201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:48.265391 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f6eca3ff-a984-45dd-a3ec-ad18ddd40bd9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.378123 Oct 03 10:40:48.266188 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1357/2600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:47 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:48.272514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:48.273467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:48.279682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:48.280355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:48.281370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:48.281851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:48.282480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:48.283702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:48.728996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:48.741323 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3e3e9d1-7ddc-49fe-95f0-3959533ec1b9 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1518 microversion: 2.1 time: 0.472548 Oct 03 10:40:48.742502 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1358/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:48 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1518 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:48.747696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1b262686-fcc4-425c-aced-2319d4f62bbc req-4e0a3f73-fae2-4f60-88d6-271d6c78284a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc538f05-7fa3-41ff-9515-21cf2614682b", "name": "network-vif-deleted", "tag": "32c5aa00-acd7-4398-9018-8100679e6eb0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:48.757655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b262686-fcc4-425c-aced-2319d4f62bbc req-4e0a3f73-fae2-4f60-88d6-271d6c78284a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:48.759171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b262686-fcc4-425c-aced-2319d4f62bbc req-4e0a3f73-fae2-4f60-88d6-271d6c78284a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:48.759854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b262686-fcc4-425c-aced-2319d4f62bbc req-4e0a3f73-fae2-4f60-88d6-271d6c78284a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:48.774287 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1b262686-fcc4-425c-aced-2319d4f62bbc req-4e0a3f73-fae2-4f60-88d6-271d6c78284a service nova] Creating event network-vif-deleted:32c5aa00-acd7-4398-9018-8100679e6eb0 for instance bc538f05-7fa3-41ff-9515-21cf2614682b on n-h2-858383-3 Oct 03 10:40:48.779969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1b262686-fcc4-425c-aced-2319d4f62bbc req-4e0a3f73-fae2-4f60-88d6-271d6c78284a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Oct 03 10:40:48.781163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1359/2602] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:48.786793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:48.787876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] [instance: bc538f05-7fa3-41ff-9515-21cf2614682b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:48.798202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:48.799606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:48.800452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:48.801635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:48.802303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:48.802936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:48.823432 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] HTTP exception thrown: Instance bc538f05-7fa3-41ff-9515-21cf2614682b could not be found. Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Request method failure captured: Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b HTTP/1.1 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOroSNV29QB2t_7wufbcZ8WzP0cWa3hY17SrS4BcrrO65Xjt4BEXxTcyFndGlIRrnf70Y47JDp-AS-nGA93Ce2-7g6ywQ0rGkyyyaZtoK3IZvVLCACE83dSYva_CZi9SdUEnL2f5dgYr3aTj1YQjNpakbCFG63joQyZ3Vb70l0hdLdRc Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/336e8fee9a974d92b181d7a600cf0ede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/336e8fee9a974d92b181d7a600cf0ede"}]}] Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-LiveMigrationTest-167149645 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 336e8fee9a974d92b181d7a600cf0ede Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-LiveMigrationTest-167149645 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 6f0eda1654514026b803bcf2a1b8f4f4 Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-LiveMigrationTest-167149645-project Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance bc538f05-7fa3-41ff-9515-21cf2614682b could not be found. Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'bc538f05-7fa3-41ff-9515-21cf2614682b'} Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc538f05-7fa3-41ff-9515-21cf2614682b could not be found. Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc538f05-7fa3-41ff-9515-21cf2614682b could not be found. Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:48.827665 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:48.831294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:48.831294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:48.831294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:48.831294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:48.831294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:48.831294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc538f05-7fa3-41ff-9515-21cf2614682b could not be found. Oct 03 10:40:48.831294 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:48.835329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] Returning 404 to user: Instance bc538f05-7fa3-41ff-9515-21cf2614682b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:48.838928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-429c2ed6-7c97-4590-9673-cba97ac8180c tempest-LiveMigrationTest-167149645 tempest-LiveMigrationTest-167149645-project] 10.222.0.27 "GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b" status: 404 len: 111 microversion: 2.1 time: 0.056376 Oct 03 10:40:48.839839 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1360/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:48 2022] GET /compute/v2.1/servers/bc538f05-7fa3-41ff-9515-21cf2614682b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:48.847038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:48.848341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:48.861223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:48.863779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:48.865142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:48.867553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:48.868600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:48.869290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:49.348353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:49.359662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0da94df-adc9-40f2-a5b7-f50b256af9d3 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1508 microversion: 2.1 time: 0.517372 Oct 03 10:40:49.361802 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1361/2604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:48 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:49.367664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:49.368703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:49.376516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:49.377379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:49.378065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:49.379558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:49.380128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:49.380719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:49.497717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:49.506996 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-689c07f4-28e1-4c26-94e7-9b41f78a50aa tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1281 microversion: 2.1 time: 0.143169 Oct 03 10:40:49.507545 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1362/2605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:49 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:49.513142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:49.514204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:49.520519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:49.522048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:49.522600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:49.523120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:49.523902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:49.524414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:49.524882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:49.896551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:49.911840 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce0f43a2-4574-49a9-be23-bee123ff3a56 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.402801 Oct 03 10:40:49.912593 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1363/2606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:49 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:49.931002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:49.932132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:49.942365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:49.943205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:49.943846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:49.944851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:49.945343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:49.945834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.127582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:50.135983 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e45e45c-c7a1-431b-b6a6-34ee31dada0b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1508 microversion: 2.1 time: 0.221513 Oct 03 10:40:50.136562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1364/2607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:49 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:50.145410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:50.146225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:50.158215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.158781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.159101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.159866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.160645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.161314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.210936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.211494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.212119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.213049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lazy-loading 'fault' on Instance uuid 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:40:50.258893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdb35f4990d4ef28f95c7547ade54c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad227b0026b4a00a99371cb695d27d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:50.269192 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65529b3d-0208-4493-a73a-6b73ca1d2854 tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 200 len: 1311 microversion: 2.1 time: 0.131355 Oct 03 10:40:50.270088 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1365/2608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:50 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 1311 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:50.431579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-cfcbb56b-4326-4290-8f06-e049b83be039 req-332831c7-81fe-4c72-9211-2de472da5c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a475675-4f2d-4bf8-9dd0-cbbd01a078bb", "name": "network-vif-deleted", "tag": "e0a9aefc-0f66-4c96-85ba-80cb5d45693b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:50.444059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cfcbb56b-4326-4290-8f06-e049b83be039 req-332831c7-81fe-4c72-9211-2de472da5c49 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.444352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cfcbb56b-4326-4290-8f06-e049b83be039 req-332831c7-81fe-4c72-9211-2de472da5c49 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.444815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cfcbb56b-4326-4290-8f06-e049b83be039 req-332831c7-81fe-4c72-9211-2de472da5c49 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.462002 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-cfcbb56b-4326-4290-8f06-e049b83be039 req-332831c7-81fe-4c72-9211-2de472da5c49 service nova] Creating event network-vif-deleted:e0a9aefc-0f66-4c96-85ba-80cb5d45693b for instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb on n-h1-858383-3 Oct 03 10:40:50.478046 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-cfcbb56b-4326-4290-8f06-e049b83be039 req-332831c7-81fe-4c72-9211-2de472da5c49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206012 Oct 03 10:40:50.488294 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1366/2609] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:50.495399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:50.496178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:50.506136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.507037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.507668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.508384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.509201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.509359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.539663 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] HTTP exception thrown: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Request method failure captured: Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 HTTP/1.1 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruX3gRCOO1Ktf3ezPiwxPc844BFXdIoLLRLBeyywCw1C71UInUGGwvclmJWyyuvWV18AKfrfxpyY7H-J2J5VzJw1sqBAfmNf0VXn9zJsongdkcU45Rta_bkhFgyFOwct9iucwr_FsXr8WXGkSl-xXRVOT-Z449v7zBTftktrsQcvBM Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}] Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: c8f07ab449064cfea68877b477f897ab Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '262b89ff-86ce-42e8-b4a1-b0f36e540142'} Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:50.543057 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Returning 404 to user: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:50.547285 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e663ce7-36d7-40bf-a670-79bffb898597 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 404 len: 111 microversion: 2.1 time: 0.054855 Oct 03 10:40:50.549361 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1367/2610] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:50 2022] DELETE /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:50.554002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:50.556798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:50.565402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.565979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.566977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.568158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.568990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.569428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.712309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:40:50.712643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:40:50.713231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:40:50.713887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:40:50.714855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:40:50.784925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:50.793580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.795711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.796615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.797737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.798479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.799311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.844072 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1fee9955-8449-4209-a649-1039d87e624c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "POST /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf/action" status: 202 len: 1110 microversion: 2.1 time: 0.294295 Oct 03 10:40:50.845436 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1368/2611] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:40:50 2022] POST /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf/action => generated 1110 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 10:40:50.851240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:50.852290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:50.875062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.875569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.876243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.876718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.878158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.878821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.960336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:50.972601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19d7459f-fe1f-4097-8be3-14fa3ed0d401 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1281 microversion: 2.1 time: 0.125479 Oct 03 10:40:50.973504 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1369/2612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:50 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1281 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:50.979734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:50.980759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 262b89ff-86ce-42e8-b4a1-b0f36e540142] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:50.994132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.995614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.996087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:50.997352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:50.998410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:50.998937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.018667 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] HTTP exception thrown: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Request method failure captured: Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 HTTP/1.1 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruX3gRCOO1Ktf3ezPiwxPc844BFXdIoLLRLBeyywCw1C71UInUGGwvclmJWyyuvWV18AKfrfxpyY7H-J2J5VzJw1sqBAfmNf0VXn9zJsongdkcU45Rta_bkhFgyFOwct9iucwr_FsXr8WXGkSl-xXRVOT-Z449v7zBTftktrsQcvBM Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}] Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: c8f07ab449064cfea68877b477f897ab Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '262b89ff-86ce-42e8-b4a1-b0f36e540142'} Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.020358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Returning 404 to user: Instance 262b89ff-86ce-42e8-b4a1-b0f36e540142 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34521a1b-808d-47ee-80e7-5dbe29f765a3 tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142" status: 404 len: 111 microversion: 2.1 time: 0.047059 Oct 03 10:40:51.024012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1370/2613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:50 2022] GET /compute/v2.1/servers/262b89ff-86ce-42e8-b4a1-b0f36e540142 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:51.029429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:51.030037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:51.035921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.036398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.037020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.038006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.038477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.038837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.213098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:51.222448 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a5affbda-a690-4e84-9277-69d311bb4377 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.198813 Oct 03 10:40:51.237319 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1371/2614] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:51 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:51.244082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:51.245498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:51.251546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.252026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.252456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.253200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.253647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.254064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.426311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:51.429565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:51.436654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e641ff4b-cb52-4ca2-bbda-6ec85f3c9986 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.197889 Oct 03 10:40:51.437618 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1372/2615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:51 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:51.442181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:51.442750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:51.450237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.451537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.453304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.454279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.455366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.455869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.471568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] HTTP exception thrown: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Request method failure captured: Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a HTTP/1.1 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruX3gRCOO1Ktf3ezPiwxPc844BFXdIoLLRLBeyywCw1C71UInUGGwvclmJWyyuvWV18AKfrfxpyY7H-J2J5VzJw1sqBAfmNf0VXn9zJsongdkcU45Rta_bkhFgyFOwct9iucwr_FsXr8WXGkSl-xXRVOT-Z449v7zBTftktrsQcvBM Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}] Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: c8f07ab449064cfea68877b477f897ab Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '65228375-8a44-40af-a10c-8326bdf1ca1a'} Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:51.473244 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Returning 404 to user: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-36188ecf-9eca-4dde-ac9b-b42739f91f7a tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 404 len: 111 microversion: 2.1 time: 0.036298 Oct 03 10:40:51.478253 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1373/2616] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:40:51 2022] DELETE /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:51.480717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:51.480893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] [instance: 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:51.487328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.487822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.488258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.488997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.489463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.489874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.504967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] HTTP exception thrown: Instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb could not be found. Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Request method failure captured: Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb HTTP/1.1 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrvFqKXuDy98ags3CnJ2_8Y9fAb2t2UgBXU4xiOKPTLEl4mhhABig__ckiXFLijufFP92BrXRC0qY__9ngSnHTazuL-RotHYEw-HO4wl1JbJSeAoCnEEaXGlKJP0axxj-oOzFoaMkrJR3i4cluXPy1ThrcomsbChpQhhjOE7HLDK7-M Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8ad227b0026b4a00a99371cb695d27d3 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8ad227b0026b4a00a99371cb695d27d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8ad227b0026b4a00a99371cb695d27d3"}]}] Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8ad227b0026b4a00a99371cb695d27d3 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-659967730 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListServerFiltersTestJSON-659967730-project Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7bdb35f4990d4ef28f95c7547ade54c0 Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListServerFiltersTestJSON-659967730-project Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb could not be found. Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '7a475675-4f2d-4bf8-9dd0-cbbd01a078bb'} Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb could not be found. Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb could not be found. Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.506493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb could not be found. Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] Returning 404 to user: Instance 7a475675-4f2d-4bf8-9dd0-cbbd01a078bb could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4dc5707b-a6e6-45e2-9bf4-47d250fa2afd tempest-ListServerFiltersTestJSON-659967730 tempest-ListServerFiltersTestJSON-659967730-project] 10.222.0.27 "GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb" status: 404 len: 111 microversion: 2.1 time: 0.031818 Oct 03 10:40:51.511444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1374/2617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:51 2022] GET /compute/v2.1/servers/7a475675-4f2d-4bf8-9dd0-cbbd01a078bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:51.513974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:51.514381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] [instance: 65228375-8a44-40af-a10c-8326bdf1ca1a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:51.521102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.521596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.522036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.522748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.523203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.524066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.539159 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] HTTP exception thrown: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Request method failure captured: Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a HTTP/1.1 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOruX3gRCOO1Ktf3ezPiwxPc844BFXdIoLLRLBeyywCw1C71UInUGGwvclmJWyyuvWV18AKfrfxpyY7H-J2J5VzJw1sqBAfmNf0VXn9zJsongdkcU45Rta_bkhFgyFOwct9iucwr_FsXr8WXGkSl-xXRVOT-Z449v7zBTftktrsQcvBM Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef9c270a5d5343e690bf17c988e25115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef9c270a5d5343e690bf17c988e25115"}]}] Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ef9c270a5d5343e690bf17c988e25115 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestMultiNic-108752752 Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: c8f07ab449064cfea68877b477f897ab Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestMultiNic-108752752-project Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '65228375-8a44-40af-a10c-8326bdf1ca1a'} Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:40:51.540785 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] Returning 404 to user: Instance 65228375-8a44-40af-a10c-8326bdf1ca1a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24ba0409-77c8-458d-8723-4c32cbf53e6e tempest-ServersTestMultiNic-108752752 tempest-ServersTestMultiNic-108752752-project] 10.222.0.27 "GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a" status: 404 len: 111 microversion: 2.1 time: 0.033748 Oct 03 10:40:51.545974 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1375/2618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:51 2022] GET /compute/v2.1/servers/65228375-8a44-40af-a10c-8326bdf1ca1a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:40:51.681074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8d5151f8-bb28-499e-b11b-a7ba270387b4 req-b7e40ee0-9e09-49a1-9d27-4674ca3510c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acc23cd-7f72-431b-b377-dc2d9dc5fdec", "tag": "40bcc76d-c520-4e63-956b-c3bb2c191671"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:51.702525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d5151f8-bb28-499e-b11b-a7ba270387b4 req-b7e40ee0-9e09-49a1-9d27-4674ca3510c5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:51.704172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d5151f8-bb28-499e-b11b-a7ba270387b4 req-b7e40ee0-9e09-49a1-9d27-4674ca3510c5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:51.704853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d5151f8-bb28-499e-b11b-a7ba270387b4 req-b7e40ee0-9e09-49a1-9d27-4674ca3510c5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:51.727811 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8d5151f8-bb28-499e-b11b-a7ba270387b4 req-b7e40ee0-9e09-49a1-9d27-4674ca3510c5 service nova] Creating event network-changed:40bcc76d-c520-4e63-956b-c3bb2c191671 for instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec on n-h1-858383-3 Oct 03 10:40:51.736518 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8d5151f8-bb28-499e-b11b-a7ba270387b4 req-b7e40ee0-9e09-49a1-9d27-4674ca3510c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059192 Oct 03 10:40:51.738266 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1376/2619] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:40:52.001370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:52.002087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:52.028587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:52.032008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:52.032649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:52.033843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:52.034203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:52.034643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:52.155460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:52.168041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b175f3a-1de5-405a-b046-2fcc92766139 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1281 microversion: 2.1 time: 0.174007 Oct 03 10:40:52.168722 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1377/2620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:51 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:52.259611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:52.260863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:52.268966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:52.269670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:52.270255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:52.271257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:52.271856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:52.272427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:52.693839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:52.707925 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7da1e9c3-d650-4618-86a5-cb9cb84c5bcd tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.453322 Oct 03 10:40:52.709516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1378/2621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:52 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:52.715631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:52.716744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:52.723294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:52.724989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:52.725665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:52.726882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:52.727553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:52.728345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:52.981090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:53.129933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:53.135003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:40:53.135706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:40:53.136325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:40:53.137337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:40:53.137789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:40:53.147776 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ad39867-892a-41bb-bf84-f1efbe32f579 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.436465 Oct 03 10:40:53.158393 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1379/2622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:52 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:53.160306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=40,nova_cell0:UPDATE=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:53.162214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:53.162914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:53.163709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:53.164934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:53.165747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:53.168310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:53.190813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:53.191707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:53.201469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:53.202299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:53.207958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:53.207958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:53.207958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:53.207958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:53.212938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Getting quotas for project 307b309d45e147b4ad14412e1266217e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:40:53.225937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Getting quotas for user 9836fe6921cc4c5cb042178421a3fa00 and project 307b309d45e147b4ad14412e1266217e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:40:53.481624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:40:53.484463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='db0da838-41da-48aa-afae-3fe0d70ad31a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='494eebb2-5a74-4f7c-9d3f-d7eb364cb3e7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3814ae59-5f60-4c3d-a1c0-0a93ff3ad02e',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:40:53.631164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:53.653637 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10661c14-f979-4605-9e44-9c1bb2e4d9bc tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 0.453913 Oct 03 10:40:53.655403 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1380/2623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:53 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:53.736198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:53.737882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:53.755224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:53.755973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:53.756650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:53.758316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:53.759150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:53.760015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:54.052760 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20a7e429-0330-4989-9e72-a0eeebff9824 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.289283 Oct 03 10:40:54.055936 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1244/2624] 10.222.0.27 () {62 vars in 1189 bytes} [Mon Oct 3 10:40:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 8293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:40:54.067467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5324a714-3ea9-4d89-9054-914f86ec5d9e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:54.068165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5324a714-3ea9-4d89-9054-914f86ec5d9e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:54.152802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:54.162465 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-199c2bfc-d2e3-4d47-bba4-8c764e6c62f9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.432927 Oct 03 10:40:54.170090 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1381/2625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:53 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:54.182665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:54.183296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:54.192055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:54.192658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:54.193301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:54.194147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:54.195063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:54.195802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:54.315529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5324a714-3ea9-4d89-9054-914f86ec5d9e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:54.327056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5324a714-3ea9-4d89-9054-914f86ec5d9e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:54.332888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5324a714-3ea9-4d89-9054-914f86ec5d9e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:54.335537 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5324a714-3ea9-4d89-9054-914f86ec5d9e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1286 microversion: 2.42 time: 0.274126 Oct 03 10:40:54.337579 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1245/2626] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:40:54 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1286 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:40:54.498049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:54.511659 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0e09257-6555-41ce-9995-6ba3bc900e32 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.339795 Oct 03 10:40:54.528566 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1382/2627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:54 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:54.681739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:54.682960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:54.689770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:54.690340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:54.691032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:54.691811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:54.692520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:54.693770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:55.187847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:55.189557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:55.197184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:55.198200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:55.199966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:55.200701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:55.201718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:55.202600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:55.203337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:55.204051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:55.364984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:55.377667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d15cb18-ba93-4603-a84f-a4ed94a20cf7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 0.697893 Oct 03 10:40:55.378286 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1246/2628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:54 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:55.389912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:55.390601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:55.406886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:55.407472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:55.408145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:55.410309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:55.411111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:55.412988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:55.431450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:55.464222 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e037aa7-5244-42be-abd0-32032bc11e9b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.278569 Oct 03 10:40:55.464872 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1383/2629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:55 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:55.535887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:55.537144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:55.544692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:55.545217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:55.549509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:55.550791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:55.552605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:55.553700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:55.774138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:55.785214 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0366f7a7-4864-4080-bd93-2ffe514d10a4 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.253959 Oct 03 10:40:55.786756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1384/2630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:55 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:56.032379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:56.048568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:56.050398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:56.051891 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-610ce608-af41-4206-93df-1928d1a0c9bb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1528 microversion: 2.42 time: 0.672266 Oct 03 10:40:56.053208 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1247/2631] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:40:55 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1528 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:40:56.407624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:56.408879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:56.425572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:56.430774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:56.431456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:56.432901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:56.435256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:56.435864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:56.489490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:56.491130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:56.514986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:56.517951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:56.519367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:56.528408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:56.535641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:56.536239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:57.272537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:57.287796 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4cf4e6f-501a-4381-9b1b-f6abdca1896d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.803613 Oct 03 10:40:57.288732 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1248/2632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:56 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:40:57.305669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:57.305983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:57.316133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:57.318072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:57.319867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:57.320758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:57.324184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:57.324741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:57.594204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:57.605220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a773f749-1990-413a-ba37-ef87317f6377 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 1.204648 Oct 03 10:40:57.605854 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1385/2633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:56 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:57.626492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-88886a2c-4c9d-4b09-a866-52c95a49b52f req-6f80fc76-4c90-4303-988a-dbc8138d2350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828", "tag": "0c26098a-c5a2-4ea3-9730-82c9bdf9eb57"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:40:57.638397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-88886a2c-4c9d-4b09-a866-52c95a49b52f req-6f80fc76-4c90-4303-988a-dbc8138d2350 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:57.639164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-88886a2c-4c9d-4b09-a866-52c95a49b52f req-6f80fc76-4c90-4303-988a-dbc8138d2350 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:57.639757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-88886a2c-4c9d-4b09-a866-52c95a49b52f req-6f80fc76-4c90-4303-988a-dbc8138d2350 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:57.652857 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-88886a2c-4c9d-4b09-a866-52c95a49b52f req-6f80fc76-4c90-4303-988a-dbc8138d2350 service nova] Creating event network-changed:0c26098a-c5a2-4ea3-9730-82c9bdf9eb57 for instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 on n-h1-858383-3 Oct 03 10:40:57.658163 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-88886a2c-4c9d-4b09-a866-52c95a49b52f req-6f80fc76-4c90-4303-988a-dbc8138d2350 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035618 Oct 03 10:40:57.658988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1386/2634] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:40:57.666660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:57.667582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:57.675077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:57.675875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:57.676577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:57.677529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:57.678257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:57.679136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:57.782231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:57.791684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce62652f-c256-44b7-be37-30cb7ef7fd2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.501336 Oct 03 10:40:57.808434 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1249/2635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:57 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:58.155283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:58.165202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:58.173127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:58.174580 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ecd926df-727f-4b65-9e52-0208b9facfa8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1594 microversion: 2.42 time: 0.514355 Oct 03 10:40:58.179523 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1387/2636] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:40:57 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1594 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:40:58.320397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:58.321206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:58.323980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:40:58.335660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:58.338425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:58.338978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:58.341372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:58.341968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:58.343189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:58.633470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:58.634093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:58.653513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:58.654527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:58.655141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:58.656114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:58.656745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:58.657364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:59.015537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:59.040754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-005acfad-42ef-41a1-ae58-b5303e00729b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.720601 Oct 03 10:40:59.043233 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1250/2637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:58 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:59.063812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:59.064443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:59.083095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:59.083600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:59.084037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:59.084858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:59.085576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:59.085670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:59.322805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:59.359259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c55ead42-bdb4-4280-afad-9c538fa44daf tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 0.729663 Oct 03 10:40:59.363438 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1388/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:58 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:40:59.392651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:40:59.413190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:40:59.432414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:59.432951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:59.433407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:59.436300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:40:59.436827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:40:59.437281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:40:59.754581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:59.780045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:59.781758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:59.783132 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce413ea1-362c-4c92-99de-e9b5a10f5247 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1594 microversion: 2.42 time: 0.400305 Oct 03 10:40:59.784062 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1389/2639] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:40:59 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1594 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:40:59.900098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:40:59.918201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3a941a41-ced3-4a66-8907-6e657f9350a7 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.873512 Oct 03 10:40:59.918835 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1251/2640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:40:59 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:00.076049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:00.076679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:00.086712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:00.090434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:00.092910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:00.094017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:00.094491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:00.094933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:00.391308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:00.392545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:00.428641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:00.433762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:00.435503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:00.443477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:00.450030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:00.450775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:01.279971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:01.288004 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff45b9e0-039f-4ce5-84b8-71b215d53cd8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 1.221750 Oct 03 10:41:01.288610 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1390/2641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:00 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:01.311774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:01.312441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:01.333052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:01.333548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:01.333988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:01.334697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:01.335153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:01.335589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:01.372036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:01.386222 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20575a4c-6eae-422c-8eac-110ab86233c7 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 1.001142 Oct 03 10:41:01.401197 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1252/2642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:00 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:01.401197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:01.413923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:01.438555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:01.446270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:01.446942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:01.448436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:01.455407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:01.456155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:02.133469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:02.145298 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d17e218d-5a83-4117-a579-66dc3331dc67 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.756378 Oct 03 10:41:02.146576 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1253/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:01 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:02.429891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-eddedc13-a34c-4736-8fc3-b6b62f308a36 req-d5398cee-e22e-495d-9e30-89de8145ccd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4acc23cd-7f72-431b-b377-dc2d9dc5fdec", "name": "network-vif-plugged", "status": "completed", "tag": "40bcc76d-c520-4e63-956b-c3bb2c191671"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:02.439831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eddedc13-a34c-4736-8fc3-b6b62f308a36 req-d5398cee-e22e-495d-9e30-89de8145ccd7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:02.440309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eddedc13-a34c-4736-8fc3-b6b62f308a36 req-d5398cee-e22e-495d-9e30-89de8145ccd7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:02.440734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eddedc13-a34c-4736-8fc3-b6b62f308a36 req-d5398cee-e22e-495d-9e30-89de8145ccd7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:02.453290 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-eddedc13-a34c-4736-8fc3-b6b62f308a36 req-d5398cee-e22e-495d-9e30-89de8145ccd7 service nova] Creating event network-vif-plugged:40bcc76d-c520-4e63-956b-c3bb2c191671 for instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec on n-h1-858383-3 Oct 03 10:41:02.464214 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-eddedc13-a34c-4736-8fc3-b6b62f308a36 req-d5398cee-e22e-495d-9e30-89de8145ccd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316130 Oct 03 10:41:02.464847 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1254/2644] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:02.486734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:02.487454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:02.513819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:02.528715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:02.529415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:02.530180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:02.530656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:02.531078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:02.720715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:02.730683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:02.742623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:02.753897 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-abe2428d-46c0-4135-8358-dcbc7d01c56b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1661 microversion: 2.42 time: 1.456059 Oct 03 10:41:02.755710 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1391/2645] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:01 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1661 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:02.773922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:02.774821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:02.788750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:02.789538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:02.790181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:02.791979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:02.792658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:02.793329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:03.131951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:03.135537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:03.153475 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78df6fbe-6fba-4195-81e7-126b7cf2b8c4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.678911 Oct 03 10:41:03.156653 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1255/2646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:02 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:03.176375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:03.177070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:03.185365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:03.199527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:03.201587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:03.203645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:03.204793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:03.208394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:03.209295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:03.597559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:03.606666 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-edc65e8b-f888-4cb9-bdc9-1fbcef2cf5cc tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1323 microversion: 2.1 time: 0.440649 Oct 03 10:41:03.611460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1256/2647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:03 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1323 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:03.787694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:03.788917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:03.811222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:03.812009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:03.815956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:03.817017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:03.818921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:03.823032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:04.021299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:04.028490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:04.043624 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6cab783c-2bed-4cb7-9eb4-f8c4f1d8fb62 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 1.274039 Oct 03 10:41:04.056803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1392/2648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:02 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:04.183702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:04.184316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:04.198509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:04.199745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:04.199745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:04.201831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:04.201831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:04.212078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:04.320373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:04.388363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:04.403232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:04.404699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:04.420607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-effd90c2-6e94-440c-af79-3c42997fd2d9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1707 microversion: 2.42 time: 0.636684 Oct 03 10:41:04.426783 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1257/2649] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:03 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1707 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:41:04.638313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:04.639808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:04.662171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:04.664054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:04.664883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:04.668063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:04.669318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:04.670506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:05.073777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:05.083460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee1ed291-f094-4c2c-a021-6f48971df746 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1520 microversion: 2.1 time: 0.449467 Oct 03 10:41:05.084056 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1258/2650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:04 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:05.111865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:05.112494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:05.124427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:05.125363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:05.126064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:05.127031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:05.127732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:05.128380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:05.489991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:05.500104 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0eac0473-dff4-47f6-a398-70473fb3758a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 1.320343 Oct 03 10:41:05.503453 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1393/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:04 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:05.517448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a16fae6d-ab92-4b7b-b902-7d2cc54d55c5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'create', calling method: .version_select at 0x7f07575104c0>, body: {"pool": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:05.676956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:05.708253 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3617de59-c494-478e-8be3-58f3973a1546 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 0.603229 Oct 03 10:41:05.709092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1259/2652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:05 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:05.738762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:05.740637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:05.759466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:05.760526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:05.761266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:05.764517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:05.779193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:05.779980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:06.569496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:06.585869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:06.590811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:06.592244 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e421edf2-a8b4-43d0-b2ae-ff26cc8d5a9d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1753 microversion: 2.42 time: 0.869821 Oct 03 10:41:06.597745 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1260/2653] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:05 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1753 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:06.602764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:06.609947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:06.620575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:06.623696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:06.624364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:06.626024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:06.626712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:06.627933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:07.096804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:07.111199 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f8a5df4-4a16-4aa0-b681-08b7666795d6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.512104 Oct 03 10:41:07.113091 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1261/2654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:06 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:07.122685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:07.125652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:07.141331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:07.141845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:07.146515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:07.147957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:07.148448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:07.148916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:07.544553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:07.560983 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-806515f4-c027-4dde-8db8-9ef9e4ed9ae2 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 0.446598 Oct 03 10:41:07.561776 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1262/2655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:07 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:07.582381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-60bf6a00-fe05-449a-b610-6d9953d88c26 req-d7c24070-bc3d-4abe-b077-54e957b79ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828", "name": "network-vif-plugged", "status": "completed", "tag": "0c26098a-c5a2-4ea3-9730-82c9bdf9eb57"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:07.631659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-60bf6a00-fe05-449a-b610-6d9953d88c26 req-d7c24070-bc3d-4abe-b077-54e957b79ec0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:07.632511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-60bf6a00-fe05-449a-b610-6d9953d88c26 req-d7c24070-bc3d-4abe-b077-54e957b79ec0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:07.633130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-60bf6a00-fe05-449a-b610-6d9953d88c26 req-d7c24070-bc3d-4abe-b077-54e957b79ec0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:07.648065 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-60bf6a00-fe05-449a-b610-6d9953d88c26 req-d7c24070-bc3d-4abe-b077-54e957b79ec0 service nova] Creating event network-vif-plugged:0c26098a-c5a2-4ea3-9730-82c9bdf9eb57 for instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 on n-h1-858383-3 Oct 03 10:41:07.655428 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-60bf6a00-fe05-449a-b610-6d9953d88c26 req-d7c24070-bc3d-4abe-b077-54e957b79ec0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091896 Oct 03 10:41:07.656061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1263/2656] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:07.662790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:07.664266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:07.676350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:07.677254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:07.679780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:07.679780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:07.679780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:07.680306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:08.170550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:08.185781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:08.191452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:08.192665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9797acc0-44fa-485a-909e-441fb945e892 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1753 microversion: 2.42 time: 0.535217 Oct 03 10:41:08.199289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1264/2657] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:07 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1753 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:08.213082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:08.214171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:08.238671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:08.241862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:08.245406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:08.247541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:08.249535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:08.250489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:09.126617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:09.155559 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7d542a4-d2bf-48a7-98f5-0943413aff72 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.952267 Oct 03 10:41:09.161095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1265/2658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:08 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:09.171661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:09.172281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:09.183739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:09.184249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:09.187112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:09.187883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:09.188374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:09.195079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:10.023290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:10.037339 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c244c50-fbe4-4ef3-bfd6-74e56c64dcfe tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1323 microversion: 2.1 time: 0.874114 Oct 03 10:41:10.039528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1266/2659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:09 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1323 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:10.046236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:10.047150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:10.061250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:10.067135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:10.071398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:10.072548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:10.073213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:10.074162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:10.697944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:10.713120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:10.714934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:10.718985 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e11cc91-0672-416d-904d-d2bfed7e7d70 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1799 microversion: 2.42 time: 0.678007 Oct 03 10:41:10.720884 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1267/2660] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:10 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1799 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:10.751236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:10.753298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:10.766096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:10.767897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:10.768519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:10.770384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:10.771323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:10.773395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:12.335176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:12.352720 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e91bd7b7-0bc8-4794-9615-01fa644de1d1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 1.611957 Oct 03 10:41:12.374577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1268/2661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:10 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:12.385342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:12.385964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:12.401138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:12.401628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:12.402075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:12.407464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:12.411979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:12.412638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:12.735175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a16fae6d-ab92-4b7b-b902-7d2cc54d55c5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.229361 Oct 03 10:41:12.736585 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1394/2662] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:41:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:12.744614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:12.746987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:12.774140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:12.784865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:12.785484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:12.793012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:12.793666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:12.794450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:12.975432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:12.983893 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1473 microversion: 2.1 time: 0.608194 Oct 03 10:41:12.984479 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1269/2663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:12 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1473 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:12.989877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:12.992152 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-156a1125-a641-4e16-953c-1aa927139101 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001348 Oct 03 10:41:13.001101 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1270/2664] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 3 10:41:12 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 03 10:41:13.008360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1129152343", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "fb857a83-42b3-4a53-b589-5a253a5b0340"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:13.181943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] validate_networks() for [('fb857a83-42b3-4a53-b589-5a253a5b0340', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:41:13.369449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:13.419222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:13.420707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:13.421938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14237c61-da7c-42c2-81fa-662cc29f8326 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1799 microversion: 2.42 time: 0.683742 Oct 03 10:41:13.422512 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1395/2665] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:12 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1799 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:13.440325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:13.443706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:13.454775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:13.455277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:13.466722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:13.467840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:13.468486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:13.469109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:13.521942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Request method failure captured: Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828/diagnostics HTTP/1.1 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrwp5t7pGxD_d82xjsSOkWwE5LUM1XqPKNR5dOFrLPQ_B6wAcW_tEZnLSVMup_E-3vF6OAIYgerGiXTmE1qobUqJ1hcQ14XlRaocP3qzCfu9j18lyFX8hArWgKIqYEzBDfFgSKvzkXPwYRqKUiqsFM9Dtv4dSbCPaEoHWcwFYhfAtAM Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86bccbbcf37a4c299ecbfeba861b7909 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-435705500 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86bccbbcf37a4c299ecbfeba861b7909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86bccbbcf37a4c299ecbfeba861b7909"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86bccbbcf37a4c299ecbfeba861b7909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86bccbbcf37a4c299ecbfeba861b7909"}]}] Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-435705500 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86bccbbcf37a4c299ecbfeba861b7909 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-435705500 Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerDiagnosticsNegativeTest-435705500-project Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 66e7764f52f8460087c09c44ab7401fd Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-435705500-project Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': 'c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828'} Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:13.530854 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:13.535395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:13.535395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:13.535395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:41:13.535395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:41:13.535395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 03 10:41:13.535395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:13.537451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:13.538501 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-470f05a5-6097-4708-b3d1-b8300c45f7d5 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.115065 Oct 03 10:41:13.553905 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1396/2666] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:41:13 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828/diagnostics => generated 117 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:13.595006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:13.595927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:13.618985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:13.624030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:13.626299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:13.627567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:13.628044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:13.628482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:14.297511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:14.312282 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3c371e73-5741-42e9-bb73-4c4ec929b6d9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 0.752102 Oct 03 10:41:14.312946 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1397/2667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:13 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:14.339788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:14.340306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:14.360651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:14.362728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:14.363287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:14.364880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:14.366485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:14.368094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:14.441968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:41:14.638664 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0c37a18-a2df-40c8-92f6-c9c70fced369 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 204 len: 0 microversion: 2.1 time: 0.324209 Oct 03 10:41:14.640099 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1398/2668] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:41:14 2022] DELETE /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:41:14.657536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:14.660314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:14.674821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:14.675541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:14.677461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:14.679092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:14.680682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:14.682896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:15.109370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:15.133228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:15.134902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:15.144155 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0159dc5-c562-416e-b605-450aea4f7004 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1845 microversion: 2.42 time: 0.502529 Oct 03 10:41:15.150325 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1399/2669] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:14 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1845 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:15.171644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:15.174089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:15.189129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:15.189625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:15.211655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:15.219689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:15.220237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:15.220688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:15.729412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:15.745169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb22ece8-105c-4200-9330-650ab6615381 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1479 microversion: 2.1 time: 0.592160 Oct 03 10:41:15.766555 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1400/2670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:15 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1479 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:15.989869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-625204151", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:16.122943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] validate_networks() for [('da7c1e20-4575-4bdb-81a4-8af3a57e8ce6', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:41:16.632983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:41:16.633937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:41:16.634731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:41:16.635288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:41:16.635855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:41:16.667206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:16.668121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:16.668727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:16.670066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:16.670701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:16.671653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:16.736209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Getting quotas for project b286477b323a4b88adf18567d28f55e9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:41:16.753889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Getting quotas for user 05e2261e6524462e982a747d4ab5bc4a and project b286477b323a4b88adf18567d28f55e9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:41:16.774552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:41:16.778524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:41:16.848032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48882830-5cbc-42d9-9a29-020820ce18d2 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.842713 Oct 03 10:41:16.856451 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1271/2671] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:41:16.876059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:16.876674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:16.890048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:16.891584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:16.892177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:16.893259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:16.895898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:16.896583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:17.653009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:41:17.654442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:41:17.655178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:41:17.655957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:41:17.656546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:41:17.708193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:17.710267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:17.716522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:17.719925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:17.720403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:17.725141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:17.773431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Getting quotas for project 7aa3cb4384e24f40aeaba5316f58a1a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:41:17.785903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Getting quotas for user d48e756911b24c6ab2d309ff46b705d6 and project 7aa3cb4384e24f40aeaba5316f58a1a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:41:17.823747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:41:17.830980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:41:17.907997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:17.968495 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-04ffcb01-9fb9-4961-9699-cb408e2c9d7f tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.198231 Oct 03 10:41:17.970252 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1401/2672] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:41:17.986008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:17.986638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:18.032822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:18.041637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:18.042135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:18.042906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:18.043386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:18.043824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:18.555798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:18.572642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:18.576617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:18.578142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2da71793-ac84-4fdb-85a7-e42e7f6f6bf8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1845 microversion: 2.42 time: 0.601530 Oct 03 10:41:18.581550 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1402/2673] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:17 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1845 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:18.593818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:18.595518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:18.616630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:18.626463 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7fd3adcd-416e-44d5-bd75-5dbdfa3b745a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1515 microversion: 2.1 time: 1.767240 Oct 03 10:41:18.629729 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1272/2674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:16 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1515 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:18.635321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:18.649116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:18.650588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:18.672073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:18.678166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:18.684256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:18.685924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:18.689360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:18.705929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:18.706452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:18.707090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:18.708027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:18.708642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:18.709273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:18.992557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:19.005684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b8d5c768-6a2b-4037-99f1-bb0f42823018 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1276 microversion: 2.1 time: 0.374709 Oct 03 10:41:19.018917 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1273/2675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:18 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:19.023913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-25324cdf-f3aa-445c-b243-8c2c076a1ddf tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:19.024823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-25324cdf-f3aa-445c-b243-8c2c076a1ddf tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:19.234320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-25324cdf-f3aa-445c-b243-8c2c076a1ddf tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:19.242669 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-25324cdf-f3aa-445c-b243-8c2c076a1ddf tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1223 microversion: 2.1 time: 0.222417 Oct 03 10:41:19.257870 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1274/2676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:19 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1223 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:19.450750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:19.466234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f4eef82-f9b3-409e-a679-39d3ef1fbb40 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1479 microversion: 2.1 time: 0.883402 Oct 03 10:41:19.467525 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1403/2677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:18 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1479 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:19.607905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:19.608825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:19.616824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:19.627508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:19.628318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:19.637950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:19.640216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:19.640877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:19.656702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:19.657659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:19.676634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:19.682900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:19.683651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:19.691767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:19.697515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:19.698269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:20.278035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:20.292562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6242f30c-5c86-42a6-8104-c458e0454c4d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1521 microversion: 2.1 time: 0.639245 Oct 03 10:41:20.294091 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1404/2678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:19 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1521 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:20.306168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c71f112a-bd5f-44a2-8cc7-73cec1877843 req-36646d50-5221-410d-9db3-11facf2db27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "b7af86eb-5635-45d8-9283-b672d13a9bae"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:20.342732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c71f112a-bd5f-44a2-8cc7-73cec1877843 req-36646d50-5221-410d-9db3-11facf2db27f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:20.345316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c71f112a-bd5f-44a2-8cc7-73cec1877843 req-36646d50-5221-410d-9db3-11facf2db27f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:20.346236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c71f112a-bd5f-44a2-8cc7-73cec1877843 req-36646d50-5221-410d-9db3-11facf2db27f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:20.374404 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c71f112a-bd5f-44a2-8cc7-73cec1877843 req-36646d50-5221-410d-9db3-11facf2db27f service nova] Creating event network-changed:b7af86eb-5635-45d8-9283-b672d13a9bae for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:41:20.389649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c71f112a-bd5f-44a2-8cc7-73cec1877843 req-36646d50-5221-410d-9db3-11facf2db27f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094060 Oct 03 10:41:20.391021 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1405/2679] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:20.409500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:20.410554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:20.425294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:20.426049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:20.426675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:20.427565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:20.429093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:20.431809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:20.943964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:20.952658 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-914188cd-a5d0-4f24-b08d-eaaf6bef1685 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1282 microversion: 2.1 time: 0.557139 Oct 03 10:41:20.955828 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1406/2680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:20 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1282 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:20.966330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:20.969481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:20.982967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:20.985551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:20.986316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:20.988187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:20.989253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:20.994389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:21.155553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:21.158481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:21.187576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:21.191099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:21.195187 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5a75df4-1ae6-485a-8897-9bbb7083c506 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1845 microversion: 2.42 time: 1.590378 Oct 03 10:41:21.209249 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1275/2681] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:19 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1845 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:21.217553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:21.220164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:21.236049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:21.236912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:21.237591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:21.238526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:21.239219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:21.239856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:21.404264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:21.412906 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-493fc679-08ee-4bb5-8a3d-0ece871c44be tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1437 microversion: 2.1 time: 0.201903 Oct 03 10:41:21.421840 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1276/2682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:21 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1437 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:21.427867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-553167d9-0d40-411f-a128-d8a845b96618 req-77014a6b-c402-4f3d-94b6-1e779a19a13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e613f2-3f15-40d6-9b03-57a819120ebf", "name": "network-vif-unplugged", "status": "completed", "tag": "5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:21.463177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-553167d9-0d40-411f-a128-d8a845b96618 req-77014a6b-c402-4f3d-94b6-1e779a19a13a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:21.463748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-553167d9-0d40-411f-a128-d8a845b96618 req-77014a6b-c402-4f3d-94b6-1e779a19a13a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:21.464261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-553167d9-0d40-411f-a128-d8a845b96618 req-77014a6b-c402-4f3d-94b6-1e779a19a13a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:21.485709 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-553167d9-0d40-411f-a128-d8a845b96618 req-77014a6b-c402-4f3d-94b6-1e779a19a13a service nova] Creating event network-vif-unplugged:5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab for instance 41e613f2-3f15-40d6-9b03-57a819120ebf on n-h2-858383-3 Oct 03 10:41:21.502753 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-553167d9-0d40-411f-a128-d8a845b96618 req-77014a6b-c402-4f3d-94b6-1e779a19a13a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079249 Oct 03 10:41:21.503802 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1277/2683] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:21.511412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:21.528214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:21.536378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:21.537361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:21.539359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:21.542194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:21.542909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:21.543614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.048316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:22.064551 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d0e6db9-51d8-49a0-a4fb-8acf379551ea tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1281 microversion: 2.1 time: 1.103482 Oct 03 10:41:22.065512 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1407/2684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:20 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1281 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:22.081590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:22.083335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:22.105009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.105515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.105958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.113246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.113740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.114185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.354544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:22.370915 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e20fe094-5311-4f9e-b4c4-016996bff967 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1282 microversion: 2.1 time: 0.303103 Oct 03 10:41:22.379384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:22.382158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1408/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:22 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:22.388603 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a579f450-e7bc-42bf-9aef-b7a4270839f6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1521 microversion: 2.1 time: 0.883503 Oct 03 10:41:22.397344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:22.397862 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1278/2686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:21 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1521 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:22.401893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:22.416840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.417299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.417739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.418447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.423981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.427019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.443666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:22.444170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:22.455097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.458146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.459522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.464984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.467005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.467659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.586844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.588033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.592402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.593231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lazy-loading 'fault' on Instance uuid c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:41:22.708243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e7764f52f8460087c09c44ab7401fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bccbbcf37a4c299ecbfeba861b7909', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:22.715709 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9c37c62a-4c3b-4b4c-802a-8bbd055c71da tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 200 len: 1313 microversion: 2.1 time: 0.276077 Oct 03 10:41:22.740897 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1279/2687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:22 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:22.740897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-68dc0609-f996-4ef9-ba33-5b7164aba7d4 req-d8ee5d40-9055-4d7a-9166-5b4ab9ea05f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828", "name": "network-vif-deleted", "tag": "0c26098a-c5a2-4ea3-9730-82c9bdf9eb57"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:22.751798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-68dc0609-f996-4ef9-ba33-5b7164aba7d4 req-d8ee5d40-9055-4d7a-9166-5b4ab9ea05f1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:22.752442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-68dc0609-f996-4ef9-ba33-5b7164aba7d4 req-d8ee5d40-9055-4d7a-9166-5b4ab9ea05f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:22.753033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-68dc0609-f996-4ef9-ba33-5b7164aba7d4 req-d8ee5d40-9055-4d7a-9166-5b4ab9ea05f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:22.779332 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-68dc0609-f996-4ef9-ba33-5b7164aba7d4 req-d8ee5d40-9055-4d7a-9166-5b4ab9ea05f1 service nova] Creating event network-vif-deleted:0c26098a-c5a2-4ea3-9730-82c9bdf9eb57 for instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 on n-h1-858383-3 Oct 03 10:41:22.787997 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-68dc0609-f996-4ef9-ba33-5b7164aba7d4 req-d8ee5d40-9055-4d7a-9166-5b4ab9ea05f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056831 Oct 03 10:41:22.790105 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1280/2688] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:23.092701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:23.093675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:23.106045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:23.106647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:23.113462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:23.119870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:23.120463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:23.121017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:23.270084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:23.275859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:23.294113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e424299-5636-4f13-a46c-ac0a21c05fe6 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1281 microversion: 2.1 time: 0.205813 Oct 03 10:41:23.302877 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1281/2689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:23 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:23.323014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:23.342530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:23.347186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5466c7cb-7fc8-4b5d-8ff2-17b14c5ff372 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1845 microversion: 2.42 time: 0.960598 Oct 03 10:41:23.373830 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1409/2690] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:22 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1845 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:23.409073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:23.410265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:23.418962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:23.419669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:23.427267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:23.429936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:23.431246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:23.435724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:23.438004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:23.438771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:23.442868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:23.444942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:23.446385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:23.447725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:23.452245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:23.453379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:23.491993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:24.335363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:24.348377 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-affc3e6b-4d7e-4c1b-8670-32cc90de4cf0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1521 microversion: 2.1 time: 0.934604 Oct 03 10:41:24.350227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1410/2691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:23 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1521 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:24.378606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:24.384575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] [instance: c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:24.402778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:24.403650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:24.404291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:24.406182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:24.407513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:24.409326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:24.449196 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] HTTP exception thrown: Instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 could not be found. Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Request method failure captured: Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 HTTP/1.1 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrwp5t7pGxD_d82xjsSOkWwE5LUM1XqPKNR5dOFrLPQ_B6wAcW_tEZnLSVMup_E-3vF6OAIYgerGiXTmE1qobUqJ1hcQ14XlRaocP3qzCfu9j18lyFX8hArWgKIqYEzBDfFgSKvzkXPwYRqKUiqsFM9Dtv4dSbCPaEoHWcwFYhfAtAM Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 86bccbbcf37a4c299ecbfeba861b7909 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-435705500 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86bccbbcf37a4c299ecbfeba861b7909"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86bccbbcf37a4c299ecbfeba861b7909"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86bccbbcf37a4c299ecbfeba861b7909"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86bccbbcf37a4c299ecbfeba861b7909"}]}] Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-435705500 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 86bccbbcf37a4c299ecbfeba861b7909 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-435705500 Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerDiagnosticsNegativeTest-435705500-project Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 66e7764f52f8460087c09c44ab7401fd Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-435705500-project Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 could not be found. Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828'} Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 could not be found. Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 could not be found. Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:24.459174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 could not be found. Oct 03 10:41:24.463782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:24.466024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] Returning 404 to user: Instance c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:24.467095 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-76548a3f-0656-48b9-b9ac-ea34534f2871 tempest-ServerDiagnosticsNegativeTest-435705500 tempest-ServerDiagnosticsNegativeTest-435705500-project] 10.222.0.27 "GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828" status: 404 len: 111 microversion: 2.1 time: 0.114385 Oct 03 10:41:24.471719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1411/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:24 2022] GET /compute/v2.1/servers/c3dee271-8fd3-4f3a-a4a2-e7b4a26ed828 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:24.487475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:24.489147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:24.497433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:24.498301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:24.498962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:24.499896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:24.500566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:24.501274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:24.931469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:24.939233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00dc74c5-26be-4369-bb5c-5d03fad58ffb tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 1.534210 Oct 03 10:41:24.949143 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1282/2693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:23 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:24.954028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:24.954643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:24.969153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:24.973572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:24.974165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:24.975065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:24.975625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:24.975931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:25.772954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:25.785750 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0cb4c832-eba3-4379-9aca-ff84a305c322 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 1.311155 Oct 03 10:41:25.786341 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1412/2694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:24 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:25.805419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:25.811805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:25.842426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:25.842932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:25.843370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:25.850441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:25.851184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:25.851795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:25.966543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:25.977685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:25.986534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:25.995084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1953948-bb66-49bb-b667-8a1121c8125c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1866 microversion: 2.42 time: 1.042909 Oct 03 10:41:26.001383 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1283/2695] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:24 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1866 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:26.007639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d7f86743-d800-4776-b055-a78558a7ddc6 req-95caf070-05a1-4b64-a5c8-1dc4a3f3a47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "dd030f06-746b-4332-9eeb-6288043d49b6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:26.047373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d7f86743-d800-4776-b055-a78558a7ddc6 req-95caf070-05a1-4b64-a5c8-1dc4a3f3a47f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:26.047858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d7f86743-d800-4776-b055-a78558a7ddc6 req-95caf070-05a1-4b64-a5c8-1dc4a3f3a47f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:26.050038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d7f86743-d800-4776-b055-a78558a7ddc6 req-95caf070-05a1-4b64-a5c8-1dc4a3f3a47f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:26.073951 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d7f86743-d800-4776-b055-a78558a7ddc6 req-95caf070-05a1-4b64-a5c8-1dc4a3f3a47f service nova] Creating event network-changed:dd030f06-746b-4332-9eeb-6288043d49b6 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:41:26.091648 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d7f86743-d800-4776-b055-a78558a7ddc6 req-95caf070-05a1-4b64-a5c8-1dc4a3f3a47f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080779 Oct 03 10:41:26.092669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1284/2696] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:26.105804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bb3c41b4-05c5-4315-a9fb-626137b029fb req-e85fea8c-6620-4a14-a1ff-916543d38bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e613f2-3f15-40d6-9b03-57a819120ebf", "name": "network-vif-plugged", "status": "completed", "tag": "5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:26.120989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bb3c41b4-05c5-4315-a9fb-626137b029fb req-e85fea8c-6620-4a14-a1ff-916543d38bbb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:26.122084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bb3c41b4-05c5-4315-a9fb-626137b029fb req-e85fea8c-6620-4a14-a1ff-916543d38bbb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:26.122760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bb3c41b4-05c5-4315-a9fb-626137b029fb req-e85fea8c-6620-4a14-a1ff-916543d38bbb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:26.162847 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bb3c41b4-05c5-4315-a9fb-626137b029fb req-e85fea8c-6620-4a14-a1ff-916543d38bbb service nova] Creating event network-vif-plugged:5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab for instance 41e613f2-3f15-40d6-9b03-57a819120ebf on n-h2-858383-3 Oct 03 10:41:26.171317 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bb3c41b4-05c5-4315-a9fb-626137b029fb req-e85fea8c-6620-4a14-a1ff-916543d38bbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076342 Oct 03 10:41:26.175201 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1285/2697] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:26.190270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:26.191615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:26.203771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:26.209575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:26.210337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:26.211257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:26.211832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:26.212169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:26.715881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:26.816693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:26.825457 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-909ba2f3-5d8f-4ad0-99d1-9f1dff5a0381 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.645781 Oct 03 10:41:26.835257 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1286/2698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:26 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:26.841369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:26.842248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:26.849764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:26.850564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:26.851004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:26.851783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:26.852241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:26.852893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:27.155661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:27.169177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-33267c43-5750-4275-b470-c386e907ec9c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1521 microversion: 2.1 time: 1.381125 Oct 03 10:41:27.169772 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1413/2699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:25 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1521 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:27.175434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:27.176392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:27.185403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:27.187992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:27.193676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:27.195321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:27.196014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:27.196503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:27.286561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:27.296517 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c27493b4-59d8-45d7-b9d2-3f14bdb0d047 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 0.468842 Oct 03 10:41:27.297841 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1287/2700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:26 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:27.749669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:27.812863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:27.854234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:27.855070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:27.878649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:27.885079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:27.885548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:27.892892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:27.893499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:27.898337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:27.993859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:28.011181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:28.013949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:28.018850 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d671e172-1e18-4151-aa21-48cf19350639 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1854 microversion: 2.42 time: 0.847696 Oct 03 10:41:28.043959 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1414/2701] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:27 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1854 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:28.161046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-177055bb-9a5c-47da-9c8c-c0374f65c850 req-43d4b79c-34c8-456d-827c-4f0e135f9ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e896961d-f325-41ba-8ab5-c98cdaba723e", "tag": "e32a934e-4dad-4114-9fdc-c285f563cfc3"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:28.181936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-177055bb-9a5c-47da-9c8c-c0374f65c850 req-43d4b79c-34c8-456d-827c-4f0e135f9ee9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:28.185103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-177055bb-9a5c-47da-9c8c-c0374f65c850 req-43d4b79c-34c8-456d-827c-4f0e135f9ee9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:28.185931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-177055bb-9a5c-47da-9c8c-c0374f65c850 req-43d4b79c-34c8-456d-827c-4f0e135f9ee9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:28.203843 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-177055bb-9a5c-47da-9c8c-c0374f65c850 req-43d4b79c-34c8-456d-827c-4f0e135f9ee9 service nova] Creating event network-changed:e32a934e-4dad-4114-9fdc-c285f563cfc3 for instance e896961d-f325-41ba-8ab5-c98cdaba723e on n-h1-858383-3 Oct 03 10:41:28.212748 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-177055bb-9a5c-47da-9c8c-c0374f65c850 req-43d4b79c-34c8-456d-827c-4f0e135f9ee9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058616 Oct 03 10:41:28.214158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1415/2702] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:28.222753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:28.225669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:28.248375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:28.250443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:28.251620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:28.253046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:28.253732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:28.254524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:28.523794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:28.535100 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-87edd0f2-7d37-4983-b2ea-890622da132f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.686828 Oct 03 10:41:28.549461 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1288/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:27 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:28.556258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:28.557102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:28.559536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:28.577647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:28.578167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:28.578896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:28.580089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:28.580944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:28.581573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:28.771829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:28.783474 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b475f9b9-acc1-457e-8726-06c6cea78a0d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1521 microversion: 2.1 time: 0.566837 Oct 03 10:41:28.784753 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1416/2704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:28 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:29.053347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:29.054350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:29.071095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:29.077580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:29.106743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:29.113234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:29.115952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:29.116694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:29.239030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:29.683982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:29.697290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:29.698760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:29.715659 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb7f69fd-dae3-4d8d-bbaa-c76e8c09dfed tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.668861 Oct 03 10:41:29.734361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:29.742444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1417/2705] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:29 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:29.751761 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5abad71d-f1c3-46cb-8875-1e96f4366628 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 1.197902 Oct 03 10:41:29.754103 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1289/2706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:28 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:29.757074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:29.759632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:29.780069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:29.783465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:29.784313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:29.785326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:29.787504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:29.788821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:29.810890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:29.811845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:29.820149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:29.821753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:29.822385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:29.823314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:29.824050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:29.824657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:30.144387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:30.158285 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-73a23a59-29a1-44aa-a352-406727f9fd5e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.411803 Oct 03 10:41:30.172798 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1418/2707] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:29 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:30.368416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f7bccae7-ddcc-4348-b7e7-ac81923102de req-78bc124c-21bf-45fd-8d38-e6c4885f31ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb441072-dd67-4669-8e53-741d5416b113", "tag": "64c23ddf-80e9-4d2c-9411-25c69041982f"}, {"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "dc02198d-727d-4273-b628-c9809a55a651"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:30.404220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f7bccae7-ddcc-4348-b7e7-ac81923102de req-78bc124c-21bf-45fd-8d38-e6c4885f31ba service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:30.406443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f7bccae7-ddcc-4348-b7e7-ac81923102de req-78bc124c-21bf-45fd-8d38-e6c4885f31ba service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:30.409369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f7bccae7-ddcc-4348-b7e7-ac81923102de req-78bc124c-21bf-45fd-8d38-e6c4885f31ba service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:30.450512 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f7bccae7-ddcc-4348-b7e7-ac81923102de req-78bc124c-21bf-45fd-8d38-e6c4885f31ba service nova] Creating event network-changed:64c23ddf-80e9-4d2c-9411-25c69041982f for instance cb441072-dd67-4669-8e53-741d5416b113 on n-h2-858383-3 Oct 03 10:41:30.455385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f7bccae7-ddcc-4348-b7e7-ac81923102de req-78bc124c-21bf-45fd-8d38-e6c4885f31ba service nova] Creating event network-changed:dc02198d-727d-4273-b628-c9809a55a651 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:41:30.474776 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f7bccae7-ddcc-4348-b7e7-ac81923102de req-78bc124c-21bf-45fd-8d38-e6c4885f31ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112618 Oct 03 10:41:30.475423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1419/2708] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:30.614972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:30.630286 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-771f7300-bf00-482f-844d-471c4f88a32d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1506 microversion: 2.1 time: 0.824486 Oct 03 10:41:30.630878 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1290/2709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:29 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1506 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:30.667399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:30.669291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:30.677997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:30.679464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:30.680567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:30.682148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:30.683198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:30.683857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:30.747950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:30.749497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:30.765716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:30.766274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:30.766733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:30.769033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:30.769739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:30.770181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:31.004840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:31.017831 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c54c1ae-6496-4e52-8076-1dd63d7db679 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 200 len: 1506 microversion: 2.1 time: 0.358239 Oct 03 10:41:31.034150 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1420/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:30 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:31.058370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:31.062222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:31.086498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:31.089273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:31.091748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:31.092669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:31.094513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:31.096080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:31.390422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:31.401087 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26e53434-c67b-4a34-bd1b-0f0b012732ee tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 0.364445 Oct 03 10:41:31.401698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1421/2711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:31 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:31.406819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:31.407609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:31.413909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:31.414472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:31.415173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:31.416344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:31.417548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:31.419108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:31.471608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:41:31.662942 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-94dab41e-26ec-4f71-98c9-cdae3d00666d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 204 len: 0 microversion: 2.1 time: 0.259904 Oct 03 10:41:31.664752 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1422/2712] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:41:31 2022] DELETE /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:41:31.681687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:31.682928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:31.692582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:31.693436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:31.694043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:31.695227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:31.695938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:31.698145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:31.719503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:31.732089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:31.733574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:31.734776 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3e4f3d1-f3ed-4d88-81ad-b3489290f6a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.990885 Oct 03 10:41:31.740593 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1291/2713] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:30 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:31.972588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1389568642", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "19fafd07-9a97-4e03-b4e2-1d09963b3097"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:32.047217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] validate_networks() for [('19fafd07-9a97-4e03-b4e2-1d09963b3097', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:41:32.049498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:32.063569 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-148a456c-2b26-442b-9907-8bdb1d5ae10b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.396813 Oct 03 10:41:32.065742 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1423/2714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:31 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:32.426235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:32.427540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:32.437226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:32.438041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:32.438659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:32.442173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:32.442847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:32.444621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:32.691707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:32.703689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e4d08259-56ba-4929-a3ec-173e45bd0181 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 0.280677 Oct 03 10:41:32.706577 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1424/2715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:32 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:32.769194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:32.770527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:32.792914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:32.793798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:32.794461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:32.795403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:32.796053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:32.796728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:33.083316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:33.108644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:33.111995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:33.114232 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-921cbc90-6ba6-47fe-a088-18f9f2d43cd9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.350346 Oct 03 10:41:33.114816 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1425/2716] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:32 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:33.121355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-48d302e7-0304-43f1-bb66-5007992930e1 req-fa80e071-34a4-4a3a-990c-0cfc0372d9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:33.172389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-48d302e7-0304-43f1-bb66-5007992930e1 req-fa80e071-34a4-4a3a-990c-0cfc0372d9c5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:33.172937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-48d302e7-0304-43f1-bb66-5007992930e1 req-fa80e071-34a4-4a3a-990c-0cfc0372d9c5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:33.173381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-48d302e7-0304-43f1-bb66-5007992930e1 req-fa80e071-34a4-4a3a-990c-0cfc0372d9c5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:33.204669 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-48d302e7-0304-43f1-bb66-5007992930e1 req-fa80e071-34a4-4a3a-990c-0cfc0372d9c5 service nova] Creating event network-changed:12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:41:33.212498 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-48d302e7-0304-43f1-bb66-5007992930e1 req-fa80e071-34a4-4a3a-990c-0cfc0372d9c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094577 Oct 03 10:41:33.213803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1426/2717] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:33.223141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:33.224074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:33.234056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:33.235357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:33.236933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:33.238522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:33.239342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:33.239963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:33.365419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:41:33.366073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:41:33.366393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:41:33.366851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:41:33.367262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:41:33.390375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:33.390865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:33.391302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:33.392024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:33.392473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:33.393081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:33.443359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Getting quotas for project a66f39dd2e184e50b5531ef369d2455c. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:41:33.457560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Getting quotas for user ad027da90cc247a8ad9ba953b39d19b1 and project a66f39dd2e184e50b5531ef369d2455c. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:41:33.506627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:41:33.514268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:41:33.675760 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a02ea98-749e-405b-a207-d3c9246d8c16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.707146 Oct 03 10:41:33.677409 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1292/2718] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:41:33.691956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0881b377-6f13-41bd-ae81-ed73292fbf78 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:33.692758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0881b377-6f13-41bd-ae81-ed73292fbf78 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:33.888229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:33.901375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4cccd84a-bdb0-46e6-8f2d-d1e8b03aa9e1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.685760 Oct 03 10:41:33.921975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1427/2719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:33 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:33.931266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:33.934888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:33.941897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0881b377-6f13-41bd-ae81-ed73292fbf78 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:33.956271 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0881b377-6f13-41bd-ae81-ed73292fbf78 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1218 microversion: 2.1 time: 0.267962 Oct 03 10:41:33.961627 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1293/2720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:33 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:33.975754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:33.988744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:33.989603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:33.992148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:33.994536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:33.995695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:34.011208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:34.141026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:34.141649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:34.153451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:34.154121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:34.154688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:34.155409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:34.155880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:34.156318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:35.102317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:35.127655 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6dfa672c-d603-4573-88a7-dc6d58c1cd71 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 1.201904 Oct 03 10:41:35.128544 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1428/2721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:33 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:35.334477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:35.394994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:35.403388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:35.408340 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43d1962b-88e7-44ca-b446-575034af9861 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.268338 Oct 03 10:41:35.413022 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1294/2722] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:34 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:35.448523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:35.452385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:35.477102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:35.478723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:35.479387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:35.499350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:35.505449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:35.507408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:35.537104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b330735b-ff90-43cd-bcae-83a523f6d3e4 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Calling method '.version_select at 0x7f074e5469d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:35.717639 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b330735b-ff90-43cd-bcae-83a523f6d3e4 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 371 microversion: 2.1 time: 0.586532 Oct 03 10:41:35.718449 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1429/2723] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 10:41:35 2022] GET /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:35.727308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:35.730984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:35.744996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:35.745504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:35.745950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:35.747998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:35.750117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:35.750567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:35.955457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:35.975579 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caf40b2e-78fd-4f65-9156-c234e8ec00a4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1270 microversion: 2.1 time: 0.255161 Oct 03 10:41:35.977513 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1430/2724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:35 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1270 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:35.984729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Action: 'update', calling method: .version_select at 0x7f074f18c1f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:36.092949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:36.093397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:36.093839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:36.094571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:36.095027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:36.095517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:36.178300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13fd1a3b-cbc9-43b1-afe1-53b48f6f71d0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 328 microversion: 2.1 time: 0.198524 Oct 03 10:41:36.193371 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1431/2725] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:41:35 2022] PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:36.198934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:36.200145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:36.206912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:36.207806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:36.208464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:36.209433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:36.210096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:36.210719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:36.679637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:36.694511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-adf489e4-b7f3-4beb-9a5f-f306c94c3395 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 0.499790 Oct 03 10:41:36.700094 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1432/2726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:36 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:36.782006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:36.794518 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d7d79d6-bdae-43c1-8b2c-b7b81dfe707d tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 1.379489 Oct 03 10:41:36.804033 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1295/2727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:35 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:36.841160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:36.841955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:36.860959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:36.863974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:36.864831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:36.872870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:36.874535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:36.875107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:36.878868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-102731708", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:36.927693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:37.008063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:41:37.374435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:41:37.376634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:41:37.377801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:41:37.380106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:41:37.382385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:41:37.404032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.405236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.406378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:37.407255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.408359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.409796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:37.438549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Getting quotas for project 74ce340adbd44b07ad0037afc69302f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:41:37.446220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Getting quotas for user f2cb0f3783a64755b74efecad927876d and project 74ce340adbd44b07ad0037afc69302f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:41:37.460983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.utils [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] cores quota exceeded for 74ce340adbd44b07ad0037afc69302f9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122269) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 03 10:41:37.462046 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Request method failure captured: Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 144 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxcMvIhSK7tbChCF8UTeysKVqPbd79ILZUWnSjdcXnq0ZSjBSe9NBcYje6MzBRWmAIWbNzj2ZScC_rsHrSAs9h5iGotJ5dTNgzs_35DyihoFb7w4FmqVn5nBrc7PKne0gG96fYQLKd030E3YbiYGBojnumexBeJrP2GoA0r_GB7fzI Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}] Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: f2cb0f3783a64755b74efecad927876d Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-102731708", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-102731708', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452'}}} Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:41:37.471796 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 10:41:37.478026 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:37.481951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:37.483209 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3fa6e75-a4e8-4c4c-8fb4-4e456c92114f tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.779102 Oct 03 10:41:37.483949 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1433/2728] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 783 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:37.489346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-14974b67-6037-4679-93c3-5d24a45e43bc req-33a6208c-1b48-4fd2-857f-2e100438ece7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e613f2-3f15-40d6-9b03-57a819120ebf", "name": "network-vif-deleted", "tag": "5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:37.510265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-14974b67-6037-4679-93c3-5d24a45e43bc req-33a6208c-1b48-4fd2-857f-2e100438ece7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.510750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-14974b67-6037-4679-93c3-5d24a45e43bc req-33a6208c-1b48-4fd2-857f-2e100438ece7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.511190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-14974b67-6037-4679-93c3-5d24a45e43bc req-33a6208c-1b48-4fd2-857f-2e100438ece7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:37.543559 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-14974b67-6037-4679-93c3-5d24a45e43bc req-33a6208c-1b48-4fd2-857f-2e100438ece7 service nova] Creating event network-vif-deleted:5d8e8ca3-c1a4-4cf8-bb0d-1e140df55fab for instance 41e613f2-3f15-40d6-9b03-57a819120ebf on n-h2-858383-3 Oct 03 10:41:37.550624 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-14974b67-6037-4679-93c3-5d24a45e43bc req-33a6208c-1b48-4fd2-857f-2e100438ece7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065037 Oct 03 10:41:37.551783 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1434/2729] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:37.558759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-432e4056-a187-441b-b768-2f19eafa19db req-3eedd6d4-10f7-4d81-96c8-db60b8a42949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb441072-dd67-4669-8e53-741d5416b113", "name": "network-vif-plugged", "status": "completed", "tag": "64c23ddf-80e9-4d2c-9411-25c69041982f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:37.577179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-432e4056-a187-441b-b768-2f19eafa19db req-3eedd6d4-10f7-4d81-96c8-db60b8a42949 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.577671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-432e4056-a187-441b-b768-2f19eafa19db req-3eedd6d4-10f7-4d81-96c8-db60b8a42949 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.578160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-432e4056-a187-441b-b768-2f19eafa19db req-3eedd6d4-10f7-4d81-96c8-db60b8a42949 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:37.599041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-432e4056-a187-441b-b768-2f19eafa19db req-3eedd6d4-10f7-4d81-96c8-db60b8a42949 service nova] Creating event network-vif-plugged:64c23ddf-80e9-4d2c-9411-25c69041982f for instance cb441072-dd67-4669-8e53-741d5416b113 on n-h2-858383-3 Oct 03 10:41:37.607549 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-432e4056-a187-441b-b768-2f19eafa19db req-3eedd6d4-10f7-4d81-96c8-db60b8a42949 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053046 Oct 03 10:41:37.608480 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1435/2730] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:37.614490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:37.615234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:37.632454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:37.637224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.637746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.638185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:37.640037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.640702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.641327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:37.798755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:37.818662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6aa25faf-9d85-4281-980c-ec80e207abd4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1276 microversion: 2.1 time: 0.208141 Oct 03 10:41:37.819785 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1436/2731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:37 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:37.840383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Action: 'update', calling method: .version_select at 0x7f074e4d0700>, body: {"quota_set": {"cores": 20}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:37.960846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.962756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.963224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:37.964229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:37.964926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:37.965633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.069272 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51ccd920-b19c-4bf0-ad78-1533ddad887a tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 329 microversion: 2.1 time: 0.247978 Oct 03 10:41:38.078411 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1437/2732] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:41:37 2022] PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 329 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:38.082834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:38.083464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:38.090707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.091482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.091644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.092419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.092910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.093404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.347131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:38.384011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:38.394672 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-354249ea-be2d-45a4-a6a4-b458e8f18690 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1323 microversion: 2.1 time: 0.318161 Oct 03 10:41:38.396046 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1438/2733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:38 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:38.417323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:38.426036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:38.426282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:38.437458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:38.438864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.440348 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bede93a3-163a-4955-a128-d7c935fe79e7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.635259 Oct 03 10:41:38.441864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.442118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.442860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.443301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.443730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.451095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1296/2734] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:36 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:38.468529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e4deb56-ffda-4576-8119-381518c66e31 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Calling method '.version_select at 0x7f074ea0ddc0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:38.668959 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e4deb56-ffda-4576-8119-381518c66e31 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 371 microversion: 2.1 time: 0.216415 Oct 03 10:41:38.669503 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1297/2735] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 10:41:38 2022] GET /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:38.682118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Action: 'update', calling method: .version_select at 0x7f074e4fcaf0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:38.700868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:38.710227 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f0fe94e-df92-4de5-9778-a0a5e160d5f8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.297284 Oct 03 10:41:38.716098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1439/2736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:38 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:38.859071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:38.860028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:38.867190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.868820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.869558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.870584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.873147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.874732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.875924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.881867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.882639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:38.884634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:38.887478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:38.893147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:39.012139 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb338c5f-fea9-4675-9a07-4202e343d9e0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 328 microversion: 2.1 time: 0.333721 Oct 03 10:41:39.014306 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1298/2737] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:41:38 2022] PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 328 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:39.114155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1194554176", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:39.201476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:41:39.223706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:39.237492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68982c48-d6f7-49b3-b65b-30e57a795c71 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1276 microversion: 2.1 time: 0.397251 Oct 03 10:41:39.238818 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1440/2738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:38 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1276 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:39.256641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-13451905-e7e2-4fc5-93e1-91505922d776 req-c9872c9f-4f58-4e62-ba7b-53a5c2dc522a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "829b5797-cf23-4334-85f8-8196dcc8acd1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:39.278100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-13451905-e7e2-4fc5-93e1-91505922d776 req-c9872c9f-4f58-4e62-ba7b-53a5c2dc522a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:39.279675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-13451905-e7e2-4fc5-93e1-91505922d776 req-c9872c9f-4f58-4e62-ba7b-53a5c2dc522a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:39.282405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-13451905-e7e2-4fc5-93e1-91505922d776 req-c9872c9f-4f58-4e62-ba7b-53a5c2dc522a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:39.317088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-13451905-e7e2-4fc5-93e1-91505922d776 req-c9872c9f-4f58-4e62-ba7b-53a5c2dc522a service nova] Creating event network-changed:829b5797-cf23-4334-85f8-8196dcc8acd1 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:41:39.333645 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-13451905-e7e2-4fc5-93e1-91505922d776 req-c9872c9f-4f58-4e62-ba7b-53a5c2dc522a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088374 Oct 03 10:41:39.337685 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1441/2739] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:39.443115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:39.443115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:39.485090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:39.486018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:39.486815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:39.487900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:39.497880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:39.498938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:39.996475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:40.009522 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-806b4062-7557-449b-9d17-7e1a59cbf7ce tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1518 microversion: 2.1 time: 0.581226 Oct 03 10:41:40.024870 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1442/2740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:39 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1518 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:41:40.024870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:40.024870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:40.035775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:40.042590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:40.043075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:40.052033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:40.052525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:40.053010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:40.811581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:40.826319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:40.829624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:40.831113 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-90dba60b-3892-4f72-ac56-684e578d5836 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.818184 Oct 03 10:41:40.832410 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1443/2741] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:40 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:40.839635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4ad5f1e2-2605-463c-b2fa-132520626f84 req-380a6c18-5a7c-4d3e-9858-feba70f72764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e896961d-f325-41ba-8ab5-c98cdaba723e", "name": "network-vif-plugged", "status": "completed", "tag": "e32a934e-4dad-4114-9fdc-c285f563cfc3"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:40.851366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4ad5f1e2-2605-463c-b2fa-132520626f84 req-380a6c18-5a7c-4d3e-9858-feba70f72764 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:40.852398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4ad5f1e2-2605-463c-b2fa-132520626f84 req-380a6c18-5a7c-4d3e-9858-feba70f72764 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:40.853981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4ad5f1e2-2605-463c-b2fa-132520626f84 req-380a6c18-5a7c-4d3e-9858-feba70f72764 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:40.886861 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4ad5f1e2-2605-463c-b2fa-132520626f84 req-380a6c18-5a7c-4d3e-9858-feba70f72764 service nova] Creating event network-vif-plugged:e32a934e-4dad-4114-9fdc-c285f563cfc3 for instance e896961d-f325-41ba-8ab5-c98cdaba723e on n-h1-858383-3 Oct 03 10:41:40.900211 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4ad5f1e2-2605-463c-b2fa-132520626f84 req-380a6c18-5a7c-4d3e-9858-feba70f72764 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066338 Oct 03 10:41:40.902867 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1444/2742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:40.915816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:40.916521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:40.938185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:40.939655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:40.940121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:40.941133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:40.941601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:40.942033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:41.348836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:41:41.349382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:41:41.349717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:41:41.350122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:41:41.350586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:41:41.383017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:41.383513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:41.383942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:41.384665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:41.385215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:41.385637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:41.439880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Getting quotas for project 74ce340adbd44b07ad0037afc69302f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:41:41.448976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Getting quotas for user f2cb0f3783a64755b74efecad927876d and project 74ce340adbd44b07ad0037afc69302f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:41:41.482131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:41.494011 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59da71b6-ba80-48cc-8d7d-2e3153d7d1db tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.589701 Oct 03 10:41:41.497962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.utils [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] instances quota exceeded for 74ce340adbd44b07ad0037afc69302f9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122270) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 03 10:41:41.499883 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 10:41:41.502034 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1445/2743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:40 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Request method failure captured: Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 145 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxcMvIhSK7tbChCF8UTeysKVqPbd79ILZUWnSjdcXnq0ZSjBSe9NBcYje6MzBRWmAIWbNzj2ZScC_rsHrSAs9h5iGotJ5dTNgzs_35DyihoFb7w4FmqVn5nBrc7PKne0gG96fYQLKd030E3YbiYGBojnumexBeJrP2GoA0r_GB7fzI Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}] Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f2cb0f3783a64755b74efecad927876d Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1194554176", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1194554176', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452'}}} Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:41:41.505548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 10:41:41.510821 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.514990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba375ecd-aa00-4d28-b26e-852f82baec91 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-683658873", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:41.518390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:41.519309 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bfeada91-f5d5-48d6-83d3-9720ff8cc27c tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 2.410268 Oct 03 10:41:41.519898 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1299/2744] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:39 2022] POST /compute/v2.1/servers => generated 119 bytes in 2412 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba375ecd-aa00-4d28-b26e-852f82baec91 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 242 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-683658873", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-683658873', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'da7c1e20-4575-4bdb-81a4-8af3a57e8ce6'}]}}} Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:41.529747 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba375ecd-aa00-4d28-b26e-852f82baec91 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:41.534343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba375ecd-aa00-4d28-b26e-852f82baec91 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.028241 Oct 03 10:41:41.541128 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1446/2745] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:41 2022] POST /compute/v2.1/servers => generated 175 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:41:41.548431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:41.549093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:41.566718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Action: 'update', calling method: .version_select at 0x7f074e546c10>, body: {"quota_set": {"instances": 10}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:41.581917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:41.588281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:41.588758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:41.589541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:41.590012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:41.590441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:41.711715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:41.712469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:41.713749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:41.714769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:41.715464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:41.716122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:41.809373 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-999956b3-e457-4b52-80ba-4d2b75952e51 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 329 microversion: 2.1 time: 0.260925 Oct 03 10:41:41.811063 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1447/2746] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:41:41 2022] PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 329 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:41.823897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-baf784f6-15c2-46f7-a2e1-43a56c43c8b5 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:41.825481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-baf784f6-15c2-46f7-a2e1-43a56c43c8b5 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: 42e8ac2d-685e-4cca-9bfe-afbb23566840] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:41.832388 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-baf784f6-15c2-46f7-a2e1-43a56c43c8b5 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] HTTP exception thrown: Instance 42e8ac2d-685e-4cca-9bfe-afbb23566840 could not be found. Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-baf784f6-15c2-46f7-a2e1-43a56c43c8b5 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/42e8ac2d-685e-4cca-9bfe-afbb23566840/metadata HTTP/1.1 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 42e8ac2d-685e-4cca-9bfe-afbb23566840 could not be found. Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '42e8ac2d-685e-4cca-9bfe-afbb23566840'} Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e8ac2d-685e-4cca-9bfe-afbb23566840 could not be found. Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e8ac2d-685e-4cca-9bfe-afbb23566840 could not be found. Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:41.839214 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:41.843900 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:41:41.843900 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:41:41.843900 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e8ac2d-685e-4cca-9bfe-afbb23566840 could not be found. Oct 03 10:41:41.843900 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:41.844748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-baf784f6-15c2-46f7-a2e1-43a56c43c8b5 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 404 to user: Instance 42e8ac2d-685e-4cca-9bfe-afbb23566840 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:41.849033 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-baf784f6-15c2-46f7-a2e1-43a56c43c8b5 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/42e8ac2d-685e-4cca-9bfe-afbb23566840/metadata" status: 404 len: 111 microversion: 2.1 time: 0.033661 Oct 03 10:41:41.849981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1448/2747] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:41:41 2022] GET /compute/v2.1/servers/42e8ac2d-685e-4cca-9bfe-afbb23566840/metadata => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:41.860207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22c472a8-b567-4819-a9b5-7879040d9ffe tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Calling method '.version_select at 0x7f074e4d01f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:41.991619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22c472a8-b567-4819-a9b5-7879040d9ffe tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 371 microversion: 2.1 time: 0.136900 Oct 03 10:41:41.992829 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1449/2748] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 10:41:41 2022] GET /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:41.999417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:42.000213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:42.012415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:42.013222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:42.013846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:42.014732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:42.015338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:42.015918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:42.362179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:42.372086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:42.373584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:42.374760 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-905ca81a-b95f-4a04-bcb7-a4221127c8cb tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.380820 Oct 03 10:41:42.375348 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1450/2749] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:41 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:42.389015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6ea44b4-2705-4b6c-b025-963cb69db6a4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1699178902", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6ea44b4-2705-4b6c-b025-963cb69db6a4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 499 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1699178902", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1699178902', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'da7c1e20-4575-4bdb-81a4-8af3a57e8ce6'}]}}} Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:41:42.397871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.401350 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.404587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6ea44b4-2705-4b6c-b025-963cb69db6a4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:42.405716 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b6ea44b4-2705-4b6c-b025-963cb69db6a4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.023014 Oct 03 10:41:42.406446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1451/2750] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:42 2022] POST /compute/v2.1/servers => generated 687 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:41:42.420928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Action: 'update', calling method: .version_select at 0x7f074f257dc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:42.512431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:42.512953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:42.513612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:42.515028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:42.515671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:42.516102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:42.599183 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f64906f3-94e2-40ac-aa80-ac28560716c0 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 325 microversion: 2.1 time: 0.182737 Oct 03 10:41:42.601261 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1452/2751] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:41:42 2022] PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 325 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:42.611665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8734dd72-fb59-4a01-96e2-799a5679a782 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-758863389", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8734dd72-fb59-4a01-96e2-799a5679a782 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 499 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-758863389", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-758863389', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'da7c1e20-4575-4bdb-81a4-8af3a57e8ce6'}]}}} Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:41:42.626478 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8734dd72-fb59-4a01-96e2-799a5679a782 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:42.629902 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8734dd72-fb59-4a01-96e2-799a5679a782 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025243 Oct 03 10:41:42.639756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1453/2752] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:42 2022] POST /compute/v2.1/servers => generated 689 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:41:42.639756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:42.639756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:42.652669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:42.653828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:42.653828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:42.654347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:42.654800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:42.655233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:42.925478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:42.940164 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-50da9aa7-debf-498a-8e47-42e6f66cdffa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1324 microversion: 2.1 time: 0.299292 Oct 03 10:41:42.943514 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1454/2753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:42 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:42.967658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1583768344", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:43.051800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:41:43.054434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:43.064115 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-425e1da2-d177-4d79-96f0-e138c1ca5973 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1318 microversion: 2.1 time: 1.536176 Oct 03 10:41:43.065019 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1300/2754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:41 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1318 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:43.071622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d57b3f2d-3e5a-4f61-a122-681ca7ecc31e tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-937116313", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d57b3f2d-3e5a-4f61-a122-681ca7ecc31e tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 753 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-937116313", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-937116313', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'da7c1e20-4575-4bdb-81a4-8af3a57e8ce6'}]}}} Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:41:43.076580 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:41:43.079621 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:41:43.082060 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.082060 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.083283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d57b3f2d-3e5a-4f61-a122-681ca7ecc31e tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:43.084323 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d57b3f2d-3e5a-4f61-a122-681ca7ecc31e tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.017184 Oct 03 10:41:43.094417 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1301/2755] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:43 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 03 10:41:43.157563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-308c82ff-6614-4e52-bc8a-0a35282b910a tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1221767886", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-308c82ff-6614-4e52-bc8a-0a35282b910a tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 1266 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1221767886", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "da7c1e20-4575-4bdb-81a4-8af3a57e8ce6"}]}} Oct 03 10:41:43.163642 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1221767886', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'da7c1e20-4575-4bdb-81a4-8af3a57e8ce6'}]}}} Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.166978 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:41:43.168235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:41:43.170282 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 10:41:43.170282 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.170282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-308c82ff-6614-4e52-bc8a-0a35282b910a tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:43.173665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-308c82ff-6614-4e52-bc8a-0a35282b910a tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.019877 Oct 03 10:41:43.180806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1302/2756] 10.222.0.27 () {60 vars in 1148 bytes} [Mon Oct 3 10:41:43 2022] POST /compute/v2.1/servers => generated 2221 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 03 10:41:43.189501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63191e5b-6240-40db-89f7-5c20b60632c4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:43.190000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63191e5b-6240-40db-89f7-5c20b60632c4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: 7d0f1646-48ba-463e-aef0-3ebe057355f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:43.198678 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-63191e5b-6240-40db-89f7-5c20b60632c4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] HTTP exception thrown: Instance 7d0f1646-48ba-463e-aef0-3ebe057355f4 could not be found. Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63191e5b-6240-40db-89f7-5c20b60632c4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/7d0f1646-48ba-463e-aef0-3ebe057355f4/metadata/test2 HTTP/1.1 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 7d0f1646-48ba-463e-aef0-3ebe057355f4 could not be found. Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': '7d0f1646-48ba-463e-aef0-3ebe057355f4', 'id': 'test2'} Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0f1646-48ba-463e-aef0-3ebe057355f4 could not be found. Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0f1646-48ba-463e-aef0-3ebe057355f4 could not be found. Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.200615 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.204423 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:41:43.204423 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:41:43.204423 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0f1646-48ba-463e-aef0-3ebe057355f4 could not be found. Oct 03 10:41:43.204423 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.204423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63191e5b-6240-40db-89f7-5c20b60632c4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 404 to user: Instance 7d0f1646-48ba-463e-aef0-3ebe057355f4 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:43.204423 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63191e5b-6240-40db-89f7-5c20b60632c4 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/7d0f1646-48ba-463e-aef0-3ebe057355f4/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.018822 Oct 03 10:41:43.204423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1303/2757] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 3 10:41:43 2022] GET /compute/v2.1/servers/7d0f1646-48ba-463e-aef0-3ebe057355f4/metadata/test2 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:43.224756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:43.225494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:43.238666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.239530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.240177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:43.241449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.242919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.243911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:43.316276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:41:43.519620 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb95a0ec-1899-417e-b45e-efe4982eeb55 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 204 len: 0 microversion: 2.1 time: 0.298553 Oct 03 10:41:43.521004 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1304/2758] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:41:43 2022] DELETE /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:41:43.529148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:43.537743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:43.548108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.548872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.549591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:43.550730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.551381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.551974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:43.632167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:41:43.633489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:41:43.634301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:41:43.634880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:41:43.635453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:41:43.663349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.663846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.664872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:43.666045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.666666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.667244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:43.700249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Getting quotas for project 74ce340adbd44b07ad0037afc69302f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:41:43.709199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Getting quotas for user f2cb0f3783a64755b74efecad927876d and project 74ce340adbd44b07ad0037afc69302f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:41:43.739799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.utils [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] ram quota exceeded for 74ce340adbd44b07ad0037afc69302f9, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122269) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 03 10:41:43.740371 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Request method failure captured: Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 145 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxcMvIhSK7tbChCF8UTeysKVqPbd79ILZUWnSjdcXnq0ZSjBSe9NBcYje6MzBRWmAIWbNzj2ZScC_rsHrSAs9h5iGotJ5dTNgzs_35DyihoFb7w4FmqVn5nBrc7PKne0gG96fYQLKd030E3YbiYGBojnumexBeJrP2GoA0r_GB7fzI Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}] Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: f2cb0f3783a64755b74efecad927876d Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1583768344", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1583768344', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452'}}} Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:41:43.744582 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:43.749171 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d20055e2-1171-4c6a-92fe-15f6f257a267 tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.787455 Oct 03 10:41:43.752157 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1455/2759] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:42 2022] POST /compute/v2.1/servers => generated 110 bytes in 808 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:43.760366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:43.761023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:43.774222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.774713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.775147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:43.775850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:43.780651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:43.781342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.299342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48e756911b24c6ab2d309ff46b705d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa3cb4384e24f40aeaba5316f58a1a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:44.310249 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c817634e-3e09-49ed-bda6-f90b0370acb2 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 200 len: 1524 microversion: 2.1 time: 0.557032 Oct 03 10:41:44.310829 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1456/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:43 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 1524 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:44.320066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Action: 'update', calling method: .version_select at 0x7f074e4c6e50>, body: {"quota_set": {"ram": 51200}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:44.394185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.394676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.395114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.395842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.396411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.396861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.488550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:44.502562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b1bea45-0ea0-49db-8dea-f7ddc6517589 tempest-QuotasAdminNegativeTest-1532619084 tempest-QuotasAdminNegativeTest-1532619084-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 200 len: 329 microversion: 2.1 time: 0.188911 Oct 03 10:41:44.512497 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1457/2761] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:41:44 2022] PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 329 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:44.525733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:44.526755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:44.536187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.537012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.537713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.538693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.539443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.540434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.571173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:44.591588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:44.605548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:44.607100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:44.608284 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-76fe9f4d-0ac5-45a5-9c53-763ee2262965 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.085702 Oct 03 10:41:44.609087 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1305/2762] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:43 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:44.613708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:44.614309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:44.627428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.628193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.629009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.638315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.639207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.639968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.897253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:44.909680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3c69d0f5-3146-4f13-8d03-f38f126bfcd5 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 200 len: 1521 microversion: 2.1 time: 0.395345 Oct 03 10:41:44.910901 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1458/2763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:44 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:44.923947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e03e62d-5f00-48dc-a439-90be6e37410b tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Action: 'update', calling method: .version_select at 0x7f074e513940>, body: {"quota_set": {"ram": 0}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:44.932363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1e03e62d-5f00-48dc-a439-90be6e37410b tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f2cb0f3783a64755b74efecad927876d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ce340adbd44b07ad0037afc69302f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e03e62d-5f00-48dc-a439-90be6e37410b tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Request method failure captured: Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 HTTP/1.1 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 25 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxcMvIhSK7tbChCF8UTeysKVqPbd79ILZUWnSjdcXnq0ZSjBSe9NBcYje6MzBRWmAIWbNzj2ZScC_rsHrSAs9h5iGotJ5dTNgzs_35DyihoFb7w4FmqVn5nBrc7PKne0gG96fYQLKd030E3YbiYGBojnumexBeJrP2GoA0r_GB7fzI Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/74ce340adbd44b07ad0037afc69302f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/74ce340adbd44b07ad0037afc69302f9"}]}] Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 74ce340adbd44b07ad0037afc69302f9 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-715290028 Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: f2cb0f3783a64755b74efecad927876d Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-QuotasAdminNegativeTest-715290028-project Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: {"quota_set": {"ram": 0}} Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '74ce340adbd44b07ad0037afc69302f9', 'body': {'quota_set': {'ram': 0}}} Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 10:41:44.940648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 03 10:41:44.945008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:44.948558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e03e62d-5f00-48dc-a439-90be6e37410b tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:44.949518 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e03e62d-5f00-48dc-a439-90be6e37410b tempest-QuotasAdminNegativeTest-715290028 tempest-QuotasAdminNegativeTest-715290028-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9" status: 403 len: 116 microversion: 2.1 time: 0.036983 Oct 03 10:41:44.950158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1459/2764] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:41:44 2022] PUT /compute/v2.1/os-quota-sets/74ce340adbd44b07ad0037afc69302f9 => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:44.955297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'action', calling method: .version_select at 0x7f07558db8b0>, body: {"addFloatingIp": {"address": "172.25.2.178"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:44.958628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:44.967936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.969752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.970377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:44.975877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:44.977010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:44.977638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:45.089374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:41:45.090001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquired lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:41:45.900297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:45.911635 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0c821161-ac3a-49a1-9d82-d1f2e85200b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1318 microversion: 2.1 time: 1.301626 Oct 03 10:41:45.912490 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1306/2765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:44 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1318 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:46.226222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1597121842", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "154cf415-1c40-42a9-bfa5-99c4a7b477bb"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:46.339380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] validate_networks() for [('154cf415-1c40-42a9-bfa5-99c4a7b477bb', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:41:47.693708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Building network info cache for instance {{(pid=122269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:41:49.248452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Updating instance_info_cache with network_info: [{"id": "40bcc76d-c520-4e63-956b-c3bb2c191671", "address": "fa:16:3e:54:ee:36", "network": {"id": "fb857a83-42b3-4a53-b589-5a253a5b0340", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1435014573-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b286477b323a4b88adf18567d28f55e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap40bcc76d-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:41:49.283319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:41:49.285251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:41:49.287072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:41:49.288651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:41:49.291076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:41:49.307763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Releasing lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:41:49.311427 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3ce0ad5-a9f3-4b47-b6c7-34f624d96c21 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action" status: 202 len: 0 microversion: 2.1 time: 4.359304 Oct 03 10:41:49.317423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1460/2766] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:41:44 2022] POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action => generated 0 bytes in 4365 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:41:49.343420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:49.344817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.347775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.348677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] [instance: cb441072-dd67-4669-8e53-741d5416b113] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:49.350566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.356389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.359111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.360559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.382266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.384572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.386017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.387712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.388890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.390414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.427042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:41:49.451445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] HTTP exception thrown: Instance cb441072-dd67-4669-8e53-741d5416b113 could not be found. Oct 03 10:41:49.454044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for user 51cf916cbc904a6a97066fe7af1b3bae and project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Request method failure captured: Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 HTTP/1.1 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxKCeganRjCWFFTe4M-7z4ydhsSKYy-8JusC5bbTVJKo493g5lRQMngaOMPHpYK3JcGabZg6F6BKuB9vJ-RovR-yE9VJdWeFk7GlI_IoMM7_YrYc3gmZUk9ARXT3ow4MeBYBFSuIGpgk8goQ1Y99MWvqK7aRdn9S1CvdYYahklHmyo Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7aa3cb4384e24f40aeaba5316f58a1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7aa3cb4384e24f40aeaba5316f58a1a7"}]}] Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7aa3cb4384e24f40aeaba5316f58a1a7 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-458645575 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d48e756911b24c6ab2d309ff46b705d6 Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-458645575-project Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance cb441072-dd67-4669-8e53-741d5416b113 could not be found. Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'cb441072-dd67-4669-8e53-741d5416b113'} Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb441072-dd67-4669-8e53-741d5416b113 could not be found. Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb441072-dd67-4669-8e53-741d5416b113 could not be found. Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:49.459301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb441072-dd67-4669-8e53-741d5416b113 could not be found. Oct 03 10:41:49.472337 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:41:49.478103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] Returning 404 to user: Instance cb441072-dd67-4669-8e53-741d5416b113 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:41:49.478915 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66c5cd74-7c7c-4fb1-a207-f09cd55a6a70 tempest-ServerMetadataNegativeTestJSON-458645575 tempest-ServerMetadataNegativeTestJSON-458645575-project] 10.222.0.27 "GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113" status: 404 len: 111 microversion: 2.1 time: 0.156610 Oct 03 10:41:49.481170 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1461/2767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:49 2022] GET /compute/v2.1/servers/cb441072-dd67-4669-8e53-741d5416b113 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:41:49.489979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:41:49.495840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:41:49.499864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:49.501638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:49.519090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.520569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.523138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.524944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.526197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.528234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.603361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1008d05-5823-4225-be61-03a0d57fa06c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.670875 Oct 03 10:41:49.611421 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1307/2768] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:41:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:41:49.616584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e985af60-59d4-4aa5-9529-cc99f5b3362e req-d11ef408-df83-42a6-b223-8c948aed2730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "5db7d0c4-80d9-4ba7-945d-4a98f691fe43"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:49.667544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e985af60-59d4-4aa5-9529-cc99f5b3362e req-d11ef408-df83-42a6-b223-8c948aed2730 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.668261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e985af60-59d4-4aa5-9529-cc99f5b3362e req-d11ef408-df83-42a6-b223-8c948aed2730 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.668898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e985af60-59d4-4aa5-9529-cc99f5b3362e req-d11ef408-df83-42a6-b223-8c948aed2730 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.693954 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e985af60-59d4-4aa5-9529-cc99f5b3362e req-d11ef408-df83-42a6-b223-8c948aed2730 service nova] Creating event network-changed:5db7d0c4-80d9-4ba7-945d-4a98f691fe43 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:41:49.708191 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e985af60-59d4-4aa5-9529-cc99f5b3362e req-d11ef408-df83-42a6-b223-8c948aed2730 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095214 Oct 03 10:41:49.709484 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1308/2769] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:49.715776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f2bd1d85-c0b6-4d8e-b06b-1c73dd78afdb req-627f2261-3133-4488-afb4-8e18c3462fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb441072-dd67-4669-8e53-741d5416b113", "name": "network-vif-deleted", "tag": "64c23ddf-80e9-4d2c-9411-25c69041982f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:49.755749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f2bd1d85-c0b6-4d8e-b06b-1c73dd78afdb req-627f2261-3133-4488-afb4-8e18c3462fae service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.756443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f2bd1d85-c0b6-4d8e-b06b-1c73dd78afdb req-627f2261-3133-4488-afb4-8e18c3462fae service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.758382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f2bd1d85-c0b6-4d8e-b06b-1c73dd78afdb req-627f2261-3133-4488-afb4-8e18c3462fae service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.785106 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f2bd1d85-c0b6-4d8e-b06b-1c73dd78afdb req-627f2261-3133-4488-afb4-8e18c3462fae service nova] Creating event network-vif-deleted:64c23ddf-80e9-4d2c-9411-25c69041982f for instance cb441072-dd67-4669-8e53-741d5416b113 on n-h2-858383-3 Oct 03 10:41:49.794902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f2bd1d85-c0b6-4d8e-b06b-1c73dd78afdb req-627f2261-3133-4488-afb4-8e18c3462fae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083614 Oct 03 10:41:49.795747 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1309/2770] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:49.810756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:49.811796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:49.832886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.833740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.834367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:49.835266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:49.836466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:49.837108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:50.339890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:50.352479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:50.356752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:50.358007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-35b4da9a-5b5c-4b06-a964-6edbd59c4825 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.871882 Oct 03 10:41:50.358560 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1462/2771] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:49 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:50.369236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.178"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:50.376258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:50.412599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:50.417253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:50.418968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:50.426679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:50.429923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:50.432529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:50.539336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "refresh_cache-e896961d-f325-41ba-8ab5-c98cdaba723e" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:41:50.539844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquired lock "refresh_cache-e896961d-f325-41ba-8ab5-c98cdaba723e" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:41:51.551978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:51.568297 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a076eb06-dd6e-424c-924b-1d291c08cafa tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1318 microversion: 2.1 time: 1.766186 Oct 03 10:41:51.596333 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1310/2772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:49 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1318 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:51.611123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:51.612345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:51.638985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:51.640524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:51.644192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:51.649620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:51.650706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:51.651188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:51.651635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:51.827144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:51.842632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e4f20fe4-fe87-4e1f-a166-49dbd8213061 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1260 microversion: 2.1 time: 0.245052 Oct 03 10:41:51.843887 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1311/2773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:51 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:51.852817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:51.860532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:51.872393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:51.873297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:51.874087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:51.875078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:51.875889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:51.883093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:52.980083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:53.004877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:53.007165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:53.008444 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ff6718e-15c1-43a6-9c30-7f93baf8cf34 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.163384 Oct 03 10:41:53.009396 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1312/2774] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:51 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:53.015237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-22536547-0a2f-4a79-a6e9-952f34c3f59e req-9c3fbde0-58d9-4b79-a654-01b84207d1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acc23cd-7f72-431b-b377-dc2d9dc5fdec", "tag": "40bcc76d-c520-4e63-956b-c3bb2c191671"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:53.058207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-22536547-0a2f-4a79-a6e9-952f34c3f59e req-9c3fbde0-58d9-4b79-a654-01b84207d1d3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:53.058885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-22536547-0a2f-4a79-a6e9-952f34c3f59e req-9c3fbde0-58d9-4b79-a654-01b84207d1d3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:53.059470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-22536547-0a2f-4a79-a6e9-952f34c3f59e req-9c3fbde0-58d9-4b79-a654-01b84207d1d3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:53.076318 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-22536547-0a2f-4a79-a6e9-952f34c3f59e req-9c3fbde0-58d9-4b79-a654-01b84207d1d3 service nova] Creating event network-changed:40bcc76d-c520-4e63-956b-c3bb2c191671 for instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec on n-h1-858383-3 Oct 03 10:41:53.082174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-22536547-0a2f-4a79-a6e9-952f34c3f59e req-9c3fbde0-58d9-4b79-a654-01b84207d1d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071360 Oct 03 10:41:53.083165 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1313/2775] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:53.089777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d27c21bd-4a79-4c81-8d28-208f99e98165 req-fc6876c4-3a1f-48d6-9355-7ec54d0c4b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c723ca0a-4535-4646-8c75-7faf0a86d96b", "tag": "640107ef-8d9b-422f-a66d-416bfe6f2d27"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:53.102354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d27c21bd-4a79-4c81-8d28-208f99e98165 req-fc6876c4-3a1f-48d6-9355-7ec54d0c4b90 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:53.103241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d27c21bd-4a79-4c81-8d28-208f99e98165 req-fc6876c4-3a1f-48d6-9355-7ec54d0c4b90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:53.104136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d27c21bd-4a79-4c81-8d28-208f99e98165 req-fc6876c4-3a1f-48d6-9355-7ec54d0c4b90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:53.125850 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d27c21bd-4a79-4c81-8d28-208f99e98165 req-fc6876c4-3a1f-48d6-9355-7ec54d0c4b90 service nova] Creating event network-changed:640107ef-8d9b-422f-a66d-416bfe6f2d27 for instance c723ca0a-4535-4646-8c75-7faf0a86d96b on n-h1-858383-3 Oct 03 10:41:53.131992 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d27c21bd-4a79-4c81-8d28-208f99e98165 req-fc6876c4-3a1f-48d6-9355-7ec54d0c4b90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046971 Oct 03 10:41:53.133926 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1314/2776] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:53.140962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:53.142162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:53.151091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:53.152008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:53.152697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:53.153895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:53.159910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:53.160753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:54.372173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:54.385536 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f752451d-b50b-4aeb-b479-fe87a5628c7d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1318 microversion: 2.1 time: 1.247436 Oct 03 10:41:54.401901 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1315/2777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:53 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1318 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:54.412752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:54.416998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:54.417622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:54.435930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:54.436723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:54.437408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:54.438297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:54.438925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:54.439520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:54.494610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=56 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:54.676462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:54.690825 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e5c897d-5de1-4c80-bc17-2c6f8204feb3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1266 microversion: 2.1 time: 0.287277 Oct 03 10:41:54.704478 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1316/2778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:54 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:54.990561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e6ef5ea-6645-47cb-8327-f1e3ffe22920 tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] Action: 'create', calling method: .version_select at 0x7f074e52f9d0>, body: {"security_group": {"name": "tempest-securitygroup-1110774678", "description": "tempest-description-526907369"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:57.564405 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e6ef5ea-6645-47cb-8327-f1e3ffe22920 tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.864751 Oct 03 10:41:57.572601 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1317/2779] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:41:54 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:57.598855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:57.599178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:57.601740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.network.neutron [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] re-assign floating IP 172.25.2.178 from instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec Oct 03 10:41:57.623825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:57.630833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:57.631550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:57.632885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:57.633362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:57.633803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:57.704547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Building network info cache for instance {{(pid=122269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:41:58.278521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:58.294540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:58.295645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:58.296919 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bfbaacde-d050-4d8e-8724-c815c3dd213d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.722581 Oct 03 10:41:58.313785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1318/2780] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:41:57 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:41:58.322387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:58.323445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:58.330693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:58.331535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:58.332290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:58.333458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:58.334119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:58.334880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:59.024931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:59.037865 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf7ac416-1f0c-43f8-b80e-ed1fc22b941e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1318 microversion: 2.1 time: 0.722545 Oct 03 10:41:59.039643 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1319/2781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:58 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:59.045305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:41:59.046328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:41:59.052953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:59.053727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:59.054589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:59.055474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:59.056324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:59.057017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:59.392203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:59.470602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=30 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:59.522492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:41:59.532522 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-381fcc92-1a3c-4dc1-9fec-fa858b64dbca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1308 microversion: 2.1 time: 0.491215 Oct 03 10:41:59.550919 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1320/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:41:59 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:41:59.561146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-87e0b5ee-ce3e-471b-a90a-37bbf996e3c6 req-1a533985-5edd-4799-b89c-12a7afbdb0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "1a182135-8788-4ba3-9eac-9ff7eb73a8c8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:59.590307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-87e0b5ee-ce3e-471b-a90a-37bbf996e3c6 req-1a533985-5edd-4799-b89c-12a7afbdb0bc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:59.590954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-87e0b5ee-ce3e-471b-a90a-37bbf996e3c6 req-1a533985-5edd-4799-b89c-12a7afbdb0bc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:59.591554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-87e0b5ee-ce3e-471b-a90a-37bbf996e3c6 req-1a533985-5edd-4799-b89c-12a7afbdb0bc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:59.605423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:41:59.610594 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-87e0b5ee-ce3e-471b-a90a-37bbf996e3c6 req-1a533985-5edd-4799-b89c-12a7afbdb0bc service nova] Creating event network-changed:1a182135-8788-4ba3-9eac-9ff7eb73a8c8 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:41:59.618238 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-87e0b5ee-ce3e-471b-a90a-37bbf996e3c6 req-1a533985-5edd-4799-b89c-12a7afbdb0bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064843 Oct 03 10:41:59.619594 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1321/2783] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:59.625719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e78a6ce0-2786-481a-b798-f447990f218a req-ee8fcf84-8590-4a72-ba09-bc59370836b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acc23cd-7f72-431b-b377-dc2d9dc5fdec", "tag": "40bcc76d-c520-4e63-956b-c3bb2c191671"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:41:59.642762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e78a6ce0-2786-481a-b798-f447990f218a req-ee8fcf84-8590-4a72-ba09-bc59370836b1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:41:59.643732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e78a6ce0-2786-481a-b798-f447990f218a req-ee8fcf84-8590-4a72-ba09-bc59370836b1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:41:59.644501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e78a6ce0-2786-481a-b798-f447990f218a req-ee8fcf84-8590-4a72-ba09-bc59370836b1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:41:59.666063 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e78a6ce0-2786-481a-b798-f447990f218a req-ee8fcf84-8590-4a72-ba09-bc59370836b1 service nova] Creating event network-changed:40bcc76d-c520-4e63-956b-c3bb2c191671 for instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec on n-h1-858383-3 Oct 03 10:41:59.674680 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e78a6ce0-2786-481a-b798-f447990f218a req-ee8fcf84-8590-4a72-ba09-bc59370836b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053218 Oct 03 10:41:59.676355 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1322/2784] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:41:59.688408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ccc88457-766a-4b60-b541-18a66262010b tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] Action: 'create', calling method: .version_select at 0x7f074e48e310>, body: {"security_group": {"name": "tempest-securitygroup-524447096", "description": "tempest-description-295721389"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:00.387425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:01.022613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Updating instance_info_cache with network_info: [{"id": "40bcc76d-c520-4e63-956b-c3bb2c191671", "address": "fa:16:3e:54:ee:36", "network": {"id": "fb857a83-42b3-4a53-b589-5a253a5b0340", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1435014573-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b286477b323a4b88adf18567d28f55e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap40bcc76d-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:42:01.049763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Building network info cache for instance {{(pid=122269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:42:01.754208 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ccc88457-766a-4b60-b541-18a66262010b tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.074811 Oct 03 10:42:01.767536 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1323/2785] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:41:59 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:01.785054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:01.785054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:01.806752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:01.809289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:01.809814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:01.812686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:01.813275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:01.813741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:02.878795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:02.898898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:02.902753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:02.906428 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99c15d0a-58aa-4f57-9aed-7e5e29b26a4b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.136647 Oct 03 10:42:02.908345 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1324/2786] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:01 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:02.936822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:02.943269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:02.976754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:02.979482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:02.982910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:02.986289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:02.989633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:02.996736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:03.537436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:03.559168 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c23e4c7-4c22-46c7-9d41-33948de4742b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1318 microversion: 2.1 time: 0.648177 Oct 03 10:42:03.560083 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1325/2787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:02 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:03.572085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:03.573226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:03.582913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:03.593322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:03.595994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:03.597528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:03.599209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:03.601349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:04.007253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:04.008441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Updating instance_info_cache with network_info: [{"id": "e32a934e-4dad-4114-9fdc-c285f563cfc3", "address": "fa:16:3e:77:b1:2a", "network": {"id": "fb857a83-42b3-4a53-b589-5a253a5b0340", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1435014573-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b286477b323a4b88adf18567d28f55e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape32a934e-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:42:04.020166 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d3bb469-21aa-4fa0-9523-aa0665b351f0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1308 microversion: 2.1 time: 0.458590 Oct 03 10:42:04.027594 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1326/2788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:03 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:04.043719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Releasing lock "refresh_cache-e896961d-f325-41ba-8ab5-c98cdaba723e" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:42:04.046644 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e900e2d-2980-45cf-9d36-9383eb84b892 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e/action" status: 202 len: 0 microversion: 2.1 time: 13.679676 Oct 03 10:42:04.050610 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1463/2789] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:41:50 2022] POST /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e/action => generated 0 bytes in 13686 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:42:04.069514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-328f4b16-e264-4eff-a4be-230a44ddb4d0 req-9737d35a-3bbb-4a80-abe6-180d76db8c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e896961d-f325-41ba-8ab5-c98cdaba723e", "tag": "e32a934e-4dad-4114-9fdc-c285f563cfc3"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:04.110579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-328f4b16-e264-4eff-a4be-230a44ddb4d0 req-9737d35a-3bbb-4a80-abe6-180d76db8c47 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:04.111380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-328f4b16-e264-4eff-a4be-230a44ddb4d0 req-9737d35a-3bbb-4a80-abe6-180d76db8c47 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:04.112099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-328f4b16-e264-4eff-a4be-230a44ddb4d0 req-9737d35a-3bbb-4a80-abe6-180d76db8c47 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:04.134644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-88efc7a5-5654-4c0e-bbcc-723eb4f76415 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'create', calling method: .version_select at 0x7f074e48edc0>, body: {"keypair": {"name": "tempest-keypair-1357729622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTlRaOEb2SGI9pSYptbrBQgUlLAIxqiXYYIJk+fsH4irMmi24GQQKc1FbXwYeIc/oGTdBuDNppblUR26CamBdIN4qIG6+1LKD+7UJrtAnwJBbaSr90tXUlN+/4cBTaL9A=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:04.168322 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-328f4b16-e264-4eff-a4be-230a44ddb4d0 req-9737d35a-3bbb-4a80-abe6-180d76db8c47 service nova] Creating event network-changed:e32a934e-4dad-4114-9fdc-c285f563cfc3 for instance e896961d-f325-41ba-8ab5-c98cdaba723e on n-h1-858383-3 Oct 03 10:42:04.180320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-88efc7a5-5654-4c0e-bbcc-723eb4f76415 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:04.193771 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-328f4b16-e264-4eff-a4be-230a44ddb4d0 req-9737d35a-3bbb-4a80-abe6-180d76db8c47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140056 Oct 03 10:42:04.198245 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1464/2790] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:04.210855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-88efc7a5-5654-4c0e-bbcc-723eb4f76415 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for user 95e90959ca07488e9a3960f7e49c99f1 and project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:04.277772 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-88efc7a5-5654-4c0e-bbcc-723eb4f76415 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.248489 Oct 03 10:42:04.284800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1327/2791] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:42:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 252 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:42:04.297351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b313f2bf-2ee2-4680-99c4-ef3b24fcaa82 req-90797541-609b-4dc7-ae45-2732ad213777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59342ad5-604b-486f-9d3f-aaf03ef28462", "tag": "57d1d845-8d04-4acb-8acc-e009744876a7"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:04.326307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b313f2bf-2ee2-4680-99c4-ef3b24fcaa82 req-90797541-609b-4dc7-ae45-2732ad213777 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:04.327068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b313f2bf-2ee2-4680-99c4-ef3b24fcaa82 req-90797541-609b-4dc7-ae45-2732ad213777 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:04.327776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b313f2bf-2ee2-4680-99c4-ef3b24fcaa82 req-90797541-609b-4dc7-ae45-2732ad213777 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:04.332118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b90e0bfa-12ae-4f18-8a6a-dfc6be0936a0 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] Action: 'create', calling method: .version_select at 0x7f074e55b820>, body: {"security_group": {"name": "tempest-securitygroup-1159634898", "description": "tempest-description-1192634308"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:04.345680 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b313f2bf-2ee2-4680-99c4-ef3b24fcaa82 req-90797541-609b-4dc7-ae45-2732ad213777 service nova] Creating event network-changed:57d1d845-8d04-4acb-8acc-e009744876a7 for instance 59342ad5-604b-486f-9d3f-aaf03ef28462 on n-h2-858383-3 Oct 03 10:42:04.351437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b313f2bf-2ee2-4680-99c4-ef3b24fcaa82 req-90797541-609b-4dc7-ae45-2732ad213777 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068694 Oct 03 10:42:04.352408 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1328/2792] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:04.358630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-cd8a5a7c-987c-4c6d-a6c8-c9c3d3854af3 req-e726380d-cd50-42d2-9fea-fd4236e250d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c723ca0a-4535-4646-8c75-7faf0a86d96b", "name": "network-vif-plugged", "status": "completed", "tag": "640107ef-8d9b-422f-a66d-416bfe6f2d27"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:04.376413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cd8a5a7c-987c-4c6d-a6c8-c9c3d3854af3 req-e726380d-cd50-42d2-9fea-fd4236e250d1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:04.377292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cd8a5a7c-987c-4c6d-a6c8-c9c3d3854af3 req-e726380d-cd50-42d2-9fea-fd4236e250d1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:04.377986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cd8a5a7c-987c-4c6d-a6c8-c9c3d3854af3 req-e726380d-cd50-42d2-9fea-fd4236e250d1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:04.413694 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-cd8a5a7c-987c-4c6d-a6c8-c9c3d3854af3 req-e726380d-cd50-42d2-9fea-fd4236e250d1 service nova] Creating event network-vif-plugged:640107ef-8d9b-422f-a66d-416bfe6f2d27 for instance c723ca0a-4535-4646-8c75-7faf0a86d96b on n-h1-858383-3 Oct 03 10:42:04.422214 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-cd8a5a7c-987c-4c6d-a6c8-c9c3d3854af3 req-e726380d-cd50-42d2-9fea-fd4236e250d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067752 Oct 03 10:42:04.423569 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1329/2793] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:04.429981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:04.431300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:04.439260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:04.440122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:04.441406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:04.443257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:04.443931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:04.445136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:05.248677 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b90e0bfa-12ae-4f18-8a6a-dfc6be0936a0 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.042410 Oct 03 10:42:05.250243 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1465/2794] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:42:04 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:05.256706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'action', calling method: .version_select at 0x7f07558dba60>, body: {"removeFloatingIp": {"address": "172.25.2.178"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:05.415844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:05.433669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:05.437734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:05.446529 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ccd667b5-ebb9-4199-88e9-455cecf30d5c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.020854 Oct 03 10:42:05.447692 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1330/2795] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:04 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:05.452571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:05.455854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:05.474288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:05.475158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:05.476423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:05.479828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:05.480657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:05.481271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:05.675171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:05.691018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:05.691915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:05.693770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:05.694823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:05.695734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:05.696371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:06.103118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:06.112325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3fd258f7-a7fc-416e-b779-5ba91e8f1467 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1318 microversion: 2.1 time: 0.663331 Oct 03 10:42:06.128149 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1331/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:05 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:06.136692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:06.137797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:06.144523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:06.146125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:06.146906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:06.148407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:06.149070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:06.149836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:06.372322 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] HTTP exception thrown: Floating IP 172.25.2.178 is not associated with instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec. Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Request method failure captured: Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action HTTP/1.1 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 49 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrwolGg4jIFUodEnhf50lb6SQhj7vqdzKLtBBl_IJkEmc4UaiJmm7ohmsk9udyozC6PZSUoTWaO5cXZOXs_RS6MzhVGjoc55nv0D8OzDJl7MDJJzGaCnDEKdHdPyCZjDTy7MNs6O_Jrvfv_6b7Ek2uiYLEnON8n9Kyoe1kwilpzytso Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b286477b323a4b88adf18567d28f55e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}] Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 05e2261e6524462e982a747d4ab5bc4a Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: {"removeFloatingIp": {"address": "172.25.2.178"}} Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: exception: Floating IP 172.25.2.178 is not associated with instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec. Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '4acc23cd-7f72-431b-b377-dc2d9dc5fdec', 'body': {'removeFloatingIp': {'address': '172.25.2.178'}}} Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.178 is not associated with instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec. Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.178 is not associated with instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec. Oct 03 10:42:06.374008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:06.379708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Returning 409 to user: Floating IP 172.25.2.178 is not associated with instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:42:06.381135 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6952a27a-f0ae-49a2-a2a5-35e798bdf2e8 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action" status: 409 len: 146 microversion: 2.1 time: 1.129519 Oct 03 10:42:06.386127 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1466/2797] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:05 2022] POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action => generated 146 bytes in 1135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:42:06.391836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3aad3960-599c-4d78-a173-1000572e2e42 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] Action: 'create', calling method: .version_select at 0x7f074f721280>, body: {"security_group": {"name": "tempest-securitygroup-799250663", "description": "tempest-description-302466291"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:06.792488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:06.815579 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19efb9a9-6051-4869-921d-a18e7ea3ad0d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1308 microversion: 2.1 time: 0.682219 Oct 03 10:42:06.820455 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1332/2798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:06 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:06.836742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.178"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:07.329809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:07.330794 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3aad3960-599c-4d78-a173-1000572e2e42 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.943140 Oct 03 10:42:07.331425 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1467/2799] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:42:06 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:07.343094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:07.343721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:07.344268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:07.346062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:07.346717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:07.349455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:07.355117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:07.357466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:07.388560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:07.390381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:07.398197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:07.403182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:07.408032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:07.415999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:07.772943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "refresh_cache-e896961d-f325-41ba-8ab5-c98cdaba723e" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:42:07.773729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquired lock "refresh_cache-e896961d-f325-41ba-8ab5-c98cdaba723e" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:42:07.923508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:07.940233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:07.947758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:07.954933 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1894018f-0862-40fe-9dd9-d08bdf8c7779 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.615579 Oct 03 10:42:07.955721 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1468/2800] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:07 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:07.963293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:07.973976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:07.998289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:07.999175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:07.999623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:08.000540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:08.001205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:08.001816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:08.106415 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 10:42:08.106661 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 10:42:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b (ip 10.222.0.27) !!! Oct 03 10:42:08.481351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:08.495248 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aaa73b82-5a64-416b-8f7f-f04b6ee0863c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1508 microversion: 2.1 time: 0.538159 Oct 03 10:42:08.496142 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1469/2801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:07 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1508 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:08.501008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3e159bd-b07c-41d1-bffd-39cc48f296f6 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] Calling method '.version_select at 0x7f07574ee5e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:09.345156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Building network info cache for instance {{(pid=122270) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:42:10.252153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Updating instance_info_cache with network_info: [{"id": "e32a934e-4dad-4114-9fdc-c285f563cfc3", "address": "fa:16:3e:77:b1:2a", "network": {"id": "fb857a83-42b3-4a53-b589-5a253a5b0340", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1435014573-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b286477b323a4b88adf18567d28f55e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape32a934e-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122270) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:42:10.265892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Releasing lock "refresh_cache-e896961d-f325-41ba-8ab5-c98cdaba723e" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:42:10.268548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9d818b2-ac42-432a-aafc-d5f55463f44e tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e/action" status: 202 len: 0 microversion: 2.1 time: 3.446035 Oct 03 10:42:10.269225 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1333/2802] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:06 2022] POST /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e/action => generated 0 bytes in 3448 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:42:10.280380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:10.281249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:10.290436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:10.291269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:10.291786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:10.292715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:10.293403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:10.293832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:10.543534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:10.554508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de947759-76cc-40d0-83ee-c831f017b3c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1308 microversion: 2.1 time: 0.279170 Oct 03 10:42:10.573950 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1334/2803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:10 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:10.581179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:10.581374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:10.589275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:10.589785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:10.591052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:10.591713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:10.592347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:10.592807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:10.783462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:10.795061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5273f81-d279-4bd1-877f-17fa5e1a6c20 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1508 microversion: 2.1 time: 0.221752 Oct 03 10:42:10.795983 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1335/2804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:10 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:10.801657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9397877f-a49a-4d90-9106-c00b3b899d24 req-e7480194-27ef-47f2-a519-32f6b442fbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59342ad5-604b-486f-9d3f-aaf03ef28462", "name": "network-vif-plugged", "status": "completed", "tag": "57d1d845-8d04-4acb-8acc-e009744876a7"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:10.817630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9397877f-a49a-4d90-9106-c00b3b899d24 req-e7480194-27ef-47f2-a519-32f6b442fbcd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:10.818338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9397877f-a49a-4d90-9106-c00b3b899d24 req-e7480194-27ef-47f2-a519-32f6b442fbcd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:10.818992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9397877f-a49a-4d90-9106-c00b3b899d24 req-e7480194-27ef-47f2-a519-32f6b442fbcd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:10.835081 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9397877f-a49a-4d90-9106-c00b3b899d24 req-e7480194-27ef-47f2-a519-32f6b442fbcd service nova] Creating event network-vif-plugged:57d1d845-8d04-4acb-8acc-e009744876a7 for instance 59342ad5-604b-486f-9d3f-aaf03ef28462 on n-h2-858383-3 Oct 03 10:42:10.840887 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9397877f-a49a-4d90-9106-c00b3b899d24 req-e7480194-27ef-47f2-a519-32f6b442fbcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043108 Oct 03 10:42:10.841880 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1336/2805] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:10.848386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:10.849466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:10.856325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:10.857372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:10.857912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:10.858728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:10.859250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:10.859780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:11.125856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:11.144609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:11.150011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:11.151341 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3c2d280-207c-40f6-96f9-d3dd94f503f7 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.308091 Oct 03 10:42:11.152569 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1337/2806] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:10 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:11.161179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-18dd81b5-ac34-4947-a09b-48cd1530829b req-1e87da31-8e20-468d-b609-e72bd462a800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e896961d-f325-41ba-8ab5-c98cdaba723e", "tag": "e32a934e-4dad-4114-9fdc-c285f563cfc3"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:11.188422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-18dd81b5-ac34-4947-a09b-48cd1530829b req-1e87da31-8e20-468d-b609-e72bd462a800 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:11.192031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-18dd81b5-ac34-4947-a09b-48cd1530829b req-1e87da31-8e20-468d-b609-e72bd462a800 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:11.195359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-18dd81b5-ac34-4947-a09b-48cd1530829b req-1e87da31-8e20-468d-b609-e72bd462a800 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:11.222058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-18dd81b5-ac34-4947-a09b-48cd1530829b req-1e87da31-8e20-468d-b609-e72bd462a800 service nova] Creating event network-changed:e32a934e-4dad-4114-9fdc-c285f563cfc3 for instance e896961d-f325-41ba-8ab5-c98cdaba723e on n-h1-858383-3 Oct 03 10:42:11.236012 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-18dd81b5-ac34-4947-a09b-48cd1530829b req-1e87da31-8e20-468d-b609-e72bd462a800 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078360 Oct 03 10:42:11.237026 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1338/2807] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:11.246802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1768033261", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "286e8ba7-7a3d-4c56-bfbe-bbee9243b57d"}], "security_groups": [{"name": "tempest-securitygroup--1581281891"}], "key_name": "tempest-keypair-1357729622", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:11.472186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] validate_networks() for [('286e8ba7-7a3d-4c56-bfbe-bbee9243b57d', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:11.889407 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3e159bd-b07c-41d1-bffd-39cc48f296f6 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10988 microversion: 2.1 time: 3.390845 Oct 03 10:42:11.907674 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1470/2808] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 3 10:42:08 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10988 bytes in 3400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:42:11.907674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:11.907674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:11.925140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:11.926674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:11.930356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:11.931268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:11.931866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:11.932393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.000309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:42:12.153604 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-98fed1c0-f3d2-42f0-8006-096bfda7e7ee tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 204 len: 0 microversion: 2.1 time: 0.252959 Oct 03 10:42:12.161245 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1471/2809] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:42:11 2022] DELETE /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:42:12.168863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:12.172734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:12.180042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.180863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.181942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.182908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.183528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.184289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.324968 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c482f8f8-82c8-44d4-8516-9b02c44c5bd5 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "PUT /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1080 microversion: 2.1 time: 0.161737 Oct 03 10:42:12.325956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:12.326431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:12.327295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:12.327703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:12.328218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:12.329688 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1472/2810] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:42:12 2022] PUT /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1080 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:12.348849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:12.349875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:12.355584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.356288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.357372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.358322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.359079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.359726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.366469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.367111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.368422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.369939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.370505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.371848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.386399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:12.393385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for user 95e90959ca07488e9a3960f7e49c99f1 and project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:12.417665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:42:12.421177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:12.515791 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9507ea94-aea6-49d0-9a22-8cdb56809e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.277202 Oct 03 10:42:12.518346 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1339/2811] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:42:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:42:12.524459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-611c9af5-4a48-4d03-b603-ff7749de8a1b tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] Calling method '.version_select at 0x7f074f81b700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:12.818793 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-611c9af5-4a48-4d03-b603-ff7749de8a1b tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.299235 Oct 03 10:42:12.820330 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1340/2812] 10.222.0.27 () {58 vars in 1191 bytes} [Mon Oct 3 10:42:12 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:12.826727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.178"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:12.830842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:12.838862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.840258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.841510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.843011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:12.844234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:12.847371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:12.912628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:42:12.914065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquired lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:42:12.999823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:13.013367 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09bf3359-9e83-49f9-845f-70ec46f04df9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1308 microversion: 2.1 time: 0.681492 Oct 03 10:42:13.014759 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1473/2813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:12 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1308 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:13.025765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:13.026684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:13.036099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:13.043042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:13.044821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:13.045948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:13.046818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:13.047541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:14.212036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:14.229443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:14.231417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:14.232711 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27cf3d47-ecde-4bf5-835f-ccb77c054670 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.216902 Oct 03 10:42:14.233403 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1474/2814] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:13 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:14.243677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:14.244552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:14.251817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:14.252560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:14.253211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:14.254100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:14.254732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:14.255162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:14.259347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:14.584530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:14.595327 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-580febfd-d1a4-4d90-9f22-17e3716ecd11 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1506 microversion: 2.1 time: 0.360562 Oct 03 10:42:14.598513 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1475/2815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:14 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:14.605819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:14.609359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:14.635181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:14.635943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:14.636588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:14.637509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:14.638139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:14.638739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:14.756869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:14.770024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:14.771946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:14.773804 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc09b543-4ddc-445f-9cdd-214ce1f47bc2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1334 microversion: 2.20 time: 0.171905 Oct 03 10:42:14.802503 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1476/2816] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:14 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1334 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:14.815794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9857424-7efa-445a-8e8c-bcc0c85c5eb0 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] Calling method '.version_select at 0x7f074f185ee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:15.590194 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9857424-7efa-445a-8e8c-bcc0c85c5eb0 tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0661a03b-fd60-415d-9aed-1021301c3949" status: 202 len: 0 microversion: 2.1 time: 0.782817 Oct 03 10:42:15.592099 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1477/2817] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:42:14 2022] DELETE /compute/v2.1/os-security-groups/0661a03b-fd60-415d-9aed-1021301c3949 => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:42:15.597177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:15.598043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:15.612994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:15.616873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:15.617844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:15.623149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:15.624107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:15.624728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:15.920206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:15.931905 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f57744f-78c7-4762-9af6-7474016efbf4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1489 microversion: 2.1 time: 0.338471 Oct 03 10:42:15.937399 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1478/2818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:15 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1489 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:15.942441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:15.947690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:15.962537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:15.964521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:15.965294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:15.967701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:15.973415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:15.974145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:16.062461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Building network info cache for instance {{(pid=122270) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:42:16.451016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:16.464938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-262bb77f-8ed9-42f3-b571-aa21b7706501 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1506 microversion: 2.1 time: 0.526097 Oct 03 10:42:16.465552 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1479/2819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:15 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:16.485393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:16.486786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:16.507817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:16.508690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:16.509510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:16.511030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:16.514189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:16.515020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:16.890321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:16.907309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:16.911297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:16.916933 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-783c705d-0c8e-4743-abbb-efaa67553d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.450291 Oct 03 10:42:16.918369 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1480/2820] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:16 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:16.924595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4303728-d7f4-4926-bf15-a706cc4f9b1b tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] Calling method '.version_select at 0x7f074f1e7b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:17.598156 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4303728-d7f4-4926-bf15-a706cc4f9b1b tempest-SecurityGroupsTestAdminJSON-931922477 tempest-SecurityGroupsTestAdminJSON-931922477-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/95288007-0612-4552-bf35-16e0c79cc0a8" status: 202 len: 0 microversion: 2.1 time: 0.677383 Oct 03 10:42:17.598879 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1481/2821] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:42:16 2022] DELETE /compute/v2.1/os-security-groups/95288007-0612-4552-bf35-16e0c79cc0a8 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:42:17.605792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:17.606602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:17.635667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:17.636882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:17.638770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:17.643348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:17.646531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:17.649546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.089891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:18.100566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:18.109426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:18.111774 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf7c57e6-8626-48ff-b94c-d462214897ff tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.511793 Oct 03 10:42:18.125137 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1482/2822] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:17 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:18.125137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:18.125137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:18.139678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.140245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.143588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.144058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.144558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.145041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.288800 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4caa5e82-e7ad-4d8a-a91b-bc2ed402b04a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462/action" status: 202 len: 0 microversion: 2.1 time: 0.172095 Oct 03 10:42:18.290068 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1483/2823] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:18 2022] POST /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:42:18.312919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2d1d5732-5386-4d76-b688-c01653495cb8 req-7400fe24-1766-41ba-94c8-24c7d251476e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acc23cd-7f72-431b-b377-dc2d9dc5fdec", "tag": "40bcc76d-c520-4e63-956b-c3bb2c191671"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:18.335986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2d1d5732-5386-4d76-b688-c01653495cb8 req-7400fe24-1766-41ba-94c8-24c7d251476e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.339073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2d1d5732-5386-4d76-b688-c01653495cb8 req-7400fe24-1766-41ba-94c8-24c7d251476e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.341681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2d1d5732-5386-4d76-b688-c01653495cb8 req-7400fe24-1766-41ba-94c8-24c7d251476e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.373321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-2d1d5732-5386-4d76-b688-c01653495cb8 req-7400fe24-1766-41ba-94c8-24c7d251476e service nova] Creating event network-changed:40bcc76d-c520-4e63-956b-c3bb2c191671 for instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec on n-h1-858383-3 Oct 03 10:42:18.386140 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2d1d5732-5386-4d76-b688-c01653495cb8 req-7400fe24-1766-41ba-94c8-24c7d251476e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092189 Oct 03 10:42:18.388232 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1484/2824] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:18.398358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:18.403766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:18.417474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.418259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.419708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.421180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.421817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.422485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.471975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Updating instance_info_cache with network_info: [{"id": "40bcc76d-c520-4e63-956b-c3bb2c191671", "address": "fa:16:3e:54:ee:36", "network": {"id": "fb857a83-42b3-4a53-b589-5a253a5b0340", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1435014573-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b286477b323a4b88adf18567d28f55e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap40bcc76d-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122270) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:42:18.536648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Releasing lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:42:18.539592 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53013404-5683-4d77-8b68-7356adb02ed6 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action" status: 202 len: 0 microversion: 2.1 time: 5.718119 Oct 03 10:42:18.541108 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1341/2825] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:12 2022] POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action => generated 0 bytes in 5720 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:42:18.553787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dbe71559-e985-4e54-9881-81aa8cf7ac9a tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] Calling method '.version_select at 0x7f074f724940>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:18.644137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:18.645571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:18.646914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:18.647342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:18.647766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:18.827170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:18.853480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.854365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.855054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.856030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.856712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.857398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.916500 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4ad69eee-aef2-44c9-953c-34cc330587e6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "POST /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b/action" status: 202 len: 1112 microversion: 2.1 time: 0.524330 Oct 03 10:42:18.918372 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1485/2826] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:18 2022] POST /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b/action => generated 1112 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 10:42:18.924670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:18.925648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:18.936713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.937789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.938468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:18.939767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:18.940503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:18.942232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:19.473847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:19.494875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:19.507352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:19.515640 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-07e5e124-bc76-4ce6-a539-01a9ec29893f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.595796 Oct 03 10:42:19.529899 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1486/2827] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:18 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:19.541869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:19.543656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:19.556419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:19.557277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:19.558758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:19.561562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:19.562284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:19.562923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:19.644064 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dbe71559-e985-4e54-9881-81aa8cf7ac9a tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b90b52f3-27e9-454f-a27b-7bf3faa027aa" status: 202 len: 0 microversion: 2.1 time: 1.101588 Oct 03 10:42:19.645242 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1342/2828] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:42:18 2022] DELETE /compute/v2.1/os-security-groups/b90b52f3-27e9-454f-a27b-7bf3faa027aa => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:42:19.652438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c269fbd3-ed58-4219-b0da-8c9a0c68f104 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '.version_select at 0x7f074e41fc10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:19.816388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:19.830294 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ae8ae7a-0aa3-4ac2-a3c8-45c8463660a0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 200 len: 1474 microversion: 2.1 time: 0.298532 Oct 03 10:42:19.844796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1487/2829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:19 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 1474 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:19.844796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:19.844796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:19.850080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:19.851097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:19.851550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:19.852291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:19.852750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:19.853210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:20.053939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:20.061894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bffbe76-da62-42d7-b940-9e3b26f08525 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1517 microversion: 2.1 time: 0.226204 Oct 03 10:42:20.063031 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1488/2830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:19 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:20.067783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:20.068510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:20.075498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:20.076274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:20.077465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:20.078689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:20.079354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:20.080011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:20.245230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:20.258319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:20.259896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:20.261647 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-119341f2-83a8-4082-ad3f-d1e9f8488266 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.197484 Oct 03 10:42:20.262217 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1489/2831] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:20 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:20.267835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-67709582-0e6e-4142-9d9d-c884f3447c2a tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] Calling method '.version_select at 0x7f074e55b550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:20.288514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c269fbd3-ed58-4219-b0da-8c9a0c68f104 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/1b08e948-b1ca-4ed1-bc05-4064f9affe0a" status: 200 len: 185 microversion: 2.1 time: 0.642308 Oct 03 10:42:20.289942 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1343/2832] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:42:19 2022] GET /compute/v2.1/os-floating-ips/1b08e948-b1ca-4ed1-bc05-4064f9affe0a => generated 185 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:20.544246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-67709582-0e6e-4142-9d9d-c884f3447c2a tempest-SecurityGroupsTestAdminJSON-1056221161 tempest-SecurityGroupsTestAdminJSON-1056221161-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/14521b5d-57e7-401c-af13-dfe0345a2af9" status: 202 len: 0 microversion: 2.1 time: 0.280581 Oct 03 10:42:20.544862 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1490/2833] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:42:20 2022] DELETE /compute/v2.1/os-security-groups/14521b5d-57e7-401c-af13-dfe0345a2af9 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:42:20.554185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-81976983"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:20.562564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:20.589076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:20.589587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:20.590036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:20.590769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:20.591229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:20.591668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:20.620536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-772909052", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:20.731404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] validate_networks() for [('26f9db07-4ea0-4e23-a6dd-08d086df3e5f', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:20.874571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:20.922088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1678bd0e-bb60-4683-9781-9e5fe74c324a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462/action" status: 202 len: 0 microversion: 2.1 time: 0.375157 Oct 03 10:42:20.922708 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1491/2834] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:20 2022] POST /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:42:20.943515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.178"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:21.186968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:21.204367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:21.204914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:21.207280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:21.212196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:21.213078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:21.213780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:21.590615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:21.591043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:21.591524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:21.591937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:21.592354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:21.601833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:21.602590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:21.603383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:21.604301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:21.605154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:21.605933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:21.655523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for project 893e3d1c38654bed94f89dfd0532340e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:21.668449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for user 21ac39f90b0744a39c356ef7d846e2b8 and project 893e3d1c38654bed94f89dfd0532340e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:21.709177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:42:21.709177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:21.712201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:42:21.712709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquired lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:42:21.760314 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a75b3185-cec7-42ba-a3b9-d2139545e6a6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.465951 Oct 03 10:42:21.763825 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1344/2835] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:42:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:42:21.774091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8df28db0-5e19-45e4-a27e-d602ad23ff7b req-6ffb4913-5cd6-48cc-b8df-472eae815772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e896961d-f325-41ba-8ab5-c98cdaba723e", "name": "network-vif-deleted", "tag": "e32a934e-4dad-4114-9fdc-c285f563cfc3"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:21.791501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:21.794104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8df28db0-5e19-45e4-a27e-d602ad23ff7b req-6ffb4913-5cd6-48cc-b8df-472eae815772 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:21.794668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8df28db0-5e19-45e4-a27e-d602ad23ff7b req-6ffb4913-5cd6-48cc-b8df-472eae815772 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:21.795256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8df28db0-5e19-45e4-a27e-d602ad23ff7b req-6ffb4913-5cd6-48cc-b8df-472eae815772 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:21.811841 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8df28db0-5e19-45e4-a27e-d602ad23ff7b req-6ffb4913-5cd6-48cc-b8df-472eae815772 service nova] Creating event network-vif-deleted:e32a934e-4dad-4114-9fdc-c285f563cfc3 for instance e896961d-f325-41ba-8ab5-c98cdaba723e on n-h1-858383-3 Oct 03 10:42:21.817538 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8df28db0-5e19-45e4-a27e-d602ad23ff7b req-6ffb4913-5cd6-48cc-b8df-472eae815772 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052094 Oct 03 10:42:21.818459 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1345/2836] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:21.824404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:21.825167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:21.831697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:21.832292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:21.832732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:21.833582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:21.834119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:21.835405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:22.073944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:22.088865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:22.090722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:22.091995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f4effbb-f36a-430c-b962-dd6aa03bf68a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.271884 Oct 03 10:42:22.104468 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1346/2837] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:21 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:22.111149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4e3f2d5-5e62-4333-8747-e7d98f200382 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e41f550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:22.203968 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4e3f2d5-5e62-4333-8747-e7d98f200382 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.096887 Oct 03 10:42:22.204400 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1347/2838] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:22 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:22.219739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:22.223501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:22.234420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:22.235189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:22.236081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:22.237061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:22.238744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:22.239142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:22.244728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:22.503199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:22.517873 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c078cace-6d46-4111-84eb-44b0eddd67c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1517 microversion: 2.1 time: 0.309679 Oct 03 10:42:22.518788 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1348/2839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:22 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:22.524921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:22.529517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:22.547369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:22.548221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:22.548893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:22.549941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:22.550557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:22.551144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:22.909754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:22.925502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:22.927574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:22.929282 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-34c1a218-ad6f-4523-9507-c832a1081caf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.409301 Oct 03 10:42:22.930352 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1349/2840] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:22 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:22.935630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:22.936927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:22.956442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:22.960387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:22.970004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:22.971317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:22.973237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:22.976627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:23.115678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:23.129738 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8530c093-6644-4946-b425-a5344e378311 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1217 microversion: 2.1 time: 0.198097 Oct 03 10:42:23.131025 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1350/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:22 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:23.142444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:23.142705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:23.179085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:23.179630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:23.183498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:23.187410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:23.188617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:23.190677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:23.355699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Building network info cache for instance {{(pid=122269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:42:23.583759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:23.597551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:23.600474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:23.602187 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cfeb50c2-852a-4de7-959c-dcbc88c04161 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.469091 Oct 03 10:42:23.618917 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1351/2842] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:23 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:23.633284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b804f9be-9fb0-4543-9298-97f29a17bf71 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e4f4e50>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:23.719926 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b804f9be-9fb0-4543-9298-97f29a17bf71 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.099823 Oct 03 10:42:23.722030 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1352/2843] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:23 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:23.736482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-523844778", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:23.878570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] validate_networks() for [('26f9db07-4ea0-4e23-a6dd-08d086df3e5f', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:24.460261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Updating instance_info_cache with network_info: [{"id": "40bcc76d-c520-4e63-956b-c3bb2c191671", "address": "fa:16:3e:54:ee:36", "network": {"id": "fb857a83-42b3-4a53-b589-5a253a5b0340", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1435014573-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b286477b323a4b88adf18567d28f55e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap40bcc76d-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:42:24.491839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Releasing lock "refresh_cache-4acc23cd-7f72-431b-b377-dc2d9dc5fdec" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:42:24.492886 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79330f7f-44ae-4deb-8be8-e425fa4da754 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action" status: 202 len: 0 microversion: 2.1 time: 3.560839 Oct 03 10:42:24.495096 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1492/2844] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:20 2022] POST /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec/action => generated 0 bytes in 3571 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:42:24.502627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d24dd509-05c7-4a9a-b0ba-8901d5139b23 req-43f44a82-9138-45dd-a1ec-19a9f09f220c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acc23cd-7f72-431b-b377-dc2d9dc5fdec", "tag": "40bcc76d-c520-4e63-956b-c3bb2c191671"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:24.527468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d24dd509-05c7-4a9a-b0ba-8901d5139b23 req-43f44a82-9138-45dd-a1ec-19a9f09f220c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:24.527468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d24dd509-05c7-4a9a-b0ba-8901d5139b23 req-43f44a82-9138-45dd-a1ec-19a9f09f220c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:24.527468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d24dd509-05c7-4a9a-b0ba-8901d5139b23 req-43f44a82-9138-45dd-a1ec-19a9f09f220c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:24.558555 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d24dd509-05c7-4a9a-b0ba-8901d5139b23 req-43f44a82-9138-45dd-a1ec-19a9f09f220c service nova] Creating event network-changed:40bcc76d-c520-4e63-956b-c3bb2c191671 for instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec on n-h1-858383-3 Oct 03 10:42:24.576645 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d24dd509-05c7-4a9a-b0ba-8901d5139b23 req-43f44a82-9138-45dd-a1ec-19a9f09f220c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080118 Oct 03 10:42:24.583289 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1493/2845] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:24.597048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:24.597758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:24.612375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:24.612975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:24.613429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:24.614173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:24.619582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:24.620111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:24.905015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:24.915947 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a421600d-ca3a-4197-bb4a-1d3f5006c1a7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1517 microversion: 2.1 time: 0.329170 Oct 03 10:42:24.939517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1494/2846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:24 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:24.967084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:24.969336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:24.996305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:25.010822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:25.014451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:25.015576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:25.019305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:25.021190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:25.421372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:25.439098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:25.440947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:25.452302 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8cd8627-0d7c-4c55-abba-f3fb1e86b6af tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.509058 Oct 03 10:42:25.454394 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1495/2847] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:24 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:25.470593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f9a6f9d2-b7df-4c66-bd82-9b3a26b15e58 req-1844035a-6f98-462c-ba98-c8be24956e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:25.508695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f9a6f9d2-b7df-4c66-bd82-9b3a26b15e58 req-1844035a-6f98-462c-ba98-c8be24956e87 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:25.509740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f9a6f9d2-b7df-4c66-bd82-9b3a26b15e58 req-1844035a-6f98-462c-ba98-c8be24956e87 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:25.510364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f9a6f9d2-b7df-4c66-bd82-9b3a26b15e58 req-1844035a-6f98-462c-ba98-c8be24956e87 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:25.544650 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f9a6f9d2-b7df-4c66-bd82-9b3a26b15e58 req-1844035a-6f98-462c-ba98-c8be24956e87 service nova] Creating event network-changed:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:42:25.560706 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f9a6f9d2-b7df-4c66-bd82-9b3a26b15e58 req-1844035a-6f98-462c-ba98-c8be24956e87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105045 Oct 03 10:42:25.564429 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1496/2848] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:25.579049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:25.582130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:25.601009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:25.618397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:25.619112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:25.621254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:25.621990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:25.622955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:25.667317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] HTTP exception thrown: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Request method failure captured: Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e HTTP/1.1 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrwolGg4jIFUodEnhf50lb6SQhj7vqdzKLtBBl_IJkEmc4UaiJmm7ohmsk9udyozC6PZSUoTWaO5cXZOXs_RS6MzhVGjoc55nv0D8OzDJl7MDJJzGaCnDEKdHdPyCZjDTy7MNs6O_Jrvfv_6b7Ek2uiYLEnON8n9Kyoe1kwilpzytso Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b286477b323a4b88adf18567d28f55e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}] Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 05e2261e6524462e982a747d4ab5bc4a Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'e896961d-f325-41ba-8ab5-c98cdaba723e'} Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:42:25.678996 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:25.685967 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:25.688832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Returning 404 to user: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:42:25.694848 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3c93e63c-5149-4d4d-b29e-4a2561f7905c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 404 len: 111 microversion: 2.1 time: 0.128871 Oct 03 10:42:25.697645 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1497/2849] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:42:25 2022] DELETE /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:42:25.710905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:25.713971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:25.729910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:25.732556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:25.733493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:25.735475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:25.736194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:25.738479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:26.319281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:26.334706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:26.336172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:26.337412 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd016d00-3ac9-4c35-b0e2-385f5c67752a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.638343 Oct 03 10:42:26.348282 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1498/2850] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:25 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:26.360113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c938915f-d615-4cc2-a543-b9a707bb507d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e563040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:26.443399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:26.446505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:26.447223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:26.448100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:26.448840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:26.471463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:26.472538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:26.473249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:26.491315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:26.492324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:26.495848 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c938915f-d615-4cc2-a543-b9a707bb507d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.145330 Oct 03 10:42:26.496632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1499/2851] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:26 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:26.496859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:26.506942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:26.507560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: e896961d-f325-41ba-8ab5-c98cdaba723e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:26.526409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:26.526856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:26.530346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:26.531126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:26.531566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:26.532001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:26.578318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] HTTP exception thrown: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Request method failure captured: Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e HTTP/1.1 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrwolGg4jIFUodEnhf50lb6SQhj7vqdzKLtBBl_IJkEmc4UaiJmm7ohmsk9udyozC6PZSUoTWaO5cXZOXs_RS6MzhVGjoc55nv0D8OzDJl7MDJJzGaCnDEKdHdPyCZjDTy7MNs6O_Jrvfv_6b7Ek2uiYLEnON8n9Kyoe1kwilpzytso Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b286477b323a4b88adf18567d28f55e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}] Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 05e2261e6524462e982a747d4ab5bc4a Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'e896961d-f325-41ba-8ab5-c98cdaba723e'} Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:26.579937 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Returning 404 to user: Instance e896961d-f325-41ba-8ab5-c98cdaba723e could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1089ca9b-38a8-4e71-b63c-424d792d2eaa tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e" status: 404 len: 111 microversion: 2.1 time: 0.083760 Oct 03 10:42:26.584511 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1500/2852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:26 2022] GET /compute/v2.1/servers/e896961d-f325-41ba-8ab5-c98cdaba723e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:42:26.605039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:26.605654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:26.612209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:26.612998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:26.613603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:26.614554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:26.615018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:26.616005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:27.014516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for project 893e3d1c38654bed94f89dfd0532340e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:27.035427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for user 21ac39f90b0744a39c356ef7d846e2b8 and project 893e3d1c38654bed94f89dfd0532340e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:27.060286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:42:27.063063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:27.071279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:27.091733 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0adbd64-3e8f-4b70-ac11-23eb6b8b597f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1517 microversion: 2.1 time: 0.503175 Oct 03 10:42:27.092331 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1501/2853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:26 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1517 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:27.111893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:27.113400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:27.124423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:27.124925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:27.125384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:27.126266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:27.126754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:27.127188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:27.170053 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef217495-e088-4413-a549-60b9f2cd71a1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.446013 Oct 03 10:42:27.171130 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1353/2854] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:42:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:42:27.437891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-670626210", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:27.559843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:27.729795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:27.746123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:27.747582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:27.748722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f108c18e-e65d-4821-a999-df1b97725cba tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.655427 Oct 03 10:42:27.753813 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1502/2855] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:27 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:27.768651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6b3499a-e7f6-4f4e-8a7d-68cdc60fa000 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '.version_select at 0x7f074e563670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:28.506362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:28.506916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:28.507553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:28.508051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:28.509121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:28.521551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:28.522898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:28.523643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:28.539186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:28.543557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:28.544307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:28.601094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:28.624148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:28.661619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:42:28.664135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:28.774857 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2450da3-3918-45e4-ad2c-2d0fd10dac6c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602387 Oct 03 10:42:28.775669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1354/2856] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:42:28.792581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:28.793635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:28.816703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:28.820829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:28.822801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:28.825535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:28.826381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:28.828230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:28.952653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:28.968952 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c05a2b8-be8b-41c0-873a-1ef0afc726a5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1217 microversion: 2.1 time: 0.188531 Oct 03 10:42:28.973003 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1355/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:28 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:29.003034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:29.004140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:29.033985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:29.035347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:29.037013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:29.040201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:29.042413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:29.045189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:29.926024 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6b3499a-e7f6-4f4e-8a7d-68cdc60fa000 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/1b08e948-b1ca-4ed1-bc05-4064f9affe0a" status: 202 len: 0 microversion: 2.1 time: 2.168752 Oct 03 10:42:29.927559 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1503/2858] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:42:27 2022] DELETE /compute/v2.1/os-floating-ips/1b08e948-b1ca-4ed1-bc05-4064f9affe0a => generated 0 bytes in 2173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:42:29.933363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-442be8b1-765c-4d48-9898-b4a44c4197bb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f257040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:30.041413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-442be8b1-765c-4d48-9898-b4a44c4197bb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.112402 Oct 03 10:42:30.042259 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1504/2859] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:29 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:30.054850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:30.065917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:30.092484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.093271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.093873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.094817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.098863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.099757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.364748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.390225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.406643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.412494 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-34df1b75-6fc0-47c9-8f6c-dde78dd89486 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.419264 Oct 03 10:42:30.413021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.413475 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1356/2860] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:28 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:30.433001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0fd1b886-adc6-405d-9a37-dd01f68945e2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1517 microversion: 2.1 time: 0.378349 Oct 03 10:42:30.433001 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1505/2861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:30 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:30.442069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:30.443183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:30.445742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:30.446371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:30.448403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:30.452123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.452929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.454737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.455651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.456276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.456888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.477032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.477547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.477999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.478822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.479215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.480124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.700544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.717619 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-18b8f88f-b515-4c61-8498-308beb254635 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1220 microversion: 2.1 time: 0.281317 Oct 03 10:42:30.721492 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1357/2862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:30 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1220 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:30.744341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-311fed3c-2a52-40c0-99cc-40a36a69d88b req-acebcb43-2b49-4e20-917b-d717716717b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "name": "network-vif-plugged", "status": "completed", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:30.756317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.768014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-311fed3c-2a52-40c0-99cc-40a36a69d88b req-acebcb43-2b49-4e20-917b-d717716717b5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.768509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-311fed3c-2a52-40c0-99cc-40a36a69d88b req-acebcb43-2b49-4e20-917b-d717716717b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.768989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-311fed3c-2a52-40c0-99cc-40a36a69d88b req-acebcb43-2b49-4e20-917b-d717716717b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.809230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.817951 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-311fed3c-2a52-40c0-99cc-40a36a69d88b req-acebcb43-2b49-4e20-917b-d717716717b5 service nova] Creating event network-vif-plugged:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:42:30.825423 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-311fed3c-2a52-40c0-99cc-40a36a69d88b req-acebcb43-2b49-4e20-917b-d717716717b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098943 Oct 03 10:42:30.826708 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1358/2863] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:30.829252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:30.833646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:30.834632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:30.837654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61e6adc6-21c9-471c-a30a-e86c1a885b6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.406456 Oct 03 10:42:30.839716 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1506/2864] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:30 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:30.841502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.842330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.842932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.843796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.844416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.845183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.868371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:30.875938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:30.893136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.894023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.894922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:30.912106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:42:30.922809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:30.923302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:30.926351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.111977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:31.128744 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3b9f2d7-b383-4628-8aa2-5061c65f8f3c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1279 microversion: 2.1 time: 0.283556 Oct 03 10:42:31.129997 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1507/2865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:30 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:31.136673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e30b45d-bc82-4ab3-831d-545d42726fee tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e513670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:31.189215 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e57aabb7-9c1a-4381-a02e-49f1f6698437 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 204 len: 0 microversion: 2.1 time: 0.357857 Oct 03 10:42:31.197714 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1359/2866] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:42:30 2022] DELETE /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:42:31.229989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:31.232258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:31.232803 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e30b45d-bc82-4ab3-831d-545d42726fee tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.099698 Oct 03 10:42:31.234209 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1508/2867] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:31 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:31.243001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.243514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.243978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.249707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.250219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.250669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.454928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:31.457161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:31.471530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.473922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.474978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.476451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.477286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.477976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.687415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:31.711418 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16b606e1-2d9d-46b7-95e4-8aaeae31bd6c tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1526 microversion: 2.1 time: 0.504305 Oct 03 10:42:31.717538 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1360/2868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:31 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1526 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:31.747903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:31.750419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:31.770270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.770797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.771267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.778281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.778707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.781238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.901242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:31.923748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:31.926375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:31.938986 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-93506474-9896-4ed2-b736-46b53a002a65 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.491598 Oct 03 10:42:31.940551 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1509/2869] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:31 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:42:31.959484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:31.962418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:31.991295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.992157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.992859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:31.993864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:31.994539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:31.995183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:32.152386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:32.163618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65c64445-41b7-4561-81c1-2175ed11f5d9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1274 microversion: 2.1 time: 0.221679 Oct 03 10:42:32.182791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1510/2870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:31 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:32.201131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:32.202659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:32.211073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:32.212055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:32.212837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:32.213828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:32.217446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:32.218203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:32.519658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:32.545836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:32.556938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:32.558701 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57eba2b0-8041-42a5-bf0e-1cbbf717959a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.374737 Oct 03 10:42:32.562525 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1511/2871] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:32 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:32.567794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:32.587353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:32.609096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:32.609975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:32.610648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:32.611605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:32.612293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:32.613525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:32.761498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:32.772454 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a33b060d-692f-4b4a-80be-84877e0aaaaa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1279 microversion: 2.1 time: 0.208412 Oct 03 10:42:32.781621 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1512/2872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:32 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1279 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:32.787974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65e0cced-4d3b-4c2b-9b8f-bb09d953cbe1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e563a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:32.885272 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65e0cced-4d3b-4c2b-9b8f-bb09d953cbe1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.102114 Oct 03 10:42:32.886247 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1513/2873] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:32 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:32.901817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b6a89e18-d2ba-4547-9f8f-48a7ea3e4fb4 req-e20aead6-012d-4892-bc5b-7d5078074a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4", "tag": "a30f35d1-8f30-4892-95ea-375d6270fb11"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:32.935828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b6a89e18-d2ba-4547-9f8f-48a7ea3e4fb4 req-e20aead6-012d-4892-bc5b-7d5078074a5e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:32.939562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b6a89e18-d2ba-4547-9f8f-48a7ea3e4fb4 req-e20aead6-012d-4892-bc5b-7d5078074a5e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:32.940285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b6a89e18-d2ba-4547-9f8f-48a7ea3e4fb4 req-e20aead6-012d-4892-bc5b-7d5078074a5e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:32.967008 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b6a89e18-d2ba-4547-9f8f-48a7ea3e4fb4 req-e20aead6-012d-4892-bc5b-7d5078074a5e service nova] Creating event network-changed:a30f35d1-8f30-4892-95ea-375d6270fb11 for instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 on n-h2-858383-3 Oct 03 10:42:32.979283 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b6a89e18-d2ba-4547-9f8f-48a7ea3e4fb4 req-e20aead6-012d-4892-bc5b-7d5078074a5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090964 Oct 03 10:42:32.980637 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1514/2874] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:32.987396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:32.988493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:33.024336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:33.025249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:33.026355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:33.027361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:33.028184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:33.029041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:33.034842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:33.140145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:33.154676 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dafacf6-f269-4aa8-8dc1-1da922c498d2 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1517 microversion: 2.1 time: 1.435306 Oct 03 10:42:33.155201 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1361/2875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:31 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1517 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:33.175914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:33.180328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:33.207299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:33.211262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:33.211747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:33.212476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:33.230753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:33.231212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:33.401425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:33.416167 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-782c1e28-02ac-4807-b86a-e4f5d2c7fc9b tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1526 microversion: 2.1 time: 0.433482 Oct 03 10:42:33.450257 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1515/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:32 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1526 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:33.467777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:33.471527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:33.494899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:33.499807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:33.508944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:33.510287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:33.515276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:33.519164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:34.216824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:34.240642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:34.242269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:34.243510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c100692b-c58f-440c-b9c8-4eeb4e6cf26c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.087366 Oct 03 10:42:34.265687 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1362/2877] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:33 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:34.284297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:34.293913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:34.323363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:34.333525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:34.334570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:34.335346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:34.335828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:34.336285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:34.551117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:34.566750 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-adaa9288-24b6-42f5-8092-908a0064b9e7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 1.112463 Oct 03 10:42:34.587684 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1516/2878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:33 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:34.610443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:34.611596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:34.639008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:34.640494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:34.647641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:34.649507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:34.654372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:34.655098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:35.175284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:35.194791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:35.197203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:35.200073 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f0f4e3b-53aa-4a0f-a517-a28f4436a4cb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1408 microversion: 2.20 time: 0.929337 Oct 03 10:42:35.202516 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1363/2879] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:34 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1408 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:35.216252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-77ccefb8-a2ea-4135-b4f0-5c12f7f63d33 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e5a4f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:35.315794 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-77ccefb8-a2ea-4135-b4f0-5c12f7f63d33 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.111970 Oct 03 10:42:35.317866 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1364/2880] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:35 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:35.331232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:35.336106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:35.347320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:35.355504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:35.357528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:35.358806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:35.361956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:35.362596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:35.738675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:35.748131 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d0cd01b-20a7-4e17-8ea0-24e883bdd1d4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1517 microversion: 2.1 time: 0.427345 Oct 03 10:42:35.749380 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1365/2881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:35 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1517 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:35.755104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:35.755963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:35.763246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:35.764048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:35.765238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:35.766255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:35.766886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:35.767483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:35.855096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:35.872006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e2083991-9447-4375-b533-aa44ed04f237 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1484 microversion: 2.1 time: 0.121104 Oct 03 10:42:35.872606 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1366/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:35 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:35.879507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:35.885130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:35.898311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:35.899081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:35.899977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:35.900936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:35.901614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:35.902210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:35.916451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:36.137121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:36.154251 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd1d94a3-03ab-436a-a3fa-6cfa637d5bfc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 1.563406 Oct 03 10:42:36.157205 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1517/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:34 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:36.192207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:36.193288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:36.210010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:36.212739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:36.213508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:36.214475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:36.216943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:36.219703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:36.611834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:36.671765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7eade6a0-f096-4e99-80f3-d2aa68c08e67 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 0.495278 Oct 03 10:42:36.689693 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1518/2884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:36 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:36.705761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e78b3652-c668-4556-b1b6-b8e85ece0d74 req-5af5fb6e-fb27-4f9c-a058-ddca6ec4621b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4acc23cd-7f72-431b-b377-dc2d9dc5fdec", "name": "network-vif-deleted", "tag": "40bcc76d-c520-4e63-956b-c3bb2c191671"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:36.751415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e78b3652-c668-4556-b1b6-b8e85ece0d74 req-5af5fb6e-fb27-4f9c-a058-ddca6ec4621b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:36.755545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e78b3652-c668-4556-b1b6-b8e85ece0d74 req-5af5fb6e-fb27-4f9c-a058-ddca6ec4621b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:36.761734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e78b3652-c668-4556-b1b6-b8e85ece0d74 req-5af5fb6e-fb27-4f9c-a058-ddca6ec4621b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:36.846219 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e78b3652-c668-4556-b1b6-b8e85ece0d74 req-5af5fb6e-fb27-4f9c-a058-ddca6ec4621b service nova] Creating event network-vif-deleted:40bcc76d-c520-4e63-956b-c3bb2c191671 for instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec on n-h1-858383-3 Oct 03 10:42:36.854552 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e78b3652-c668-4556-b1b6-b8e85ece0d74 req-5af5fb6e-fb27-4f9c-a058-ddca6ec4621b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156085 Oct 03 10:42:36.855777 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1519/2885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:36.861698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:36.863003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:36.871412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:36.872843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:36.874075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:36.875148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:36.883593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:36.884600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:36.898348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:36.917477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:36.921132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:36.927437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e501531-699f-4f6b-93b2-e960fcfc8ad1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.051255 Oct 03 10:42:36.928212 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1367/2886] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:35 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:36.945964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-545b1bf9-bf06-43ff-8315-2b74629c35ee tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e522a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:37.064831 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-545b1bf9-bf06-43ff-8315-2b74629c35ee tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.134665 Oct 03 10:42:37.073990 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1368/2887] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:36 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:37.079054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e4b8a4a0-581c-4e40-8d52-ee0f8e6fcd36 req-a65f9577-73db-4cdf-8ff0-a597565fcd1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309241dd-9390-48da-b52c-521667f3808c", "tag": "ec92c056-8195-41fa-bb3d-6c81f4fbd9db"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:37.109396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e4b8a4a0-581c-4e40-8d52-ee0f8e6fcd36 req-a65f9577-73db-4cdf-8ff0-a597565fcd1d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.114541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e4b8a4a0-581c-4e40-8d52-ee0f8e6fcd36 req-a65f9577-73db-4cdf-8ff0-a597565fcd1d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.115372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e4b8a4a0-581c-4e40-8d52-ee0f8e6fcd36 req-a65f9577-73db-4cdf-8ff0-a597565fcd1d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.137076 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e4b8a4a0-581c-4e40-8d52-ee0f8e6fcd36 req-a65f9577-73db-4cdf-8ff0-a597565fcd1d service nova] Creating event network-changed:ec92c056-8195-41fa-bb3d-6c81f4fbd9db for instance 309241dd-9390-48da-b52c-521667f3808c on n-h1-858383-3 Oct 03 10:42:37.152124 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e4b8a4a0-581c-4e40-8d52-ee0f8e6fcd36 req-a65f9577-73db-4cdf-8ff0-a597565fcd1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076373 Oct 03 10:42:37.153252 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1369/2888] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:37.160535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:37.170296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:37.187871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.188518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.189086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.189912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.190475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.191030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.400948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:37.410374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:37.416536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:37.417817 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc0667fd-803f-479e-a4c1-f29e0b31a4ed tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1600 microversion: 2.20 time: 0.560683 Oct 03 10:42:37.418391 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1520/2889] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:36 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1600 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:37.436391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:37.446648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:37.464515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.468351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.470628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.474482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.477265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.479829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.593291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.593784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.594224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.594690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lazy-loading 'fault' on Instance uuid 4acc23cd-7f72-431b-b377-dc2d9dc5fdec {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:42:37.620474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:37.632407 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e5d6e4a8-84b4-4272-90ce-e8208bec3471 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.477663 Oct 03 10:42:37.635540 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1370/2890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:37 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:37.641217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:37.642056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:37.671602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.672452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.685033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.691767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.693072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.694305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.695658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:37.708634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a76fe6c-5999-4675-b7c4-cb64ae71a5c9 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1313 microversion: 2.1 time: 0.280818 Oct 03 10:42:37.709706 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1521/2891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:37 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:37.723947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:37.725558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:37.744394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.745177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.745772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:37.746649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:37.747265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:37.750243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.020369 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5df320fe-9322-4fc9-b89e-93f35caa010a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.309085 Oct 03 10:42:38.028936 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1522/2892] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:42:37 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:42:38.033965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:38.034583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:38.051263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.051813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.056534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.057666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.060397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.063442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.074257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:38.085923 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5df2a02a-6e5d-4ac9-bb7f-9ba1451d2b68 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.448493 Oct 03 10:42:38.087223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1371/2893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:37 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:38.092835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:38.093897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:38.102313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.105647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.106749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.107769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.108415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.109041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.483335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:38.498110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:38.500272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:38.501538 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e3bdd53-ab77-4cd7-a7a8-8705e20dcc03 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.413059 Oct 03 10:42:38.502160 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1372/2894] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:38 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:38.509953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-926fab0b-a69b-4049-95c2-388e673bde9b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e495430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:38.580601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:38.614612 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-926fab0b-a69b-4049-95c2-388e673bde9b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.110408 Oct 03 10:42:38.616721 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1373/2895] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:38 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:38.651759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:38.671237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=28 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:38.680375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:38.690832 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2dffb444-2f97-4d0f-b0c8-72d1e30eccba tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 0.660674 Oct 03 10:42:38.691420 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1523/2896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:38 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:38.701728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:38.727732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.728842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.729653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.730987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.732271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.733123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.746066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:38.746729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:38.755639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.756552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.757219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.758275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.758905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.759510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.811707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.812552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.813229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.814169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lazy-loading 'fault' on Instance uuid 4acc23cd-7f72-431b-b377-dc2d9dc5fdec {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:42:38.910877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e2261e6524462e982a747d4ab5bc4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b286477b323a4b88adf18567d28f55e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:38.917488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:38.925414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d19c8a5-55cb-4aab-9260-930fa81eeae1 tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 200 len: 1313 microversion: 2.1 time: 0.186633 Oct 03 10:42:38.926837 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1524/2897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:38 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:38.927608 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-23d54816-f928-46b6-b25b-091d13e8fbd9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.270834 Oct 03 10:42:38.928645 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1374/2898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:38 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:38.932262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-47b5f463-75ab-49c9-9113-3244502ead45 req-2067caba-6366-46f4-97f2-362c9e73cd0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8a08d3-3b84-458e-aa9f-1941ac2386c8", "tag": "9a481fa9-ba9e-468a-8c8d-ada1db6b9976"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:38.942459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47b5f463-75ab-49c9-9113-3244502ead45 req-2067caba-6366-46f4-97f2-362c9e73cd0c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:38.943207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47b5f463-75ab-49c9-9113-3244502ead45 req-2067caba-6366-46f4-97f2-362c9e73cd0c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:38.943797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47b5f463-75ab-49c9-9113-3244502ead45 req-2067caba-6366-46f4-97f2-362c9e73cd0c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:38.956887 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-47b5f463-75ab-49c9-9113-3244502ead45 req-2067caba-6366-46f4-97f2-362c9e73cd0c service nova] Creating event network-changed:9a481fa9-ba9e-468a-8c8d-ada1db6b9976 for instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 on n-h2-858383-3 Oct 03 10:42:38.971324 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-47b5f463-75ab-49c9-9113-3244502ead45 req-2067caba-6366-46f4-97f2-362c9e73cd0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042054 Oct 03 10:42:38.972805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1525/2899] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:39.110604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:39.112647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:39.129905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:39.130452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:39.131414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:39.131637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:39.132109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:39.132715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:39.528707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:39.529432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:39.537417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:39.537912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:39.538353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:39.539058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:39.539775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:39.540201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:39.671737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:39.682897 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1eec53f-42db-4e26-af40-eca47ab385da tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.576365 Oct 03 10:42:39.687319 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1375/2900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:39 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:39.698010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ecd43e0d-feb7-4ad0-ba5e-f3b29e57a50a req-82a9e8b9-4010-418a-8532-1b91bb34543c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c723ca0a-4535-4646-8c75-7faf0a86d96b", "name": "network-vif-unplugged", "status": "completed", "tag": "640107ef-8d9b-422f-a66d-416bfe6f2d27"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:39.722895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ecd43e0d-feb7-4ad0-ba5e-f3b29e57a50a req-82a9e8b9-4010-418a-8532-1b91bb34543c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:39.725983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ecd43e0d-feb7-4ad0-ba5e-f3b29e57a50a req-82a9e8b9-4010-418a-8532-1b91bb34543c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:39.727948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ecd43e0d-feb7-4ad0-ba5e-f3b29e57a50a req-82a9e8b9-4010-418a-8532-1b91bb34543c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:39.755240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ecd43e0d-feb7-4ad0-ba5e-f3b29e57a50a req-82a9e8b9-4010-418a-8532-1b91bb34543c service nova] Creating event network-vif-unplugged:640107ef-8d9b-422f-a66d-416bfe6f2d27 for instance c723ca0a-4535-4646-8c75-7faf0a86d96b on n-h1-858383-3 Oct 03 10:42:39.766441 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ecd43e0d-feb7-4ad0-ba5e-f3b29e57a50a req-82a9e8b9-4010-418a-8532-1b91bb34543c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077159 Oct 03 10:42:39.768720 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1376/2901] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:39.781331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b0c6dc1-aab4-4d65-935f-b822014cd6da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e4013a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:39.892510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b0c6dc1-aab4-4d65-935f-b822014cd6da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.122298 Oct 03 10:42:39.893518 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1377/2902] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:39 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:39.901887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:39.912099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:39.931291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:39.932845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:39.933544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:39.934761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:39.935441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:39.936093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:40.220549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:40.271333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:40.274096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:40.276338 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e36581bb-fee0-4639-bf3c-eda2bf942353 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.752386 Oct 03 10:42:40.276689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:40.278136 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1526/2903] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:39 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:42:40.288951 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a24b7ed2-d397-427c-9815-a5d337f025a1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 0.390255 Oct 03 10:42:40.290424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:40.298103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:40.301530 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1378/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:39 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:40.313942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:40.314751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] [instance: 4acc23cd-7f72-431b-b377-dc2d9dc5fdec] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:40.322213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:40.323713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:40.329222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:40.330236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:40.330934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:40.331548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:40.337615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:40.338338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:40.346163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:40.347661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:40.348937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:40.349098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:40.417623 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] HTTP exception thrown: Instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec could not be found. Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Request method failure captured: Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec HTTP/1.1 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrwolGg4jIFUodEnhf50lb6SQhj7vqdzKLtBBl_IJkEmc4UaiJmm7ohmsk9udyozC6PZSUoTWaO5cXZOXs_RS6MzhVGjoc55nv0D8OzDJl7MDJJzGaCnDEKdHdPyCZjDTy7MNs6O_Jrvfv_6b7Ek2uiYLEnON8n9Kyoe1kwilpzytso Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b286477b323a4b88adf18567d28f55e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b286477b323a4b88adf18567d28f55e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b286477b323a4b88adf18567d28f55e9"}]}] Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b286477b323a4b88adf18567d28f55e9 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2041741146 Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 05e2261e6524462e982a747d4ab5bc4a Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2041741146-project Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec could not be found. Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '4acc23cd-7f72-431b-b377-dc2d9dc5fdec'} Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec could not be found. Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec could not be found. Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:42:40.419360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec could not be found. Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:42:40.423775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] Returning 404 to user: Instance 4acc23cd-7f72-431b-b377-dc2d9dc5fdec could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:42:40.433329 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d5276bf-d976-4e2c-8153-f3e5e4a71d2f tempest-FloatingIPsAssociationTestJSON-2041741146 tempest-FloatingIPsAssociationTestJSON-2041741146-project] 10.222.0.27 "GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec" status: 404 len: 111 microversion: 2.1 time: 0.130507 Oct 03 10:42:40.440822 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1379/2905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:40 2022] GET /compute/v2.1/servers/4acc23cd-7f72-431b-b377-dc2d9dc5fdec => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:42:40.712072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:40.712956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:40.719854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:40.723087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:40.723762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:40.724713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:40.727429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:40.728074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:40.877454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:40.894400 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99f061a6-a2ea-4750-91a6-01843b6b8ec0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.611956 Oct 03 10:42:40.923484 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1527/2906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:40 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:40.935837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8034cffa-09df-4c06-8ec0-d729dd0198ff tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f07574ee550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:41.019700 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8034cffa-09df-4c06-8ec0-d729dd0198ff tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.094988 Oct 03 10:42:41.020331 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1528/2907] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:40 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:41.082995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-04a3ab43-272c-43ec-8f29-725fd5998ca7 req-6595b666-a995-4cb2-8963-03eedd011039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:41.107767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-04a3ab43-272c-43ec-8f29-725fd5998ca7 req-6595b666-a995-4cb2-8963-03eedd011039 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:41.108501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-04a3ab43-272c-43ec-8f29-725fd5998ca7 req-6595b666-a995-4cb2-8963-03eedd011039 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:41.109145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-04a3ab43-272c-43ec-8f29-725fd5998ca7 req-6595b666-a995-4cb2-8963-03eedd011039 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:41.128807 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-04a3ab43-272c-43ec-8f29-725fd5998ca7 req-6595b666-a995-4cb2-8963-03eedd011039 service nova] Creating event network-changed:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:42:41.145603 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-04a3ab43-272c-43ec-8f29-725fd5998ca7 req-6595b666-a995-4cb2-8963-03eedd011039 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066422 Oct 03 10:42:41.149058 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1529/2908] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:42:41.193579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:41.204610 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-45727d24-d5a3-495f-a8ce-9f973457c26a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.496906 Oct 03 10:42:41.207676 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1380/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:40 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:41.320059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:41.321601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:41.322521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:41.324892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:41.342616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:41.343503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:41.347506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:41.348907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:41.350256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:41.356485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:41.356989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:41.357712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:41.359668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:41.362140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:41.362942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:41.364567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:41.736890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:41.752422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:41.755241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:41.759408 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-84ec3579-1eeb-431d-b6bb-bcc652f318b3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.450745 Oct 03 10:42:41.760716 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1530/2910] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:41 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:41.931493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:41.932098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:41.945760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:41.946523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:41.947347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:41.948451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:41.950795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:41.952369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:42.382441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:42.450387 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38328d1a-39bd-4b85-a6e0-d0ac9ffe8d84 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.473745 Oct 03 10:42:42.450387 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1531/2911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:41 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:42.451315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:42.451899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-plugged", "status": "completed", "tag": "dc02198d-727d-4273-b628-c9809a55a651"}, {"server_uuid": "59342ad5-604b-486f-9d3f-aaf03ef28462", "name": "network-vif-plugged", "status": "completed", "tag": "57d1d845-8d04-4acb-8acc-e009744876a7"}, {"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-plugged", "status": "completed", "tag": "dd030f06-746b-4332-9eeb-6288043d49b6"}, {"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-plugged", "status": "completed", "tag": "1a182135-8788-4ba3-9eac-9ff7eb73a8c8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:42.452196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5121d754-0a0f-4b47-afd3-8b7a66f69e7c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 1.103145 Oct 03 10:42:42.452196 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1381/2912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:41 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:42.452196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9453bdc5-00c5-48db-a821-a70d1a8d030e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074fad4c10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:42.460755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:42.461448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:42.462323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:42.543075 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Creating event network-vif-plugged:dc02198d-727d-4273-b628-c9809a55a651 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:42.543586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Creating event network-vif-plugged:57d1d845-8d04-4acb-8acc-e009744876a7 for instance 59342ad5-604b-486f-9d3f-aaf03ef28462 on n-h2-858383-3 Oct 03 10:42:42.544803 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Creating event network-vif-plugged:dd030f06-746b-4332-9eeb-6288043d49b6 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:42.545928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] Creating event network-vif-plugged:1a182135-8788-4ba3-9eac-9ff7eb73a8c8 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:42.557977 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9453bdc5-00c5-48db-a821-a70d1a8d030e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.137071 Oct 03 10:42:42.558750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1382/2913] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:42 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:42.563916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f09e4602-3ac6-47be-b93c-b315c908ed35 req-b5ea1427-36c7-4f3f-965d-1633bc31ec27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.161721 Oct 03 10:42:42.565089 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1532/2914] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:42.571599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:42.572547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:42.592803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:42.598301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:42.599024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:42.601645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:42.602349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:42.608221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:42.787843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:42.789129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:42.804430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:42.807451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:42.810146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:42.811762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:42.812364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:42.812677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:43.178874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:43.202131 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a21accec-36b7-4bd1-807a-f037c76994a2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.639510 Oct 03 10:42:43.223188 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1383/2915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:42 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:43.472129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:43.472826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:43.486182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:43.503905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:43.504386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:43.504849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:43.506829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:43.507952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:43.509462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:43.509687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:43.511892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f52c220-c8a3-49ee-9ec9-c042ece86d5d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.728811 Oct 03 10:42:43.512111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:43.531300 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1533/2916] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:42 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:43.547192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:43.553666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:43.565773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:43.570056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:43.573282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:43.574656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:43.575293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:43.578006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:43.791354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:43.809567 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f924f1ba-2e71-475a-a633-e7b3cf449ae7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.276736 Oct 03 10:42:43.810906 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1534/2917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:43 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:43.816358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a68b15ac-53a6-4a13-a6f9-9f336ac475e7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f21e280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:43.909353 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a68b15ac-53a6-4a13-a6f9-9f336ac475e7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.096984 Oct 03 10:42:43.922489 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1535/2918] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:43 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:44.239016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:44.243115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:44.264485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:44.270192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:44.275997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:44.279283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:44.283145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:44.284402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:44.388430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:44.476785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:44.497706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d8d1993-7d79-4cf9-a99a-f965a7023c05 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 1.029979 Oct 03 10:42:44.517526 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1384/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:43 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:44.570257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:44.578765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:44.590204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:44.602488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:44.604874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:44.606011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:44.607691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:44.608442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:44.609296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:44.762472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:44.782229 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e00bbe0a-dbea-4e69-8924-4981a5d97635 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.548282 Oct 03 10:42:44.786181 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1536/2920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:44 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:44.794613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0185313d-75f3-4e7c-9ed6-6d08911fc6af req-02e3c2e1-fb7e-4137-9068-720f6934e547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-plugged", "status": "completed", "tag": "b7af86eb-5635-45d8-9283-b672d13a9bae"}, {"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-plugged", "status": "completed", "tag": "12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:44.860453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0185313d-75f3-4e7c-9ed6-6d08911fc6af req-02e3c2e1-fb7e-4137-9068-720f6934e547 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:44.861513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0185313d-75f3-4e7c-9ed6-6d08911fc6af req-02e3c2e1-fb7e-4137-9068-720f6934e547 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:44.862374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0185313d-75f3-4e7c-9ed6-6d08911fc6af req-02e3c2e1-fb7e-4137-9068-720f6934e547 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:44.892317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0185313d-75f3-4e7c-9ed6-6d08911fc6af req-02e3c2e1-fb7e-4137-9068-720f6934e547 service nova] Creating event network-vif-plugged:b7af86eb-5635-45d8-9283-b672d13a9bae for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:44.893907 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0185313d-75f3-4e7c-9ed6-6d08911fc6af req-02e3c2e1-fb7e-4137-9068-720f6934e547 service nova] Creating event network-vif-plugged:12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:44.909794 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0185313d-75f3-4e7c-9ed6-6d08911fc6af req-02e3c2e1-fb7e-4137-9068-720f6934e547 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120320 Oct 03 10:42:44.913781 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1537/2921] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:44.922516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:44.923911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:44.935578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:44.936696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:44.937747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:44.939198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:44.940180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:44.941167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:45.280133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:45.301308 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa2314a1-5bc0-47ef-88a8-5f41ae25e041 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.383516 Oct 03 10:42:45.305981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1538/2922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:44 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:45.327149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2347d539-a764-46d1-aaa7-efe0fc6ced7a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f751940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:45.388195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:45.410012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:45.419484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:45.436983 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-404ac105-92ed-426a-b118-6d2593cbdc1c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.883663 Oct 03 10:42:45.437669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1385/2923] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:44 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:45.463407 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2347d539-a764-46d1-aaa7-efe0fc6ced7a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.155741 Oct 03 10:42:45.472612 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1539/2924] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:45 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:45.522541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:45.523161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:45.534929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:45.538664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:45.539685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:45.540859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:45.553615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:45.554129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:45.815363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:45.816672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:45.839106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:45.840450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:45.842194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:45.843704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:45.844382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:45.845043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:46.110366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:46.129997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2331135-1547-4dae-bc06-e111e2851b08 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.321651 Oct 03 10:42:46.131169 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1540/2925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:45 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:46.323631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:46.331013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:46.331722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:46.340696 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a91e13f0-c9ee-4e9d-bbc4-63f89fd265b9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 0.823183 Oct 03 10:42:46.341630 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1386/2926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:45 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:46.353686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:46.354303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:46.355314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:46.356116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:46.357174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:46.357676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:46.482717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9baaeb4-abd5-4202-a74b-6cc46e563ba8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f2409d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:46.551326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9baaeb4-abd5-4202-a74b-6cc46e563ba8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.072590 Oct 03 10:42:46.552616 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1387/2927] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:46 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:46.557622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:46.558242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:46.589545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:46.590051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:46.590679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:46.597559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:46.598066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:46.601691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:46.603094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:46.613234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34441166-9761-463d-94e8-dba8d85c501f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.286677 Oct 03 10:42:46.614543 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1541/2928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:46 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:47.158735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:47.160499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:47.178524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:47.179376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:47.180004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:47.181068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:47.181859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:47.182452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:47.359254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:47.382313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:47.387103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:47.392009 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bab126cf-a0ea-441c-b499-0d361836deca tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.837357 Oct 03 10:42:47.394809 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1388/2929] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:46 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:47.405886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-eab91909-58c0-4e23-8023-cfb98ede6900 req-d9644c27-77fb-4eeb-8617-6830ae19a78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-plugged", "status": "completed", "tag": "829b5797-cf23-4334-85f8-8196dcc8acd1"}, {"server_uuid": "c723ca0a-4535-4646-8c75-7faf0a86d96b", "name": "network-vif-plugged", "status": "completed", "tag": "640107ef-8d9b-422f-a66d-416bfe6f2d27"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:47.439083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eab91909-58c0-4e23-8023-cfb98ede6900 req-d9644c27-77fb-4eeb-8617-6830ae19a78c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:47.442203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eab91909-58c0-4e23-8023-cfb98ede6900 req-d9644c27-77fb-4eeb-8617-6830ae19a78c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:47.442567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eab91909-58c0-4e23-8023-cfb98ede6900 req-d9644c27-77fb-4eeb-8617-6830ae19a78c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:47.480477 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-eab91909-58c0-4e23-8023-cfb98ede6900 req-d9644c27-77fb-4eeb-8617-6830ae19a78c service nova] Creating event network-vif-plugged:829b5797-cf23-4334-85f8-8196dcc8acd1 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:47.490754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-eab91909-58c0-4e23-8023-cfb98ede6900 req-d9644c27-77fb-4eeb-8617-6830ae19a78c service nova] Creating event network-vif-plugged:640107ef-8d9b-422f-a66d-416bfe6f2d27 for instance c723ca0a-4535-4646-8c75-7faf0a86d96b on n-h1-858383-3 Oct 03 10:42:47.524325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-eab91909-58c0-4e23-8023-cfb98ede6900 req-d9644c27-77fb-4eeb-8617-6830ae19a78c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.127275 Oct 03 10:42:47.524979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1389/2930] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:47.548839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:47.549888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:47.579063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:47.579693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:47.580007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:47.580742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:47.581237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:47.581674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:48.113510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:48.125394 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58cbb575-fecd-4533-bc9a-b235010c9e3b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 0.599115 Oct 03 10:42:48.126004 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1390/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:47 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:48.148131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb1d30bf-ab72-498e-8b45-1f1b899a2a95 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e495700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:48.318491 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb1d30bf-ab72-498e-8b45-1f1b899a2a95 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.191397 Oct 03 10:42:48.319689 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1391/2932] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:48 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:48.331184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:48.335915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:48.356918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:48.369102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:48.372117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:48.375865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:48.380497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:48.387044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:48.410072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:48.428835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:48.435461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b41671c-f3d3-451b-bbc4-36d096a56869 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 1.281634 Oct 03 10:42:48.436925 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1542/2933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:47 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:48.485036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:48.486208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:48.512927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:48.517012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:48.517750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:48.518841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:48.520397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:48.524479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:49.043926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:49.055634 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-14449ead-a0fc-494b-a68b-d22e58965f38 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.734661 Oct 03 10:42:49.056250 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1392/2934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:48 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:49.150037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:49.150934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:49.163667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:49.164709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:49.165351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:49.175293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:49.176024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:49.176633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:49.569379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:49.580503 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-62d4bce0-2108-4928-8293-b64f13bc4d14 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 0.434620 Oct 03 10:42:49.583674 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1393/2935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:49 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:49.605214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8219e467-43c8-4d22-a8c2-e6bb3c9f4668 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f0f1a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:49.673924 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8219e467-43c8-4d22-a8c2-e6bb3c9f4668 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.087174 Oct 03 10:42:49.683547 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1394/2936] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:49 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:49.689190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:49.690296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:49.690675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:49.701175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:49.701746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:49.702153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:49.702838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:49.703207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:49.704390 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1eeab5f9-3b4d-4f82-9210-a86de0215b1e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 1.256093 Oct 03 10:42:49.704721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:49.705565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:49.706204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:49.720051 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1543/2937] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:48 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:49.730639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-plugged", "status": "completed", "tag": "5db7d0c4-80d9-4ba7-945d-4a98f691fe43"}, {"server_uuid": "f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4", "name": "network-vif-plugged", "status": "completed", "tag": "a30f35d1-8f30-4892-95ea-375d6270fb11"}, {"server_uuid": "bf8a08d3-3b84-458e-aa9f-1941ac2386c8", "name": "network-vif-plugged", "status": "completed", "tag": "9a481fa9-ba9e-468a-8c8d-ada1db6b9976"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:49.768865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:49.772496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:49.773274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:49.794063 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] Creating event network-vif-plugged:5db7d0c4-80d9-4ba7-945d-4a98f691fe43 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:49.794581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] Creating event network-vif-plugged:a30f35d1-8f30-4892-95ea-375d6270fb11 for instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 on n-h2-858383-3 Oct 03 10:42:49.795300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] Creating event network-vif-plugged:9a481fa9-ba9e-468a-8c8d-ada1db6b9976 for instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 on n-h2-858383-3 Oct 03 10:42:49.804298 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c669e88f-1ee2-4ef6-9f78-014ee59083c5 req-cfbcd4bf-7d59-408a-a666-80cc48c08fb4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.082367 Oct 03 10:42:49.805231 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1544/2938] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:50.086646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:50.087304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:50.102706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:50.103486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:50.104129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:50.108109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:50.109499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:50.110133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:50.387955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:50.402247 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc8e1431-79de-433b-bea5-6dc4e35f5711 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.717232 Oct 03 10:42:50.407039 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1395/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:49 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:50.610848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:50.611834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:50.628857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:50.629679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:50.630814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:50.636475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:50.637185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:50.637739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:50.715145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:50.728720 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c23be579-912f-44dc-bfdf-1b496ec6546d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1523 microversion: 2.1 time: 0.647458 Oct 03 10:42:50.731265 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1545/2940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:50 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1523 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:50.737641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62d60612-5821-4f37-b4e6-af4f18af4456 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f18c790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:50.836931 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62d60612-5821-4f37-b4e6-af4f18af4456 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.104014 Oct 03 10:42:50.837528 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1546/2941] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:50 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:50.875419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:50.876451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:50.910264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:50.911131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:50.912375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:50.913526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:50.914251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:50.915134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:51.246083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:51.260926 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6da8ea66-5967-45cd-bf64-b7c12dfe55c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1316 microversion: 2.1 time: 0.655332 Oct 03 10:42:51.274745 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1396/2942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:50 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:51.449180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:51.450680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:51.480280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:51.486591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:51.488346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:51.496725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:51.501400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:51.507052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:51.551020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:51.604437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:51.613872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:51.618247 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d879265d-a86b-450e-a436-4fe95f5c339b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1875 microversion: 2.42 time: 0.778342 Oct 03 10:42:51.640759 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1547/2943] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:50 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1875 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:51.760878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:51.762184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:51.825843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:51.839933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:51.841424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:51.855253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:51.856446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:51.857412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:52.151471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:52.190514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8262763e-7c45-49a1-9d0d-1db9442fcd13 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.747874 Oct 03 10:42:52.195889 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1397/2944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:51 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:52.220702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-938af7c1-6ec8-4de9-a894-dffbca82f441 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f1459d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:52.357594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:52.397334 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-717de2ee-1db4-4264-9537-293766aad92f tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1508 microversion: 2.1 time: 0.644183 Oct 03 10:42:52.402017 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-938af7c1-6ec8-4de9-a894-dffbca82f441 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1410 microversion: 2.1 time: 0.202987 Oct 03 10:42:52.407979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1398/2945] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:52 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1410 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:52.420902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-02dd14ab-e0f0-4e97-99a2-063c791aee2b req-6ca3e030-4531-4f4c-b302-56719e101099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309241dd-9390-48da-b52c-521667f3808c", "name": "network-vif-plugged", "status": "completed", "tag": "ec92c056-8195-41fa-bb3d-6c81f4fbd9db"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:52.431059 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1548/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:51 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:52.483645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-02dd14ab-e0f0-4e97-99a2-063c791aee2b req-6ca3e030-4531-4f4c-b302-56719e101099 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:52.486763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:52.487542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-02dd14ab-e0f0-4e97-99a2-063c791aee2b req-6ca3e030-4531-4f4c-b302-56719e101099 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:52.488161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-02dd14ab-e0f0-4e97-99a2-063c791aee2b req-6ca3e030-4531-4f4c-b302-56719e101099 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:52.496949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:52.521127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:52.522019 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-02dd14ab-e0f0-4e97-99a2-063c791aee2b req-6ca3e030-4531-4f4c-b302-56719e101099 service nova] Creating event network-vif-plugged:ec92c056-8195-41fa-bb3d-6c81f4fbd9db for instance 309241dd-9390-48da-b52c-521667f3808c on n-h1-858383-3 Oct 03 10:42:52.523300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:52.524239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:52.526989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:52.527546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:52.527996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:52.537321 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-02dd14ab-e0f0-4e97-99a2-063c791aee2b req-6ca3e030-4531-4f4c-b302-56719e101099 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123037 Oct 03 10:42:52.538694 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1399/2947] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:52.554773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b24cad17-d7ea-4867-ae93-982e03258dd8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Action: 'create', calling method: .version_select at 0x7f07573e3670>, body: {"keypair": {"name": "tempest-keypair-2088735604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoLw+mUmJRvbzo8TlSxwPTG1xh8WxTV8lnqS8coam8gUH+b5wKFDBE4YbSmW7WQnG3Kx9azSCGDcp9LdvQ17Kf8mVFKaVi331tVAMWkLYx3j9DuYW7TODLpn6gEbxiVSw=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:52.588847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b24cad17-d7ea-4867-ae93-982e03258dd8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Getting quotas for project 2675121b976b452db6d77e8e6e628954. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:52.617579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b24cad17-d7ea-4867-ae93-982e03258dd8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Getting quotas for user 8661b68516064439beaa63b26678a918 and project 2675121b976b452db6d77e8e6e628954. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:52.663724 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b24cad17-d7ea-4867-ae93-982e03258dd8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.123133 Oct 03 10:42:52.684937 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1400/2948] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:42:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:42:52.700860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:52.702521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:52.717989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:52.718905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:52.720804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:52.721947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:52.723560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:52.724873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.022502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:53.036066 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-989f7ebb-7526-410e-8921-257e82fd949b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1466 microversion: 2.1 time: 0.574436 Oct 03 10:42:53.045185 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1549/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:52 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1466 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:53.071471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:53.072447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:53.081347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.082176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.082847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.084339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.085155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.085751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.321409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:53.341434 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68f0d460-bcc8-49e6-bd15-a64236874e2a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 200 len: 1508 microversion: 2.1 time: 0.653066 Oct 03 10:42:53.362120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1401/2950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:52 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 1508 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:53.493844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:53.494692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:53.510444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.511250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.512891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.515432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.518304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.519484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:53.520356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.535314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:53.543201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:53.544648 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e5703b24-a9e7-493e-b90c-0c5678caa819 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2831 microversion: 2.42 time: 0.485257 Oct 03 10:42:53.545267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1550/2951] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:42:53 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2831 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:53.563951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:53.565457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:53.591222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.592062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.592662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.594473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.595119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.595632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.881532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:53.896147 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0a3b01f-c9f2-411b-a7e1-123addc0f063 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.343885 Oct 03 10:42:53.898233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1551/2952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:53 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:53.899080 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ef0fb99-f18f-49be-8a00-d7f9633b200a tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1617 microversion: 2.1 time: 0.535313 Oct 03 10:42:53.905146 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1402/2953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:53 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1617 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:53.905393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:53.906212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:53.917633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-67b78479-afbd-4f04-9ab0-bc6415f87751 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e4c0f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:53.918427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.919983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.920831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.921795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:53.922675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:53.923528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:53.982834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:42:53.992813 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-67b78479-afbd-4f04-9ab0-bc6415f87751 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1419 microversion: 2.1 time: 0.086636 Oct 03 10:42:53.994024 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1403/2954] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:53 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1419 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:53.999090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:53.999856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:54.009405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:54.011142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:54.011984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:54.012957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:54.014271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:54.015042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:54.125353 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-008ab1b1-6e91-4b68-9613-e3f3ad5a4af0 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 204 len: 0 microversion: 2.1 time: 0.225054 Oct 03 10:42:54.127631 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1552/2955] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:42:53 2022] DELETE /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:42:54.149647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f79d6695-1506-4009-a892-3d5d9271b61d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: .version_select at 0x7f074f751c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-861868107", "policies": ["affinity"]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:54.170772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f79d6695-1506-4009-a892-3d5d9271b61d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:54.177926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f79d6695-1506-4009-a892-3d5d9271b61d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:54.183704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:54.189377 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-378cf271-de0f-46a3-966c-6e7f05ec3978 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.193926 Oct 03 10:42:54.190360 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1404/2956] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:42:53 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f/os-interface => generated 1829 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:42:54.196317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5736febc-5470-4ae9-93a5-1cd28095b0df tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f98e550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:54.281428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f79d6695-1506-4009-a892-3d5d9271b61d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:54.287546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f79d6695-1506-4009-a892-3d5d9271b61d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:54.303527 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f79d6695-1506-4009-a892-3d5d9271b61d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.164997 Oct 03 10:42:54.304080 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5736febc-5470-4ae9-93a5-1cd28095b0df tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 200 len: 1419 microversion: 2.1 time: 0.106626 Oct 03 10:42:54.315171 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1553/2957] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 3 10:42:54 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:54.319984 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1405/2958] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:42:54 2022] GET /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 1419 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:54.327199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a52fc33-07c8-4760-a777-24ebf18b9760 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f21e160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:54.367801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-347357465", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "19fafd07-9a97-4e03-b4e2-1d09963b3097"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:54.474405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] validate_networks() for [('19fafd07-9a97-4e03-b4e2-1d09963b3097', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:55.324543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:55.325190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:55.326571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:55.328081 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a52fc33-07c8-4760-a777-24ebf18b9760 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 204 len: 0 microversion: 2.1 time: 1.006716 Oct 03 10:42:55.328705 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1554/2959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:54 2022] DELETE /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:42:55.339579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-680247782", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2d1769a0-dd55-4b57-a6f7-dcc670dfe3d6"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:55.340592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:55.341119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:55.361499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:55.362062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:55.362516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:55.363456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:55.363925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:55.366407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:55.398128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Getting quotas for project a66f39dd2e184e50b5531ef369d2455c. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:55.405067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Getting quotas for user ad027da90cc247a8ad9ba953b39d19b1 and project a66f39dd2e184e50b5531ef369d2455c. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:55.427971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:42:55.429523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:55.430843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:55.486343 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c0bcae81-5990-42f5-afaa-be64de272a16 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122981 Oct 03 10:42:55.493287 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1406/2960] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:42:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:42:55.493287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:55.493287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:55.501081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:55.501760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:55.502430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:55.503609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:55.504296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:55.505275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:55.707553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:55.717012 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a7e458e8-7457-4b53-9241-9a444c80d27c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1321 microversion: 2.1 time: 0.228485 Oct 03 10:42:55.717588 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1407/2961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:55 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:55.737007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:55.737893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:55.751782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:55.752287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:55.752726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:55.753656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:55.754336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:55.755979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:55.796161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:42:55.920957 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-97d50178-772a-4502-93e9-4b45864dd772 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 204 len: 0 microversion: 2.1 time: 0.196484 Oct 03 10:42:55.922211 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1408/2962] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:42:55 2022] DELETE /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:42:55.929486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-585af22f-f0ae-4fc7-b68d-4de1f991952d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:55.930424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-585af22f-f0ae-4fc7-b68d-4de1f991952d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:56.037563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-585af22f-f0ae-4fc7-b68d-4de1f991952d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:56.050627 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-585af22f-f0ae-4fc7-b68d-4de1f991952d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1217 microversion: 2.1 time: 0.126410 Oct 03 10:42:56.082057 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1409/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:55 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:56.104748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1632089403", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "154cf415-1c40-42a9-bfa5-99c4a7b477bb"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:56.162845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:56.164214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:56.165195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:56.166326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:56.172002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:56.195196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] validate_networks() for [('154cf415-1c40-42a9-bfa5-99c4a7b477bb', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:56.220830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:56.221669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:56.222663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:56.224027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:56.224716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:56.225514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:56.248143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:56.255780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:56.279149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Going to run 2 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:42:56.283857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:56.335134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122269) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 03 10:42:56.357673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:56.365838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:56.438290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:56.448850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:56.474836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=19597ad5-1d81-4e4d-8f6b-a0ecb551f42e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:56.555191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:56.561095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:56.623926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:56.630764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:56.673382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-74b00870-3ac6-4122-9282-c8e9d28b20ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.337507 Oct 03 10:42:56.674688 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1555/2964] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:42:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1345 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:42:56.683299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:56.689041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:56.690187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Searching by: {'deleted': False, 'project_id': '784dad77eab8442e85f2141e9641ca22'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:42:56.708970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:56.709877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:56.710689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:56.711791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:56.712391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:56.712937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:56.741324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:42:56.766237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:56.775086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f66c1d49-ef8b-4fc6-8208-c1623711e600 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.095860 Oct 03 10:42:56.782869 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1556/2965] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:42:56 2022] GET /compute/v2.1/servers => generated 1001 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:42:56.782869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:56.782869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:56.803388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:56.804025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:56.804570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:56.805452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:56.806173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:56.806711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:57.040793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:42:57.041298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:42:57.041681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:42:57.042312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:42:57.042726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:42:57.064397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:57.064912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:57.067413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:57.068982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:57.069550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:57.069991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:57.090815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:42:57.096433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for user 51cf916cbc904a6a97066fe7af1b3bae and project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:42:57.109612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:42:57.111948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:42:57.169106 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fcacaaa3-89e0-483d-8d09-361c50e95c19 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084483 Oct 03 10:42:57.170423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1410/2966] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:42:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:42:57.176405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb83523a-d3db-40e1-9970-9fa28d61b19e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:57.178295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb83523a-d3db-40e1-9970-9fa28d61b19e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:57.382547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:57.392482 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf89af31-9d0f-497c-b0ac-67083f559b11 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1515 microversion: 2.1 time: 0.615243 Oct 03 10:42:57.394038 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1557/2967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:56 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:57.401248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:57.404201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:57.435638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:57.455086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:57.456752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:57.461736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:57.462483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:57.463206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:57.470001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb83523a-d3db-40e1-9970-9fa28d61b19e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:57.489991 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb83523a-d3db-40e1-9970-9fa28d61b19e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1218 microversion: 2.1 time: 0.317643 Oct 03 10:42:57.500837 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1411/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:57 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1218 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:57.504383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83ab3909-54e2-4987-a22d-d1da5a04c0b7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:57.513328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-83ab3909-54e2-4987-a22d-d1da5a04c0b7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:57.739442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83ab3909-54e2-4987-a22d-d1da5a04c0b7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:57.753209 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83ab3909-54e2-4987-a22d-d1da5a04c0b7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1208 microversion: 2.1 time: 0.259093 Oct 03 10:42:57.757958 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1412/2969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:57 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1208 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:57.768271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:57.776296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:57.797325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:57.798189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:57.798888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:57.799869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:57.800743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:57.801742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:57.877275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'flavor' on Instance uuid 309241dd-9390-48da-b52c-521667f3808c {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:42:58.019141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:58.039215 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec9862c5-cd37-4755-a568-51228913b089 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1277 microversion: 2.1 time: 0.643806 Oct 03 10:42:58.040974 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1558/2970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:57 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1277 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:58.050973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d192664a-7fc8-465b-97ae-2854510e30ae req-e0cc93ad-0c1a-48e7-a855-bfb55bbdcb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c723ca0a-4535-4646-8c75-7faf0a86d96b", "name": "network-vif-deleted", "tag": "640107ef-8d9b-422f-a66d-416bfe6f2d27"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:58.123694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d192664a-7fc8-465b-97ae-2854510e30ae req-e0cc93ad-0c1a-48e7-a855-bfb55bbdcb74 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:58.126032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d192664a-7fc8-465b-97ae-2854510e30ae req-e0cc93ad-0c1a-48e7-a855-bfb55bbdcb74 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:58.131949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d192664a-7fc8-465b-97ae-2854510e30ae req-e0cc93ad-0c1a-48e7-a855-bfb55bbdcb74 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:58.137469 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f97bd4f2-b6bb-403f-b166-2c48d03111e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action" status: 200 len: 32 microversion: 2.1 time: 0.370743 Oct 03 10:42:58.162251 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1413/2971] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:42:57 2022] POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:42:58.191294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3c570f66-e2c8-4bc4-9c40-3cd89194d5dd req-a782b9d2-ffae-4162-82ef-db5a39e8b49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "tag": "b7af86eb-5635-45d8-9283-b672d13a9bae"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:58.228117 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d192664a-7fc8-465b-97ae-2854510e30ae req-e0cc93ad-0c1a-48e7-a855-bfb55bbdcb74 service nova] Creating event network-vif-deleted:640107ef-8d9b-422f-a66d-416bfe6f2d27 for instance c723ca0a-4535-4646-8c75-7faf0a86d96b on n-h1-858383-3 Oct 03 10:42:58.248258 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d192664a-7fc8-465b-97ae-2854510e30ae req-e0cc93ad-0c1a-48e7-a855-bfb55bbdcb74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204825 Oct 03 10:42:58.250967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c570f66-e2c8-4bc4-9c40-3cd89194d5dd req-a782b9d2-ffae-4162-82ef-db5a39e8b49d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:58.252635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c570f66-e2c8-4bc4-9c40-3cd89194d5dd req-a782b9d2-ffae-4162-82ef-db5a39e8b49d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:58.254287 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1559/2972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:58.256543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c570f66-e2c8-4bc4-9c40-3cd89194d5dd req-a782b9d2-ffae-4162-82ef-db5a39e8b49d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:58.309433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:58.315198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:58.323687 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3c570f66-e2c8-4bc4-9c40-3cd89194d5dd req-a782b9d2-ffae-4162-82ef-db5a39e8b49d service nova] Creating event network-changed:b7af86eb-5635-45d8-9283-b672d13a9bae for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:42:58.335970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:58.341487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:58.346728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:58.347621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:58.349584 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3c570f66-e2c8-4bc4-9c40-3cd89194d5dd req-a782b9d2-ffae-4162-82ef-db5a39e8b49d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185165 Oct 03 10:42:58.350795 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1414/2973] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:58.354220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:58.356481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:58.357209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:58.357739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e7d0371f-0e0f-4bb9-8835-6c707f36e589 req-e441b267-7c67-4002-8294-1913aee31043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59342ad5-604b-486f-9d3f-aaf03ef28462", "name": "network-vif-unplugged", "status": "completed", "tag": "57d1d845-8d04-4acb-8acc-e009744876a7"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:58.412370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e7d0371f-0e0f-4bb9-8835-6c707f36e589 req-e441b267-7c67-4002-8294-1913aee31043 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:58.413185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e7d0371f-0e0f-4bb9-8835-6c707f36e589 req-e441b267-7c67-4002-8294-1913aee31043 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:58.413833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e7d0371f-0e0f-4bb9-8835-6c707f36e589 req-e441b267-7c67-4002-8294-1913aee31043 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:58.446268 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e7d0371f-0e0f-4bb9-8835-6c707f36e589 req-e441b267-7c67-4002-8294-1913aee31043 service nova] Creating event network-vif-unplugged:57d1d845-8d04-4acb-8acc-e009744876a7 for instance 59342ad5-604b-486f-9d3f-aaf03ef28462 on n-h2-858383-3 Oct 03 10:42:58.458334 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e7d0371f-0e0f-4bb9-8835-6c707f36e589 req-e441b267-7c67-4002-8294-1913aee31043 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105520 Oct 03 10:42:58.460949 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1415/2974] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:42:58.514202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:58.514906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:58.526946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:58.528890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:58.529479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:58.530153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:58.530814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:58.531362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:58.531801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:58.842210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:58.859608 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed86861a-52c5-41e7-9cfc-21f25639dab0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.602023 Oct 03 10:42:58.860211 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1560/2975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:58 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:58.886624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-324928017", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "589b6bd8-c109-43fa-b4db-6fe8fb7847cc"}, {"port": "274f027e-bcda-4a01-8a4f-7c02cb37e040", "tag": "port-1"}, {"port": "ab64d46f-159d-49ad-ac8a-d284c51b9e13", "tag": "port-2"}, {"uuid": "eb52a72e-3254-44f5-ab7a-8555e39993b1", "tag": "net-1"}, {"uuid": "eb52a72e-3254-44f5-ab7a-8555e39993b1"}, {"uuid": "fa60d914-af0b-46bf-b7a0-a3ca3ca916ac", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fa60d914-af0b-46bf-b7a0-a3ca3ca916ac", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a695cd25-12aa-40e3-8426-0ccbe376a9d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d464c0e1-06f7-408d-8cec-318940c26297", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d9fa333a-01e6-4254-ac23-04c4a9a67d76", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1141671237"}], "key_name": "tempest-keypair-2088735604", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:42:59.219271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:59.222136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] validate_networks() for [('589b6bd8-c109-43fa-b4db-6fe8fb7847cc', None, None, None, None, None), (None, None, '274f027e-bcda-4a01-8a4f-7c02cb37e040', None, None, None), (None, None, 'ab64d46f-159d-49ad-ac8a-d284c51b9e13', None, None, None), ('eb52a72e-3254-44f5-ab7a-8555e39993b1', None, None, None, None, None), ('eb52a72e-3254-44f5-ab7a-8555e39993b1', None, None, None, None, None), ('fa60d914-af0b-46bf-b7a0-a3ca3ca916ac', '10.2.2.100', None, None, None, None), ('fa60d914-af0b-46bf-b7a0-a3ca3ca916ac', '10.2.2.200', None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:42:59.233672 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-59fb15f3-4be7-4ce8-b2e4-6ee978c4e0a6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1214 microversion: 2.1 time: 0.723328 Oct 03 10:42:59.234292 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1416/2976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:58 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1214 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:59.245206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:59.249611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:59.264952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:59.265454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:59.265897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:59.266692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:59.267144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:59.268480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:59.279805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:42:59.530438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:42:59.552178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-76a9bd56-16cf-468a-b5c9-5a9cb2411912 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1204 microversion: 2.1 time: 0.313275 Oct 03 10:42:59.553315 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1417/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:59 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1204 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:42:59.562164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:42:59.564523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:42:59.575681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:59.576550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:59.577482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:42:59.578586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:42:59.579980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:42:59.580840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:00.103618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:00.111645 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72c8070b-b0b2-4a8e-8863-6e2490c8b5b7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1275 microversion: 2.1 time: 0.556892 Oct 03 10:43:00.112247 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1418/2978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:42:59 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1275 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:00.131320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:00.131930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:00.155303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:00.155759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:00.157939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:00.158913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:00.161828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:00.166441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:00.631805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:00.646000 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3fa7d84e-9f52-4853-a76f-566695ea9dc7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.528535 Oct 03 10:43:00.647106 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1419/2979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:00 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:00.654198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:00.657471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:00.679081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:00.679858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:00.680466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:00.695594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:00.696352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:00.696937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:01.288879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:01.300705 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed2a5300-beb5-4669-bbaa-d09c3b3725fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1270 microversion: 2.1 time: 0.651958 Oct 03 10:43:01.325274 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1420/2980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:00 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1270 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:01.330863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:01.338616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:01.351831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:01.356809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:01.365412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:01.366413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:01.367041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:01.367960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:01.997129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:02.057811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eed096cd-ff3e-49a9-b11a-b2e04ce0a47f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1260 microversion: 2.1 time: 0.730577 Oct 03 10:43:02.067463 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1421/2981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:01 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1260 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:02.101560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:02.103007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:02.141689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:02.142494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:02.145892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:02.150289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:02.153621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:02.155269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:02.925923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:02.940750 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6a3c218-71f9-44ca-acd1-67067bd16047 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.870544 Oct 03 10:43:02.942113 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1422/2982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:02 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:02.948216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:02.949161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:02.965193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:02.966034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:02.966723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:02.967674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:02.968345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:02.969022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:03.578241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:03.606637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bccfed8a-68da-4954-b71f-4891c4a3df1c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.662326 Oct 03 10:43:03.608882 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1423/2983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:02 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:03.617062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ea3ea4d5-12fb-4371-8daf-b658bc653adf req-03db2ca7-849f-4a13-ae2e-1fad7e905eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59342ad5-604b-486f-9d3f-aaf03ef28462", "name": "network-vif-deleted", "tag": "57d1d845-8d04-4acb-8acc-e009744876a7"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:03.641313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ea3ea4d5-12fb-4371-8daf-b658bc653adf req-03db2ca7-849f-4a13-ae2e-1fad7e905eda service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:03.642241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ea3ea4d5-12fb-4371-8daf-b658bc653adf req-03db2ca7-849f-4a13-ae2e-1fad7e905eda service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:03.642951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ea3ea4d5-12fb-4371-8daf-b658bc653adf req-03db2ca7-849f-4a13-ae2e-1fad7e905eda service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:03.664116 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ea3ea4d5-12fb-4371-8daf-b658bc653adf req-03db2ca7-849f-4a13-ae2e-1fad7e905eda service nova] Creating event network-vif-deleted:57d1d845-8d04-4acb-8acc-e009744876a7 for instance 59342ad5-604b-486f-9d3f-aaf03ef28462 on n-h2-858383-3 Oct 03 10:43:03.673055 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ea3ea4d5-12fb-4371-8daf-b658bc653adf req-03db2ca7-849f-4a13-ae2e-1fad7e905eda service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061766 Oct 03 10:43:03.690663 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1424/2984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:03.708338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:03.710805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:03.725681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:03.726332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:03.726965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:03.727935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:03.728743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:03.729766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:04.099562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:04.133606 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-02ee8f03-8c27-456d-b36b-8cce059d199a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1276 microversion: 2.1 time: 0.439672 Oct 03 10:43:04.134200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1425/2985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:03 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1276 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:04.139145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:04.139981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:04.146905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:04.147619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:04.148252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:04.149174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:04.149810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:04.150394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:04.276744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:04.289009 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f34653a-09fa-459f-8399-97afb5afadf5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1266 microversion: 2.1 time: 0.153499 Oct 03 10:43:04.290143 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1426/2986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:04 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:04.294971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:04.295783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:04.302901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:04.303579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:04.304175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:04.305091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:04.305694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:04.306266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:04.751273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:04.765563 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-654f0d0b-98a9-46db-ac9f-9bf8e7f91101 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.474180 Oct 03 10:43:04.767061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1427/2987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:04 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:04.787120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:04.789174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:04.798014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:04.800065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:04.800872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:04.801812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:04.802652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:04.803249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:05.560441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:05.577164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-adce920c-5c62-4814-bcbb-9a6b3ac7c4d0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.808181 Oct 03 10:43:05.588801 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1428/2988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:04 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:05.588801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:05.588801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:05.601130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:05.601630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:05.602670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:05.602813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:05.603233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:05.603662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:06.219948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:43:06.221770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:43:06.222447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:43:06.224408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:43:06.225417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:43:06.246170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:06.249383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:06.252792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:06.255566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:06.256333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:06.257288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:06.302170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Getting quotas for project 2675121b976b452db6d77e8e6e628954. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:06.312045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Getting quotas for user 8661b68516064439beaa63b26678a918 and project 2675121b976b452db6d77e8e6e628954. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:06.449232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:06.457161 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7fb34432-368f-47d4-88df-e104d9a40f82 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.877941 Oct 03 10:43:06.458325 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1429/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:05 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:06.477878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:06.480934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:06.490653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:06.491755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:06.492363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:06.493464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:06.494084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:06.495304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:06.567724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:43:06.572482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a695cd25-12aa-40e3-8426-0ccbe376a9d5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d464c0e1-06f7-408d-8cec-318940c26297',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9fa333a-01e6-4254-ac23-04c4a9a67d76',volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:43:07.079344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:07.085083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:07.103561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5ae5cc7-f326-4886-8e94-b4a020761b16 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.637626 Oct 03 10:43:07.129223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1430/2990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:06 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:07.137744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:07.138632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:07.150357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.151311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.151711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:07.168977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.169653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.170113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:07.198515 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6911a180-5ed1-4a6e-a5cf-45502e8bb1ae tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.318727 Oct 03 10:43:07.199174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1561/2991] 10.222.0.27 () {62 vars in 1189 bytes} [Mon Oct 3 10:42:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 8320 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:43:07.220113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a31fae02-0aec-4ba7-bd4c-7cc61c4529aa req-d49d6761-6631-4774-a16e-dc4f24e34974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12496d3-8e1d-4df5-8cb2-1585ed5db478", "tag": "42138797-dea5-4761-b283-1d4eda8d82d2"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:07.241255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a31fae02-0aec-4ba7-bd4c-7cc61c4529aa req-d49d6761-6631-4774-a16e-dc4f24e34974 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.241938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a31fae02-0aec-4ba7-bd4c-7cc61c4529aa req-d49d6761-6631-4774-a16e-dc4f24e34974 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.246514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a31fae02-0aec-4ba7-bd4c-7cc61c4529aa req-d49d6761-6631-4774-a16e-dc4f24e34974 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:07.281492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a31fae02-0aec-4ba7-bd4c-7cc61c4529aa req-d49d6761-6631-4774-a16e-dc4f24e34974 service nova] Creating event network-changed:42138797-dea5-4761-b283-1d4eda8d82d2 for instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 on n-h1-858383-3 Oct 03 10:43:07.289036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a31fae02-0aec-4ba7-bd4c-7cc61c4529aa req-d49d6761-6631-4774-a16e-dc4f24e34974 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077402 Oct 03 10:43:07.290052 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1562/2992] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:07.297215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-93ba7cfe-a713-4b16-b2a4-28a33f0811ba req-1a73efed-35c3-484d-92f0-c6a087c40861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19597ad5-1d81-4e4d-8f6b-a0ecb551f42e", "tag": "fecbfa54-c2f0-4482-a247-6bd804d352a2"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:07.307518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-93ba7cfe-a713-4b16-b2a4-28a33f0811ba req-1a73efed-35c3-484d-92f0-c6a087c40861 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.308001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-93ba7cfe-a713-4b16-b2a4-28a33f0811ba req-1a73efed-35c3-484d-92f0-c6a087c40861 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.308435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-93ba7cfe-a713-4b16-b2a4-28a33f0811ba req-1a73efed-35c3-484d-92f0-c6a087c40861 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:07.321307 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-93ba7cfe-a713-4b16-b2a4-28a33f0811ba req-1a73efed-35c3-484d-92f0-c6a087c40861 service nova] Creating event network-changed:fecbfa54-c2f0-4482-a247-6bd804d352a2 for instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e on n-h1-858383-3 Oct 03 10:43:07.327146 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-93ba7cfe-a713-4b16-b2a4-28a33f0811ba req-1a73efed-35c3-484d-92f0-c6a087c40861 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034823 Oct 03 10:43:07.328014 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1563/2993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:07.333943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:07.334665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:07.343619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.344263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.344712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:07.345447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.346074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.347265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:07.594981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:07.605908 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd180f74-0876-4591-8c31-a23a60e826f9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.276963 Oct 03 10:43:07.607317 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1564/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:07 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:07.613754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b961afdd-251a-463b-962d-0de7defe48d5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:07.614698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b961afdd-251a-463b-962d-0de7defe48d5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:07.697385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:07.710569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b961afdd-251a-463b-962d-0de7defe48d5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:07.722704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b961afdd-251a-463b-962d-0de7defe48d5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:07.725652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b961afdd-251a-463b-962d-0de7defe48d5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:07.726859 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c014d793-c04e-4364-a184-66cbae80c94d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.596297 Oct 03 10:43:07.727635 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1431/2995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:07 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:07.736110 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b961afdd-251a-463b-962d-0de7defe48d5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1285 microversion: 2.32 time: 0.127353 Oct 03 10:43:07.737087 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1565/2996] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:07 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:07.744638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:07.745484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:07.764676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=22 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:07.766918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.769266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.773091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:07.774553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:07.775545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:07.775999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:08.143969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:08.144596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:08.151811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:08.153463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:08.154258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:08.155273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:08.155975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:08.156715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:08.378098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:08.391064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb5b6fe8-5cf1-4044-9c5a-933f969a8a1a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.251286 Oct 03 10:43:08.406390 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1566/2997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:08 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:08.518104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:08.530767 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61b19bfb-1a94-4aca-b6c9-345b41545a50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.799710 Oct 03 10:43:08.557141 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1432/2998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:07 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:08.651354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:08.651998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:08.652887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1997314743", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "68fef825-1740-401a-a108-2da5fb99fb5b"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:08.668884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:08.669508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:08.670825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:08.672089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:08.673420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:08.673866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:08.749642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] validate_networks() for [('68fef825-1740-401a-a108-2da5fb99fb5b', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:43:08.864991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:08.873392 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e71cd880-06c3-4a0d-bcd2-76701c3fe9e3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.246931 Oct 03 10:43:08.889466 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1433/2999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:08 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:08.894720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:08.896435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:08.903693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:08.904310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:08.904875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:08.905708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:08.906880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:08.907578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:08.926086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:09.083431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:09.093074 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a9b22776-bc95-486c-a6b1-1fcdcfb98dc7 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.202287 Oct 03 10:43:09.105910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1434/3000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:08 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:09.112106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:09.112895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:09.121090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.121963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.122645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.123593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.124279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.125001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.198299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:09.209452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:09.210832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:09.212222 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00c104cf-d866-431f-90b4-7cdd8ce868e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1575 microversion: 2.32 time: 0.105255 Oct 03 10:43:09.212996 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1435/3001] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:09 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1575 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:09.342575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3f446581-9f77-489c-bc9e-4104b438d824 req-69b3d52a-1b80-4a4a-a8f3-62e4d44d8a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefa13c2-df74-4e2f-b73d-b848254cf657", "tag": "289f924a-d021-4bfb-a113-f4990b842c1c"}, {"name": "network-changed", "server_uuid": "951eaf6a-7c9d-4f81-b5eb-d01ef0d59243", "tag": "97f76ef1-55de-461a-86b3-e25afc9e4abc"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:09.354686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3f446581-9f77-489c-bc9e-4104b438d824 req-69b3d52a-1b80-4a4a-a8f3-62e4d44d8a53 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.355486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3f446581-9f77-489c-bc9e-4104b438d824 req-69b3d52a-1b80-4a4a-a8f3-62e4d44d8a53 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.355925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3f446581-9f77-489c-bc9e-4104b438d824 req-69b3d52a-1b80-4a4a-a8f3-62e4d44d8a53 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.371108 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3f446581-9f77-489c-bc9e-4104b438d824 req-69b3d52a-1b80-4a4a-a8f3-62e4d44d8a53 service nova] Creating event network-changed:289f924a-d021-4bfb-a113-f4990b842c1c for instance eefa13c2-df74-4e2f-b73d-b848254cf657 on n-h1-858383-3 Oct 03 10:43:09.371808 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3f446581-9f77-489c-bc9e-4104b438d824 req-69b3d52a-1b80-4a4a-a8f3-62e4d44d8a53 service nova] Creating event network-changed:97f76ef1-55de-461a-86b3-e25afc9e4abc for instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 on n-h1-858383-3 Oct 03 10:43:09.378230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3f446581-9f77-489c-bc9e-4104b438d824 req-69b3d52a-1b80-4a4a-a8f3-62e4d44d8a53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040668 Oct 03 10:43:09.379765 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1436/3002] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:09.417233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:09.418294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:09.425408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.425912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.426476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.427399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.428018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.428625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.619889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:09.632289 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8689fd32-138f-406a-b726-d195680a77af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.219498 Oct 03 10:43:09.638203 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1437/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:09 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:09.650585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:09.651208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:09.663806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.665455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.665911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.669688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.670148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.670747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.696025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:43:09.696541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:43:09.697441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:43:09.697582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:43:09.698089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:43:09.730513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.731525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.732125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.734207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:09.735125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:09.735739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:09.774817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Getting quotas for project 88f464a0fb634b4d83940ae609717889. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:09.782542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Getting quotas for user 57d093d3c0924bef9033a3cc13315b48 and project 88f464a0fb634b4d83940ae609717889. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:09.798673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:43:09.801084 n-d-858383-3 devstack@n-api.service[122269]: WARNING nova.utils [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1997314743 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-199731474 Oct 03 10:43:09.802919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:43:09.871206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e9a8cbf-13cb-4a3b-b50e-d910c364262a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443386 Oct 03 10:43:09.874907 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1567/3004] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:43:09.885246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27bd7b23-009a-4c5b-a5bc-b5eb8817ef11 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:09.886731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27bd7b23-009a-4c5b-a5bc-b5eb8817ef11 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:10.015807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27bd7b23-009a-4c5b-a5bc-b5eb8817ef11 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:10.026701 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27bd7b23-009a-4c5b-a5bc-b5eb8817ef11 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1232 microversion: 2.1 time: 0.145197 Oct 03 10:43:10.027846 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1568/3005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:09 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1232 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:10.036663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:10.037318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:10.060500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.061278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.061951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:10.062868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.063622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.064218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:10.275594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:10.283816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7173048a-ed67-4812-aa5e-a5a59c03a787 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.644339 Oct 03 10:43:10.284344 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1438/3006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:09 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:10.291655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:10.303321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c42b83dc-9aa4-47aa-b7a2-52b26a366fa0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.273850 Oct 03 10:43:10.304207 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1569/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:10 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:10.309814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:10.310736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:10.311089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:10.311718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:10.318333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.319098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.319310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.319889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:10.320830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.321265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:10.321695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.321971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.322430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.322837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.322950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:10.323567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:10.407301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:10.422122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:10.424491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:10.430268 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ce7e4b3-8144-4fc2-96f8-487412b15663 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1593 microversion: 2.32 time: 0.124250 Oct 03 10:43:10.432063 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1570/3008] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:10 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1593 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:10.647742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:10.658851 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d462bf50-d6b6-4e2d-9eeb-4b6ab1f1dc1d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.356064 Oct 03 10:43:10.673021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:10.673021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:10.679317 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1439/3009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:10 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:10.685794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.686190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.686628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:10.689374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:10.689945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:10.690383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.015618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:11.032295 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7545bcd7-1a71-4f0e-b86b-4c56a8d9bc43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.366755 Oct 03 10:43:11.035035 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1571/3010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:10 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:11.052002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:11.060821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:11.076106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.076919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.077574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.079084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.079808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.080441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.247971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:11.269884 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-476e6f01-b2da-451e-bb85-40e57a0d72bc tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1228 microversion: 2.1 time: 0.222705 Oct 03 10:43:11.270777 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1440/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:11 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1228 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:11.313407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:11.314291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:11.325942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.329456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.330261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.331206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.332184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:11.332683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.333063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.333210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:11.355295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.363206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.364751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.365927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.367713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.368977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.572509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:11.582271 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ab2da75-4ce0-47b9-aff0-8d11acfa21ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.278314 Oct 03 10:43:11.582935 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1572/3012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:11 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:11.592995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:11.592995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:11.603173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.603802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.604308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.605115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.605813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.606125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.762525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:11.778638 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1019289-25b5-46dd-b6db-eaafe30faed3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.448127 Oct 03 10:43:11.793809 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1441/3013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:11 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:11.804466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:11.805641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:11.814751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.815804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.816480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.817812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:11.818274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:11.818704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:11.883438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:11.915368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:11.916956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:11.925224 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-645685ee-742c-4c86-82b7-c0e2a2affcb7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1661 microversion: 2.32 time: 0.334296 Oct 03 10:43:11.928846 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1573/3014] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:11 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1661 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:12.060299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:12.061380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:12.076399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.077046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.080298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.081221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.081762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.082323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.272841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:12.295329 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40842988-f8e4-45f4-95e1-8b7156781e62 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.500170 Oct 03 10:43:12.298372 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1442/3015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:11 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:12.313054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:12.323236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b6c2537d-7591-4463-a131-7e950d78cf83 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.268560 Oct 03 10:43:12.325894 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1574/3016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:12 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:12.330951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:12.331842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:12.342166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.344047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.345276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.349456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.350280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.351482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.579138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:12.599553 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-316acf25-acfc-45da-b69d-45ca315bc35b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1290 microversion: 2.1 time: 0.287977 Oct 03 10:43:12.610393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:12.610968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:12.619945 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1443/3017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:12 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1290 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:12.626922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.627423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.627866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.628586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.629570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.630224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.805985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:12.806660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:12.818676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.819180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.819943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.820683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.821177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.821613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.965554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:12.978094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-584370e2-0307-4aa3-9e04-5fe3a9ca2ff3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.376559 Oct 03 10:43:12.979487 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1575/3018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:12 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:12.984586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:12.985484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:12.992673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.994295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.994976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:12.995974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:12.996876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:12.997507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:13.259565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:13.271179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:13.273020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:13.274347 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3032ef09-dbef-4e28-a832-f736ace4572d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1661 microversion: 2.32 time: 0.293744 Oct 03 10:43:13.275384 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1576/3019] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:12 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1661 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:13.330917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:13.332016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:13.340451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:13.341287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:13.341897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:13.342789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:13.343443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:13.344079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:13.566404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:13.584251 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6891dd12-db72-4cea-84d6-5e54852b3204 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.261058 Oct 03 10:43:13.601325 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1577/3020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:13 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:13.601325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:13.604111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:13.611097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:13.611632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:13.612134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:13.614262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:13.614823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:13.615401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:13.703526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:13.712892 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a0242ac-b133-4ca1-8e20-35c6b5d51bef tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.910764 Oct 03 10:43:13.721423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1444/3021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:12 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:13.727310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:13.730546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:13.745246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:13.749773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:13.757492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:13.758382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:13.759777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:13.763660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:13.861748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:13.866845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:13.872858 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-289f2745-01bc-4e65-a2a2-3e8dca5c36c0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.282787 Oct 03 10:43:13.873746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1578/3022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:13 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:13.919562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:13.933875 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d7a760ea-9fb5-44bd-8239-33909ce7acb0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1290 microversion: 2.1 time: 0.209253 Oct 03 10:43:13.935264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1445/3023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:13 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1290 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:14.015432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:14.016283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:14.023856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.024806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.025499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.026464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.027141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.027919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.208403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:14.218859 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b57dbdc1-04ec-42e6-816e-5c10650213e1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.209494 Oct 03 10:43:14.220128 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1579/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:14 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:14.306735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:14.307574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:14.316086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.316868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.317492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.318389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.319012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.319602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.398364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-45db29d2-ba5e-4e9d-a205-007105839ec8 req-dab479b9-7329-437b-952f-414880a7cb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19597ad5-1d81-4e4d-8f6b-a0ecb551f42e", "name": "network-vif-plugged", "status": "completed", "tag": "fecbfa54-c2f0-4482-a247-6bd804d352a2"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:14.411239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-45db29d2-ba5e-4e9d-a205-007105839ec8 req-dab479b9-7329-437b-952f-414880a7cb1b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.412735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-45db29d2-ba5e-4e9d-a205-007105839ec8 req-dab479b9-7329-437b-952f-414880a7cb1b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.413603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-45db29d2-ba5e-4e9d-a205-007105839ec8 req-dab479b9-7329-437b-952f-414880a7cb1b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.427805 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-45db29d2-ba5e-4e9d-a205-007105839ec8 req-dab479b9-7329-437b-952f-414880a7cb1b service nova] Creating event network-vif-plugged:fecbfa54-c2f0-4482-a247-6bd804d352a2 for instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e on n-h1-858383-3 Oct 03 10:43:14.433928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-45db29d2-ba5e-4e9d-a205-007105839ec8 req-dab479b9-7329-437b-952f-414880a7cb1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041370 Oct 03 10:43:14.435222 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1580/3025] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:43:14.608134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:14.608878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:14.615534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.616043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.616485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.617229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.617692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.618124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.646964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:14.658430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:14.660060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:14.661469 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b85b6d51-8dba-457c-b962-3d1bcfb7ca37 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1708 microversion: 2.32 time: 0.359770 Oct 03 10:43:14.662666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1446/3026] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:14 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1708 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:14.744917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:14.746271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:14.757693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.758574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.779414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.781072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.781754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.782847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.783491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:14.793690 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2324f34f-adbe-4e21-918f-5d197a68bb41 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.189573 Oct 03 10:43:14.795283 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1581/3027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:14 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:14.898241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:14.898864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:14.914873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.915657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.916312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:14.917404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:14.918678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:14.919331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.075673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:15.105514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e80e5556-2174-41a9-bb10-94c83fc2b0a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.362721 Oct 03 10:43:15.108283 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1447/3028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:14 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:15.123472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:15.125498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:15.146883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.147663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.148694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.153038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.153988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.154592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.205340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:15.213584 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-46aa1061-ab36-4194-ba35-0ba62af5fc01 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.319521 Oct 03 10:43:15.225409 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1582/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:14 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:15.243548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:15.244999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:15.252552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.253074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.253730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.254678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.255175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.255734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.428637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:15.439994 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ccb20f18-c983-43ed-910f-c7e267e46c4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.201484 Oct 03 10:43:15.441422 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1583/3030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:15 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:15.580788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:15.592388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-beb19697-278e-4fa6-adb5-0d4bd9d57619 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.480006 Oct 03 10:43:15.599284 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1448/3031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:15 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:15.688112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:15.688302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:15.694498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.694990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.695432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.696130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.696587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.697040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.821739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:15.823153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:15.832934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.833841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.834830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.835930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:15.838565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:15.839284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:15.876104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:15.886366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:15.888355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:15.889964 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cfc26edc-c8c1-46e5-82e7-fa774ccd89f8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1755 microversion: 2.32 time: 0.206309 Oct 03 10:43:15.906805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1584/3032] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:15 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:16.134326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:16.135203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:16.148077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.148720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.149291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.154012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.155939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.161044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.366936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:16.370087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:16.378923 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f04405a-2b17-493d-950b-02065e994e06 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.248683 Oct 03 10:43:16.379932 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8771b0ad-4da5-47a0-9208-c67568e24c69 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.563856 Oct 03 10:43:16.380506 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1449/3033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:15 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:16.393113 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1585/3034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:16 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:16.407031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:16.408013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:16.420944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.422265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.422887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.424115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.424800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.425747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.470139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:16.471025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:16.481649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.484329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.485021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.485739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.486590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.487223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.700400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:16.712493 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-11a34b56-1324-4825-944b-6ea2a3590e6b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.248552 Oct 03 10:43:16.724575 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1586/3035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:16 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:16.724575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9327d8fe-16a4-4820-a9ff-dadd27881ac7 req-b4efbc23-01cc-47f7-9120-bab128229b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12496d3-8e1d-4df5-8cb2-1585ed5db478", "name": "network-vif-plugged", "status": "completed", "tag": "42138797-dea5-4761-b283-1d4eda8d82d2"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:16.729693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9327d8fe-16a4-4820-a9ff-dadd27881ac7 req-b4efbc23-01cc-47f7-9120-bab128229b19 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.732228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9327d8fe-16a4-4820-a9ff-dadd27881ac7 req-b4efbc23-01cc-47f7-9120-bab128229b19 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.732228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9327d8fe-16a4-4820-a9ff-dadd27881ac7 req-b4efbc23-01cc-47f7-9120-bab128229b19 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.751356 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9327d8fe-16a4-4820-a9ff-dadd27881ac7 req-b4efbc23-01cc-47f7-9120-bab128229b19 service nova] Creating event network-vif-plugged:42138797-dea5-4761-b283-1d4eda8d82d2 for instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 on n-h1-858383-3 Oct 03 10:43:16.760563 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9327d8fe-16a4-4820-a9ff-dadd27881ac7 req-b4efbc23-01cc-47f7-9120-bab128229b19 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045728 Oct 03 10:43:16.761700 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1587/3036] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:16.771042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:16.772141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:16.779608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.779608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.785654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.786970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:16.787293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.787680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.788156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.828504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4b6dacb-21cd-4076-833f-a01e8295ee3a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.443305 Oct 03 10:43:16.829600 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1450/3037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:16 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:16.837079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-762e309b-3717-4da9-8628-491e45440135 req-56c97281-7164-4e78-82fa-cf7adaeaed6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eef4889-3f78-43c8-afdd-b6ca52ce723a", "tag": "b231caa1-577d-4d87-b429-cc9eda124029"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:16.868412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-762e309b-3717-4da9-8628-491e45440135 req-56c97281-7164-4e78-82fa-cf7adaeaed6a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.870561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-762e309b-3717-4da9-8628-491e45440135 req-56c97281-7164-4e78-82fa-cf7adaeaed6a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.871207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-762e309b-3717-4da9-8628-491e45440135 req-56c97281-7164-4e78-82fa-cf7adaeaed6a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.887355 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-762e309b-3717-4da9-8628-491e45440135 req-56c97281-7164-4e78-82fa-cf7adaeaed6a service nova] Creating event network-changed:b231caa1-577d-4d87-b429-cc9eda124029 for instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a on n-h2-858383-3 Oct 03 10:43:16.894326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-762e309b-3717-4da9-8628-491e45440135 req-56c97281-7164-4e78-82fa-cf7adaeaed6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062966 Oct 03 10:43:16.896341 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1451/3038] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:16.922768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:16.923511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:16.933200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.934573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.935062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.935836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:16.936504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:16.937808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:16.965355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:16.984399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:16.998120 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f96f5fcf-29ff-4a03-a681-6ec9c398eba0 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.232185 Oct 03 10:43:16.998831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1588/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:16 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:17.297349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:17.309350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:17.311187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:17.312368 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c984bc3-13fc-4159-a11e-1852413fd207 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1755 microversion: 2.32 time: 0.395673 Oct 03 10:43:17.313385 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1452/3040] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:16 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1755 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:17.408439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:17.409704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:17.412909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:17.414619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:17.418187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.418951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.419591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:17.420635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.421300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.422057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:17.427294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.428714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.429396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:17.431073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.431742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.433239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:17.625920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:17.634621 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a5a087e-788a-4839-a982-b1a6ee655109 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.233381 Oct 03 10:43:17.635759 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1589/3041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:17 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:17.720032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:17.731266 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aebc62ae-54a6-48ae-b7df-5ea2cb1dc802 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.326605 Oct 03 10:43:17.755031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:17.755541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:17.756798 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1453/3042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:17 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:17.763049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.763539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.764631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:17.764913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.765440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.766116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:17.853182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:17.854621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:17.870998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.871509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.871953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:17.872838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:17.873145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:17.873571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.018501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:18.027069 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02e84a5d-8f0a-44e5-9c21-b1a61764e237 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.280013 Oct 03 10:43:18.028346 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1590/3043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:17 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:18.034686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:18.035552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:18.043694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.044966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.045840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.046727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.047346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.047929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.099313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:18.110954 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a7005b9-bd07-494b-ac6a-c5ade41b3bec tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.262143 Oct 03 10:43:18.131881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1454/3044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:17 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:18.210765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:18.219407 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3873743-6a45-42cf-bbf3-4e1171b1c325 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.189710 Oct 03 10:43:18.220499 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1591/3045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:18 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:18.341486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:18.342020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:18.349121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.349616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.350046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.350916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.351374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.351853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.531330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:18.541388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:18.542920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:18.544074 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-980c83b3-89c4-4762-865a-15bfe1684764 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1802 microversion: 2.32 time: 0.206673 Oct 03 10:43:18.544642 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1455/3046] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:18 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:18.658859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:18.659486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:18.667538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.668172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.669111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.669255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.669721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.670154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.759766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:18.760389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:18.767525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.768072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.769213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.769475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:18.770485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:18.770966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:18.940705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:18.949828 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8df99a69-fbe3-4256-b7dd-b6e3069ed098 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.294787 Oct 03 10:43:18.965229 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1592/3047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:18 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:19.051171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:19.052078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:19.055146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:19.059508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.060068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.060515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.061255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.061707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.062129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.214933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:19.223290 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4454bd81-359e-4f86-a4f7-b1c04857e731 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.175968 Oct 03 10:43:19.224140 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1593/3048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:19 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:19.229446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:19.231283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:19.238133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.239441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.240104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.241182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.241861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.242500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.398813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:19.407502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4a43786-8cf5-4473-8176-11ab21bba0cb tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.181839 Oct 03 10:43:19.423393 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1594/3049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:19 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:19.423393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:19.423393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:19.423393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.423393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.423393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.425511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.425511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.425511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.593892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:19.614296 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-78f3ad0c-560a-4c22-82c7-a7b1ce90acd5 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.204008 Oct 03 10:43:19.614975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1595/3050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:19 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:19.620111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:19.621200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:19.628023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.628735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.629999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.631108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.631709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.632414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.752255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:19.794078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:19.815764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:19.818451 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-50343f99-16d1-4249-bdf8-fd7539c89496 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 1.063093 Oct 03 10:43:19.834825 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1456/3051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:18 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:19.837632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:19.844815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:19.846611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:19.848330 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d88c7697-c578-45b7-9909-4152a22f2ca8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1802 microversion: 2.32 time: 0.231695 Oct 03 10:43:19.849146 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1596/3052] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:19 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:19.976237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:19.977025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:19.983536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.984211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.984841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:19.985778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:19.986478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:19.987080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.249610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:20.250474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:20.257138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=46 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:20.258916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.259663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.260268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.261350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.262097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.262737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.375682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:20.383497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12409100-1b1d-4d3f-a9a6-3c29b45884e8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.412475 Oct 03 10:43:20.397174 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1457/3053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:19 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:20.430888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:20.431587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:20.442515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.448339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.449010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.450385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.452752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.453852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.481507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:20.495266 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75ddeec7-7052-4110-9b61-fa4a8482c0d5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.248656 Oct 03 10:43:20.497994 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1597/3054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:20 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:20.596303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e1a8e0bd-7c7f-4d75-9c03-5d430abd348e req-283d70bd-e9f2-4c91-9548-adb279934c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefa13c2-df74-4e2f-b73d-b848254cf657", "name": "network-vif-plugged", "status": "completed", "tag": "289f924a-d021-4bfb-a113-f4990b842c1c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:20.628439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e1a8e0bd-7c7f-4d75-9c03-5d430abd348e req-283d70bd-e9f2-4c91-9548-adb279934c96 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.630520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e1a8e0bd-7c7f-4d75-9c03-5d430abd348e req-283d70bd-e9f2-4c91-9548-adb279934c96 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.631262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e1a8e0bd-7c7f-4d75-9c03-5d430abd348e req-283d70bd-e9f2-4c91-9548-adb279934c96 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.666131 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e1a8e0bd-7c7f-4d75-9c03-5d430abd348e req-283d70bd-e9f2-4c91-9548-adb279934c96 service nova] Creating event network-vif-plugged:289f924a-d021-4bfb-a113-f4990b842c1c for instance eefa13c2-df74-4e2f-b73d-b848254cf657 on n-h1-858383-3 Oct 03 10:43:20.682851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e1a8e0bd-7c7f-4d75-9c03-5d430abd348e req-283d70bd-e9f2-4c91-9548-adb279934c96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091993 Oct 03 10:43:20.684053 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1598/3055] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:20.689593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:20.690304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:20.708656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.709181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.709627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.710349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.710805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.715840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.886454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:20.899506 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68355aac-5f65-48f7-8558-6761f4b9eb15 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.472227 Oct 03 10:43:20.900103 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1458/3056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:20 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:20.905345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:20.914655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:20.924391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.924956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.925368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.926735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.928850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.933847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.936093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:20.952242 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb4c7bdd-765b-4acf-9a68-7b67b7129a90 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.266642 Oct 03 10:43:20.954040 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1599/3057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:20 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:20.975580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:20.976062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:20.984066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.984066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.984066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:20.984594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:20.985036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:20.985529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.221746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:21.233725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:21.235297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:21.236938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27a3cd27-8244-4833-b2da-0d7a6bcb428c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1849 microversion: 2.32 time: 0.265465 Oct 03 10:43:21.248789 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1600/3058] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:20 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1849 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:21.249195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:21.260830 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ed1b25a-7861-48a9-bfa4-af693b87d4d5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.350726 Oct 03 10:43:21.260830 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1459/3059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:20 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:21.407981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:21.409263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:21.422117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.427191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.427718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.431073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.434851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.435328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.523836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:21.524721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:21.532659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.533410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.534055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.535618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.536174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.536803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.623444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:21.632824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0d0bc3d-2100-4778-a1f1-750ec76d211d tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1317 microversion: 2.1 time: 0.229344 Oct 03 10:43:21.633701 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1601/3060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:21 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:21.836965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:21.845570 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b6d9dcd2-2b60-4291-9578-d052495e1af3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.326679 Oct 03 10:43:21.861192 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1460/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:21 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:21.927624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:21.928797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:21.945291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.947508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.950147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.951255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.951954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.953269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.979088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:21.979721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:21.993681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.995060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.995518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:21.998702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:21.999380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:21.999826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.195064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:22.204242 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06c7e525-6aa6-4890-9de0-cf737fac9ad9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.282943 Oct 03 10:43:22.206719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1602/3062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:21 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:22.293528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:22.294175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:22.294927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:22.307439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.308220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0de59548-2254-4fb9-98ea-219199161a1a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.335428 Oct 03 10:43:22.308418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.311006 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1461/3063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:21 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:22.321756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.325869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.326668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:22.326668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:22.327561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.328524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.350701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.351192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.356662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.357516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.357999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.364101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.479084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:22.494946 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82ebea89-1403-48ca-80dc-25f5d77fe8b0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.207796 Oct 03 10:43:22.513238 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1603/3064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:22 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:22.660879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:22.661948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:22.672015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.673130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.673817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.675542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.677154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.677870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.802951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:22.816141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:22.819249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:22.836964 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9157967e-29e7-4f20-90d5-8f8eea53b639 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1849 microversion: 2.32 time: 0.523474 Oct 03 10:43:22.838413 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1462/3065] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:22 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1849 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:22.844739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1d88f7be-d9f2-47c2-9221-bed16e32753a req-101d36c4-3988-4d89-a78f-4129c1c2818c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eaf6a-7c9d-4f81-b5eb-d01ef0d59243", "name": "network-vif-plugged", "status": "completed", "tag": "97f76ef1-55de-461a-86b3-e25afc9e4abc"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:22.859932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1d88f7be-d9f2-47c2-9221-bed16e32753a req-101d36c4-3988-4d89-a78f-4129c1c2818c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.860794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1d88f7be-d9f2-47c2-9221-bed16e32753a req-101d36c4-3988-4d89-a78f-4129c1c2818c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.861550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1d88f7be-d9f2-47c2-9221-bed16e32753a req-101d36c4-3988-4d89-a78f-4129c1c2818c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.881648 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1d88f7be-d9f2-47c2-9221-bed16e32753a req-101d36c4-3988-4d89-a78f-4129c1c2818c service nova] Creating event network-vif-plugged:97f76ef1-55de-461a-86b3-e25afc9e4abc for instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 on n-h1-858383-3 Oct 03 10:43:22.890282 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1d88f7be-d9f2-47c2-9221-bed16e32753a req-101d36c4-3988-4d89-a78f-4129c1c2818c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049752 Oct 03 10:43:22.891050 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1463/3066] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:22.898288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f7b1f0d9-9ed7-4570-9f6f-a50a9137dd1d req-c17d1d7f-4d8b-40be-a4c3-fd0abdb5c0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "3ffca724-9017-4dbe-b9e6-d315e9ca8f10"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:22.911796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f7b1f0d9-9ed7-4570-9f6f-a50a9137dd1d req-c17d1d7f-4d8b-40be-a4c3-fd0abdb5c0ac service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:22.914506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f7b1f0d9-9ed7-4570-9f6f-a50a9137dd1d req-c17d1d7f-4d8b-40be-a4c3-fd0abdb5c0ac service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:22.917117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f7b1f0d9-9ed7-4570-9f6f-a50a9137dd1d req-c17d1d7f-4d8b-40be-a4c3-fd0abdb5c0ac service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:22.933726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:22.949252 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f7b1f0d9-9ed7-4570-9f6f-a50a9137dd1d req-c17d1d7f-4d8b-40be-a4c3-fd0abdb5c0ac service nova] Creating event network-changed:3ffca724-9017-4dbe-b9e6-d315e9ca8f10 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:43:22.957960 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a814cb9-c50d-4ad8-b37b-f359e193111e tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1508 microversion: 2.1 time: 0.303282 Oct 03 10:43:22.961954 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1604/3067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:22 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:22.983592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:22.988756 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f7b1f0d9-9ed7-4570-9f6f-a50a9137dd1d req-c17d1d7f-4d8b-40be-a4c3-fd0abdb5c0ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095534 Oct 03 10:43:22.989318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:22.989607 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1464/3068] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:22.995785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:22.996488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:23.000539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.001276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.001997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.004286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.005078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.005853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.006133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.007191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.007747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.008654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.009916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.010707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.178607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:23.188008 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-803111fa-ef9c-4314-bd9f-97ceff37406a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.223645 Oct 03 10:43:23.188681 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1605/3069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:22 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:23.229747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:23.230428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:23.237011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.237553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.238786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.239554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.240012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.240442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.407085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:23.411312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:23.420391 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c0b01f26-1f88-452a-ae4d-b47ea87d9ed8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1508 microversion: 2.1 time: 0.428828 Oct 03 10:43:23.421421 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1465/3070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:22 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1508 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:23.433057 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a2fb6b08-aec9-4d89-8df9-d3ab4fd2f59a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.196102 Oct 03 10:43:23.433619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1606/3071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:23 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:23.445908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:23.446884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:23.448413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:23.451544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:23.453202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:23.455275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.456132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.456831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.458008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.458644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.459252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.460357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.461225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.461675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.462471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.462923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.463432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.552938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bfb51cbc-6b2f-4187-a5a5-76d13ade523c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "PUT /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1080 microversion: 2.1 time: 0.108181 Oct 03 10:43:23.557466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1607/3072] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:43:23 2022] PUT /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1080 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:23.562170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:23.562839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:23.583176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.584497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.585365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.586836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.587781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.588376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.800561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:23.812262 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d15d7dea-8ea2-404e-ace0-e995bc268e33 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.253268 Oct 03 10:43:23.813189 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1608/3073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:23 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:23.819011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:23.819643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:23.826340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.827052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.827560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:23.828273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:23.828731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:23.829234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.009629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.024190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e91a52e8-2ad9-4cfb-8344-930029aa0e6a tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1506 microversion: 2.1 time: 0.208917 Oct 03 10:43:24.025624 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1609/3074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:23 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:24.032513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:24.036299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:24.058168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.058804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.059817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.060592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.061092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.062980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.211920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.226412 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5cee076d-2845-4a2a-a2ae-6bbe552a86e3 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.791057 Oct 03 10:43:24.247087 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1466/3075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:23 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:24.262265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:24.263015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:24.278174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.281009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.281009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.281009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.282025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.282581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.347750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.359187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.360833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.362282 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cac4cc60-ba76-4e6e-9bdf-ad31111e4863 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1870 microversion: 2.32 time: 0.335740 Oct 03 10:43:24.363228 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1610/3076] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:24 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1870 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:24.368274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:24.368965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:24.375949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.377209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.377861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.379494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.380611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.380999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.540354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.549552 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-491e1888-2a71-407a-bcb4-af1334401044 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1318 microversion: 2.1 time: 0.185247 Oct 03 10:43:24.550488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1611/3077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:24 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:24.556682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:24.557481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:24.564031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.568901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.570112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.571467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.572075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.572661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.592201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.602241 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0549c4f0-bed0-47b0-965f-31c6ed6af8f8 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1506 microversion: 2.1 time: 0.353797 Oct 03 10:43:24.614729 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1467/3078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:24 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:24.626573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:24.630001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:24.638275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.639022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.639653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.640631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.641301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.641890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.739189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.754445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-931d7c5f-b007-47be-b2f7-09e4de236ea9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.200740 Oct 03 10:43:24.755358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-005529da-40bb-40a3-8703-b41b7ef56a70 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "PUT /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1082 microversion: 2.1 time: 0.133109 Oct 03 10:43:24.755690 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1612/3079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:24 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:24.766446 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1468/3080] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:43:24 2022] PUT /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1082 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:24.787233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:24.788326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:24.796824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.797663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.798437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.799684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.800356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.802172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.827690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:24.836533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:24.837190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:24.845675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.846190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.846634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.847341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:24.847834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:24.848796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:24.974106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:24.984651 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c79a13f-2355-4566-85eb-b5df646390a1 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1508 microversion: 2.1 time: 0.203734 Oct 03 10:43:24.985730 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1613/3081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:24 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:24.995197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d10e5d81-3832-4cc4-a776-9c62602300c9 req-49f12395-287f-4450-81bd-2df0f9ed78e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eef4889-3f78-43c8-afdd-b6ca52ce723a", "name": "network-vif-plugged", "status": "completed", "tag": "b231caa1-577d-4d87-b429-cc9eda124029"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:25.011407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d10e5d81-3832-4cc4-a776-9c62602300c9 req-49f12395-287f-4450-81bd-2df0f9ed78e5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.012094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d10e5d81-3832-4cc4-a776-9c62602300c9 req-49f12395-287f-4450-81bd-2df0f9ed78e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.013357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d10e5d81-3832-4cc4-a776-9c62602300c9 req-49f12395-287f-4450-81bd-2df0f9ed78e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.027118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d10e5d81-3832-4cc4-a776-9c62602300c9 req-49f12395-287f-4450-81bd-2df0f9ed78e5 service nova] Creating event network-vif-plugged:b231caa1-577d-4d87-b429-cc9eda124029 for instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a on n-h2-858383-3 Oct 03 10:43:25.032376 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d10e5d81-3832-4cc4-a776-9c62602300c9 req-49f12395-287f-4450-81bd-2df0f9ed78e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044675 Oct 03 10:43:25.034078 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1614/3082] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:25.060870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:25.062438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:25.084596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.085135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.085587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.086307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.088931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.089413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.134618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:25.136873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:25.155466 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7da3644e-0d89-4412-bb33-898ac82764d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.323547 Oct 03 10:43:25.156082 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1469/3083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:24 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:25.164973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-769786f4-ae4b-4561-a36a-aa96c6e2a522 req-c29c4e70-cc9f-4888-872e-452da2fa3a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "274f027e-bcda-4a01-8a4f-7c02cb37e040"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:25.180832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-769786f4-ae4b-4561-a36a-aa96c6e2a522 req-c29c4e70-cc9f-4888-872e-452da2fa3a2a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.181320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-769786f4-ae4b-4561-a36a-aa96c6e2a522 req-c29c4e70-cc9f-4888-872e-452da2fa3a2a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.181754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-769786f4-ae4b-4561-a36a-aa96c6e2a522 req-c29c4e70-cc9f-4888-872e-452da2fa3a2a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.195700 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-769786f4-ae4b-4561-a36a-aa96c6e2a522 req-c29c4e70-cc9f-4888-872e-452da2fa3a2a service nova] Creating event network-changed:274f027e-bcda-4a01-8a4f-7c02cb37e040 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:43:25.200959 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-769786f4-ae4b-4561-a36a-aa96c6e2a522 req-c29c4e70-cc9f-4888-872e-452da2fa3a2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043646 Oct 03 10:43:25.203676 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1470/3084] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:25.255322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:25.256852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:25.264651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.265448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.266111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.267079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.267765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.268436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.407866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:25.419024 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5aeb8207-448a-46dd-98fc-a6d12f6b4435 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1508 microversion: 2.1 time: 0.378137 Oct 03 10:43:25.421342 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1615/3085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:25 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:25.431960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:25.434064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:25.450389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.453743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.454338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.455255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.455813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.460928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.599791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:25.615811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bab9cb54-7bad-4f30-b25d-3af67afe396b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.364869 Oct 03 10:43:25.616417 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1471/3086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:25 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:25.621066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:25.623455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:25.640426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.641237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.641840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.642755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.643386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.643988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.695493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:43:25.797041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:25.806927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:25.808400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:25.810813 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f8af657-141a-46fc-8194-b8420c1308f7 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1870 microversion: 2.32 time: 0.383014 Oct 03 10:43:25.811719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d25efcc5-6971-459a-9c55-270b2ab78816 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 204 len: 0 microversion: 2.1 time: 0.192765 Oct 03 10:43:25.813829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1472/3087] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:43:25 2022] DELETE /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:43:25.820798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:25.821690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:25.824651 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1616/3088] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:25 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1870 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:25.838921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.839388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.841355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:25.841505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:25.843683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.844414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.844898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.845320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.850034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.850731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.851337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:25.852257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:25.852902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:25.853481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.010104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.020620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d920b10-c690-4a31-832a-245155b7dfe2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.194751 Oct 03 10:43:26.021616 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1617/3089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:25 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:26.028383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.028922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.035067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.035552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.035989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.036687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.037168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.037665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.041803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.055536 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-412747fb-170e-454b-845b-f6b2c219cd16 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1468 microversion: 2.1 time: 0.240139 Oct 03 10:43:26.060232 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1473/3090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:25 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1468 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:26.071813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:43:26.084544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.086160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.095320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.096078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.096793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.098369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.099608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.100205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.125628 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Instance is already in deleting state, ignoring this request Oct 03 10:43:26.126475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-074c38d8-5c31-4bb6-b1db-4d8b47271533 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 204 len: 0 microversion: 2.1 time: 0.103920 Oct 03 10:43:26.129373 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1618/3091] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:43:26 2022] DELETE /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:43:26.139020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.139850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.147141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.147858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.148293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.149026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.149475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.149902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.288944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.298907 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2db5f8cb-c921-43a1-b160-8216327e3de0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1468 microversion: 2.1 time: 0.219822 Oct 03 10:43:26.299695 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1474/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:26.302025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.305812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.306418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.312859 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8654db94-31f8-488d-a003-f492d0f0f63c tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1514 microversion: 2.1 time: 0.180276 Oct 03 10:43:26.313738 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1619/3093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:26.314224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.314711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.315181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.315888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.317018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.317447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.322812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.326808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.327754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Searching by: {'reservation_id': 'r-0a0job4k', 'deleted': False, 'project_id': '784dad77eab8442e85f2141e9641ca22'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:43:26.333363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.333952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.334446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.335241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.335765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.336262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.442053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:43:26.514878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.523424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.524150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.524748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.573552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.584449 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-158a38b0-f49f-4b96-b243-e1040c35537f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.283900 Oct 03 10:43:26.585383 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1475/3094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:26.641756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.642529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.648986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.649743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.650285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.651090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.651719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.652269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.672300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7bf02c96-4e19-4898-962e-3b0774982cdc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-0a0job4k" status: 200 len: 2929 microversion: 2.1 time: 0.354078 Oct 03 10:43:26.673719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1620/3095] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0a0job4k => generated 2929 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:26.697021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80afafd3-b44e-4a18-8eee-a0d78d987fcf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.715347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.server_groups [None req-80afafd3-b44e-4a18-8eee-a0d78d987fcf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Querying cell 5d809412-179d-487a-a3ff-24b9afa0366c(cell1) for 2 instances {{(pid=122269) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 10:43:26.716187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80afafd3-b44e-4a18-8eee-a0d78d987fcf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.717000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80afafd3-b44e-4a18-8eee-a0d78d987fcf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.717530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80afafd3-b44e-4a18-8eee-a0d78d987fcf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.756040 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80afafd3-b44e-4a18-8eee-a0d78d987fcf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/2d1769a0-dd55-4b57-a6f7-dcc670dfe3d6" status: 200 len: 265 microversion: 2.1 time: 0.062681 Oct 03 10:43:26.757448 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1621/3096] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/os-server-groups/2d1769a0-dd55-4b57-a6f7-dcc670dfe3d6 => generated 265 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:43:26.768199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.769287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.775597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.776344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.776909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.777511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.778053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.778477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.923553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:26.933045 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bed9cd33-b727-4469-a362-a39f7c0135ab tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1332 microversion: 2.1 time: 0.295980 Oct 03 10:43:26.950136 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1476/3097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1332 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:26.953579 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-811c67a9-5060-443c-b08d-291be07d4d5c tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1619 microversion: 2.1 time: 0.189640 Oct 03 10:43:26.955081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.955787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.956567 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1622/3098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1619 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:26.963277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.965099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.965587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.966748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.967227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.967666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.980381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:26.981216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:26.988367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.988887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.989325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:26.990038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:26.990498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:26.990985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.144102 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6bc10ba-088d-4284-b7f1-c77252f25396 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 200 len: 1619 microversion: 2.1 time: 0.167357 Oct 03 10:43:27.146171 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1623/3099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 1619 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:27.154115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:27.155017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:27.163083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.163885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.164945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.166019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.166778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.167270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.282573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:27.293596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:27.296919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:27.298983 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fd1eb3d-021b-4818-9b27-9a68bf10ce74 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1891 microversion: 2.32 time: 0.347244 Oct 03 10:43:27.309442 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1477/3100] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:26 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1891 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:27.323944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f47881d9-c76e-4225-bd3c-49a3e1dc5f08 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: .version_select at 0x7f0757481790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1791344487", "policies": ["anti-affinity"]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:27.326251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:27.337045 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9b73496-9e41-4c35-909e-ceac311fa82a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.186799 Oct 03 10:43:27.337864 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1624/3101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:27 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:27.342609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-520a5d19-4578-461e-b89f-f83a18896eeb req-bde454da-1b36-4a41-9057-2a08cd06ac28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "ab64d46f-159d-49ad-ac8a-d284c51b9e13"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:27.355122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-520a5d19-4578-461e-b89f-f83a18896eeb req-bde454da-1b36-4a41-9057-2a08cd06ac28 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.355593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-520a5d19-4578-461e-b89f-f83a18896eeb req-bde454da-1b36-4a41-9057-2a08cd06ac28 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.356209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-520a5d19-4578-461e-b89f-f83a18896eeb req-bde454da-1b36-4a41-9057-2a08cd06ac28 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.359259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f47881d9-c76e-4225-bd3c-49a3e1dc5f08 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:27.365103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f47881d9-c76e-4225-bd3c-49a3e1dc5f08 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:27.370997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-520a5d19-4578-461e-b89f-f83a18896eeb req-bde454da-1b36-4a41-9057-2a08cd06ac28 service nova] Creating event network-changed:ab64d46f-159d-49ad-ac8a-d284c51b9e13 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:43:27.376972 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-520a5d19-4578-461e-b89f-f83a18896eeb req-bde454da-1b36-4a41-9057-2a08cd06ac28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037724 Oct 03 10:43:27.379209 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1625/3102] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:27.384568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:27.385517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:27.400581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.401608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.402957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.404123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.404882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.405519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.429603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f47881d9-c76e-4225-bd3c-49a3e1dc5f08 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:27.435679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f47881d9-c76e-4225-bd3c-49a3e1dc5f08 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:27.452311 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f47881d9-c76e-4225-bd3c-49a3e1dc5f08 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.141655 Oct 03 10:43:27.453720 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1478/3103] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 3 10:43:27 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:27.601594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-961746048", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a98ab6c6-9894-424b-bd26-70ff2e9d2f93"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:27.696908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:43:27.697126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:27.709324 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08e6e9cf-402c-4f9f-8843-086312ad8257 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1514 microversion: 2.1 time: 0.328843 Oct 03 10:43:27.710220 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1626/3104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:27 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:27.714949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:27.715748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:27.722207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.722942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.723581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.724451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.725161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.725754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.959137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:27.967935 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-191f11e2-ce64-4b29-849a-ef755ea518fb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1521 microversion: 2.1 time: 0.256470 Oct 03 10:43:27.968826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1627/3105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:27 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:27.974469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:27.975094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:27.981295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.981666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.982093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:27.982785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:27.983232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:27.983649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:28.131931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:43:28.132373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:43:28.132882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:43:28.133301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:43:28.133720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:43:28.155298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:28.165696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:28.166193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:28.166637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:28.167292 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ca49b50-1d4c-4ca3-a76c-b66a64e3345c tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1537 microversion: 2.1 time: 0.196295 Oct 03 10:43:28.167436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:28.167827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:28.168271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:28.168760 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1628/3106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:27 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:28.192038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d2bb7ade-731c-432c-81c3-6f65f345a6ba tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'create', calling method: .version_select at 0x7f074eaf0dc0>, body: {"pool": "1a762c72-6509-4b1b-94ef-14d89b24dd91"} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:28.197572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:28.203423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:28.217205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Going to run 2 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:43:28.219812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:43:28.260347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122270) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 03 10:43:28.287531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:28.294570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:28.351194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:28.359183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:28.377662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:28.383310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=523b4e6e-c8ab-449f-93e0-f365ddeaf011,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:43:28.491597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:28.499351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:28.546233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:28.552184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'server_group_members'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:28.603603 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc224d38-7327-40dd-830f-f2f9ccdd4876 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.006279 Oct 03 10:43:28.610527 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1479/3107] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:43:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 1015 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:43:28.621182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:28.622579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:28.640979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:28.641541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:28.641987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:28.642806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:28.643360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:28.648935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:29.057569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:29.068174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:29.069866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:29.070919 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aac9bb3d-24c3-4604-a122-15b38a5f9718 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1891 microversion: 2.32 time: 0.458026 Oct 03 10:43:29.084738 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1480/3108] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:28 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1891 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:29.084738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:29.084738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:29.105535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:29.106278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:29.106507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:29.107253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:29.107720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:29.108155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:29.558418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:29.584110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b5f9d01-e793-4a43-8f1f-da5bcf1b63bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1308 microversion: 2.1 time: 0.511457 Oct 03 10:43:29.598590 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1481/3109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:29 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1308 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:29.603295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:29.607629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:29.608406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Searching by: {'deleted': False, 'project_id': '784dad77eab8442e85f2141e9641ca22'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:43:29.629300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:29.629798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:29.630250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:29.630985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:29.631447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:29.631872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:29.696551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Listed batch of 5 results from cell out of 999 limit. Returned 5 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:43:29.734483 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e6b9835-b72f-45eb-87e0-b2ffea90bc43 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.136567 Oct 03 10:43:29.736759 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1482/3110] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:43:29 2022] GET /compute/v2.1/servers => generated 1661 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:29.748029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:29.751396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:29.774426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:29.775412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:29.777239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:29.781803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:29.782366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:29.783146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:30.174579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad027da90cc247a8ad9ba953b39d19b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66f39dd2e184e50b5531ef369d2455c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:30.196346 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-38d6571a-2a9c-40db-8681-b77175f267b6 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 200 len: 1514 microversion: 2.1 time: 0.456758 Oct 03 10:43:30.197325 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1483/3111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:29 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 1514 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:30.203895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:30.205439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:30.213864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:30.216154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:30.216624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:30.217375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:30.218120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:30.218561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:30.862510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d2bb7ade-731c-432c-81c3-6f65f345a6ba tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.674323 Oct 03 10:43:30.867648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:30.874573 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1629/3112] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:43:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:30.894211 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e15e276-9b5b-435b-af05-51ec8bbdfdc2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1501 microversion: 2.1 time: 0.695740 Oct 03 10:43:30.894819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1484/3113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:30 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1501 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:30.899236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3683e1fc-2eaa-4acf-9455-0d03840e3fc9 req-5e094dab-e758-4c61-8862-3ebdfa7ef740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "32bd2338-d1b6-42fd-b856-25db395ef05c"}, {"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "431054ce-fa85-4a93-921c-f45394fb158e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:30.913631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:30.914526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:30.932265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3683e1fc-2eaa-4acf-9455-0d03840e3fc9 req-5e094dab-e758-4c61-8862-3ebdfa7ef740 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:30.932750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3683e1fc-2eaa-4acf-9455-0d03840e3fc9 req-5e094dab-e758-4c61-8862-3ebdfa7ef740 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:30.933851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:30.934359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:30.934801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3683e1fc-2eaa-4acf-9455-0d03840e3fc9 req-5e094dab-e758-4c61-8862-3ebdfa7ef740 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:30.938063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:30.939004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:30.939623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:30.940561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:30.969079 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3683e1fc-2eaa-4acf-9455-0d03840e3fc9 req-5e094dab-e758-4c61-8862-3ebdfa7ef740 service nova] Creating event network-changed:32bd2338-d1b6-42fd-b856-25db395ef05c for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:43:30.970034 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3683e1fc-2eaa-4acf-9455-0d03840e3fc9 req-5e094dab-e758-4c61-8862-3ebdfa7ef740 service nova] Creating event network-changed:431054ce-fa85-4a93-921c-f45394fb158e for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:43:30.982794 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3683e1fc-2eaa-4acf-9455-0d03840e3fc9 req-5e094dab-e758-4c61-8862-3ebdfa7ef740 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096743 Oct 03 10:43:30.984609 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1630/3114] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:30.997407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:31.003020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:31.024424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.026737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.027427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:31.036449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.038664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.041024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:31.076242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:31.249960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:31.262065 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5272ea7d-1726-4dfe-8629-44264fd69f50 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1278 microversion: 2.1 time: 0.363969 Oct 03 10:43:31.263819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1485/3115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:30 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1278 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:31.280960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:31.281595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:31.298093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.298620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.301277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:31.303063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.303884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.304615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:31.538404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:31.551808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:31.554372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:31.556095 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-db82fc80-88c9-467e-9753-26835e9efce6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.566525 Oct 03 10:43:31.557116 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1631/3116] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:30 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:31.564099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.31"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:31.585530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:31.595425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.596166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.596853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:31.599084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.600124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.602138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:31.639424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:43:31.640289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquired lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:43:31.827948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:31.831224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:31.839540 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-79948584-e47a-48e5-b432-f42e174c1804 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1488 microversion: 2.1 time: 0.574311 Oct 03 10:43:31.840239 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1486/3117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:31 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1488 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:31.845222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:31.846043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:31.862355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.863542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.864313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:31.865202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:31.865817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:31.866258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.251820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:32.260871 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6a52d01f-b991-452f-b5ae-b94a4b04c30f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1514 microversion: 2.1 time: 0.418879 Oct 03 10:43:32.261902 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1487/3118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:31 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:32.268230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:32.268977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c12496d3-8e1d-4df5-8cb2-1585ed5db478] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:32.287262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.288569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.289939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.290764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.291663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.292349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.312042 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] HTTP exception thrown: Instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 could not be found. Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Request method failure captured: Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 HTTP/1.1 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrwWBuRsDoqzAdENNj0Ra_82dUTOc922g6SGKva0J5aZFtk21KkX7bjtzaT2TUUiuYZRyshqptwsvuEB2OTbbDxUNzTFBdSPS8gkqgrPliCcXfq_c0R04o9kMuDm5MCgVuqkm1wE9WeIDTfqvsz0B1MKJ8-uY-CtTmWato8C6Ch3A9k Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}] Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ad027da90cc247a8ad9ba953b39d19b1 Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 could not be found. Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'c12496d3-8e1d-4df5-8cb2-1585ed5db478'} Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 could not be found. Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 could not be found. Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:32.313682 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 could not be found. Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Returning 404 to user: Instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e51c85a-1e19-40a2-9f9d-e0ea0f236d29 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478" status: 404 len: 111 microversion: 2.1 time: 0.051156 Oct 03 10:43:32.321840 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1488/3119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:32 2022] GET /compute/v2.1/servers/c12496d3-8e1d-4df5-8cb2-1585ed5db478 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:43:32.323291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c65b64ea-d87e-4779-8c43-f6f63b3bd399 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:32.331093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c65b64ea-d87e-4779-8c43-f6f63b3bd399 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.331620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c65b64ea-d87e-4779-8c43-f6f63b3bd399 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.332066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c65b64ea-d87e-4779-8c43-f6f63b3bd399 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.359244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c65b64ea-d87e-4779-8c43-f6f63b3bd399 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 10:43:32.413196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c65b64ea-d87e-4779-8c43-f6f63b3bd399 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243/action" status: 202 len: 0 microversion: 2.1 time: 0.093142 Oct 03 10:43:32.414782 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1489/3120] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:32 2022] POST /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:43:32.424292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bc7a170-5a4c-40a6-9f1b-d0fc9d2754e8 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:32.430505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4bc7a170-5a4c-40a6-9f1b-d0fc9d2754e8 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 1c56acbc-4e1f-4e87-ba19-1d8fc9c213de] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:32.438757 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4bc7a170-5a4c-40a6-9f1b-d0fc9d2754e8 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Instance 1c56acbc-4e1f-4e87-ba19-1d8fc9c213de could not be found. Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bc7a170-5a4c-40a6-9f1b-d0fc9d2754e8 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/1c56acbc-4e1f-4e87-ba19-1d8fc9c213de/action HTTP/1.1 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 14 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: {"rescue": {}} Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 1c56acbc-4e1f-4e87-ba19-1d8fc9c213de could not be found. Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '1c56acbc-4e1f-4e87-ba19-1d8fc9c213de', 'body': {'rescue': {}}} Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c56acbc-4e1f-4e87-ba19-1d8fc9c213de could not be found. Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c56acbc-4e1f-4e87-ba19-1d8fc9c213de could not be found. Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.450018 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c56acbc-4e1f-4e87-ba19-1d8fc9c213de could not be found. Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bc7a170-5a4c-40a6-9f1b-d0fc9d2754e8 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 404 to user: Instance 1c56acbc-4e1f-4e87-ba19-1d8fc9c213de could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4bc7a170-5a4c-40a6-9f1b-d0fc9d2754e8 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/1c56acbc-4e1f-4e87-ba19-1d8fc9c213de/action" status: 404 len: 111 microversion: 2.1 time: 0.036929 Oct 03 10:43:32.456412 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1490/3121] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:32 2022] POST /compute/v2.1/servers/1c56acbc-4e1f-4e87-ba19-1d8fc9c213de/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:43:32.463244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:32.463883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:32.473053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.473550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.474795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.475537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.476005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.476616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.632260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:32.642273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cd4d83b7-2a53-4815-a105-6d8fbfb68904 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1276 microversion: 2.1 time: 0.184777 Oct 03 10:43:32.643137 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1491/3122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:32 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:32.653664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:32.654476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:32.663550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.664494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.665054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.665909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.666456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.667035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.683150 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] HTTP exception thrown: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Request method failure captured: Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b HTTP/1.1 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrwWBuRsDoqzAdENNj0Ra_82dUTOc922g6SGKva0J5aZFtk21KkX7bjtzaT2TUUiuYZRyshqptwsvuEB2OTbbDxUNzTFBdSPS8gkqgrPliCcXfq_c0R04o9kMuDm5MCgVuqkm1wE9WeIDTfqvsz0B1MKJ8-uY-CtTmWato8C6Ch3A9k Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}] Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ad027da90cc247a8ad9ba953b39d19b1 Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'c723ca0a-4535-4646-8c75-7faf0a86d96b'} Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:43:32.686243 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:32.691480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Returning 404 to user: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:32.692884 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1afd7f03-5a92-45a9-a4af-09dcb57c6915 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 404 len: 111 microversion: 2.1 time: 0.048045 Oct 03 10:43:32.693776 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1492/3123] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:43:32 2022] DELETE /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:43:32.701475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:32.702653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:32.708961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.709522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.710032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:32.710776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:32.711293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:32.711783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.023060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:33.034615 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9cda9c42-4791-47b0-8d21-78a629c2bf9f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.339308 Oct 03 10:43:33.035993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1493/3124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:32 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:33.054730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:33.055336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:33.062865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.063357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.063946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.064660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.065248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.065629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.165224 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8553b821-19eb-4a18-b723-52828edcd371 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action" status: 202 len: 0 microversion: 2.1 time: 0.126912 Oct 03 10:43:33.167448 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1494/3125] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:33 2022] POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:43:33.176441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:33.177553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:33.187063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.187939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.188959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.189888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.190376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.191771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.705733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:33.717015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:33.718557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:33.719939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb01db48-3a7a-47ee-8919-9e7404ebaa7a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.550907 Oct 03 10:43:33.720748 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1495/3126] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:33 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:33.726068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:33.726767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: c723ca0a-4535-4646-8c75-7faf0a86d96b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:33.734593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.735171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.735679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.736380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.736858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.737520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.755135 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] HTTP exception thrown: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Request method failure captured: Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b HTTP/1.1 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrwWBuRsDoqzAdENNj0Ra_82dUTOc922g6SGKva0J5aZFtk21KkX7bjtzaT2TUUiuYZRyshqptwsvuEB2OTbbDxUNzTFBdSPS8gkqgrPliCcXfq_c0R04o9kMuDm5MCgVuqkm1wE9WeIDTfqvsz0B1MKJ8-uY-CtTmWato8C6Ch3A9k Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}] Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ad027da90cc247a8ad9ba953b39d19b1 Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'c723ca0a-4535-4646-8c75-7faf0a86d96b'} Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:33.757188 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Returning 404 to user: Instance c723ca0a-4535-4646-8c75-7faf0a86d96b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2220ccdd-884c-41b3-8b48-d1649d42490b tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b" status: 404 len: 111 microversion: 2.1 time: 0.036645 Oct 03 10:43:33.762664 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1496/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:33 2022] GET /compute/v2.1/servers/c723ca0a-4535-4646-8c75-7faf0a86d96b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:43:33.766647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8e01954f-aa5d-4311-a3b1-c9f7bbe955e0 req-b645d260-25d0-4249-bb00-1c489752fae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "3308c5b3-42cc-478c-a7ed-eb3a91f256f4"}, {"server_uuid": "c12496d3-8e1d-4df5-8cb2-1585ed5db478", "name": "network-vif-deleted", "tag": "42138797-dea5-4761-b283-1d4eda8d82d2"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:33.778854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8e01954f-aa5d-4311-a3b1-c9f7bbe955e0 req-b645d260-25d0-4249-bb00-1c489752fae9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.779423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8e01954f-aa5d-4311-a3b1-c9f7bbe955e0 req-b645d260-25d0-4249-bb00-1c489752fae9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.780078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8e01954f-aa5d-4311-a3b1-c9f7bbe955e0 req-b645d260-25d0-4249-bb00-1c489752fae9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.796543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8e01954f-aa5d-4311-a3b1-c9f7bbe955e0 req-b645d260-25d0-4249-bb00-1c489752fae9 service nova] Creating event network-changed:3308c5b3-42cc-478c-a7ed-eb3a91f256f4 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:43:33.797326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8e01954f-aa5d-4311-a3b1-c9f7bbe955e0 req-b645d260-25d0-4249-bb00-1c489752fae9 service nova] Creating event network-vif-deleted:42138797-dea5-4761-b283-1d4eda8d82d2 for instance c12496d3-8e1d-4df5-8cb2-1585ed5db478 on n-h1-858383-3 Oct 03 10:43:33.808034 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8e01954f-aa5d-4311-a3b1-c9f7bbe955e0 req-b645d260-25d0-4249-bb00-1c489752fae9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047322 Oct 03 10:43:33.809980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1497/3128] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:33.817262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:33.818478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:33.826989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.827761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.828437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:33.829342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:33.829961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:33.830612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:34.452600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:34.465242 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e5538a24-eb56-4655-a5bf-2336d8575e75 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1499 microversion: 2.1 time: 0.653687 Oct 03 10:43:34.481657 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1498/3129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:33 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1499 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:34.489646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:34.490613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:34.498301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:34.499515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:34.500192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:34.501166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:34.501850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:34.502497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:34.703931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Building network info cache for instance {{(pid=122269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:43:34.969338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:34.986986 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d12a7594-c7d9-4740-bbe0-74ce47c5bb27 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.502495 Oct 03 10:43:34.988755 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1499/3130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:34 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:34.997941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:34.999491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:35.012285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.013149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.013968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:35.016355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.017099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.018204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:35.045694 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] HTTP exception thrown: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Request method failure captured: Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf HTTP/1.1 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrwWBuRsDoqzAdENNj0Ra_82dUTOc922g6SGKva0J5aZFtk21KkX7bjtzaT2TUUiuYZRyshqptwsvuEB2OTbbDxUNzTFBdSPS8gkqgrPliCcXfq_c0R04o9kMuDm5MCgVuqkm1wE9WeIDTfqvsz0B1MKJ8-uY-CtTmWato8C6Ch3A9k Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}] Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ad027da90cc247a8ad9ba953b39d19b1 Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '41e613f2-3f15-40d6-9b03-57a819120ebf'} Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:43:35.054145 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.059098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Returning 404 to user: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:35.061817 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1b3ea0e7-5144-4bf0-8040-90e420d9bbc4 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 404 len: 111 microversion: 2.1 time: 0.067063 Oct 03 10:43:35.061817 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1500/3131] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:43:34 2022] DELETE /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:43:35.071464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:35.072473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:35.080243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.080745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.081221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:35.082287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.082412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.082925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:35.454887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:35.467435 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78965811-63a4-4d05-aab1-35391b48892c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.401695 Oct 03 10:43:35.468894 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1501/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:35 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:35.480476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:35.487667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:35.500517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.501373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.503686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:35.506695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.507439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.508011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:35.547106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'flavor' on Instance uuid f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:43:35.569331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Cannot 'rescue' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state paused Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action HTTP/1.1 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 14 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: {"rescue": {}} Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'rescue' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state paused Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4', 'body': {'rescue': {}}} Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 in vm_state paused. Cannot rescue while the instance is in this state. Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state paused Oct 03 10:43:35.571859 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state paused Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 409 to user: Cannot 'rescue' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state paused {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d01e6cc1-46a4-4fc3-98a4-4759deb78715 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action" status: 409 len: 144 microversion: 2.1 time: 0.104092 Oct 03 10:43:35.579387 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1502/3133] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:35 2022] POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action => generated 144 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:43:35.583505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:35.583505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:35.590391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.591458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.591809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:35.592539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:35.593148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:35.593575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.123304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:36.133703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:36.135623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:36.137076 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fef8e150-67cf-48cc-a0a3-d24cefb9f973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.560088 Oct 03 10:43:36.138165 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1503/3134] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:35 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:36.146038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b005d26b-7600-419c-a2c7-90592cc4b358 req-59c709d6-a75a-4e9c-a418-735dee1ed8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eef4889-3f78-43c8-afdd-b6ca52ce723a", "tag": "b231caa1-577d-4d87-b429-cc9eda124029"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:36.165093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b005d26b-7600-419c-a2c7-90592cc4b358 req-59c709d6-a75a-4e9c-a418-735dee1ed8a4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.165865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b005d26b-7600-419c-a2c7-90592cc4b358 req-59c709d6-a75a-4e9c-a418-735dee1ed8a4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.166475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b005d26b-7600-419c-a2c7-90592cc4b358 req-59c709d6-a75a-4e9c-a418-735dee1ed8a4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.184013 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b005d26b-7600-419c-a2c7-90592cc4b358 req-59c709d6-a75a-4e9c-a418-735dee1ed8a4 service nova] Creating event network-changed:b231caa1-577d-4d87-b429-cc9eda124029 for instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a on n-h2-858383-3 Oct 03 10:43:36.190765 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b005d26b-7600-419c-a2c7-90592cc4b358 req-59c709d6-a75a-4e9c-a418-735dee1ed8a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051215 Oct 03 10:43:36.198108 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1504/3135] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:36.223323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:36.224374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] [instance: 41e613f2-3f15-40d6-9b03-57a819120ebf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:36.233066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.233821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.234426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.235294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.235916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.236588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.255103 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] HTTP exception thrown: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Request method failure captured: Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf HTTP/1.1 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrwWBuRsDoqzAdENNj0Ra_82dUTOc922g6SGKva0J5aZFtk21KkX7bjtzaT2TUUiuYZRyshqptwsvuEB2OTbbDxUNzTFBdSPS8gkqgrPliCcXfq_c0R04o9kMuDm5MCgVuqkm1wE9WeIDTfqvsz0B1MKJ8-uY-CtTmWato8C6Ch3A9k Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a66f39dd2e184e50b5531ef369d2455c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a66f39dd2e184e50b5531ef369d2455c"}]}] Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a66f39dd2e184e50b5531ef369d2455c Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1632131923 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ad027da90cc247a8ad9ba953b39d19b1 Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerDiskConfigTestJSON-1632131923-project Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '41e613f2-3f15-40d6-9b03-57a819120ebf'} Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:36.257195 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:36.262149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:36.262149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:36.262149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:36.262149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:36.262149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:36.262149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. Oct 03 10:43:36.262149 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:36.264470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] Returning 404 to user: Instance 41e613f2-3f15-40d6-9b03-57a819120ebf could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:36.265554 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-74b7f153-2430-40b3-b2c4-2d66c2b766c9 tempest-ServerDiskConfigTestJSON-1632131923 tempest-ServerDiskConfigTestJSON-1632131923-project] 10.222.0.27 "GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf" status: 404 len: 111 microversion: 2.1 time: 0.052719 Oct 03 10:43:36.270770 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1505/3136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:36 2022] GET /compute/v2.1/servers/41e613f2-3f15-40d6-9b03-57a819120ebf => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:43:36.277714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:36.278654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:36.290278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.290778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.291222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.291972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.292415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.292867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.366823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:36.377607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:36.419958 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72fcc22c-969d-43cf-9092-f8486ff4c325 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action" status: 202 len: 0 microversion: 2.1 time: 0.147323 Oct 03 10:43:36.421291 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1506/3137] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:36 2022] POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:43:36.428891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fa6f8fde-7275-41e0-9668-755ba4461b52 req-f79e1ebf-45be-4d16-a77f-dc86fa2171c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "728b9d45-bcb3-4720-a1ae-79eec1829570"}, {"name": "network-changed", "server_uuid": "ff887894-ecab-428b-b626-90b9642b09fc", "tag": "e0ad5a7d-5d3b-46e2-97d3-d4ed81f0fb64"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:36.447364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa6f8fde-7275-41e0-9668-755ba4461b52 req-f79e1ebf-45be-4d16-a77f-dc86fa2171c4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.448081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa6f8fde-7275-41e0-9668-755ba4461b52 req-f79e1ebf-45be-4d16-a77f-dc86fa2171c4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.448517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa6f8fde-7275-41e0-9668-755ba4461b52 req-f79e1ebf-45be-4d16-a77f-dc86fa2171c4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.469416 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fa6f8fde-7275-41e0-9668-755ba4461b52 req-f79e1ebf-45be-4d16-a77f-dc86fa2171c4 service nova] Creating event network-changed:728b9d45-bcb3-4720-a1ae-79eec1829570 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:43:36.470481 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fa6f8fde-7275-41e0-9668-755ba4461b52 req-f79e1ebf-45be-4d16-a77f-dc86fa2171c4 service nova] Creating event network-changed:e0ad5a7d-5d3b-46e2-97d3-d4ed81f0fb64 for instance ff887894-ecab-428b-b626-90b9642b09fc on n-h1-858383-3 Oct 03 10:43:36.490296 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fa6f8fde-7275-41e0-9668-755ba4461b52 req-f79e1ebf-45be-4d16-a77f-dc86fa2171c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066834 Oct 03 10:43:36.491210 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1507/3138] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:36.497615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:36.498269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:36.506258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.506795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.507257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.508059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.508579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.509169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.511913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:36.806938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Updating instance_info_cache with network_info: [{"id": "b231caa1-577d-4d87-b429-cc9eda124029", "address": "fa:16:3e:03:34:b6", "network": {"id": "68fef825-1740-401a-a108-2da5fb99fb5b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1317464843-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "88f464a0fb634b4d83940ae609717889", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb231caa1-57", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:43:36.822807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Releasing lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:43:36.824324 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f494055a-d543-48f9-8bbc-1a83ea2b485d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action" status: 202 len: 0 microversion: 2.1 time: 5.265219 Oct 03 10:43:36.825322 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1632/3139] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:31 2022] POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action => generated 0 bytes in 5268 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:43:36.832050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:36.833070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:36.840479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.841654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.842881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.843799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.844440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.844901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.914952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:36.924199 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd79140e-c778-40b3-82f8-0cdad1bcf3cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.431293 Oct 03 10:43:36.937562 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1508/3140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:36 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:36.947285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:36.948096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:36.955485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.957087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.957820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:36.958807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:36.959418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:36.960046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:37.306765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:37.326682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:37.338476 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c2648f9e-2588-4d67-bccb-d11917ef907f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1514 microversion: 2.1 time: 0.511173 Oct 03 10:43:37.341685 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1633/3141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:36 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1514 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:37.347020 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04dd138e-d93c-4a6e-8edc-61b7f551a97d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.403357 Oct 03 10:43:37.351019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62042e0d-f5a8-4b1a-b862-3796c08dd0c6 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'create', calling method: .version_select at 0x7f074f210280>, body: {"pool": "1a762c72-6509-4b1b-94ef-14d89b24dd91"} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:37.361585 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1509/3142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:36 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:37.369112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:37.379197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:37.389904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:37.390477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:37.391238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:37.392067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:37.392534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:37.393157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:38.149569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:38.161050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:38.162551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:38.163744 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e599dcab-3572-40ef-9d06-67bba2cecc0b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.799614 Oct 03 10:43:38.176792 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1510/3143] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:37 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:38.176792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:38.176792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:38.181456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:38.182916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:38.184134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:38.185068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:38.185543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:38.185980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:38.350311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:38.361402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11871905-916b-4e49-9d54-d19aa763ea89 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.194385 Oct 03 10:43:38.363300 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1511/3144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:38 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:38.368608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8c60fa4d-9e1b-4f13-a3ae-8507c6dd1b51 req-d9de2b84-f026-4dc5-8911-29ce37dc6a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523b4e6e-c8ab-449f-93e0-f365ddeaf011", "tag": "47f4d3d0-9fcb-4d2b-8dd3-cc2ec22907c1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:38.385851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8c60fa4d-9e1b-4f13-a3ae-8507c6dd1b51 req-d9de2b84-f026-4dc5-8911-29ce37dc6a4b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:38.386335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8c60fa4d-9e1b-4f13-a3ae-8507c6dd1b51 req-d9de2b84-f026-4dc5-8911-29ce37dc6a4b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:38.386831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8c60fa4d-9e1b-4f13-a3ae-8507c6dd1b51 req-d9de2b84-f026-4dc5-8911-29ce37dc6a4b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:38.400274 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8c60fa4d-9e1b-4f13-a3ae-8507c6dd1b51 req-d9de2b84-f026-4dc5-8911-29ce37dc6a4b service nova] Creating event network-changed:47f4d3d0-9fcb-4d2b-8dd3-cc2ec22907c1 for instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 on n-h2-858383-3 Oct 03 10:43:38.422111 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8c60fa4d-9e1b-4f13-a3ae-8507c6dd1b51 req-d9de2b84-f026-4dc5-8911-29ce37dc6a4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057077 Oct 03 10:43:38.424313 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1512/3145] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:38.442797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:38.444407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:38.462330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:38.463097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:38.464485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:38.465438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:38.466129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:38.466718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:38.560957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=30 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:38.799064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:38.818789 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8dd6e037-57ef-42ee-9c0d-3d1a7226403c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.392400 Oct 03 10:43:38.820333 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1513/3146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:38 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:39.193678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:39.194583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:39.202007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:39.202761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:39.203555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:39.204494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:39.205220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:39.205707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:39.484159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:39.497175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:39.498742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:39.500188 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c8de49fe-4137-46b4-b298-2d91b6bc00a8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.312530 Oct 03 10:43:39.505341 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1514/3147] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:39 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:43:39.516294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:39.518033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:39.526663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:39.531849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:39.532393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:39.533246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:39.534169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:39.536404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:39.536964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:39.660888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:39.707527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:39.715931 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ead497a-49ec-47b6-bf50-0edd16e079dc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.209123 Oct 03 10:43:39.716524 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1515/3148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:39 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:39.849543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:39.850507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:39.857854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:39.858339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:39.858773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:39.859472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:39.859922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:39.860341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:40.076038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:40.085979 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-caff044b-b44e-4dc3-9fa5-11de1a6884f5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.242171 Oct 03 10:43:40.100796 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1516/3149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:39 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:40.100796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:40.100796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:40.104466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:40.105725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:40.105725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:40.106613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:40.107167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:40.108016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:40.138500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'flavor' on Instance uuid f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:43:40.228207 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae2d947e-1d86-4db3-b008-262e797e536c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action" status: 200 len: 32 microversion: 2.1 time: 0.139653 Oct 03 10:43:40.228835 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1517/3150] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:40 2022] POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action => generated 32 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:43:40.238865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:40.239818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:40.246617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:40.247107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:40.247547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:40.248245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:40.248697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:40.249178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:40.445135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:40.453534 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-706e701a-f6f9-4fe3-b5fd-5b83b5b1e35f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.219087 Oct 03 10:43:40.454618 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1518/3151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:40 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:40.529874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:40.530607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:40.541175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:40.547722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:40.548317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:40.549338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:40.549769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:40.550839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.037084 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62042e0d-f5a8-4b1a-b862-3796c08dd0c6 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.692562 Oct 03 10:43:41.038435 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1634/3152] 10.222.0.27 () {60 vars in 1170 bytes} [Mon Oct 3 10:43:37 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:41.048739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:41.049983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:41.063361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.064507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.064979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.065848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.069948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.070609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.098032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:41.110144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:41.125241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:41.126824 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bedd3ba-a165-4015-be78-fa662e33d77d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.601182 Oct 03 10:43:41.127584 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1519/3153] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:40 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:43:41.146509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.7"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:41.149345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:41.164453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.164978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.165416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.166122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.172342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.172813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.212299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:43:41.223044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquired lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:43:41.392561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:41.403610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2e4c40ce-c876-4106-8f68-b0422c70705c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.363353 Oct 03 10:43:41.405907 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1635/3154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:41 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:41.412516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:41.422446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:41.436091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.436975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.437694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.438565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.439174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.439774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.639596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:41.649109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa99d7a9-0d5c-4228-bb53-9bf2f357eb43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.241914 Oct 03 10:43:41.649719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1636/3155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:41 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:41.654684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:41.655490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:41.661757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.662447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.663090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.664223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:41.664867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:41.665452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:41.814029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:41.826602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa1f65b5-8b79-4028-9eed-9929c5fc4018 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.175545 Oct 03 10:43:41.827359 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1637/3156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:41 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:42.158182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:42.160136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:42.168963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.169730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.170172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:42.170939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.171994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.171994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:42.459828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:42.471224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:42.473600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:42.474792 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58067909-6d28-4ae3-96d3-bcd13e2d1eb1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.321280 Oct 03 10:43:42.475840 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1638/3157] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:42 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:42.483040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:42.483841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:42.484829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91.", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:43:42.485421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Releasing lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:43:42.485972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91. Oct 03 10:43:42.485972 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-cda6c275-41e8-4571-a5a0-95b1703c38d9'] Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Request method failure captured: Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action HTTP/1.1 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 44 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOry85NWTu8-cPAWr193cZVJq0h23vzgVWCaGWmPvh7hx4arwRjMeHGYVaAXIuJEAEvtFiY4SUM8vsheSsUWkHGwX_EXxVRFc4jnofsn4fIY9s-Lr6iH8m5QfVu_isMO2w7NgY2ARFOvYvxLYZ7m417JjPshe8NFqpJsyuqxaaH-zw-o Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88f464a0fb634b4d83940ae609717889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88f464a0fb634b4d83940ae609717889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}] Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 57d093d3c0924bef9033a3cc13315b48 Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: {"addFloatingIp": {"address": "172.25.2.7"}} Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91. Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-cda6c275-41e8-4571-a5a0-95b1703c38d9'] Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '6eef4889-3f78-43c8-afdd-b6ca52ce723a', 'body': {'addFloatingIp': {'address': '172.25.2.7'}}} Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:43:42.489079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91. Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cda6c275-41e8-4571-a5a0-95b1703c38d9'] Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91. Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cda6c275-41e8-4571-a5a0-95b1703c38d9'] Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91. Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cda6c275-41e8-4571-a5a0-95b1703c38d9'] Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91. Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cda6c275-41e8-4571-a5a0-95b1703c38d9'] Oct 03 10:43:42.493704 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:43:42.499614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Returning 400 to user: Cannot associate floating IP 172.25.2.7 (b5f755c6-6e34-4402-98d1-0c92b99b1f9e) with port b231caa1-577d-4d87-b429-cc9eda124029 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 1a762c72-6509-4b1b-94ef-14d89b24dd91. Oct 03 10:43:42.499614 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-cda6c275-41e8-4571-a5a0-95b1703c38d9'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:42.499614 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eea657a4-994f-47a9-8a7a-c0d7ae5779d7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action" status: 400 len: 380 microversion: 2.1 time: 1.362412 Oct 03 10:43:42.499614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1520/3158] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:41 2022] POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action => generated 380 bytes in 1367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:43:42.499997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-163f02c0-8b8d-462b-8b7d-96a7929a4926 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '.version_select at 0x7f074f2f4f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:42.501778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.502779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.503531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:42.504149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.504795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.505436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:42.670153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:42.678735 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f3c6739-ae90-4f80-a617-519a054388f7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.201587 Oct 03 10:43:42.679446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1639/3159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:42 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:42.686413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:42.687233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:42.693762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.694335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.694784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:42.695527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.695911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.696331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:42.889041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:42.898952 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf911cc7-7886-4de7-b801-171dc12a16c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.216053 Oct 03 10:43:42.900467 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1640/3160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:42 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:42.905431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:42.906255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:42.913649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.914598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.915206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:42.916087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:42.916539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:42.917000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:43.063974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:43.075306 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-277af7f6-e320-4c9a-b877-16cd1065e9d4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.173284 Oct 03 10:43:43.076404 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1641/3161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:42 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:43.286647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-021ecaac-64f7-4625-aed9-a24620ff87f0 req-c6e7b433-3986-451f-8618-499e1441582f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff887894-ecab-428b-b626-90b9642b09fc", "name": "network-vif-plugged", "status": "completed", "tag": "e0ad5a7d-5d3b-46e2-97d3-d4ed81f0fb64"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:43.301303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-021ecaac-64f7-4625-aed9-a24620ff87f0 req-c6e7b433-3986-451f-8618-499e1441582f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:43.301303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-021ecaac-64f7-4625-aed9-a24620ff87f0 req-c6e7b433-3986-451f-8618-499e1441582f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:43.301303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-021ecaac-64f7-4625-aed9-a24620ff87f0 req-c6e7b433-3986-451f-8618-499e1441582f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:43.314906 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-021ecaac-64f7-4625-aed9-a24620ff87f0 req-c6e7b433-3986-451f-8618-499e1441582f service nova] Creating event network-vif-plugged:e0ad5a7d-5d3b-46e2-97d3-d4ed81f0fb64 for instance ff887894-ecab-428b-b626-90b9642b09fc on n-h1-858383-3 Oct 03 10:43:43.321038 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-021ecaac-64f7-4625-aed9-a24620ff87f0 req-c6e7b433-3986-451f-8618-499e1441582f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038751 Oct 03 10:43:43.322149 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1642/3162] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:43.502534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:43.503821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:43.506955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:43.510922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:43.511409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:43.512426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:43.513387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:43.513870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:43.514395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:43.709554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:43.718910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:43.720365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:43.721559 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3e67320-bcd2-4a07-9d8b-f2d1c618ba3c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.223661 Oct 03 10:43:43.722668 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1643/3163] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:43 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:43:43.743166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:43.743790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:43.755505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:43.756004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:43.756448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:43.757188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:43.757642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:43.758277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:43.995434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:44.005232 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26de0d38-17db-4518-bad6-765b2c383d5d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.266055 Oct 03 10:43:44.005959 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1644/3164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:43 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:44.027646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:44.028530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:44.036345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.036836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.038297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.039464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.039935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.040364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.281510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:44.287857 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-163f02c0-8b8d-462b-8b7d-96a7929a4926 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b5f755c6-6e34-4402-98d1-0c92b99b1f9e" status: 202 len: 0 microversion: 2.1 time: 1.792146 Oct 03 10:43:44.292824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bbea4a7-af6b-4c5f-8959-c63150e2d111 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.270518 Oct 03 10:43:44.296370 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1521/3165] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:43:42 2022] DELETE /compute/v2.1/os-floating-ips/b5f755c6-6e34-4402-98d1-0c92b99b1f9e => generated 0 bytes in 1801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:43:44.296896 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1645/3166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:44 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:44.309982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.31"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:44.314529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:44.317546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:44.349010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.349904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.350604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.351574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.352475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.353656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.561299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:44.568920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.569429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.569879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.570602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.571067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.571490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.637353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:44.647021 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-026fc416-2818-452e-9866-d5955eb8a27d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.346838 Oct 03 10:43:44.648348 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1522/3167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:44 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:44.758516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:44.760245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:44.771687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.772191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.772638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.774997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:44.775469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:44.776004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:44.815168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:44.911374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:43:44.912005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquired lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:43:45.115651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:45.125401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:45.127041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:45.129178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-859a9a35-b6fd-436f-9e40-e75598d42355 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.373867 Oct 03 10:43:45.133494 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1523/3168] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:44 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:45.138591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:45.140614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:45.149878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:45.150373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:45.150813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:45.152013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:45.152469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:45.153132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:45.442095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:45.453724 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-344e7739-9d78-4984-a0d5-d77e343d8814 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1318 microversion: 2.1 time: 0.322844 Oct 03 10:43:45.457289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1524/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:45 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:45.472711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:45.473850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:45.484928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:45.485421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:45.488385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:45.489165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:45.489644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:45.490074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:45.747739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:45.762995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7636909c-e76b-42b2-9a05-542c3e4c5970 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.303901 Oct 03 10:43:45.770772 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1525/3170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:45 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:45.778859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-065af02a-1db8-4663-b578-5e3918a9ea32 req-cd0e365f-3d7c-47ad-8a7d-756046b8b3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523b4e6e-c8ab-449f-93e0-f365ddeaf011", "name": "network-vif-plugged", "status": "completed", "tag": "47f4d3d0-9fcb-4d2b-8dd3-cc2ec22907c1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:45.793230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-065af02a-1db8-4663-b578-5e3918a9ea32 req-cd0e365f-3d7c-47ad-8a7d-756046b8b3ad service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:45.793778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-065af02a-1db8-4663-b578-5e3918a9ea32 req-cd0e365f-3d7c-47ad-8a7d-756046b8b3ad service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:45.794208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-065af02a-1db8-4663-b578-5e3918a9ea32 req-cd0e365f-3d7c-47ad-8a7d-756046b8b3ad service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:45.807321 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-065af02a-1db8-4663-b578-5e3918a9ea32 req-cd0e365f-3d7c-47ad-8a7d-756046b8b3ad service nova] Creating event network-vif-plugged:47f4d3d0-9fcb-4d2b-8dd3-cc2ec22907c1 for instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 on n-h2-858383-3 Oct 03 10:43:45.814568 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-065af02a-1db8-4663-b578-5e3918a9ea32 req-cd0e365f-3d7c-47ad-8a7d-756046b8b3ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042185 Oct 03 10:43:45.815423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1526/3171] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:45.822349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:45.823045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:45.832516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:45.833325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:45.834059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:45.835170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:45.837080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:45.837720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.067288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:46.075091 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e8687fe-e111-4fd8-b3c3-c9b66c23d610 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.257467 Oct 03 10:43:46.089158 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1527/3172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:45 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:46.157383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:46.157383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:46.163554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.164436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.165029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.165833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.166391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.167045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.189986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Building network info cache for instance {{(pid=122269) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 10:43:46.387414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:46.421682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:46.423226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:46.424461 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81401c23-995f-4963-b90f-ac3666b8d276 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.272883 Oct 03 10:43:46.425605 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1528/3173] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:46 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:43:46.437683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-16d35c9f-a4be-412f-878a-c78e31ca2b2f req-f59123fa-8901-49c2-a6bc-0c5d7d4af03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eef4889-3f78-43c8-afdd-b6ca52ce723a", "tag": "b231caa1-577d-4d87-b429-cc9eda124029"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:46.441424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16d35c9f-a4be-412f-878a-c78e31ca2b2f req-f59123fa-8901-49c2-a6bc-0c5d7d4af03d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.442312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16d35c9f-a4be-412f-878a-c78e31ca2b2f req-f59123fa-8901-49c2-a6bc-0c5d7d4af03d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.443345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16d35c9f-a4be-412f-878a-c78e31ca2b2f req-f59123fa-8901-49c2-a6bc-0c5d7d4af03d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.455269 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-16d35c9f-a4be-412f-878a-c78e31ca2b2f req-f59123fa-8901-49c2-a6bc-0c5d7d4af03d service nova] Creating event network-changed:b231caa1-577d-4d87-b429-cc9eda124029 for instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a on n-h2-858383-3 Oct 03 10:43:46.461754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-16d35c9f-a4be-412f-878a-c78e31ca2b2f req-f59123fa-8901-49c2-a6bc-0c5d7d4af03d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034242 Oct 03 10:43:46.462564 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1529/3174] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:46.490406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:46.491294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:46.498892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.499386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.499882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.500596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.501236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.501674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.694350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:46.703091 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f74c0b0-af68-49be-913f-eefb069f4408 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1468 microversion: 2.1 time: 0.219199 Oct 03 10:43:46.718416 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1530/3175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:46 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:46.730389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:46.731355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:46.740606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.741375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.742651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.743588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.744423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.745193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.833740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Updating instance_info_cache with network_info: [{"id": "b231caa1-577d-4d87-b429-cc9eda124029", "address": "fa:16:3e:03:34:b6", "network": {"id": "68fef825-1740-401a-a108-2da5fb99fb5b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1317464843-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "88f464a0fb634b4d83940ae609717889", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb231caa1-57", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:43:46.851071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Releasing lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:43:46.852310 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7da020b2-1c67-4560-9fff-f33fa4fd930b tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action" status: 202 len: 0 microversion: 2.1 time: 2.552318 Oct 03 10:43:46.856163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1646/3176] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:44 2022] POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action => generated 0 bytes in 2557 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 10:43:46.863118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:46.864220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:46.872017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.872689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.873322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.874035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:46.875494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:46.876091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:46.908215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:46.917411 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2583e611-8042-4f33-9155-22ba5c2bef76 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 200 len: 1318 microversion: 2.1 time: 0.192549 Oct 03 10:43:46.918690 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1531/3177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:46 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:46.923873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-236f4754-5cff-44a9-94ae-aac1a0fac176 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '.version_select at 0x7f074ea3eca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:47.054576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:47.064151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f733530-f15f-4108-815e-a9f9f2b37a93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.206845 Oct 03 10:43:47.066325 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1647/3178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:46 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:47.102384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:47.103444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:47.112196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:47.113175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:47.113621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:47.114961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:47.115601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:47.116224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:47.122731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:47.348626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:47.373244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-706e8769-9d2d-422d-b28b-4931de5f0be6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.277132 Oct 03 10:43:47.374980 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1648/3179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:47 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:47.457228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:47.458823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:47.467014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:47.468089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:47.468808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:47.470694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:47.471552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:47.472285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:47.969885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:47.984057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:47.990203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:47.995188 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d9a31f0-e132-4990-b45f-845682322a49 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.541030 Oct 03 10:43:47.996059 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1649/3180] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:47 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:48.013523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:48.020136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:48.028565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.030502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.043918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.046675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.049370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.050136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.354769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:48.365366 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0bf31291-ff01-4556-9140-717db77ffb6f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 200 len: 1468 microversion: 2.1 time: 0.367908 Oct 03 10:43:48.366132 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1650/3181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:47 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 1468 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:48.371442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:48.372057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:48.379232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.379931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.380544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.381438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.382069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.382658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.434525 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-236f4754-5cff-44a9-94ae-aac1a0fac176 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/65b9cdec-39d8-4459-ad97-0a776e92809f" status: 202 len: 0 microversion: 2.1 time: 1.514463 Oct 03 10:43:48.435225 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1532/3182] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:43:46 2022] DELETE /compute/v2.1/os-floating-ips/65b9cdec-39d8-4459-ad97-0a776e92809f => generated 0 bytes in 1516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:43:48.441186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:48.446750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:48.447899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Searching by: {'reservation_id': 'r-f43xi6n0', 'deleted': False, 'project_id': '784dad77eab8442e85f2141e9641ca22'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:43:48.454766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.455379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.455917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.457464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.458023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.458547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.576203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:43:48.612136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:48.622066 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a223332e-130d-4366-b29c-4e024a479b4e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.254256 Oct 03 10:43:48.623600 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1651/3183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:48 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:48.639709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:48.643469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:48.660255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:48.670834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.671578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.672208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.680558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.681087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.681527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.682233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.682686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.683114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.871247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:48.882076 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57b3444e-b65e-48d1-86e7-11379a8d671b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.257222 Oct 03 10:43:48.883159 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1652/3184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:48 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:48.888696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08f86c75-cf52-40e3-9e9a-e25e4810718a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08f86c75-cf52-40e3-9e9a-e25e4810718a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Request method failure captured: Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action HTTP/1.1 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 34 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOry85NWTu8-cPAWr193cZVJq0h23vzgVWCaGWmPvh7hx4arwRjMeHGYVaAXIuJEAEvtFiY4SUM8vsheSsUWkHGwX_EXxVRFc4jnofsn4fIY9s-Lr6iH8m5QfVu_isMO2w7NgY2ARFOvYvxLYZ7m417JjPshe8NFqpJsyuqxaaH-zw-o Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88f464a0fb634b4d83940ae609717889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88f464a0fb634b4d83940ae609717889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}] Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 57d093d3c0924bef9033a3cc13315b48 Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: {"addFloatingIp": {"address": ""}} Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '6eef4889-3f78-43c8-afdd-b6ca52ce723a', 'body': {'addFloatingIp': {'address': ''}}} Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '' Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:43:48.893162 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 03 10:43:48.898905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:48.901449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08f86c75-cf52-40e3-9e9a-e25e4810718a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:48.902716 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08f86c75-cf52-40e3-9e9a-e25e4810718a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action" status: 400 len: 142 microversion: 2.1 time: 0.018169 Oct 03 10:43:48.903443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1653/3185] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:48 2022] POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:43:48.915282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:48.918227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:48.926190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.926825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.927366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.928182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:48.929044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:48.929680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:48.959983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 10:43:48.960668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquired lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 10:43:49.003373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-74f26537-a993-428c-ac4a-27a7976167d0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-f43xi6n0" status: 200 len: 2929 microversion: 2.1 time: 0.565181 Oct 03 10:43:49.004254 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1533/3186] 10.222.0.27 () {58 vars in 1197 bytes} [Mon Oct 3 10:43:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-f43xi6n0 => generated 2929 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:49.027777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:49.028431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:49.036145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.037034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.037671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.038639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.039599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.040185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.084262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Releasing lock "refresh_cache-6eef4889-3f78-43c8-afdd-b6ca52ce723a" {{(pid=122269) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 10:43:49.085034 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] HTTP exception thrown: floating IP not found Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Request method failure captured: Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action HTTP/1.1 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 41 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOry85NWTu8-cPAWr193cZVJq0h23vzgVWCaGWmPvh7hx4arwRjMeHGYVaAXIuJEAEvtFiY4SUM8vsheSsUWkHGwX_EXxVRFc4jnofsn4fIY9s-Lr6iH8m5QfVu_isMO2w7NgY2ARFOvYvxLYZ7m417JjPshe8NFqpJsyuqxaaH-zw-o Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88f464a0fb634b4d83940ae609717889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88f464a0fb634b4d83940ae609717889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}] Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 57d093d3c0924bef9033a3cc13315b48 Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: exception: floating IP not found Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '6eef4889-3f78-43c8-afdd-b6ca52ce723a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 03 10:43:49.086985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Returning 404 to user: floating IP not found {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-04f16bac-2527-4cfb-b2e1-87c6feebbfca tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action" status: 404 len: 67 microversion: 2.1 time: 0.179789 Oct 03 10:43:49.091913 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1654/3187] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:48 2022] POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action => generated 67 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:43:49.104143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0056d204-6c86-455c-92ce-b65ef454b0ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:49.121227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.server_groups [None req-0056d204-6c86-455c-92ce-b65ef454b0ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Querying cell 5d809412-179d-487a-a3ff-24b9afa0366c(cell1) for 2 instances {{(pid=122269) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 10:43:49.121966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0056d204-6c86-455c-92ce-b65ef454b0ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.122434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0056d204-6c86-455c-92ce-b65ef454b0ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.123059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0056d204-6c86-455c-92ce-b65ef454b0ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.145552 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0056d204-6c86-455c-92ce-b65ef454b0ae tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/a98ab6c6-9894-424b-bd26-70ff2e9d2f93" status: 200 len: 271 microversion: 2.1 time: 0.052962 Oct 03 10:43:49.146748 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1655/3188] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 10:43:49 2022] GET /compute/v2.1/os-server-groups/a98ab6c6-9894-424b-bd26-70ff2e9d2f93 => generated 271 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:49.151757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70ab0645-8af5-48e1-9f51-a915bbd4f4c4 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:49.197987 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-70ab0645-8af5-48e1-9f51-a915bbd4f4c4 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70ab0645-8af5-48e1-9f51-a915bbd4f4c4 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Request method failure captured: Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action HTTP/1.1 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 44 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOry85NWTu8-cPAWr193cZVJq0h23vzgVWCaGWmPvh7hx4arwRjMeHGYVaAXIuJEAEvtFiY4SUM8vsheSsUWkHGwX_EXxVRFc4jnofsn4fIY9s-Lr6iH8m5QfVu_isMO2w7NgY2ARFOvYvxLYZ7m417JjPshe8NFqpJsyuqxaaH-zw-o Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88f464a0fb634b4d83940ae609717889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88f464a0fb634b4d83940ae609717889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}] Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 57d093d3c0924bef9033a3cc13315b48 Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: exception: Floating IP not found for address 0.0.0.0. Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '6eef4889-3f78-43c8-afdd-b6ca52ce723a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 03 10:43:49.199619 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:49.204344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70ab0645-8af5-48e1-9f51-a915bbd4f4c4 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:49.205603 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-70ab0645-8af5-48e1-9f51-a915bbd4f4c4 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action" status: 404 len: 88 microversion: 2.1 time: 0.057486 Oct 03 10:43:49.207009 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1656/3189] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:43:49 2022] POST /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a/action => generated 88 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:43:49.216103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:49.216912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:49.223807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.224298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.224719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.225436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.225887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.226304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.384442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:49.391298 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e4f0fcd-30bc-46f2-b848-93f5aad31d63 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 200 len: 1619 microversion: 2.1 time: 0.178835 Oct 03 10:43:49.394478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1657/3190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:49 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 1619 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:49.405038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:49.406206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:49.411740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:49.413230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:49.414684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3fb37794-cd4a-4cac-a562-16a1ee625a84 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.391926 Oct 03 10:43:49.415248 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1534/3191] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:49 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:49.429819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.430529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.431307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.432274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.437798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.438320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:49.438773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:49.439716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.447767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.448495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.449301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.450389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.450856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.451303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.470305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:43:49.582976 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3474a824-add4-4b75-a224-ff85d174717a tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 204 len: 0 microversion: 2.1 time: 0.187083 Oct 03 10:43:49.583812 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1658/3192] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:43:49 2022] DELETE /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:43:49.595400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:49.596141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:49.602751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.603239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.603674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.604376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.604852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.605275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.734460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12811bb7-418f-4ee8-beb3-5f996e06e940 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1619 microversion: 2.1 time: 0.312222 Oct 03 10:43:49.735064 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1535/3193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:49 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1619 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:49.741709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:49.742639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:49.749406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.750180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.750858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.751858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:49.752729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:49.754019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:49.786613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:49.798108 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfc5eb5b-bd3e-4894-a5c7-e90e0346a9b7 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1543 microversion: 2.1 time: 0.208229 Oct 03 10:43:49.799076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1659/3194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:49 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1543 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:49.877608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-931759690", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "bf8a08d3-3b84-458e-aa9f-1941ac2386c8"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:49.947197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:43:50.048533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.057101 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8724d9c7-f40a-4835-b871-f11a1b8b2eb9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.320988 Oct 03 10:43:50.057962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1536/3195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:49 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:50.062614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:50.063429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:50.074866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.075603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.076111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.077359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.078017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.078618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.207280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:43:50.207702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:43:50.208344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:43:50.209099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:43:50.209534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:43:50.224472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.224992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.225432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.226156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.226609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.227039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.246912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:50.254926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:50.270540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:43:50.272941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:43:50.327951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8fcd848a-54c4-4bfc-aed3-3f968a0cc875 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455148 Oct 03 10:43:50.328945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1660/3196] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:43:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:43:50.339664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.344831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21ba60c7-38b6-4095-b123-d736b9d9b7df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:50.346004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-21ba60c7-38b6-4095-b123-d736b9d9b7df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:50.351142 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2558bfde-64bf-41af-bf55-9f8c6cf37224 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.291978 Oct 03 10:43:50.373410 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1537/3197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:50 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:50.414607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-21ba60c7-38b6-4095-b123-d736b9d9b7df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.422652 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-21ba60c7-38b6-4095-b123-d736b9d9b7df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1216 microversion: 2.1 time: 0.086226 Oct 03 10:43:50.423235 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1661/3198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:50 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:50.446175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:50.446780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:50.456953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.457457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.457902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.458623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.459079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.459507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.562692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:50.563406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:50.580151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.580809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.582933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.584145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.584683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.585237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.765445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.775396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.776884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.782272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb93ec8b-7b79-48cd-9f79-df46dd7323c3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.339878 Oct 03 10:43:50.805187 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1538/3199] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:50 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:50.825271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:50.825916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:50.836484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.837015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.837463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.838185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.842982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.843447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:50.928368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.942049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.943534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:50.944927 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c5477b6-a6ac-4500-9eba-014b0ebea5a5 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2949 microversion: 2.42 time: 0.386946 Oct 03 10:43:50.953615 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1662/3200] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:50 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2949 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:50.984572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:50.985256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:50.998091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:50.998711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:50.999227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.000053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.005299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.006164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.189512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:51.201935 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b6366f76-8ea5-4be2-a465-3cdf83ed82ac tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1543 microversion: 2.1 time: 0.380091 Oct 03 10:43:51.212820 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1539/3201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:50 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1543 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:51.225962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:51.226740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:51.231312 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0ba25d9-64a1-467c-8c2d-b0681e0cf0ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.250907 Oct 03 10:43:51.232442 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1663/3202] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:43:50 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f/os-interface => generated 1829 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:51.242782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.242782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.247194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.249829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.250588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.251264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.380887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:51.393289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:51.409754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.412959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.415779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.418339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.420953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.421656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.660202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:51.670843 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-21752d03-a3a5-4053-9e35-c5e698f68bd0 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.295331 Oct 03 10:43:51.671554 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1664/3203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:51 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:51.685613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:51.686354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:51.696501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.697145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.697710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.699010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.699575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.700222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.770797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:51.780454 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-290367ed-7c5e-4cef-b06b-35f4b3d07271 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1268 microversion: 2.1 time: 0.101952 Oct 03 10:43:51.781637 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1665/3204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:51 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1268 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:51.817631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:51.818661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:51.825904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.826938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.827650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:51.828442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:51.829145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:51.829799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:52.022253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:52.031067 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-939ff59f-e16d-401a-8e95-1f8ac29d41da tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.827010 Oct 03 10:43:52.032437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1540/3205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:51 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:52.055249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:52.072090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:52.074340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:52.076087 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-487d74ac-f64e-4123-8776-7a995d74526c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.263115 Oct 03 10:43:52.085382 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1666/3206] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:51 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:52.236990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:52.238577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:52.246902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:52.247386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:52.248031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:52.248967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:52.249811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:52.250424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:52.695566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:52.697589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:52.698919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:52.699566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:52.707936 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dfc40358-b4d3-4e13-8353-090ab5a32ba2 tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1543 microversion: 2.1 time: 0.483586 Oct 03 10:43:52.708523 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1541/3207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:52 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1543 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:52.714108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:52.714596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:52.715038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:52.715794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:52.717383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:52.718100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:52.813926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:52.814982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:52.824288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:52.826157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:52.826904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:52.828072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:52.830262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:52.832138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:52.936025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:52.940050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:52.951583 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0f22c7a-e3ba-4028-9e72-641031d025c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.258293 Oct 03 10:43:52.963500 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1667/3208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:52 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:53.053408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:53.061589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:53.063844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:53.072418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.073316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.073807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.074518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.074976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.075464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.089163 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28a4365d-38d6-40b8-8108-269650e2fcf8 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1274 microversion: 2.1 time: 0.273913 Oct 03 10:43:53.093906 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1542/3209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:52 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1274 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:53.115587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:53.116635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:53.136531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.137208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.138029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.140738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.141508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.142040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.355962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:53.365659 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38cec9cc-d7dc-42a9-ba73-93b33d5f898e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.309645 Oct 03 10:43:53.366354 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1668/3210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:53 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:53.381864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-15366160-679d-4fb8-9d5f-6c0108ba8f20 req-211607ff-3881-4c5a-88f6-c444466e16fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eef4889-3f78-43c8-afdd-b6ca52ce723a", "name": "network-vif-deleted", "tag": "b231caa1-577d-4d87-b429-cc9eda124029"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:53.398765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15366160-679d-4fb8-9d5f-6c0108ba8f20 req-211607ff-3881-4c5a-88f6-c444466e16fd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.399425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15366160-679d-4fb8-9d5f-6c0108ba8f20 req-211607ff-3881-4c5a-88f6-c444466e16fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.399862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15366160-679d-4fb8-9d5f-6c0108ba8f20 req-211607ff-3881-4c5a-88f6-c444466e16fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.417645 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-15366160-679d-4fb8-9d5f-6c0108ba8f20 req-211607ff-3881-4c5a-88f6-c444466e16fd service nova] Creating event network-vif-deleted:b231caa1-577d-4d87-b429-cc9eda124029 for instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a on n-h2-858383-3 Oct 03 10:43:53.423259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-15366160-679d-4fb8-9d5f-6c0108ba8f20 req-211607ff-3881-4c5a-88f6-c444466e16fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055466 Oct 03 10:43:53.424257 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1669/3211] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:53.644542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:53.658727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:53.661463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:53.663298 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7999912-a3c7-41c8-bcc1-0893416a50a0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.555551 Oct 03 10:43:53.664406 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1543/3212] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:53 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:43:53.733421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:53.734405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:53.741608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.742447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.742974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.743909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.744471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.745002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.782636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.783401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.785063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.785713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lazy-loading 'fault' on Instance uuid 6eef4889-3f78-43c8-afdd-b6ca52ce723a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:43:53.870872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d093d3c0924bef9033a3cc13315b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f464a0fb634b4d83940ae609717889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:53.882865 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f29f1fee-575d-4631-8458-861393a1317d tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 200 len: 1322 microversion: 2.1 time: 0.153839 Oct 03 10:43:53.895577 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1670/3213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:53 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:53.979100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:53.980140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:53.986469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.986973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.987438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:53.988760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:53.989826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:53.989826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.130860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:54.134482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:54.145191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.145802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.146323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.147264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.147881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.148427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.248536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:54.268253 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9b1fe3c-79cc-4ddd-aff3-b0419ef8790d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1274 microversion: 2.1 time: 0.133476 Oct 03 10:43:54.269585 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1671/3214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:54 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:54.357097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:54.370487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-54da3188-09a1-4a98-a3de-3d36338fdd84 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.395222 Oct 03 10:43:54.371554 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1544/3215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:53 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:54.394253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:54.395166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:54.403994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.404801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.405645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.406377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.406827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.407257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.692684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:54.693403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:54.704639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.708007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.708642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.710732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.713685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.714316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.845897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:54.861871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c0b19c1-1ada-49e6-ac45-e56327909208 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.472590 Oct 03 10:43:54.863615 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1672/3216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:54 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:54.908284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:54.909598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] [instance: 6eef4889-3f78-43c8-afdd-b6ca52ce723a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:54.918280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.919131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.919640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.920419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:54.921131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:54.921666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:54.945449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] HTTP exception thrown: Instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a could not be found. Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Request method failure captured: Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a HTTP/1.1 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOry85NWTu8-cPAWr193cZVJq0h23vzgVWCaGWmPvh7hx4arwRjMeHGYVaAXIuJEAEvtFiY4SUM8vsheSsUWkHGwX_EXxVRFc4jnofsn4fIY9s-Lr6iH8m5QfVu_isMO2w7NgY2ARFOvYvxLYZ7m417JjPshe8NFqpJsyuqxaaH-zw-o Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88f464a0fb634b4d83940ae609717889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88f464a0fb634b4d83940ae609717889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88f464a0fb634b4d83940ae609717889"}]}] Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 88f464a0fb634b4d83940ae609717889 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 57d093d3c0924bef9033a3cc13315b48 Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a could not be found. Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '6eef4889-3f78-43c8-afdd-b6ca52ce723a'} Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a could not be found. Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a could not be found. Oct 03 10:43:54.952875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a could not be found. Oct 03 10:43:54.958426 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:43:54.960782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] Returning 404 to user: Instance 6eef4889-3f78-43c8-afdd-b6ca52ce723a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:43:54.963170 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df280909-ca59-401e-96da-f525b2a33daa tempest-FloatingIPsAssociationNegativeTestJSON-190445309 tempest-FloatingIPsAssociationNegativeTestJSON-190445309-project] 10.222.0.27 "GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a" status: 404 len: 111 microversion: 2.1 time: 0.059428 Oct 03 10:43:54.967629 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1673/3217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:54 2022] GET /compute/v2.1/servers/6eef4889-3f78-43c8-afdd-b6ca52ce723a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:43:55.259745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:55.294766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:55.295506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:55.298273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:55.301072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:55.304517 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83c02c66-d696-49c1-a7cd-cd1d1df4c176 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.616571 Oct 03 10:43:55.305703 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1545/3218] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:54 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:43:55.307279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.307784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.308229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:55.308989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.309454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.309889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:55.359650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:55.360968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:55.368571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.369597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.370618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:55.371729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.372403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.373072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:55.407956 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0a608b2-54f4-4b77-8fd2-90c1e7df0f66 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/ips" status: 200 len: 152 microversion: 2.20 time: 0.052727 Oct 03 10:43:55.418624 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1546/3219] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 3 10:43:55 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/ips => generated 152 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:43:55.425751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:55.427560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:55.435271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.436234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.437424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:55.439050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.439738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.440996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:55.638430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:55.647583 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9cf0816f-ecc4-455d-b1b0-5407021f3fda tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.356717 Oct 03 10:43:55.661731 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1674/3220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:55 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:55.893172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:55.893932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:55.904350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.904973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.905703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:55.907661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:55.909486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:55.911358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:56.199803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:56.212674 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f6d62c2b-5d88-41a8-82f5-27b612e57ee7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.792669 Oct 03 10:43:56.231900 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1547/3221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:55 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:56.242218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:56.250066 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e827a2ae-d27e-46a5-8ff9-acd9563a15b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.363455 Oct 03 10:43:56.251394 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1675/3222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:55 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:56.340058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:56.341699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:56.366126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:56.367391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:56.370521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:56.371682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:56.372362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:56.373055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:56.681338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:56.681956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:56.688752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:56.689348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:56.689786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:56.691034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:56.691484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:56.691905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:56.827776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:56.848023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:56.851218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:56.855612 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a9a76196-b0e0-43e1-9313-bbc4eeefcc13 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.525711 Oct 03 10:43:56.874403 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1548/3223] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:56 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:57.169414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-652780217", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "3a89faec-6085-4ef0-b59d-87812a12dfb1"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:57.235534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] validate_networks() for [('3a89faec-6085-4ef0-b59d-87812a12dfb1', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:43:57.284695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:57.294557 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce433a7e-b987-4761-9efa-7bbb1c27250e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.617662 Oct 03 10:43:57.302719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1676/3224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:56 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:43:57.309521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b44c74b7-d819-403a-8178-3efe159855ea req-1d7e6cad-d344-4183-a6f9-179b65e9c92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79c33b6-48e6-4dd6-877d-38df2afdfe84", "tag": "eba7a7b4-aa69-43fa-b3b3-f61e0939458d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:57.323229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b44c74b7-d819-403a-8178-3efe159855ea req-1d7e6cad-d344-4183-a6f9-179b65e9c92d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:57.325361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b44c74b7-d819-403a-8178-3efe159855ea req-1d7e6cad-d344-4183-a6f9-179b65e9c92d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:57.325911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b44c74b7-d819-403a-8178-3efe159855ea req-1d7e6cad-d344-4183-a6f9-179b65e9c92d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:57.345359 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b44c74b7-d819-403a-8178-3efe159855ea req-1d7e6cad-d344-4183-a6f9-179b65e9c92d service nova] Creating event network-changed:eba7a7b4-aa69-43fa-b3b3-f61e0939458d for instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 on n-h1-858383-3 Oct 03 10:43:57.353601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b44c74b7-d819-403a-8178-3efe159855ea req-1d7e6cad-d344-4183-a6f9-179b65e9c92d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049531 Oct 03 10:43:57.355219 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1677/3225] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:43:57.366425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:57.367938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:57.377732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:57.379122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:57.379740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:57.380626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:57.381321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:57.381906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:57.577224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:57.589605 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-228162ed-80b1-4bc7-96b0-fa7624b68c94 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.233079 Oct 03 10:43:57.603126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1678/3226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:57 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:57.616841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:57.618298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:57.625797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:57.626297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:57.626737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:57.627447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:57.628006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:57.628437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.237110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:58.253678 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-35d9e367-b0c2-4037-a773-3dad637e2d5f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.647321 Oct 03 10:43:58.255236 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1679/3227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:57 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:58.264640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:58.266009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:58.274714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.275564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.277060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.278182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.278847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.279541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.291225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:43:58.292188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:43:58.292855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:43:58.293836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:43:58.294786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:43:58.308332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.308842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.309487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.310373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.310991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.312002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.334538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Getting quotas for project 04e12137dc394204baac6034aa3ff3ff. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:43:58.341995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Getting quotas for user d20e3f4497264811be457c0a82719d78 and project 04e12137dc394204baac6034aa3ff3ff. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:43:58.364674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:43:58.367463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:43:58.429961 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00df05a2-59bc-4494-be5a-9f1e96c9040b tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554092 Oct 03 10:43:58.431330 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1549/3228] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:43:58.436374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:58.437628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:58.457677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.458747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.459622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.460577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.461452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.462686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.582863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:58.592740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:58.594375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:58.595670 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b85e061-cd8f-4854-ac37-24ffdc28eb8c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.338662 Oct 03 10:43:58.596645 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1680/3229] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:58 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:58.602500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f562626e-2dfa-4b54-bbd0-bfabe0aba2e7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:58.603988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f562626e-2dfa-4b54-bbd0-bfabe0aba2e7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:58.616319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:43:58.674314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f562626e-2dfa-4b54-bbd0-bfabe0aba2e7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:58.682807 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f562626e-2dfa-4b54-bbd0-bfabe0aba2e7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1216 microversion: 2.1 time: 0.084961 Oct 03 10:43:58.698053 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1681/3230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:58 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1216 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:58.705828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:58.706523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:58.713766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.714061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.714499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.715201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.715656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.716077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.752439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:58.761674 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-604d5fce-bfe5-469f-83e3-e28a56f3f65b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.328930 Oct 03 10:43:58.772846 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1550/3231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:58 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:58.772846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:43:58.777473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:58.787844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.788547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.791316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.792141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:58.792541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:58.793133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:58.903092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lazy-loading 'flavor' on Instance uuid 46b2f725-65f5-4190-a0db-43ed8788b274 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:43:59.008276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:59.016348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-239926b2-0e76-4c1d-a355-489e5d794959 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.317141 Oct 03 10:43:59.034835 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1682/3232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:58 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:59.195121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b43e20aa-e7d3-4011-af82-8911a76378b7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/action" status: 202 len: 0 microversion: 2.20 time: 0.431134 Oct 03 10:43:59.197999 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1551/3233] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:43:58 2022] POST /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:43:59.210434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:59.211042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:59.218124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.218567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.219011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.220008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.220423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.220997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.286274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:59.287373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:59.314002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.315360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.316744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.318063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.318735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.319373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.424986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:59.435429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:59.436950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:59.438393 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-84593aef-d977-4455-acb9-f7e77ab37da7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.235899 Oct 03 10:43:59.441134 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1683/3234] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:59 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:43:59.591916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:59.603295 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-17244a74-49aa-4ba9-a47e-d064fa3eae45 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.324220 Oct 03 10:43:59.603970 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1552/3235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:59 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:59.632918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:59.633720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:59.642679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.643146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.644106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.644835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.645580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.646310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.712569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:59.713495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:59.722270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.723014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.723687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.724557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.725583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.726325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.817650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:43:59.825641 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6a726f72-8396-41ec-a0a6-11f7104bc455 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1220 microversion: 2.1 time: 0.118099 Oct 03 10:43:59.826437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1553/3236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:59 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:43:59.840860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:43:59.841807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:43:59.850971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.851464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.851896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:43:59.852813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:43:59.853484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:43:59.854070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.022844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.036352 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-439a0589-1792-44b9-8a9b-b79b39b905fd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.202940 Oct 03 10:44:00.037492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.051528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1554/3237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:43:59 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:00.058922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.062111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.064308 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4be8d4a6-7acc-4e1a-aacf-ddd8d719821a tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.435523 Oct 03 10:44:00.064742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:00.066518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:00.071150 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1684/3238] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:43:59 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:00.074296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.075035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.075699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.076656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.077336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.077962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.256044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.264928 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1745902-bbb1-4b85-9282-a1343ae29546 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.212034 Oct 03 10:44:00.265852 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1555/3239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:00 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:00.466235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:00.466952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:00.476636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:00.478476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.478938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.479374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.480254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.480710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.481170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.630918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.634946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:00.645343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:00.646910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.649447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.653452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.654454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.654902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.655610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.656068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.656489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.662344 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e9721871-dd7c-4cb0-9fbf-a411a04204f9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.200116 Oct 03 10:44:00.663184 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1685/3240] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:00 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:00.842535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:00.849862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:00.850475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:00.853514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2763b0a4-736e-419a-ac5e-652b24a16136 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.228871 Oct 03 10:44:00.854702 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1556/3241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:00 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:00.873809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.874651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.875801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:00.877426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:00.878547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:00.879198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.006635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.017750 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-47fb3e8a-c92d-46a3-a79b-1f41ef321785 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1220 microversion: 2.1 time: 0.172301 Oct 03 10:44:01.019218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1686/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:00 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:01.064491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:01.065809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:01.074938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.075459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.076352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.084671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.085456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.087128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.096922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:01.098019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:01.109018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.109926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.112723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.113596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.115440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:01.117757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.119787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.194102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:01.400361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.411981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d7667a8b-22a6-4b5b-83fa-4b7c02814cad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.351567 Oct 03 10:44:01.412590 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1557/3243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:01 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:01.425170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:01.425170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:01.439665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.441150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.441757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.442658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.443272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.444009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.613046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.634287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.639255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.641345 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f54448e-0e31-4f02-b09a-1c9de3c9c2e2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.553687 Oct 03 10:44:01.643636 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1687/3244] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:01 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:01.690466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:01.692332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:01.701227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.703373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.705899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.706877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.708605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.711049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.724098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.742384 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a294db84-53d6-44f2-a26d-fbf4b8f165e7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.328686 Oct 03 10:44:01.745974 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1558/3245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:01 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:01.878028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:01.878632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:01.881687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:01.889722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.890219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.890655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.891356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:01.891841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:01.900168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:01.935588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.947904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.949721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:01.953845 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a784727-962c-412e-9fe8-f3a4c9da7a09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.267620 Oct 03 10:44:01.967994 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1688/3246] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:01 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:02.048879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.050998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:02.061833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.062508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.063833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.065294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.066242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.067875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.173095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:02.186618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f03f500-c7a3-4e14-99b8-5138e483f5da tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1212 microversion: 2.1 time: 0.149593 Oct 03 10:44:02.187955 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1689/3247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:02 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:02.244408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:02.274976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca740284-3d78-4062-b1c0-2512ddbd5243 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.400762 Oct 03 10:44:02.275560 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1559/3248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:01 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:02.430639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-101d17c3-ab43-4c14-b5a7-5a386406cdf3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Action: 'create', calling method: .version_select at 0x7f074eaf2dc0>, body: {"keypair": {"name": "tempest-keypair-1657778965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOiBpGWRvCf1wShK0VZCVx3Nlxf2yznnOlAWdk580hY/qgMUU65crxxleFyF3vWlZ4Z1p0QkeBjBKTtbM2L82WeEpd1THacsY0UmJNDxL1e62LEMmUyL27urSnKy+GGJw=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:02.445261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.446037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:02.448842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-101d17c3-ab43-4c14-b5a7-5a386406cdf3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:02.453597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.454306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.454644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-101d17c3-ab43-4c14-b5a7-5a386406cdf3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for user 4f21834c6af4403ebb9b2c444dde8ed4 and project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:02.455095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.456047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.456671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.458114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.483536 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-101d17c3-ab43-4c14-b5a7-5a386406cdf3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202815 Oct 03 10:44:02.484233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1690/3249] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:44:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:02.505202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-531e0396-3ebb-4723-82f0-c4bec6ce5697 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e29bc10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.520661 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-531e0396-3ebb-4723-82f0-c4bec6ce5697 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1657778965" status: 200 len: 498 microversion: 2.1 time: 0.017210 Oct 03 10:44:02.521751 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1691/3250] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:44:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1657778965 => generated 498 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:02.535106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6dbc14a2-8985-43d7-a244-03ebc26945b5 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e2a1a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.560502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6dbc14a2-8985-43d7-a244-03ebc26945b5 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657778965" status: 202 len: 0 microversion: 2.1 time: 0.030702 Oct 03 10:44:02.561298 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1692/3251] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1657778965 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:44:02.574897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-470ed729-4554-4644-b007-535f6db340ec tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Action: 'create', calling method: .version_select at 0x7f074eb041f0>, body: {"keypair": {"name": "tempest-keypair-1052030208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+LK4DovXXLIDeKgqe4+Bo4/OYccG8aQ3L+L4PYoxYAwBRaD0k4fm/KORx/uagrS39RRDJUuJe9cZ9DfeUZZX2zizxcNyqcMM42JskK8RYI7gCqmuTc8nofJV7+WGeNlA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:02.595292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-470ed729-4554-4644-b007-535f6db340ec tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:02.620568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-470ed729-4554-4644-b007-535f6db340ec tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for user 4f21834c6af4403ebb9b2c444dde8ed4 and project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:02.641532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:02.652656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-470ed729-4554-4644-b007-535f6db340ec tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082839 Oct 03 10:44:02.657393 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1693/3252] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:44:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:02.662824 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-065b73c5-1926-4686-9113-42675c641495 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.224500 Oct 03 10:44:02.665679 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1560/3253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:02 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:02.669287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42d80be1-00b5-4535-a0dd-70a75188f18b tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e2a1670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.671855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.672712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:02.681406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.682068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.682694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.683568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.684173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.684891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.701756 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42d80be1-00b5-4535-a0dd-70a75188f18b tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052030208" status: 202 len: 0 microversion: 2.1 time: 0.040430 Oct 03 10:44:02.702733 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1694/3254] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052030208 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:44:02.716146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f6ea063-e892-4109-935a-e3e970bd3d62 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Action: 'create', calling method: .version_select at 0x7f074e256d30>, body: {"keypair": {"name": "tempest-keypair-1887419287", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:02.739392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9f6ea063-e892-4109-935a-e3e970bd3d62 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:02.745564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9f6ea063-e892-4109-935a-e3e970bd3d62 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for user 4f21834c6af4403ebb9b2c444dde8ed4 and project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:02.779898 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f6ea063-e892-4109-935a-e3e970bd3d62 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.069937 Oct 03 10:44:02.780670 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1695/3255] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:44:02 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:44:02.790841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.791627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:02.800244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.800735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.801456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.802444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.802903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.803331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.935990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:02.947522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:02.949018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:02.950380 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-85011698-a78d-45d3-bad3-d7e2e8ca3f89 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.283598 Oct 03 10:44:02.951101 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1561/3256] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:02 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:02.956516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1ca24b3-6a5a-4481-b09d-3c2a0d421de3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e2c9d30>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.972275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:02.981156 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-969fad15-e5b4-43c3-9403-3e9d152d77a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.194825 Oct 03 10:44:02.981903 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1696/3257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:02 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:02.986620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:02.987257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:02.993461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.993950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.994394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:02.994851 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1ca24b3-6a5a-4481-b09d-3c2a0d421de3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887419287" status: 202 len: 0 microversion: 2.1 time: 0.042201 Oct 03 10:44:02.995090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:02.995550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:02.996137 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1562/3258] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1887419287 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:44:02.997060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:03.007204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4105ec46-e5d3-415c-bd34-9b40b3a66363 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Action: 'create', calling method: .version_select at 0x7f074e2a38b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1350880018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnDvHKwXUGHA4jyLRn3dMpms+0sKuRVzIuXv2LTDXjuuS9+ez2MRRCJDfRR0jAYlTMJyrvPoXY7NqMQgT/W3mX4YVzsJY/BtxRye4pa7ZhKvAXxemn15tKUTe+nuRnvmw=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:03.025476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4105ec46-e5d3-415c-bd34-9b40b3a66363 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:03.031189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4105ec46-e5d3-415c-bd34-9b40b3a66363 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for user 4f21834c6af4403ebb9b2c444dde8ed4 and project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:03.066811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4105ec46-e5d3-415c-bd34-9b40b3a66363 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063271 Oct 03 10:44:03.067341 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1563/3259] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:44:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:03.080350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-daf5c78e-9943-4856-bac9-9cf8a2dc64f3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Action: 'create', calling method: .version_select at 0x7f074e2f6ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-258079747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV06LzStAiUj5+gHE3D/SVkNwafYkU4ZFTvcI30vHUUDbhc+C1/JQGAtsW7cXLEZirBXxecVf7+/RRxg3XF/Dd7I+Wc1pkALeU8dQUcYUz0HyAfAAPm1aR6vVFO3yWD6w=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:03.097392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-daf5c78e-9943-4856-bac9-9cf8a2dc64f3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:03.102460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-daf5c78e-9943-4856-bac9-9cf8a2dc64f3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for user 4f21834c6af4403ebb9b2c444dde8ed4 and project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:03.127921 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-daf5c78e-9943-4856-bac9-9cf8a2dc64f3 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051283 Oct 03 10:44:03.137132 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1564/3260] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:44:03 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:03.142440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d783a13-900a-4e72-94f7-9247394be16b tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Action: 'create', calling method: .version_select at 0x7f074e2a3af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1294415980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5gLpHMM/c5hQYQir7fBd+zePfx2VghhlzIUxZ83Lo+SvKBXWG/nxYwH4FX4V1tSTItuNQcw9qo6POTWRSjBycALTMyZOcO4U3uZe4KBpRPDzsazP11gErC8pR4FZDxA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:03.146343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:03.154926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:03.156364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:03.157737 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0c278f1e-3bda-42ff-a8ff-01c37c4e6261 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.174788 Oct 03 10:44:03.159368 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1697/3261] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:02 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:03.177128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6d783a13-900a-4e72-94f7-9247394be16b tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:03.183171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6d783a13-900a-4e72-94f7-9247394be16b tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Getting quotas for user 4f21834c6af4403ebb9b2c444dde8ed4 and project a226e0907c104738a72fe6a292edc19c. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:03.213050 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d783a13-900a-4e72-94f7-9247394be16b tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.074706 Oct 03 10:44:03.214630 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1565/3262] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:44:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:03.214755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.215200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:03.221546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:03.222037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:03.222478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:03.223177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:03.223625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:03.224259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:03.224902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c81b80bd-e011-49c2-b967-d07ba8280731 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e2ebe50>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.229918 n-d-858383-3 devstack@n-api.service[122270]: WARNING oslo_db.sqlalchemy.utils [None req-c81b80bd-e011-49c2-b967-d07ba8280731 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 10:44:03.235370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c81b80bd-e011-49c2-b967-d07ba8280731 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.014576 Oct 03 10:44:03.236637 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1566/3263] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:44:03 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:03.247509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-710a219e-b657-4683-b02b-e4d07029a06e tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e2a3c10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.267852 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-710a219e-b657-4683-b02b-e4d07029a06e tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1294415980" status: 202 len: 0 microversion: 2.1 time: 0.023678 Oct 03 10:44:03.273397 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1567/3264] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 3 10:44:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1294415980 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:44:03.277611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6ca4502d-60c0-4325-83d8-5fd0e43f74a7 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e2f6a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.290703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:03.300296 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-293525ba-ee53-4bbd-bf65-6e7d04e163a7 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1268 microversion: 2.1 time: 0.089542 Oct 03 10:44:03.300533 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6ca4502d-60c0-4325-83d8-5fd0e43f74a7 tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-258079747" status: 202 len: 0 microversion: 2.1 time: 0.026890 Oct 03 10:44:03.304046 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1698/3266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:03 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1268 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:03.304182 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1568/3266] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:44:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-258079747 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:44:03.306434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.307037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:03.313165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:03.313656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:03.314156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:03.315397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:03.315846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:03.316273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:03.321159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28d020a5-cb18-4a43-80b1-3c5a000a489c tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] Calling method '.version_select at 0x7f074e2f2f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.353339 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28d020a5-cb18-4a43-80b1-3c5a000a489c tempest-KeyPairsV2TestJSON-2139666543 tempest-KeyPairsV2TestJSON-2139666543-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1350880018" status: 202 len: 0 microversion: 2.1 time: 0.047917 Oct 03 10:44:03.357242 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1569/3267] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 3 10:44:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1350880018 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:44:03.528973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:03.538493 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ef2d418e-6d37-43f8-b8a3-d3ef58fa8117 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1498 microversion: 2.1 time: 0.235962 Oct 03 10:44:03.539896 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1699/3268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:03 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1498 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:03.688162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.689700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:03.711872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:03.712651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:03.713357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:03.714686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:03.715224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:03.715864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:03.985050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:03.986032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:04.023045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.023856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.024375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.025642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.026972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.027717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.027998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:04.036879 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-715501cf-44f3-4cd2-8d78-b3359dbff32f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.353224 Oct 03 10:44:04.046026 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1570/3269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:03 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:04.051133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:04.051955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:04.068394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.068913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.069568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.070448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.071067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.071673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.300241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:04.335365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a14399d7-eca3-4dba-b9d6-d7dcd051747c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.287940 Oct 03 10:44:04.342566 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1571/3270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:04 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:04.348305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-de445c77-cfce-4557-8fee-6a53a16d0879 req-dc8f2e69-7121-4694-b661-77d67cab5cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79c33b6-48e6-4dd6-877d-38df2afdfe84", "name": "network-vif-plugged", "status": "completed", "tag": "eba7a7b4-aa69-43fa-b3b3-f61e0939458d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:04.361102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-de445c77-cfce-4557-8fee-6a53a16d0879 req-dc8f2e69-7121-4694-b661-77d67cab5cf2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.363000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-de445c77-cfce-4557-8fee-6a53a16d0879 req-dc8f2e69-7121-4694-b661-77d67cab5cf2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.363600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-de445c77-cfce-4557-8fee-6a53a16d0879 req-dc8f2e69-7121-4694-b661-77d67cab5cf2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.386268 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-de445c77-cfce-4557-8fee-6a53a16d0879 req-dc8f2e69-7121-4694-b661-77d67cab5cf2 service nova] Creating event network-vif-plugged:eba7a7b4-aa69-43fa-b3b3-f61e0939458d for instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 on n-h1-858383-3 Oct 03 10:44:04.391324 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-de445c77-cfce-4557-8fee-6a53a16d0879 req-dc8f2e69-7121-4694-b661-77d67cab5cf2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047392 Oct 03 10:44:04.392241 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1572/3271] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:04.397638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:04.398505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:04.399208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:04.405953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.407230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.407677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.408387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.408910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.409337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.410726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:04.413326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:04.414937 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a23366a1-85ef-4283-82ba-f630defeda00 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.439753 Oct 03 10:44:04.416607 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1700/3272] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:03 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:04.422171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:04.424110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:04.439120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.439803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.461236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.462368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.464621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.466946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.547273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:04.564242 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02dd9e67-8f42-4b61-90a6-fb0479ac2ee4 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1274 microversion: 2.1 time: 0.145391 Oct 03 10:44:04.584966 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1701/3273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:04 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:04.591439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:04.592062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:04.598093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.598577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.599012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.599708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.600157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.600574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.760268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:04.773457 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-23f5843e-1362-4f3c-9e7a-d5bb4eb11d3d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 200 len: 1475 microversion: 2.1 time: 0.187058 Oct 03 10:44:04.778095 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1702/3274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:04 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:04.797693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-874863022"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:04.801223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:04.810680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.811173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.811604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:04.812472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:04.812957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:04.813382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.035702 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d958353b-741a-47cb-b142-a2b1ab9deeac tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243/action" status: 202 len: 0 microversion: 2.1 time: 0.241629 Oct 03 10:44:05.036647 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1703/3275] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:44:04 2022] POST /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 03 10:44:05.050232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfdb81ac-e92b-4d80-a96d-714345614092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2564c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.061026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.073124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.075013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.076972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c4a05ec-32d5-41e5-8bd9-5582d126ca88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.683501 Oct 03 10:44:05.094599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1573/3276] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:04 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:05.102302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.102916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:05.113960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.114457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.117223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.118315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.119391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.119975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.145346 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfdb81ac-e92b-4d80-a96d-714345614092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.101171 Oct 03 10:44:05.155491 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1704/3277] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:05 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:05.288007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.297474 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e7c515e-2919-48f9-9445-d6d853fee8d6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.201656 Oct 03 10:44:05.298486 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1574/3278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:05 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:05.363638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.364622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:05.371474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.371964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.372406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.373289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.373748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.374494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.529434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.541519 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0a6d3fc5-9204-431e-90fa-201ce184859e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1500 microversion: 2.1 time: 0.182441 Oct 03 10:44:05.542362 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1705/3279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:05 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1500 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:05.547143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.547941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:05.555279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.555279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.555568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.556049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.556517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.556956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.588699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9995e266-03bc-46c1-9641-d0e14a9abc1a tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e59edc0>, body: {"keypair": {"name": "tempest-keypair-258309196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7d452PcV2FuZ9qW5X2BQ48TTUAf2wK/vmgNNxCITwipN3YZidha33Tl3LiiFRxz9P5nSgNiP2RsXFb02BROm0hQuQPRRFGI18m79OHMVFRuzwsAMhwnl4E/J4qtaV3qQ=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:05.605133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9995e266-03bc-46c1-9641-d0e14a9abc1a tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:05.610839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9995e266-03bc-46c1-9641-d0e14a9abc1a tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:05.636421 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9995e266-03bc-46c1-9641-d0e14a9abc1a tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.248996 Oct 03 10:44:05.637493 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1575/3280] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 3 10:44:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:44:05.642462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f57a879e-7c74-43d0-b5b6-9ad3860a6d57"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:05.645468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:05.652220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.652801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.653315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.654089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.654616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.655144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.680241 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Cannot 'attach_volume' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state rescued Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/os-volume_attachments HTTP/1.1 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 74 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: {"volumeAttachment": {"volumeId": "f57a879e-7c74-43d0-b5b6-9ad3860a6d57"}} Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'attach_volume' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state rescued Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': 'f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4', 'body': {'volumeAttachment': {'volumeId': 'f57a879e-7c74-43d0-b5b6-9ad3860a6d57'}}} Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 03 10:44:05.682152 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state rescued Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state rescued Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 409 to user: Cannot 'attach_volume' instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 while it is in vm_state rescued {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e230c41-a35c-4ecb-8983-b5c1ad7b6301 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044912 Oct 03 10:44:05.686390 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1576/3281] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:44:05 2022] POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:44:05.693110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.693720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:05.699905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.700390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.700846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.701733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.702360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.702783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.781502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.791072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.792521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.793700 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eb4a2405-8afe-43af-b499-6e9f05c96b29 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.250612 Oct 03 10:44:05.794264 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1706/3282] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:05 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:05.798693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bff555e7-3a12-4d2a-80f9-03d12abd6b7c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e29bf70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.807676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bff555e7-3a12-4d2a-80f9-03d12abd6b7c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-258309196" status: 200 len: 512 microversion: 2.2 time: 0.012430 Oct 03 10:44:05.808823 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1707/3283] 10.222.0.27 () {60 vars in 1255 bytes} [Mon Oct 3 10:44:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-258309196 => generated 512 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:05.813289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:05.813882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:05.821127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.821622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.822069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.822775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.823232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.823661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.891678 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3175be43-3059-4e44-8d66-a052e9e00804 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action" status: 202 len: 0 microversion: 2.1 time: 0.082223 Oct 03 10:44:05.895588 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1708/3284] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:44:05 2022] POST /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:44:05.897872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-01d075a2-fc23-4527-817c-18794c3f36cf tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074eb2c5e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.918059 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-01d075a2-fc23-4527-817c-18794c3f36cf tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-258309196" status: 204 len: 0 microversion: 2.2 time: 0.024406 Oct 03 10:44:05.918930 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1709/3285] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 3 10:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-258309196 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:05.921351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:05.932370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7677d93f-d8cd-4e2a-a406-0963a0efea27 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.243782 Oct 03 10:44:05.933243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:05.934216 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1577/3286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:05 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:05.938504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:05.941575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ba2458f-2a6c-4f33-b1e1-5f1e70e165db tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e2a3ca0>, body: {"keypair": {"name": "tempest-keypair-129423398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXUuH6cJ8J7Lp6Wqv+iWMQgNHOYZvop2pKxyxxACAeG3JeWW7uHweL81JvUTQH5sLJGkniKdLTys7SxX5UKYblZNqYMtfBQBPTzQ2uRy1A5nz7FnRSq/+iTDrhEwjLLCg=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:05.954101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.954656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.955109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.955904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:05.956468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:05.959019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:05.964830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5ba2458f-2a6c-4f33-b1e1-5f1e70e165db tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:05.970693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5ba2458f-2a6c-4f33-b1e1-5f1e70e165db tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:05.978692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:06.004591 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ba2458f-2a6c-4f33-b1e1-5f1e70e165db tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.069058 Oct 03 10:44:06.005408 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1578/3287] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 3 10:44:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:44:06.016106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8740f9a9-3eaf-4984-b4e4-53a3c336bf67 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e2c9b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.036781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:06.052067 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8740f9a9-3eaf-4984-b4e4-53a3c336bf67 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-129423398" status: 204 len: 0 microversion: 2.2 time: 0.039737 Oct 03 10:44:06.057013 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1579/3288] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 3 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-129423398 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:44:06.065993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b930ebe-e22f-42bf-9467-391749f1ec1c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e2af790>, body: {"keypair": {"name": "tempest-keypair-1099836773", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:06.094270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3b930ebe-e22f-42bf-9467-391749f1ec1c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:06.103296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3b930ebe-e22f-42bf-9467-391749f1ec1c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:06.110224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:06.120375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b46e14ad-0ca6-4bd9-913b-2be38dc3f6b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1508 microversion: 2.1 time: 0.192315 Oct 03 10:44:06.121080 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1710/3289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:05 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:06.139485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.139826 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b930ebe-e22f-42bf-9467-391749f1ec1c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.080472 Oct 03 10:44:06.140110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:06.141227 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1580/3290] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 3 10:44:06 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:44:06.151093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:06.152677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:06.153284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:06.154002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:06.154459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:06.155770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:06.156133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29a06aa7-af78-46f3-84f1-2a9a0577a209 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e2e33a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.186357 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29a06aa7-af78-46f3-84f1-2a9a0577a209 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099836773" status: 204 len: 0 microversion: 2.2 time: 0.036601 Oct 03 10:44:06.187653 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1581/3291] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 3 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099836773 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:06.194982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d3a9b2e-a6c5-4ab9-ab9d-46258bd2a742 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e5221f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.258298 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d3a9b2e-a6c5-4ab9-ab9d-46258bd2a742 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.068603 Oct 03 10:44:06.260886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1582/3292] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:06 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:06.271132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c63c121-13f6-4980-a547-c6f1c2104354 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e2a3a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1758317655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNW2oCK8ntSnsNIT8y9YFczC9AmJAJQKXXUY/euB/9wF34UB1/hjcBiqC+rHE2mIqMlem5rOGqqYbg+Uvq9QCQvHsXzr2vn/gGNc2CG0XS6AXCI14YEeTh3UPyEeWZRdA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:06.305914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8c63c121-13f6-4980-a547-c6f1c2104354 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:06.315943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8c63c121-13f6-4980-a547-c6f1c2104354 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:06.356745 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c63c121-13f6-4980-a547-c6f1c2104354 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.094682 Oct 03 10:44:06.357361 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1583/3293] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 3 10:44:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:44:06.366460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.366460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:06.369142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:06.373095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:06.373584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:06.374077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:06.376346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:06.376861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:06.377607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:06.379993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:06.382829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:06.385818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-af1f4465-8149-4042-a804-6bb3438059b5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.263147 Oct 03 10:44:06.387000 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1711/3294] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:06 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:06.392641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce5bc981-2631-4829-95f2-262c691b97d6 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e25fe50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1270545576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXY2dJpNCyav1Jg5/1qOu4YLcsIdJYUfyWGz1qCv8eg6pW2IeJXYo+NdLfYTplNpricVisss/LIHIQLH438yXId2e2w78WbN/jcePLupG7xTC5kJqFJ2f2uo7vDEPmzog=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:06.422033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ce5bc981-2631-4829-95f2-262c691b97d6 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:06.425624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:06.430050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ce5bc981-2631-4829-95f2-262c691b97d6 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:06.462425 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce5bc981-2631-4829-95f2-262c691b97d6 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.073804 Oct 03 10:44:06.472392 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1712/3295] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 3 10:44:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:44:06.482352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0db5013-a83c-4c22-ae54-3e469424f90f tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e27a160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-647218869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuevxhvkiCd6+N20WteCh3I1ncsBL8aXLUdBZWcIFsxVbsabnsiKp1dOTveTYB/XS9jqLyWCLDoqLjiQ7Xt+s7ReB6Np27WHo7f3xS8VZcoCrHOlIfADANTbVuk5ra2mg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:06.502401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f0db5013-a83c-4c22-ae54-3e469424f90f tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:06.508756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f0db5013-a83c-4c22-ae54-3e469424f90f tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:06.537510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0db5013-a83c-4c22-ae54-3e469424f90f tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.062739 Oct 03 10:44:06.544079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1713/3296] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 3 10:44:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:44:06.553420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f415b03-1065-4d94-b81a-6111a6633e40 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e20c430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.559322 n-d-858383-3 devstack@n-api.service[122269]: WARNING oslo_db.sqlalchemy.utils [None req-3f415b03-1065-4d94-b81a-6111a6633e40 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 10:44:06.567152 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f415b03-1065-4d94-b81a-6111a6633e40 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.018367 Oct 03 10:44:06.573792 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1714/3297] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 3 10:44:06 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:06.586409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53920015-ac74-421a-85bf-748b687ed62a tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e25f310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.612601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53920015-ac74-421a-85bf-748b687ed62a tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-647218869" status: 204 len: 0 microversion: 2.2 time: 0.032605 Oct 03 10:44:06.617308 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1715/3298] 10.222.0.27 () {60 vars in 1318 bytes} [Mon Oct 3 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-647218869 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:06.622652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd0f28be-a615-4e38-b88b-4650dbb81866 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e29ba60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.648446 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd0f28be-a615-4e38-b88b-4650dbb81866 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1270545576" status: 204 len: 0 microversion: 2.2 time: 0.029318 Oct 03 10:44:06.652360 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1716/3299] 10.222.0.27 () {60 vars in 1321 bytes} [Mon Oct 3 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1270545576 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:44:06.672882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:06.677741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5cd26dcf-ae91-4d6c-b5ad-2b6355d37ad2 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074ea8a790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.681373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed5636e2-9300-4d5a-9776-d142bb3ef520 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1316 microversion: 2.1 time: 0.322584 Oct 03 10:44:06.686634 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1584/3300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:06 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:06.710785 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5cd26dcf-ae91-4d6c-b5ad-2b6355d37ad2 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1758317655" status: 204 len: 0 microversion: 2.2 time: 0.040031 Oct 03 10:44:06.712818 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1717/3301] 10.222.0.27 () {60 vars in 1321 bytes} [Mon Oct 3 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1758317655 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:06.730001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc1b93c6-ec77-4a2a-a9f9-af6c080ded7d tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e59e1f0>, body: {"keypair": {"name": "tempest-keypair-1899988149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6VXaSlcKemU65fMUdw7cDTFaCqBXmfIdyEIF7qkYZar8Cc3eQln20Fp97r9qUXbGfvL+muE5iupe9Awb5vAzCJ77bBPzmFoyHOrOD6pvIkMPgO6DdWomplVM17uEInGw=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:06.746926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cc1b93c6-ec77-4a2a-a9f9-af6c080ded7d tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:06.753035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cc1b93c6-ec77-4a2a-a9f9-af6c080ded7d tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:06.784194 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc1b93c6-ec77-4a2a-a9f9-af6c080ded7d tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.056221 Oct 03 10:44:06.785637 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1585/3302] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Oct 3 10:44:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:44:06.797012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-050914d6-a3bd-4a5d-895f-c54613bdf8c8 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e2460d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.803751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9c7b6dd3-ca03-4083-a8a2-297041d8c486 req-8ea49bf0-ec05-4bed-a82f-8758a035dc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e3b3bf6-2456-48b9-84ac-a738ceca5a97", "tag": "27f5ebdb-2c42-4578-be02-73b0f0421102"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:06.807138 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-050914d6-a3bd-4a5d-895f-c54613bdf8c8 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1899988149" status: 200 len: 513 microversion: 2.2 time: 0.014368 Oct 03 10:44:06.807722 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1718/3303] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 3 10:44:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1899988149 => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:06.819009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9c7b6dd3-ca03-4083-a8a2-297041d8c486 req-8ea49bf0-ec05-4bed-a82f-8758a035dc60 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:06.819867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9c7b6dd3-ca03-4083-a8a2-297041d8c486 req-8ea49bf0-ec05-4bed-a82f-8758a035dc60 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:06.820526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9c7b6dd3-ca03-4083-a8a2-297041d8c486 req-8ea49bf0-ec05-4bed-a82f-8758a035dc60 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:06.825213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c49568cf-0dc9-4e99-a04b-3ab61f0ad767 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074eb2ce50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.831601 n-d-858383-3 devstack@n-api.service[122269]: WARNING oslo_db.sqlalchemy.utils [None req-c49568cf-0dc9-4e99-a04b-3ab61f0ad767 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 10:44:06.834407 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9c7b6dd3-ca03-4083-a8a2-297041d8c486 req-8ea49bf0-ec05-4bed-a82f-8758a035dc60 service nova] Creating event network-changed:27f5ebdb-2c42-4578-be02-73b0f0421102 for instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 on n-h1-858383-3 Oct 03 10:44:06.837703 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c49568cf-0dc9-4e99-a04b-3ab61f0ad767 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.020256 Oct 03 10:44:06.841487 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1719/3304] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 3 10:44:06 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:06.843286 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9c7b6dd3-ca03-4083-a8a2-297041d8c486 req-8ea49bf0-ec05-4bed-a82f-8758a035dc60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044647 Oct 03 10:44:06.845663 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1586/3305] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:06.849217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.850350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:06.852844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b08bdf9-13a5-4c22-8e10-212e0d0fda5c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e2a3dc0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:06.869711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:06.870290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:06.870741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:06.871471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:06.871925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:06.872816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:06.880562 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b08bdf9-13a5-4c22-8e10-212e0d0fda5c tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899988149" status: 204 len: 0 microversion: 2.2 time: 0.031887 Oct 03 10:44:06.886419 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1587/3306] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 3 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899988149 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:06.892413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Action: 'create', calling method: .version_select at 0x7f074e4c4c10>, body: {"keypair": {"name": "tempest-keypair-1626698143", "type": "x509"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:06.914530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:06.922045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:06.942233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.processutils [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpxwwtxcps/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxwwtxcps/temp.key -subj /CN=0d877fd179164402af4fba370c779081 -extensions v3_req_client {{(pid=122270) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 03 10:44:07.113753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.126713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.129017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.130268 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b908881-49ac-45cf-8549-3458bd5f7257 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.290490 Oct 03 10:44:07.131230 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1720/3307] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:06 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:07.138428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.139146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:07.147337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.147829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.148348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.149087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.150004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.150447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.166833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.processutils [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpxwwtxcps/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxwwtxcps/temp.key -subj /CN=0d877fd179164402af4fba370c779081 -extensions v3_req_client" returned: 0 in 0.224s {{(pid=122270) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 03 10:44:07.168554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.processutils [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpxwwtxcps/temp.key -password pass: {{(pid=122270) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 03 10:44:07.205958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.processutils [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpxwwtxcps/temp.key -password pass:" returned: 0 in 0.036s {{(pid=122270) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 03 10:44:07.266788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:07.273525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Getting quotas for user 0d877fd179164402af4fba370c779081 and project 6a50b48bc8db4f44ab70c54c051b93dc. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:07.291295 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-57eb48f5-f8c9-4081-bbbf-061fab325d93 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.403144 Oct 03 10:44:07.292424 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1588/3308] 10.222.0.27 () {62 vars in 1198 bytes} [Mon Oct 3 10:44:06 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 405 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:07.303005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.304440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:07.311311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.311955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.312469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.313427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.313930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.315493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.315676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.325786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15be4a90-7a86-4e12-a041-c1356a7d57f6 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.193468 Oct 03 10:44:07.338027 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1721/3309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:07.346886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f720c0dd-fcd0-409f-bab8-2feb57b3b0e4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e25f1f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.394564 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f720c0dd-fcd0-409f-bab8-2feb57b3b0e4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.056033 Oct 03 10:44:07.395244 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1722/3310] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:07.400167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28238cfb-9b3b-4623-b6a0-47f91f6cec21 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e287790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.410060 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28238cfb-9b3b-4623-b6a0-47f91f6cec21 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1626698143" status: 200 len: 1534 microversion: 2.2 time: 0.013544 Oct 03 10:44:07.410648 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1723/3311] 10.222.0.27 () {60 vars in 1258 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1626698143 => generated 1534 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:07.418798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.419401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:07.428005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.428495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.428991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.429722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.430194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.430619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.542903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.552550 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e6ad418-03c9-41f8-a702-196f1e3af658 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1508 microversion: 2.1 time: 0.258237 Oct 03 10:44:07.553032 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1589/3312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:07.557661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68005ce5-32e4-42ef-ba5e-d34d9977b130 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e2a3700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.562162 n-d-858383-3 devstack@n-api.service[122270]: WARNING oslo_db.sqlalchemy.utils [None req-68005ce5-32e4-42ef-ba5e-d34d9977b130 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 10:44:07.569028 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68005ce5-32e4-42ef-ba5e-d34d9977b130 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.014683 Oct 03 10:44:07.572980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1590/3313] 10.222.0.27 () {60 vars in 1177 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:07.580238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a7928fcd-6feb-4c54-b10b-23d09aed0401 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] Calling method '.version_select at 0x7f074e4c49d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.582539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.594224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.596027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.597635 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f120c62-42e3-4027-8ece-c4d65a23fc98 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.183490 Oct 03 10:44:07.598280 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1724/3314] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:07.614816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a7928fcd-6feb-4c54-b10b-23d09aed0401 tempest-KeyPairsV22TestJSON-1651614710 tempest-KeyPairsV22TestJSON-1651614710-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626698143" status: 204 len: 0 microversion: 2.2 time: 0.038361 Oct 03 10:44:07.615421 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1591/3315] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Oct 3 10:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626698143 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:44:07.703492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.704075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:07.710295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.710781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.711278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.711978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.712430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.712881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.852743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:07.861383 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-47b4c3ab-406d-4ed8-82b3-111e83fe3456 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1466 microversion: 2.1 time: 0.161661 Oct 03 10:44:07.862062 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1725/3316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:07.884484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:07.885129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:07.891986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.892757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.893256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:07.893970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:07.894426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:07.894852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.034750 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7be2a38-ba3b-4f7f-987c-55b743886ec2 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1617 microversion: 2.1 time: 0.154425 Oct 03 10:44:08.035441 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1592/3317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:07 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1617 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:08.157345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:08.158077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:08.174125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.174654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.175091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.175493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2045498174", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["bf8a08d3-3b84-458e-aa9f-1941ac2386c8"]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:08.175957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.176252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.177193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.236562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:44:08.324037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:08.374351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.384151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.385708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.386961 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-70518c41-e753-4a2c-a6ce-1a7ba71fb742 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.233523 Oct 03 10:44:08.387600 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1726/3318] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:08 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:08.392416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:08.393636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:08.399760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.400464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.401148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.402150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.402813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.403649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.533284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:44:08.533883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:44:08.534253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:44:08.534978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:44:08.535101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:44:08.544385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.544907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.545339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.546064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.546518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.546943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.565843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:08.569782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.581289 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b2824c4d-597a-48cd-b72a-967a84d37a32 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.191769 Oct 03 10:44:08.589010 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1727/3319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:08 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:08.589426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:08.593739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd549a43-51c9-4308-b072-7eaa224260db tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e29ba60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:08.601510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:44:08.604002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:44:08.642594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd549a43-51c9-4308-b072-7eaa224260db tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.059323 Oct 03 10:44:08.644066 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1728/3320] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:08 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:08.654114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:08.654925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:08.657058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65b4bad9-ffc0-47a4-af09-f6faf3d74bc1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487535 Oct 03 10:44:08.664415 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1593/3321] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:44:08.670106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:08.670720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:08.680384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.681149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.681407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.682122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.682584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.683013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.685639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.687762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.688268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.691988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:08.692859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:08.693492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:08.845194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.854373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.855847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.857520 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-939decf0-7c11-44fe-bad1-3b75011dd10b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.191532 Oct 03 10:44:08.858562 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1594/3322] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:08 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:08.863489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2a9601b5-a1fd-4890-958f-04ef34e199bd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:08.864331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2a9601b5-a1fd-4890-958f-04ef34e199bd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:08.868394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:08.895738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.906485 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2adbc669-2e9a-4618-b68a-9016ba4850ab tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1508 microversion: 2.1 time: 0.256291 Oct 03 10:44:08.909326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1729/3323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:08 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:08.927337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2a9601b5-a1fd-4890-958f-04ef34e199bd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:08.936908 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2a9601b5-a1fd-4890-958f-04ef34e199bd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1217 microversion: 2.1 time: 0.077475 Oct 03 10:44:08.937654 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1595/3324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:08 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:09.414699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:09.415314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:09.422241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.423395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.423838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.425201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.425767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.426199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.606020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:09.606528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:09.615769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.616611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.617083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.617781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.618408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.618837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.627014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:09.637639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:09.639228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:09.640462 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-efe55cd0-02e2-4399-9a11-64904482e150 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.229848 Oct 03 10:44:09.641386 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1730/3325] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:09 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:09.665361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02be03e3-9d40-4a07-9661-53718002d923 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e27a310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:09.714920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02be03e3-9d40-4a07-9661-53718002d923 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.058969 Oct 03 10:44:09.715523 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1731/3326] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:09 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:09.814026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:09.823110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-51dbd97f-a92d-495a-b48d-0a07a1b5d8c5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.221462 Oct 03 10:44:09.823858 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1596/3327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:09 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:09.883796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:09.884362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:09.890552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.891056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.891501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.892214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.893430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.894034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.932645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:09.933510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:09.941053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.941792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.942236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.943115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:09.943764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:09.944358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:09.962778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:10.107333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:10.121810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:10.134737 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-44a9a7f8-9ecd-41a8-8b62-58fa627ab757 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1514 microversion: 2.1 time: 0.204744 Oct 03 10:44:10.135287 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1597/3328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:09 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:10.136305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:10.139037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:10.142274 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b31aaa71-e402-4bff-b712-efd2f55d54cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.262593 Oct 03 10:44:10.151897 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1732/3329] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:09 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:10.152647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:10.153760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:10.169962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:10.170514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:10.171135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:10.172042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:10.172523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:10.173553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:10.287806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:10.313430 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0483e647-b00b-4c34-89c9-f0a856e29639 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1221 microversion: 2.1 time: 0.160723 Oct 03 10:44:10.314307 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1598/3330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:10 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1221 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:10.670551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:10.671924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:10.683555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:10.694224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:10.694774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:10.695530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:10.695996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:10.696418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:10.735315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a9ec88dc-277e-434f-bd06-e8cf6617e3e9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e59e4c0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:10.845372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a9ec88dc-277e-434f-bd06-e8cf6617e3e9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.113744 Oct 03 10:44:10.855836 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1599/3331] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:10 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:10.881290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:10.884370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:10.922443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:10.923228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:10.930523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:10.932457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:10.934267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:10.936218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:11.054676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.079317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.083197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.086533 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d81d0527-2933-4bc8-a31c-479f49a25610 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.419926 Oct 03 10:44:11.098873 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1733/3332] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:10 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:11.179588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:11.180239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:11.192029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:11.192515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:11.194321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:11.195293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:11.196931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:11.200402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:11.302156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.310592 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba52e5f8-4a54-4db4-9210-9b83fd53e941 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.453222 Oct 03 10:44:11.317949 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1600/3333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:10 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:11.337037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:11.337661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:11.353134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:11.353630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:11.354073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:11.354797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:11.355325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:11.356531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:11.413753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.427379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.433612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.436171 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-243c570d-3b74-4138-9f36-096550a94bc6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.260119 Oct 03 10:44:11.438042 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1734/3334] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:11 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:11.538670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:11.551491 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb3c134e-28a5-449d-b105-d2d863575073 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1269 microversion: 2.1 time: 0.218832 Oct 03 10:44:11.552085 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1601/3335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:11 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:11.867390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a2f8992d-fe30-48f9-b6e3-3c6fb0a6295e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e201dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:11.932927 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a2f8992d-fe30-48f9-b6e3-3c6fb0a6295e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.074161 Oct 03 10:44:11.938192 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1735/3336] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:11 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:12.115330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:12.116046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:12.124231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.125735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.126410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.129373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.130319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.130978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.142847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6b08a7b6-36dc-400e-9aff-e26ecc404159 req-bf1854b2-b299-4979-8f3d-af4b5e6639e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eaf6a-7c9d-4f81-b5eb-d01ef0d59243", "name": "network-vif-plugged", "status": "completed", "tag": "97f76ef1-55de-461a-86b3-e25afc9e4abc"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:12.167644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6b08a7b6-36dc-400e-9aff-e26ecc404159 req-bf1854b2-b299-4979-8f3d-af4b5e6639e2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.168394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6b08a7b6-36dc-400e-9aff-e26ecc404159 req-bf1854b2-b299-4979-8f3d-af4b5e6639e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.169060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6b08a7b6-36dc-400e-9aff-e26ecc404159 req-bf1854b2-b299-4979-8f3d-af4b5e6639e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.187786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6b08a7b6-36dc-400e-9aff-e26ecc404159 req-bf1854b2-b299-4979-8f3d-af4b5e6639e2 service nova] Creating event network-vif-plugged:97f76ef1-55de-461a-86b3-e25afc9e4abc for instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 on n-h1-858383-3 Oct 03 10:44:12.206508 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6b08a7b6-36dc-400e-9aff-e26ecc404159 req-bf1854b2-b299-4979-8f3d-af4b5e6639e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069634 Oct 03 10:44:12.207757 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1736/3337] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:12.347672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:12.348383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:12.355620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.356111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.356604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.357404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.357857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.358283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.530694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.540531 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d412a0b-d1f2-4f51-ac60-81a0dadfe61a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.197996 Oct 03 10:44:12.541430 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1737/3338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:12 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:12.554104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:12.555548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:12.563766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.563766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.564040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.564910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.565420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.565793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.743672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.757583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.759902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.761516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-341a0ab2-be8c-4e20-b8e3-d366530119ff tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.650618 Oct 03 10:44:12.762686 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1602/3339] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:12 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:12.766246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.768442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:12.769527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:12.777753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.789649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.790467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.791824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0c460cab-94f3-4de1-8b9a-f3390c5922a4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.249285 Oct 03 10:44:12.793409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.794018 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1738/3340] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:12 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:12.795279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.799308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:12.799873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:12.800386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:12.816044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-176ae0a2-4d28-4d4f-ab0c-fe4cbd01c33a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'create', calling method: .version_select at 0x7f074e20c0d0>, body: {"keypair": {"name": "tempest-keypair-885762128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrz+5idVpj9PxpOqcGstl3CXxBtH7AWM+NQdUlo7FNXCAWlxdHYLGDz+2vpeJVk3T0CiHjhF8PBtNaFV0gC77KHonDos/kEnPVM9MDZcLqOrLaEO+cBLgJNmqypvg5s+A=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:12.854348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-176ae0a2-4d28-4d4f-ab0c-fe4cbd01c33a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for project 893e3d1c38654bed94f89dfd0532340e. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:12.865464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-176ae0a2-4d28-4d4f-ab0c-fe4cbd01c33a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for user 21ac39f90b0744a39c356ef7d846e2b8 and project 893e3d1c38654bed94f89dfd0532340e. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:12.916429 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-176ae0a2-4d28-4d4f-ab0c-fe4cbd01c33a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120452 Oct 03 10:44:12.918227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1739/3341] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:44:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:12.925901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:12.937545 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f5bce075-4463-4d32-99c0-ad1b175f3af6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1275 microversion: 2.1 time: 0.173346 Oct 03 10:44:12.938490 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1603/3342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:12 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:12.959002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7f4997d-0417-4c41-8ff8-3e3356c12afa tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e29b940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:13.031492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7f4997d-0417-4c41-8ff8-3e3356c12afa tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.077115 Oct 03 10:44:13.032401 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1740/3343] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:12 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:13.566406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:13.567009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:13.591308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:13.591928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:13.592797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:13.593766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:13.594572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:13.595087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:13.804661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:13.806275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:13.825945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:13.828403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:13.828896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:13.829623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:13.830084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:13.831097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:13.873602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:13.883480 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b8d91565-1e6c-416e-ac03-2a3ada456646 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.322857 Oct 03 10:44:13.897355 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1604/3344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:13 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:13.907092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:13.907712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:13.914799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:13.915353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:13.915793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:13.916501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:13.916987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:13.917413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:14.156735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:14.187441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:14.189814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:14.192651 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5039eef2-01be-4717-a9af-3e360abefd03 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1746 microversion: 2.20 time: 0.307602 Oct 03 10:44:14.193934 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1605/3345] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:13 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1746 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:14.200173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:14.201650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:14.215157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:14.217432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:14.232482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:14.235163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:14.235907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:14.236643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:14.301694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:14.317353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:14.318974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:14.320602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13167e45-7631-42dc-963e-4c49bc4c0973 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.528883 Oct 03 10:44:14.321440 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1741/3346] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:13 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:14.330936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc73e28a-4d0d-4a66-922d-48f63eb35cf0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e29b790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:14.406282 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc73e28a-4d0d-4a66-922d-48f63eb35cf0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.083562 Oct 03 10:44:14.407262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1742/3347] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:14 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:14.464336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:14.476014 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-34f0a534-d882-4295-b26f-bcb1101d6c62 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.280500 Oct 03 10:44:14.489084 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1606/3348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:14 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:14.909423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:14.910027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:14.936360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:14.936877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:14.937495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:14.938359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:14.938822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:14.939250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.220445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:15.222291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:15.231802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.233676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.235015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.236077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.238157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.239475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.275614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.279778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:15.288154 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15353ec7-c3c8-4272-a15f-7a480ad12c43 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.383103 Oct 03 10:44:15.291373 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1743/3349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:14 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:15.349372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-93682eb3-e292-4f06-9668-7e267372e9a1 req-2c3bddae-1477-4a21-9c0c-0c4a05ebe89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59698ccb-4f34-4887-b9d9-0531ee882bef", "tag": "79bd76a9-60f1-4bd0-96c6-078da3b6cc6d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:15.377218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-93682eb3-e292-4f06-9668-7e267372e9a1 req-2c3bddae-1477-4a21-9c0c-0c4a05ebe89a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.377964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-93682eb3-e292-4f06-9668-7e267372e9a1 req-2c3bddae-1477-4a21-9c0c-0c4a05ebe89a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.378528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-93682eb3-e292-4f06-9668-7e267372e9a1 req-2c3bddae-1477-4a21-9c0c-0c4a05ebe89a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.405339 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-93682eb3-e292-4f06-9668-7e267372e9a1 req-2c3bddae-1477-4a21-9c0c-0c4a05ebe89a service nova] Creating event network-changed:79bd76a9-60f1-4bd0-96c6-078da3b6cc6d for instance 59698ccb-4f34-4887-b9d9-0531ee882bef on n-h1-858383-3 Oct 03 10:44:15.415647 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-93682eb3-e292-4f06-9668-7e267372e9a1 req-2c3bddae-1477-4a21-9c0c-0c4a05ebe89a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075161 Oct 03 10:44:15.425092 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1744/3350] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:15.450048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:15.452250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:15.460665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.462147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.462743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.464706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.465942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.466729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.502371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.517559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.520166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.521733 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b8da70d4-e9ff-401d-b4c6-c25df4cb62a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1746 microversion: 2.20 time: 0.306112 Oct 03 10:44:15.523186 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1607/3351] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:15 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1746 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:15.528719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5de32edc-fde6-416b-ac59-78365cea2d09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2e3430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:15.592424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5de32edc-fde6-416b-ac59-78365cea2d09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.067565 Oct 03 10:44:15.593159 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1608/3352] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:15 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:15.598869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:15.599879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:15.612703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.613621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.614341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.615330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.616415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.617136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:15.895648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.910352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.927041 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ac7e125-6d82-4700-a197-25f86d447d9d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.332383 Oct 03 10:44:15.927958 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1609/3353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:15 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:15.929254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.930710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:15.931883 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-740b070c-5a2d-41c0-be3e-c85cf9485284 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.503792 Oct 03 10:44:15.932430 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1745/3354] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:15 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:15.972276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f5b09149-ef0c-4093-880e-7669bc3d993d req-e1ff98ae-8790-4831-91cd-ad4b57de1872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-plugged", "status": "completed", "tag": "431054ce-fa85-4a93-921c-f45394fb158e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:15.991869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f5b09149-ef0c-4093-880e-7669bc3d993d req-e1ff98ae-8790-4831-91cd-ad4b57de1872 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:15.992616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f5b09149-ef0c-4093-880e-7669bc3d993d req-e1ff98ae-8790-4831-91cd-ad4b57de1872 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:15.994063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f5b09149-ef0c-4093-880e-7669bc3d993d req-e1ff98ae-8790-4831-91cd-ad4b57de1872 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:16.024979 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f5b09149-ef0c-4093-880e-7669bc3d993d req-e1ff98ae-8790-4831-91cd-ad4b57de1872 service nova] Creating event network-vif-plugged:431054ce-fa85-4a93-921c-f45394fb158e for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:16.043926 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f5b09149-ef0c-4093-880e-7669bc3d993d req-e1ff98ae-8790-4831-91cd-ad4b57de1872 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075669 Oct 03 10:44:16.045779 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1610/3355] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:16.241130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-639629658", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26f9db07-4ea0-4e23-a6dd-08d086df3e5f"}], "security_groups": [{"name": "tempest-securitygroup--1022100798"}], "key_name": "tempest-keypair-885762128", "user_data": "}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:16.321337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:16.322945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:16.344880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:16.345385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:16.346091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:16.347097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:16.348256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:16.348887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:16.415295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] validate_networks() for [('26f9db07-4ea0-4e23-a6dd-08d086df3e5f', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:44:16.563102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:16.576058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff91866b-6c50-468c-89c5-f524dafba40e tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.262248 Oct 03 10:44:16.586735 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1611/3356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:16 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:16.597621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:16.598247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:16.604835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:16.605323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:16.606515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:16.607249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:16.607712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:16.608142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:16.778971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:16.791818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:16.794909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:16.795492 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7ed0cc34-1d3f-4476-aa21-b539b10edcee tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1746 microversion: 2.20 time: 0.207618 Oct 03 10:44:16.796410 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1612/3357] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:16 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1746 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:16.803205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75b4922f-7245-42a5-9d61-ba7208ea4f2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2c0af0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:16.883496 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75b4922f-7245-42a5-9d61-ba7208ea4f2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.085917 Oct 03 10:44:16.884344 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1613/3358] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:16 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:16.950181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:16.950801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:16.960753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:16.961021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:16.961283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:16.962132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:16.962451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:16.962881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.162952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:17.185746 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-70460fef-c8e0-4b3b-ac73-73db7868bfc4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.238971 Oct 03 10:44:17.198030 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1614/3359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:16 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:17.208057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:17.208868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:17.215922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.216588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.217174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.218244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.218808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.219629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.452333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:17.468893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:17.471377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:17.472878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6491fb17-7455-4f12-8ddb-c085b1b5dac5 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.273648 Oct 03 10:44:17.474144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1615/3360] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:17 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:17.569310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:44:17.570294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:44:17.570941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:44:17.571530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:44:17.572109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:44:17.587320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=35 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:17.589151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.589807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.590422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.591335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.591983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.592586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.601123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:17.601727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:17.607795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.608284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.608716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.609443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.609895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.610315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.633788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for project 893e3d1c38654bed94f89dfd0532340e. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:17.652229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Getting quotas for user 21ac39f90b0744a39c356ef7d846e2b8 and project 893e3d1c38654bed94f89dfd0532340e. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:17.665965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:17.667892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:44:17.670885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:44:17.762452 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6db2dd73-ad91-463a-a838-8f221e50474e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.528170 Oct 03 10:44:17.770449 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1746/3361] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:44:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:44:17.812177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:17.830998 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-662dca3e-c5d7-4499-81a3-07385f3ee5c9 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.233505 Oct 03 10:44:17.831739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1616/3362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:17 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:17.836721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2e931e7-aeee-4f08-9a1d-4a78ecf56332 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:17.837508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d2e931e7-aeee-4f08-9a1d-4a78ecf56332 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:17.923118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2e931e7-aeee-4f08-9a1d-4a78ecf56332 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:17.933455 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2e931e7-aeee-4f08-9a1d-4a78ecf56332 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1244 microversion: 2.1 time: 0.100412 Oct 03 10:44:17.944866 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1617/3363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:17 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:17.944866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:17.944866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:17.959736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.960226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.965629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.967521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:17.968173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:17.968793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:17.971084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-2133889290", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "06008f18-3289-41e3-9bc5-43700aeb4a58"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:18.048403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] validate_networks() for [('06008f18-3289-41e3-9bc5-43700aeb4a58', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:44:18.163765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.167142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:18.176955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.178192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.179534 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae5fb7fd-6934-4428-9837-0b136d28a2ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1746 microversion: 2.20 time: 0.241041 Oct 03 10:44:18.180098 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1618/3364] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:17 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1746 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:18.200728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9605ee0-aedc-47ed-a228-093b0d2c84c9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e280af0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:18.282873 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9605ee0-aedc-47ed-a228-093b0d2c84c9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.099985 Oct 03 10:44:18.284277 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1619/3365] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:18 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:18.289630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3b3bf6-2456-48b9-84ac-a738ceca5a97", "name": "network-vif-plugged", "status": "completed", "tag": "27f5ebdb-2c42-4578-be02-73b0f0421102"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-plugged", "status": "completed", "tag": "ab64d46f-159d-49ad-ac8a-d284c51b9e13"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-plugged", "status": "completed", "tag": "32bd2338-d1b6-42fd-b856-25db395ef05c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:18.301105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.301524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.302248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.317668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] Creating event network-vif-plugged:27f5ebdb-2c42-4578-be02-73b0f0421102 for instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 on n-h1-858383-3 Oct 03 10:44:18.318521 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] Creating event network-vif-plugged:ab64d46f-159d-49ad-ac8a-d284c51b9e13 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:18.319414 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] Creating event network-vif-plugged:32bd2338-d1b6-42fd-b856-25db395ef05c for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:18.330273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-af9e67a0-84ad-4148-b6bd-a5e5de1a84d5 req-c9d0f6de-bbf5-4eee-b333-9eef96e69b3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044319 Oct 03 10:44:18.331820 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1620/3366] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:18.346716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:18.347358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:18.354452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.354901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.355347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.356062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.356515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.357184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.555451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:18.567463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.576570 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd3643cd-b835-4c5d-8490-da316226def2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.243151 Oct 03 10:44:18.583081 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1621/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:18 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:18.597654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:18.601725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:18.608172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.608753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.609380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.610498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.610868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.611512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.625202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:44:18.626260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:44:18.626932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:44:18.627502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:44:18.628073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:44:18.637863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.638349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.638795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.639513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.640130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.640722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.666065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Getting quotas for project 7db7fc80d54a48f4833cf667e1df8a99. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:18.676163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Getting quotas for user b5c8618f25ce4ba9a609f05fe603164a and project 7db7fc80d54a48f4833cf667e1df8a99. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:18.695146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:44:18.697412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:44:18.761056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-934b228d-269b-4e6a-8254-98dd8fad8ea4 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 0.996173 Oct 03 10:44:18.762366 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1747/3368] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:44:18.780824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d79189a-8d41-4801-b03f-4f3e03c1ad8a tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:18.789742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d79189a-8d41-4801-b03f-4f3e03c1ad8a tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:18.880820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d79189a-8d41-4801-b03f-4f3e03c1ad8a tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.892392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d79189a-8d41-4801-b03f-4f3e03c1ad8a tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.894404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d79189a-8d41-4801-b03f-4f3e03c1ad8a tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.896137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.897562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d79189a-8d41-4801-b03f-4f3e03c1ad8a tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1259 microversion: 2.21 time: 0.125020 Oct 03 10:44:18.898144 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1748/3369] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:18 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1259 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:18.903784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:18.904424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:18.923889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.924642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.926327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.927349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.932209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.933973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.936328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:18.937856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c25a1b7a-9d8e-4b50-a061-fe3b23a28a69 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.353466 Oct 03 10:44:18.940846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.953968 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1622/3370] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:18 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:18.969847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:18.970466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:18.986351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.987807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.988501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:18.989777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:18.990450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:18.991094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.117909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:19.136497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c982f8ae-c59d-4d5c-8422-1b9100e1e8c1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1296 microversion: 2.1 time: 0.172889 Oct 03 10:44:19.137538 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1623/3371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:18 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:19.207757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:19.211474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:19.212077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:19.220880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.221434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.221879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.222593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.223042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.223680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.224946 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ed4992a-403a-40ed-b9d4-316b0f35e684 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.324492 Oct 03 10:44:19.225595 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1749/3372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:18 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:19.299952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1442bf29-0a68-4dcd-abf0-434d356ef852 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2011f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:19.358828 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1442bf29-0a68-4dcd-abf0-434d356ef852 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.062994 Oct 03 10:44:19.360142 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1750/3373] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:19 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:19.600296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:19.601176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:19.609694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.615061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.615663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.617168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.617744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.618310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.860527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:19.869598 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5cb35629-3cfa-43ba-8365-602f3116fd6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.273546 Oct 03 10:44:19.872978 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1751/3374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:19 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:19.894772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:19.903342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:19.904998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:19.906265 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4326f27a-2d2a-4922-965d-14eda51a7cf7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1746 microversion: 2.20 time: 0.703313 Oct 03 10:44:19.906842 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1624/3375] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:19 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1746 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:19.936068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:19.936688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:19.945483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.945952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.946541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.947541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.948158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.949581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.969693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:19.971229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:19.979751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.980279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.980718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:19.981474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:19.981929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:19.982352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.075869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.103237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.106895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.109828 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e2f7947-3567-4ef5-84b2-15db8d29677d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1311 microversion: 2.21 time: 0.179647 Oct 03 10:44:20.111388 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1752/3376] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:19 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:20.163405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:20.164536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:20.170612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.171118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.171901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.172895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.173648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.174312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.262299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.274146 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bff7d4b9-3f71-4dab-94e5-4cb6b5bf8bdc tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1302 microversion: 2.1 time: 0.115886 Oct 03 10:44:20.275276 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1753/3377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:20 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:20.282150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:20.283085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:20.290232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.290874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.291480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.292383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.293210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.294050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.429711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.448912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.451560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.453757 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c325d77b-b292-45f0-b3a9-243a392dc693 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.489679 Oct 03 10:44:20.455820 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1625/3378] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:19 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:20.463865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-plugged", "status": "completed", "tag": "274f027e-bcda-4a01-8a4f-7c02cb37e040"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-plugged", "status": "completed", "tag": "728b9d45-bcb3-4720-a1ae-79eec1829570"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-plugged", "status": "completed", "tag": "3308c5b3-42cc-478c-a7ed-eb3a91f256f4"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-plugged", "status": "completed", "tag": "3ffca724-9017-4dbe-b9e6-d315e9ca8f10"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:20.480145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.481444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.482164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.501239 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Creating event network-vif-plugged:274f027e-bcda-4a01-8a4f-7c02cb37e040 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:20.502655 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Creating event network-vif-plugged:728b9d45-bcb3-4720-a1ae-79eec1829570 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:20.502785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:20.503458 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Creating event network-vif-plugged:3308c5b3-42cc-478c-a7ed-eb3a91f256f4 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:20.504197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] Creating event network-vif-plugged:3ffca724-9017-4dbe-b9e6-d315e9ca8f10 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:20.512297 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b56ea793-2b85-41bc-8d11-2e879c09cb6d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.235811 Oct 03 10:44:20.513314 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5e6013d2-ade3-405e-8c36-ad2414212eac req-ccf94db1-6e89-4eb5-b9f9-73cd082eb2ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054826 Oct 03 10:44:20.513993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1626/3379] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:20.514532 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1754/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:20 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:20.519986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3464070b-fdeb-445e-8dc0-f42cef3a627d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2bac10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:20.575707 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3464070b-fdeb-445e-8dc0-f42cef3a627d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.060337 Oct 03 10:44:20.585268 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1627/3381] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:20 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:20.893680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:20.895005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:20.901848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.902675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.903340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.904319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.905044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.905740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.937964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:20.940737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:20.953292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.955582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.958499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:20.959657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:20.962520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:20.963280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.390969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.403167 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-775651ad-6d4e-4c22-bc16-ff9a8e70e411 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.515232 Oct 03 10:44:21.406279 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1755/3382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:20 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:21.417243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:21.418885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:21.432260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.436920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.437664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.438593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.439299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.439895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.554144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.567394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.569934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.571610 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-56f48e0a-a8af-4440-bf83-922baff15260 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1746 microversion: 2.20 time: 0.640000 Oct 03 10:44:21.573500 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1628/3383] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:20 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1746 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:21.578927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:21.580559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:21.591163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.592108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.592797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.593844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.594523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.595320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.604433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.619940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.626511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.628324 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d9cc24f-9377-43ff-87c3-fbb849655796 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1317 microversion: 2.21 time: 0.220903 Oct 03 10:44:21.629116 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1756/3384] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:21 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:21.653475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:21.654050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:21.664813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.665463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.666667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.667661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.668232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.668800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.878225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:21.890676 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b035f6fd-d3d5-4942-9702-fae064433bfa tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1370 microversion: 2.1 time: 0.315838 Oct 03 10:44:21.891757 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1629/3385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:21 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:21.899485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:21.900256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:21.910231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.911402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.911865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:21.913509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:21.914995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:21.915604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.002239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.017400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.018977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.020190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8df5bef9-e8ea-448b-bc24-8bc8a2a6539b tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1879 microversion: 2.32 time: 0.376807 Oct 03 10:44:22.042969 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1757/3386] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:21 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1879 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:22.054608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a995f42b-4171-4755-957d-915f80174385 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e246670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:22.132039 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a995f42b-4171-4755-957d-915f80174385 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.087571 Oct 03 10:44:22.138051 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1758/3387] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:22 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:22.203945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.215093 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc310f5c-13ce-4940-8869-78c468198e20 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1316 microversion: 2.1 time: 0.321287 Oct 03 10:44:22.220619 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1630/3388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:21 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:22.434356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:22.435167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:22.449162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:22.449966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:22.450934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.452123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:22.452794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:22.453501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.552859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-47235a85-8131-4f9e-b995-cf8fd865dcd5 req-8f36f7d0-9584-4a6d-af73-4328d5a34343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "name": "network-vif-plugged", "status": "completed", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:22.577838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-47235a85-8131-4f9e-b995-cf8fd865dcd5 req-8f36f7d0-9584-4a6d-af73-4328d5a34343 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:22.578542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-47235a85-8131-4f9e-b995-cf8fd865dcd5 req-8f36f7d0-9584-4a6d-af73-4328d5a34343 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:22.580944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-47235a85-8131-4f9e-b995-cf8fd865dcd5 req-8f36f7d0-9584-4a6d-af73-4328d5a34343 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.614651 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-47235a85-8131-4f9e-b995-cf8fd865dcd5 req-8f36f7d0-9584-4a6d-af73-4328d5a34343 service nova] Creating event network-vif-plugged:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:44:22.620208 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-47235a85-8131-4f9e-b995-cf8fd865dcd5 req-8f36f7d0-9584-4a6d-af73-4328d5a34343 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073744 Oct 03 10:44:22.621223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1631/3389] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:22.626644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:22.627850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:22.647933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:22.648454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:22.648926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.649627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:22.650289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:22.650900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.837414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.849746 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-862f8d75-f7f8-4090-aff1-89c88707541c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.419500 Oct 03 10:44:22.850733 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1759/3390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:22 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:22.865311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:22.868049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:22.906712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:22.909715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:22.911438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.914293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:22.916562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:22.917875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:22.952513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.968323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.970102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:22.971901 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-033a7236-722e-48c6-9df6-e1a403c897a2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1746 microversion: 2.20 time: 0.349567 Oct 03 10:44:22.972505 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1632/3391] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:22 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1746 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:22.985846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ea2a9624-179e-41c3-a657-045adc0650e1 req-af9b007d-5e92-4a97-b2fe-06f7c3368e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b71dd5c-ef34-4807-90a2-7c03aec69537", "tag": "ea7b3416-8f70-4236-bf50-c70b14cc3af9"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:23.037006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ea2a9624-179e-41c3-a657-045adc0650e1 req-af9b007d-5e92-4a97-b2fe-06f7c3368e09 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.037538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ea2a9624-179e-41c3-a657-045adc0650e1 req-af9b007d-5e92-4a97-b2fe-06f7c3368e09 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.037984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ea2a9624-179e-41c3-a657-045adc0650e1 req-af9b007d-5e92-4a97-b2fe-06f7c3368e09 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.073216 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ea2a9624-179e-41c3-a657-045adc0650e1 req-af9b007d-5e92-4a97-b2fe-06f7c3368e09 service nova] Creating event network-changed:ea7b3416-8f70-4236-bf50-c70b14cc3af9 for instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 on n-h2-858383-3 Oct 03 10:44:23.088796 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ea2a9624-179e-41c3-a657-045adc0650e1 req-af9b007d-5e92-4a97-b2fe-06f7c3368e09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111453 Oct 03 10:44:23.090657 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1633/3392] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:23.102814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:23.103527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:23.114479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.114983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.115775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.116762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.117442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.118780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.271067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:23.284956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:23.287193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:23.289689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e71f2d6b-05d2-4f69-bb74-202bf7610c3e tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1359 microversion: 2.21 time: 0.436733 Oct 03 10:44:23.296932 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1760/3393] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:22 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1359 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:23.322234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:23.323206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:23.331944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.333011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.333731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.334682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.335321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.336989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.487470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:23.495314 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9949c90c-f2a3-4e05-9c8f-176535cff0d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1370 microversion: 2.1 time: 0.402384 Oct 03 10:44:23.495892 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1634/3394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:23 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1370 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:23.515689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d24fe77e-6039-4cca-a114-4caee688db62 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074f164310>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:23.715010 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d24fe77e-6039-4cca-a114-4caee688db62 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1411 microversion: 2.1 time: 0.208188 Oct 03 10:44:23.726384 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1635/3395] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:23 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1411 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:23.731562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:23.732972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:23.734582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:23.742880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.744466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.745215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.747008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.747715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.748384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.767353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:23.777209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:23.781928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca5d577c-8cd8-4d1d-81d9-aca897485dfa tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2830 microversion: 2.32 time: 0.470419 Oct 03 10:44:23.785573 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1761/3396] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:23 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2830 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:23.830155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:23.831887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:23.842368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.842871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.843319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:23.844017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:23.844472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:23.844963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.085192 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3a795308-d572-44c3-a2ff-a1852b866d5d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.260596 Oct 03 10:44:24.097112 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1762/3397] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:44:23 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3/os-interface => generated 1830 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:24.103231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:24.104268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:24.118777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.119280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.119719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.120422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.120915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.123805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.153890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:24.169236 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0aee50b0-bfba-4477-87f0-2e4e9ec8077a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1506 microversion: 2.1 time: 0.439061 Oct 03 10:44:24.169610 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1636/3398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:23 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:24.181768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-90bdecf9-627b-4759-9b5f-4dfa4624504d req-e491b3b4-1003-434e-8c51-29e9aef4c27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e", "tag": "e957fea8-5ff8-4498-9b20-9abc35b35ffa"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:24.202773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-90bdecf9-627b-4759-9b5f-4dfa4624504d req-e491b3b4-1003-434e-8c51-29e9aef4c27f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.215830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-90bdecf9-627b-4759-9b5f-4dfa4624504d req-e491b3b4-1003-434e-8c51-29e9aef4c27f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.217041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-90bdecf9-627b-4759-9b5f-4dfa4624504d req-e491b3b4-1003-434e-8c51-29e9aef4c27f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.248256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-90bdecf9-627b-4759-9b5f-4dfa4624504d req-e491b3b4-1003-434e-8c51-29e9aef4c27f service nova] Creating event network-changed:e957fea8-5ff8-4498-9b20-9abc35b35ffa for instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e on n-h2-858383-3 Oct 03 10:44:24.259871 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-90bdecf9-627b-4759-9b5f-4dfa4624504d req-e491b3b4-1003-434e-8c51-29e9aef4c27f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085505 Oct 03 10:44:24.261029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1637/3399] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:24.266869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:24.267950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:24.276671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.277202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.277835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.278553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.279960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.280529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.525547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:24.536948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:24.538630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:24.542116 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d01c2191-6ee6-43e9-94e7-f1af745c7774 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1741 microversion: 2.20 time: 0.279909 Oct 03 10:44:24.547717 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1638/3400] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:24 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:24.561182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:24.572696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:24.575218 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8f1be83-7478-4cf4-963b-0d8a5b03fdf4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.472952 Oct 03 10:44:24.576220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:24.579533 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1763/3401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:24 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:24.587275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:24.587896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:24.596139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.597081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.597759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.598718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.599406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.603652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.604149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.604596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.605002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.610298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.610827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.611307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.657735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:24.659721 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e4d47cb6-b6d1-49b7-b682-3ef4bab0a83c tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97/os-instance-actions/req-00df05a2-59bc-4494-be5a-9f1e96c9040b" status: 200 len: 313 microversion: 2.1 time: 0.096727 Oct 03 10:44:24.660563 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1639/3402] 10.222.0.27 () {58 vars in 1419 bytes} [Mon Oct 3 10:44:24 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97/os-instance-actions/req-00df05a2-59bc-4494-be5a-9f1e96c9040b => generated 313 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:24.673232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:24.674536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:24.687873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.688463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.688944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.689749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:24.690727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:24.691168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:24.929894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:24.946878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c9f9eae0-5489-4c90-97d0-0d311007876b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1370 microversion: 2.1 time: 0.284997 Oct 03 10:44:24.947476 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1640/3403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:24 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:24.976269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:24.978921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:25.006377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:25.013548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:25.014337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:25.018000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:25.025625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:25.028013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:25.029016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:25.029656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:25.030275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:25.031618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f26a412d-0caf-4277-8395-d8f8a516feb6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1359 microversion: 2.21 time: 0.450490 Oct 03 10:44:25.037249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1764/3404] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:24 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:25.043437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-955ac113-2620-4b0d-8176-b05a4b56a639 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e218dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:25.168496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:25.274555 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b495b768-67fb-473f-acaa-018862f71897 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "POST /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97/action" status: 202 len: 0 microversion: 2.1 time: 0.314956 Oct 03 10:44:25.278691 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1641/3405] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:44:24 2022] POST /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:44:25.291007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:25.292008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:25.308667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:25.309481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:25.310275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:25.311176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:25.311789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:25.312473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:26.144076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:26.163448 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7ddd5ce4-486c-4ea1-b579-41ee956e177a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1508 microversion: 2.1 time: 0.882719 Oct 03 10:44:26.180802 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1642/3406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:25 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1508 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:26.182030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:26.183005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:26.204724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:26.205590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:26.206290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:26.209756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:26.210470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:26.211302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:27.249086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:27.257998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:27.259452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:27.261150 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-05aeb15d-2de0-4d44-912f-6a8735e342ab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1741 microversion: 2.20 time: 1.092489 Oct 03 10:44:27.288758 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1643/3407] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:26 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1741 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:27.307590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:27.312144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:27.338696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:27.340922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:27.341678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:27.346598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:27.350114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:27.351724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:27.780096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:27.792043 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f1eff1b9-0264-41d0-9275-ec7ee64a7b91 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.500117 Oct 03 10:44:27.795570 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1644/3408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:27 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:27.814753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:27.818504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:27.853700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:27.858871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:27.862907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:27.865142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:27.865877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:27.868332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:27.931147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=58 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:28.211418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:28.221189 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc3e2648-a2e4-4b57-840d-0136cebc20ad tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1370 microversion: 2.1 time: 0.422540 Oct 03 10:44:28.236801 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1645/3409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:27 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:28.241702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0f3fab95-b5b3-419a-ac42-2674d2072aae req-05b060e0-1123-4e96-870c-76ebc92b3b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59698ccb-4f34-4887-b9d9-0531ee882bef", "name": "network-vif-plugged", "status": "completed", "tag": "79bd76a9-60f1-4bd0-96c6-078da3b6cc6d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:28.251377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0f3fab95-b5b3-419a-ac42-2674d2072aae req-05b060e0-1123-4e96-870c-76ebc92b3b8a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:28.252171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0f3fab95-b5b3-419a-ac42-2674d2072aae req-05b060e0-1123-4e96-870c-76ebc92b3b8a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:28.252295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0f3fab95-b5b3-419a-ac42-2674d2072aae req-05b060e0-1123-4e96-870c-76ebc92b3b8a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:28.276255 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0f3fab95-b5b3-419a-ac42-2674d2072aae req-05b060e0-1123-4e96-870c-76ebc92b3b8a service nova] Creating event network-vif-plugged:79bd76a9-60f1-4bd0-96c6-078da3b6cc6d for instance 59698ccb-4f34-4887-b9d9-0531ee882bef on n-h1-858383-3 Oct 03 10:44:28.287837 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0f3fab95-b5b3-419a-ac42-2674d2072aae req-05b060e0-1123-4e96-870c-76ebc92b3b8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048900 Oct 03 10:44:28.289370 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1646/3410] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:28.296118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:28.308606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:28.315512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:28.316230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:28.316890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:28.318378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:28.319005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:28.319593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:28.647520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:28.650114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:28.661961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:28.663528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:28.665018 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-130cf4f9-d16d-44a7-b8ed-1dc7019d0f3d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1359 microversion: 2.21 time: 0.373851 Oct 03 10:44:28.665584 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1647/3411] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:28 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1359 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:28.692252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:28.692905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:28.715934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:28.730778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:28.731247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:28.732001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:28.732455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:28.732921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:28.892261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=13 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:29.274219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:29.292198 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8aafaf41-65d4-4d54-93fe-36317d200c2d tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1506 microversion: 2.1 time: 0.625556 Oct 03 10:44:29.309978 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1648/3412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:28 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:29.316140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-782a4066-fefc-498c-9950-0e85f9bcadd6 req-bf02ab04-a09a-473b-91ea-2d3ec0224f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "tag": "3ffca724-9017-4dbe-b9e6-d315e9ca8f10"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:29.359738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:29.374967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-782a4066-fefc-498c-9950-0e85f9bcadd6 req-bf02ab04-a09a-473b-91ea-2d3ec0224f72 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:29.381472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-782a4066-fefc-498c-9950-0e85f9bcadd6 req-bf02ab04-a09a-473b-91ea-2d3ec0224f72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:29.383221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-782a4066-fefc-498c-9950-0e85f9bcadd6 req-bf02ab04-a09a-473b-91ea-2d3ec0224f72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:29.416477 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-782a4066-fefc-498c-9950-0e85f9bcadd6 req-bf02ab04-a09a-473b-91ea-2d3ec0224f72 service nova] Creating event network-changed:3ffca724-9017-4dbe-b9e6-d315e9ca8f10 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:44:29.434486 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-782a4066-fefc-498c-9950-0e85f9bcadd6 req-bf02ab04-a09a-473b-91ea-2d3ec0224f72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120600 Oct 03 10:44:29.435931 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1649/3413] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:29.444932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:29.449269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:29.464016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:29.467568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:29.468328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:29.469357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:29.476661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:29.477543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:29.802698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:29.854964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:29.859511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:29.861426 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-deed8b4c-e281-44ad-a5db-748f551d1a71 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1741 microversion: 2.20 time: 0.423525 Oct 03 10:44:29.864012 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1650/3414] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:29 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1741 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:29.871842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:29.881985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:29.898927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:29.899428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:29.899858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:29.900560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:29.901031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:29.901461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:30.769011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:30.783827 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8dcda305-b783-44d8-bb43-cddec64251f2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1317 microversion: 2.1 time: 0.914460 Oct 03 10:44:30.784707 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1651/3415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:29 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1317 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:30.797960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:30.799118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:30.813178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:30.813867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:30.814356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:30.819723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:30.820143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:30.820594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:31.152628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:31.178716 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a96c5165-7425-4d5e-8393-d608a6c7ab14 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1370 microversion: 2.1 time: 0.391536 Oct 03 10:44:31.186143 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1652/3416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:30 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:31.205517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '.version_select at 0x7f074e270a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:31.207571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:31.226481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:31.227561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:31.228176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:31.237548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:31.238295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:31.238903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:31.378445 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40c3a84b-cbf5-4e80-8017-9a5bb21cd5be tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.189139 Oct 03 10:44:31.384232 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1653/3417] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 3 10:44:31 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97/os-instance-actions => generated 611 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:31.411988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:31.418263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:31.447369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:31.449470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:31.456907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:31.460482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:31.462586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:31.465170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:31.779699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:31.791070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:31.795164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:31.795815 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-899f0614-7fef-465c-82b1-042a994e160d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1359 microversion: 2.21 time: 0.408334 Oct 03 10:44:31.796391 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1654/3418] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:31 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1359 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:31.811407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:31.815336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:31.827881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:31.832366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:31.832877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:31.833817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:31.834301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:31.834731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:32.113400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:32.123899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:32.127918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:32.129386 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6326d2fd-612f-44b4-80ec-b769bd9485bc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1741 microversion: 2.20 time: 0.331862 Oct 03 10:44:32.146002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1655/3419] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:31 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1741 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:32.153820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:32.154460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:32.162433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:32.162433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:32.163015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:32.164200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:32.164506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:32.165411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:32.199056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:44:32.385430 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f77877c-eaee-4e7a-89c0-f52964db7fb5 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 204 len: 0 microversion: 2.1 time: 0.237551 Oct 03 10:44:32.385790 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1656/3420] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:44:32 2022] DELETE /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:32.400578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:32.400578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:32.426330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:32.426330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:32.433684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:32.434861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:32.435308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:32.435752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:32.450784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:32.695278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:32.705114 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-569f1d08-13ae-4c4f-b573-cb42484cb17d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1467 microversion: 2.1 time: 0.317932 Oct 03 10:44:32.705793 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1657/3421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:32 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1467 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:32.710900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-cff3e03a-2826-468c-b147-1eb1e97a1c7e req-49eb1060-7d06-4437-9599-ef5996628cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b71dd5c-ef34-4807-90a2-7c03aec69537", "name": "network-vif-plugged", "status": "completed", "tag": "ea7b3416-8f70-4236-bf50-c70b14cc3af9"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:32.723143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cff3e03a-2826-468c-b147-1eb1e97a1c7e req-49eb1060-7d06-4437-9599-ef5996628cab service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:32.723934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cff3e03a-2826-468c-b147-1eb1e97a1c7e req-49eb1060-7d06-4437-9599-ef5996628cab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:32.724549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cff3e03a-2826-468c-b147-1eb1e97a1c7e req-49eb1060-7d06-4437-9599-ef5996628cab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:32.745637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-cff3e03a-2826-468c-b147-1eb1e97a1c7e req-49eb1060-7d06-4437-9599-ef5996628cab service nova] Creating event network-vif-plugged:ea7b3416-8f70-4236-bf50-c70b14cc3af9 for instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 on n-h2-858383-3 Oct 03 10:44:32.751864 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-cff3e03a-2826-468c-b147-1eb1e97a1c7e req-49eb1060-7d06-4437-9599-ef5996628cab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044497 Oct 03 10:44:32.752542 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1658/3422] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:32.757823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:32.758941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:32.767213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:32.767998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:32.768839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:32.769775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:32.770401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:32.771153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.014957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:33.031594 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28bd064a-d010-4b8f-922a-c612140e208c tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1370 microversion: 2.1 time: 0.277353 Oct 03 10:44:33.032667 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1659/3423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:32 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:33.045305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:33.046709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:33.061933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.062497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.062967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.066920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.067617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.068212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.343525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20e3f4497264811be457c0a82719d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e12137dc394204baac6034aa3ff3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:33.356304 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b26617c-1ac7-494f-b2b9-5a4d1e49130a tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 200 len: 1512 microversion: 2.1 time: 0.319422 Oct 03 10:44:33.373016 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1660/3424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:33 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:33.374654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:33.375358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:33.385006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.385006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.386120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.386333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.386790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.387333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.553227 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19d60eb4-f486-4b32-9077-73d4c698ae74 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1618 microversion: 2.1 time: 0.192187 Oct 03 10:44:33.569722 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1661/3425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:33 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1618 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:33.590385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:33.591195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:33.598751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.599254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.599759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.600608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.601324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.601631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.906768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:33.915936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:33.917512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:33.918620 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-69810a31-d779-4d21-aa0a-e390ddcef4ec tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1359 microversion: 2.21 time: 0.347736 Oct 03 10:44:33.919376 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1662/3426] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:33 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1359 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:33.937884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:33.938508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:33.957178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.957583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.958712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:33.958844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:33.959325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:33.959802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:34.272600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:34.297743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:34.301527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:34.303106 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-524eae80-b478-43e4-9123-a3ff6d71d170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1741 microversion: 2.20 time: 0.382972 Oct 03 10:44:34.304267 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1663/3427] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:33 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1741 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:34.311258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-827759707", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "bf8a08d3-3b84-458e-aa9f-1941ac2386c8"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:34.603758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:35.011876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=94 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:39.155781 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-955ac113-2620-4b0d-8176-b05a4b56a639 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1420 microversion: 2.1 time: 14.115816 Oct 03 10:44:39.160274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:44:39.165546 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1765/3428] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:25 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1420 bytes in 14127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:39.170455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.171079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:39.178266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.178994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.179443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.180150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.180606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.181063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.324119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.331929 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-457e8810-b0c0-4845-a834-b709ad404ace tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1564 microversion: 2.1 time: 0.165315 Oct 03 10:44:39.332509 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1766/3429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:39 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:39.337217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.338166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] [instance: 2e3b3bf6-2456-48b9-84ac-a738ceca5a97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:39.344355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.345631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.346077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.346782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.347238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.347667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.361910 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] HTTP exception thrown: Instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 could not be found. Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Request method failure captured: Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 HTTP/1.1 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrzskB29VglpGic7cYLPAtSgq4nsrggs8vUJBqa74-ZpBHbryDnqGehW3fEHA-p_zNi_le0L2Cb77DiZh0WABmXP30C9ey9bj7omXttz_75rermVl1BmF9lod3yvRwVFaa8llCzbI_SD3kZ-wnA-_zG_uWPIyZSJERnc5lsUPNGD0oM Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 04e12137dc394204baac6034aa3ff3ff Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceActionsTestJSON-452212368 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e12137dc394204baac6034aa3ff3ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_04e12137dc394204baac6034aa3ff3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/04e12137dc394204baac6034aa3ff3ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/04e12137dc394204baac6034aa3ff3ff"}]}] Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceActionsTestJSON-452212368 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 04e12137dc394204baac6034aa3ff3ff Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceActionsTestJSON-452212368 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceActionsTestJSON-452212368-project Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d20e3f4497264811be457c0a82719d78 Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceActionsTestJSON-452212368-project Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 could not be found. Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '2e3b3bf6-2456-48b9-84ac-a738ceca5a97'} Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 could not be found. Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 could not be found. Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:39.363570 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 could not be found. Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] Returning 404 to user: Instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75696a0e-600b-4729-af3e-e8601656c248 tempest-InstanceActionsTestJSON-452212368 tempest-InstanceActionsTestJSON-452212368-project] 10.222.0.27 "GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97" status: 404 len: 111 microversion: 2.1 time: 0.031594 Oct 03 10:44:39.368364 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1767/3430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:39 2022] GET /compute/v2.1/servers/2e3b3bf6-2456-48b9-84ac-a738ceca5a97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:44:39.369938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ade1ce06-7eb7-42b7-b0a3-7e2ed744e5f7 req-98296d93-f0fb-4007-aec5-19dbc4c37b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e", "name": "network-vif-plugged", "status": "completed", "tag": "e957fea8-5ff8-4498-9b20-9abc35b35ffa"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:39.381217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ade1ce06-7eb7-42b7-b0a3-7e2ed744e5f7 req-98296d93-f0fb-4007-aec5-19dbc4c37b21 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.381711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ade1ce06-7eb7-42b7-b0a3-7e2ed744e5f7 req-98296d93-f0fb-4007-aec5-19dbc4c37b21 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.382143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ade1ce06-7eb7-42b7-b0a3-7e2ed744e5f7 req-98296d93-f0fb-4007-aec5-19dbc4c37b21 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.395003 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ade1ce06-7eb7-42b7-b0a3-7e2ed744e5f7 req-98296d93-f0fb-4007-aec5-19dbc4c37b21 service nova] Creating event network-vif-plugged:e957fea8-5ff8-4498-9b20-9abc35b35ffa for instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e on n-h2-858383-3 Oct 03 10:44:39.400406 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ade1ce06-7eb7-42b7-b0a3-7e2ed744e5f7 req-98296d93-f0fb-4007-aec5-19dbc4c37b21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033591 Oct 03 10:44:39.401064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:44:39.401387 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1768/3431] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:39.401694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:44:39.402268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:44:39.403739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:44:39.404722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:44:39.406721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.407942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:39.415477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.416209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.416648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.417390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.417847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.418278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.429306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.430231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.430888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.431799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.432494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.433154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.459145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:39.464918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Getting quotas for user 3e9b6cf965ae4084b9b42de13417e90e and project 784dad77eab8442e85f2141e9641ca22. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:39.479091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:44:39.481540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:44:39.528621 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9cf33f09-6d8c-4eb7-9f55-24cb5fe4185c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.222739 Oct 03 10:44:39.529686 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1664/3432] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:44:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 5224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:44:39.534916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-6d658329-5e0f-4964-9091-c19ed05831ca req-ba24f8c1-1cc9-4b5b-b5af-276ab7c15091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e3b3bf6-2456-48b9-84ac-a738ceca5a97", "name": "network-vif-deleted", "tag": "27f5ebdb-2c42-4578-be02-73b0f0421102"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:39.546165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6d658329-5e0f-4964-9091-c19ed05831ca req-ba24f8c1-1cc9-4b5b-b5af-276ab7c15091 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.546953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6d658329-5e0f-4964-9091-c19ed05831ca req-ba24f8c1-1cc9-4b5b-b5af-276ab7c15091 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.547596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6d658329-5e0f-4964-9091-c19ed05831ca req-ba24f8c1-1cc9-4b5b-b5af-276ab7c15091 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.566293 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-6d658329-5e0f-4964-9091-c19ed05831ca req-ba24f8c1-1cc9-4b5b-b5af-276ab7c15091 service nova] Creating event network-vif-deleted:27f5ebdb-2c42-4578-be02-73b0f0421102 for instance 2e3b3bf6-2456-48b9-84ac-a738ceca5a97 on n-h1-858383-3 Oct 03 10:44:39.586067 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-6d658329-5e0f-4964-9091-c19ed05831ca req-ba24f8c1-1cc9-4b5b-b5af-276ab7c15091 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053517 Oct 03 10:44:39.588079 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1665/3433] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:39.596582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.597521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:39.607008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.607585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.608127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.609205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.609772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.610331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.769126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.781605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.786742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.788725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.790353 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82fe9c04-450e-4088-8cb7-7954df533832 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1359 microversion: 2.21 time: 0.387537 Oct 03 10:44:39.791180 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1769/3434] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:39 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:39.795174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.796726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26dcb2d1-86a7-4e1b-9c8a-196ed97d5def tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e20c670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.798195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.799715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5bcfd3ee-4c0b-4b6a-9cec-8a5fb0e74cce tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1741 microversion: 2.20 time: 0.208975 Oct 03 10:44:39.805508 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1666/3435] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:39 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:39.824115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.824115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:39.833410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.833908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.834351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.835071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:39.835531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:39.835965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:39.871252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26dcb2d1-86a7-4e1b-9c8a-196ed97d5def tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 200 len: 1420 microversion: 2.1 time: 0.078606 Oct 03 10:44:39.880848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1770/3436] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:44:39 2022] GET /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:39.885571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24b7b616-6646-4f66-9827-08a001c893e9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.886191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24b7b616-6646-4f66-9827-08a001c893e9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:39.938145 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fbf8dea8-4ac3-4cff-8866-589ba5f0aa74 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131466 Oct 03 10:44:39.939719 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1667/3437] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:44:39 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:39.947128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0e3b682-5457-4102-88c3-c73c93ba7952 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2eb9d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:39.977902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24b7b616-6646-4f66-9827-08a001c893e9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:39.989314 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24b7b616-6646-4f66-9827-08a001c893e9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1216 microversion: 2.1 time: 0.107387 Oct 03 10:44:39.990217 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1771/3438] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:39 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:40.496272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0e3b682-5457-4102-88c3-c73c93ba7952 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 204 len: 0 microversion: 2.1 time: 0.555358 Oct 03 10:44:40.496879 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1668/3439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:39 2022] DELETE /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:40.505226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:40.506352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:40.513484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:40.514051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:40.514566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:40.515338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:40.515884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:40.516392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:40.547192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:44:40.676036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ee4fb9f-419e-49dd-8dcf-6b7a3a1f02bd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 204 len: 0 microversion: 2.1 time: 0.173823 Oct 03 10:44:40.677339 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1772/3440] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:44:40 2022] DELETE /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:40.818027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:40.819015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:40.833356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:40.834450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:40.842517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:40.844421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:40.847257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:40.849264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:40.851417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:40.852479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:40.861531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:40.861782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:40.862384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:40.862640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:40.863126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:40.863563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:41.142561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:41.153695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:41.155759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:41.157506 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8fd48938-2434-41b4-bf14-d7547c029e2d tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1359 microversion: 2.21 time: 0.344209 Oct 03 10:44:41.159058 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1669/3441] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:40 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1359 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:41.167920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2085703356", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "154cf415-1c40-42a9-bfa5-99c4a7b477bb"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:41.174076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:41.184902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:41.187226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:41.191186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e99f073f-14ce-4b16-9df5-93e9dc204125 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1723 microversion: 2.20 time: 0.363426 Oct 03 10:44:41.196231 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1773/3442] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:40 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:41.211819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:41.213000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:41.224793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:41.225473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:41.226499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:41.227500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:41.228123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:41.228715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:41.279733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] validate_networks() for [('154cf415-1c40-42a9-bfa5-99c4a7b477bb', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:44:41.368296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:41.376625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d819893f-a0fc-423c-bcfa-ee18bd05b5f6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1268 microversion: 2.1 time: 0.177228 Oct 03 10:44:41.391103 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1774/3443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:41 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:41.606066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0bc712f5-6b1a-4e15-b60b-aeb86f6f0357 req-6a828d8e-03aa-48f6-89db-acd60f9deec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b71dd5c-ef34-4807-90a2-7c03aec69537", "tag": "ea7b3416-8f70-4236-bf50-c70b14cc3af9"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:41.625484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0bc712f5-6b1a-4e15-b60b-aeb86f6f0357 req-6a828d8e-03aa-48f6-89db-acd60f9deec7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:41.626059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0bc712f5-6b1a-4e15-b60b-aeb86f6f0357 req-6a828d8e-03aa-48f6-89db-acd60f9deec7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:41.627244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0bc712f5-6b1a-4e15-b60b-aeb86f6f0357 req-6a828d8e-03aa-48f6-89db-acd60f9deec7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:41.654372 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0bc712f5-6b1a-4e15-b60b-aeb86f6f0357 req-6a828d8e-03aa-48f6-89db-acd60f9deec7 service nova] Creating event network-changed:ea7b3416-8f70-4236-bf50-c70b14cc3af9 for instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 on n-h2-858383-3 Oct 03 10:44:41.662315 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0bc712f5-6b1a-4e15-b60b-aeb86f6f0357 req-6a828d8e-03aa-48f6-89db-acd60f9deec7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059815 Oct 03 10:44:41.666399 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1775/3444] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:41.851705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:44:41.852310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:44:41.852612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:44:41.853060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:44:41.853773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:44:41.872795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:41.873308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:41.874084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:41.874830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:41.875291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:41.875742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:41.927926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:44:41.963725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for user 51cf916cbc904a6a97066fe7af1b3bae and project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:44:42.012734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:44:42.015120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:44:42.099296 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-17107a4f-b47d-4447-8be0-762b70a50cb6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938936 Oct 03 10:44:42.112700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70347750-fd40-44c7-9af3-b1ff9d07f70d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:42.113882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-70347750-fd40-44c7-9af3-b1ff9d07f70d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:42.118943 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1670/3445] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:44:42.186886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:42.190387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:42.200660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:42.201453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:42.202628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:42.203609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:42.204406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:42.205747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:42.377242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70347750-fd40-44c7-9af3-b1ff9d07f70d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:42.384856 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-70347750-fd40-44c7-9af3-b1ff9d07f70d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1208 microversion: 2.1 time: 0.276685 Oct 03 10:44:42.388251 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1776/3446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:42 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1208 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:42.401097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:42.401815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:42.426146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:42.427840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:42.431381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:42.432279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:42.437619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:42.438071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:42.758336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:42.768538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:42.773884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:42.784031 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae7eae3d-2351-4977-b8ab-74eef8fb47ce tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1552 microversion: 2.21 time: 0.601713 Oct 03 10:44:42.784657 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1671/3447] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:42 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1552 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:42.789641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:42.790258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:42.808498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:42.809051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:42.809585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:42.810303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:42.810813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:42.811185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.000357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.015045 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d70835b-7f6a-4e64-a78c-6c6ffb9c1ef6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1274 microversion: 2.1 time: 0.225121 Oct 03 10:44:43.016099 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1672/3448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:42 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:43.024379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:43.028636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:43.045096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:43.047486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:43.049475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.050817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:43.053260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:43.053903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.071743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.102344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.105170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.107534 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e83aa1e4-736b-452a-b52c-63c85ca621c3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1723 microversion: 2.20 time: 0.718156 Oct 03 10:44:43.109046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:44:43.136510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1777/3449] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:42 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1723 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:43.259877 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4001d7e0-46cf-472c-8877-28bec81a60e1 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "DELETE /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 204 len: 0 microversion: 2.21 time: 0.241237 Oct 03 10:44:43.262139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1673/3450] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:44:43 2022] DELETE /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:44:43.273048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:43.275096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:43.291400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:43.293368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:43.294753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.297098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:43.298617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:43.313137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.315651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-87c419dc-a4d6-490d-b90d-56853d9f6d36 req-b1535f20-e7f2-422f-992b-4d1840d5981b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "name": "network-vif-unplugged", "status": "completed", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:43.358004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-87c419dc-a4d6-490d-b90d-56853d9f6d36 req-b1535f20-e7f2-422f-992b-4d1840d5981b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:43.358924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-87c419dc-a4d6-490d-b90d-56853d9f6d36 req-b1535f20-e7f2-422f-992b-4d1840d5981b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:43.359537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-87c419dc-a4d6-490d-b90d-56853d9f6d36 req-b1535f20-e7f2-422f-992b-4d1840d5981b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.381432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-87c419dc-a4d6-490d-b90d-56853d9f6d36 req-b1535f20-e7f2-422f-992b-4d1840d5981b service nova] Creating event network-vif-unplugged:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:44:43.387672 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-87c419dc-a4d6-490d-b90d-56853d9f6d36 req-b1535f20-e7f2-422f-992b-4d1840d5981b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081225 Oct 03 10:44:43.389667 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1674/3451] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:43.417891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:43.421477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:43.450885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:43.454606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:43.455171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.458195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:43.458909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:43.459473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:43.619374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.631932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.636497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.638321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb945dc0-8a3b-495e-a6a6-bf3ce36caab2 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1558 microversion: 2.21 time: 0.371816 Oct 03 10:44:43.639426 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1778/3452] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:43 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1558 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:43.753897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:43.775242 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e58124ef-0b85-489b-ad0b-1065b8f79880 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1260 microversion: 2.1 time: 0.367862 Oct 03 10:44:43.791895 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1675/3453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:43 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1260 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:44.044706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:44.045570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:44.053558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.054219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.054742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.055609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.056126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.056668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.144170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:44.145468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:44.146488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:44.170111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.171017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.171831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.173019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.179232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.179998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.180851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6242fdd8-23c4-4f78-b579-b0e7f8a68316 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1274 microversion: 2.1 time: 0.139953 Oct 03 10:44:44.184181 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1779/3454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:44 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:44.543539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2b9e52b4-8de2-49ff-a78e-c017b1abae1e req-556f8bfa-53d6-4cc6-b6ef-db38809bb3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eaf6a-7c9d-4f81-b5eb-d01ef0d59243", "name": "network-vif-deleted", "tag": "97f76ef1-55de-461a-86b3-e25afc9e4abc"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:44.550759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:44.553479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:44.563298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:44.566219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:44.566672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2b9e52b4-8de2-49ff-a78e-c017b1abae1e req-556f8bfa-53d6-4cc6-b6ef-db38809bb3cf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.567153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2b9e52b4-8de2-49ff-a78e-c017b1abae1e req-556f8bfa-53d6-4cc6-b6ef-db38809bb3cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.567586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2b9e52b4-8de2-49ff-a78e-c017b1abae1e req-556f8bfa-53d6-4cc6-b6ef-db38809bb3cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.582194 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-46098d60-ea59-4940-9b55-fec5b0b54441 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1723 microversion: 2.20 time: 0.445436 Oct 03 10:44:44.588547 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1676/3455] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:44 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:44.631470 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-2b9e52b4-8de2-49ff-a78e-c017b1abae1e req-556f8bfa-53d6-4cc6-b6ef-db38809bb3cf service nova] Creating event network-vif-deleted:97f76ef1-55de-461a-86b3-e25afc9e4abc for instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 on n-h1-858383-3 Oct 03 10:44:44.660916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2b9e52b4-8de2-49ff-a78e-c017b1abae1e req-556f8bfa-53d6-4cc6-b6ef-db38809bb3cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121605 Oct 03 10:44:44.662216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1780/3456] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:44.664638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:44.665282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:44.689052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.690325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.707916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.708747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.709280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.714238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.805949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:44.807878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:44.821156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.822677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.823216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.825112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:44.825591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:44.826031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:44.959116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:44.972210 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0658f797-d5a5-47cf-aad4-b9a4c0cd77b5 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1268 microversion: 2.1 time: 0.172116 Oct 03 10:44:44.972856 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1781/3457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:44 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:45.077383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:45.086526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:45.087964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:45.089136 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b3f19280-7ff1-401f-82f2-05676c5e93af tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1558 microversion: 2.21 time: 0.429318 Oct 03 10:44:45.090174 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1677/3458] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:44 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1558 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:45.210671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:45.213949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:45.233524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:45.234638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:45.235408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:45.238733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:45.241380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:45.243031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:45.508407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-00ebecd8-05d6-4397-9d3b-dd3af43f2855 req-26b3115b-5a1c-47f4-bb3a-98dfc9e600ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eaf6a-7c9d-4f81-b5eb-d01ef0d59243", "name": "network-vif-unplugged", "status": "completed", "tag": "97f76ef1-55de-461a-86b3-e25afc9e4abc"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:45.519668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-00ebecd8-05d6-4397-9d3b-dd3af43f2855 req-26b3115b-5a1c-47f4-bb3a-98dfc9e600ed service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:45.520521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-00ebecd8-05d6-4397-9d3b-dd3af43f2855 req-26b3115b-5a1c-47f4-bb3a-98dfc9e600ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:45.521226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-00ebecd8-05d6-4397-9d3b-dd3af43f2855 req-26b3115b-5a1c-47f4-bb3a-98dfc9e600ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:45.523090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:45.538437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-00ebecd8-05d6-4397-9d3b-dd3af43f2855 req-26b3115b-5a1c-47f4-bb3a-98dfc9e600ed service nova] Creating event network-vif-unplugged:97f76ef1-55de-461a-86b3-e25afc9e4abc for instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 on n-h1-858383-3 Oct 03 10:44:45.538575 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c383c8c2-adc0-413f-94da-29fbe32c28c3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.334096 Oct 03 10:44:45.539802 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1782/3459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:45 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:45.545022 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-00ebecd8-05d6-4397-9d3b-dd3af43f2855 req-26b3115b-5a1c-47f4-bb3a-98dfc9e600ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040193 Oct 03 10:44:45.546377 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1678/3460] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:44:45.617571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:45.618190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:45.624740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:45.625678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:45.626334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:45.627333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:45.627950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:45.628524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:45.972174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:45.986572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:45.989635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:45.991578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ae28775c-d9bb-49cd-bcad-952ad2d7fa2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1723 microversion: 2.20 time: 0.378101 Oct 03 10:44:46.001783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:46.002878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:46.029942 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1783/3461] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:45 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:46.033122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:46.034377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:46.035048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:46.036050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:46.037072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:46.037721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:46.114324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:46.114951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:46.122319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:46.122820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:46.123294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:46.124007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:46.124470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:46.124937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:46.209632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:46.225414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:46.227829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:46.229582 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-680692e6-596a-4ecf-ad33-c05ade8608ca tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1516 microversion: 2.21 time: 0.119486 Oct 03 10:44:46.249042 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1784/3462] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:46 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1516 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:46.262276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:46.277159 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c9ef9ffc-b3f2-41e0-82d2-22c0ce684e2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1278 microversion: 2.1 time: 0.282228 Oct 03 10:44:46.278120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1679/3463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:45 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1278 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:46.561970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:46.562598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:46.574905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:46.576244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:46.576915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:46.579305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:46.580721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:46.581422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:46.716735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-48e001db-87c8-4fd5-b9e1-80b22a831ff8 req-765177d3-e64c-48c0-ae11-db0e4bc79d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e", "name": "network-vif-deleted", "tag": "e957fea8-5ff8-4498-9b20-9abc35b35ffa"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:46.730775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:46.767329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48e001db-87c8-4fd5-b9e1-80b22a831ff8 req-765177d3-e64c-48c0-ae11-db0e4bc79d18 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:46.769291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:46.769456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48e001db-87c8-4fd5-b9e1-80b22a831ff8 req-765177d3-e64c-48c0-ae11-db0e4bc79d18 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:46.769820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48e001db-87c8-4fd5-b9e1-80b22a831ff8 req-765177d3-e64c-48c0-ae11-db0e4bc79d18 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:46.781592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee45bc9b-93cc-4bdd-bae9-4ac329b3d2c5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.223411 Oct 03 10:44:46.784147 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1785/3464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:46 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:46.802006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-48e001db-87c8-4fd5-b9e1-80b22a831ff8 req-765177d3-e64c-48c0-ae11-db0e4bc79d18 service nova] Creating event network-vif-deleted:e957fea8-5ff8-4498-9b20-9abc35b35ffa for instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e on n-h2-858383-3 Oct 03 10:44:46.820364 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-48e001db-87c8-4fd5-b9e1-80b22a831ff8 req-765177d3-e64c-48c0-ae11-db0e4bc79d18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108242 Oct 03 10:44:46.821707 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1680/3465] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:44:47.035638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:47.036249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:47.043494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.044255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.044703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.045540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.046242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.046813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.073124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:47.235038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:47.249154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:47.250673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:47.251940 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8cff8fc4-cbfa-4191-be58-76ebd2a79c6c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1726 microversion: 2.20 time: 0.220433 Oct 03 10:44:47.252514 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1786/3466] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:47 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:47.258576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:47.259494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:47.272541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.273438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.274164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.275168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.275817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.276447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.286881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1485466-9653-440c-a34e-39c1d2249679"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:47.290553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:47.305833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.306760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.309417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.312670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.314360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.314994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.317875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.318510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.319043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.319753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lazy-loading 'fault' on Instance uuid 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:44:47.573929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:47.589506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:47.591600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5c8618f25ce4ba9a609f05fe603164a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db7fc80d54a48f4833cf667e1df8a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:47.594211 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8109a183-ba35-4fc7-9a6c-3215e99032c6 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 200 len: 1349 microversion: 2.21 time: 0.339292 Oct 03 10:44:47.594999 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1681/3467] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:47 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 1349 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:47.600795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:47.602701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:47.621734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.627356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.628611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.630748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.633241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.634831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.745679 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2b1079b-5be3-4768-9eda-4c1c680acd2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.465685 Oct 03 10:44:47.746641 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1787/3468] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 3 10:44:47 2022] POST /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 188 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:44:47.772538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:47.784469 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86a95946-1918-409d-b251-63ad43cb309e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1266 microversion: 2.1 time: 0.187570 Oct 03 10:44:47.793044 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1682/3469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:47 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:47.810603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:47.811594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:47.820234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.820650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.821113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.821916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.822377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.822922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.974538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:47.975151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:47.981419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.981998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.982489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:47.983204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:47.983736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:47.984385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.014042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:48.025391 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-36b726de-51e9-4ee3-8f6c-d7a93f82edc6 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.219467 Oct 03 10:44:48.039433 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1788/3470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:47 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:48.134514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122270) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 10:44:48.251716 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-32f90a99-32ad-4aeb-bf8c-e19caf2b4257 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/action" status: 202 len: 0 microversion: 2.20 time: 0.282970 Oct 03 10:44:48.261329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:48.262086 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1683/3471] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:44:47 2022] POST /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:48.262712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:48.275615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.276527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.277022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.277737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.278802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.279246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.522510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:48.534109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:48.537217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:48.539492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea50cb04-947b-442b-a2eb-7748d9c7da95 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1752 microversion: 2.20 time: 0.281726 Oct 03 10:44:48.540981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1789/3472] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:48 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1752 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:48.635384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:48.636250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:48.643052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.643614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.644240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.644978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.645432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.645934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.661113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] HTTP exception thrown: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Request method failure captured: Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e HTTP/1.1 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr0B05uT2cWikLYohQIUkFJRQvjbZXpkVOUSrLPS7JalxdPlglf8FMV5FQEoGx4ha_Fklaue7IvVfbt_g9FfyTDbCKkvK5ligE-zoPmMfYqD8ehFjlhC8Khp3LV21aHaIVOSZ9I2ljoZyAjlZzLixDbYYehXa7_RLW-4Q-vgTRZiOjo Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.21 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7db7fc80d54a48f4833cf667e1df8a99 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db7fc80d54a48f4833cf667e1df8a99"}]}] Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7db7fc80d54a48f4833cf667e1df8a99 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-InstanceActionsV221TestJSON-1637968737-project Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: b5c8618f25ce4ba9a609f05fe603164a Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-InstanceActionsV221TestJSON-1637968737-project Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e'} Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.664062 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.668258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.670461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Returning 404 to user: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:44:48.672608 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c54dba18-9bd8-4b22-9062-64936714a86f tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 404 len: 111 microversion: 2.21 time: 0.050543 Oct 03 10:44:48.673794 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1684/3473] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:48 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:44:48.682420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '.version_select at 0x7f074e23ddc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:48.682998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:48.690519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.691047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.691475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.692147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.692603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.693065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.797635 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4ebddd13-3bba-472c-8223-0c65200a3c75 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.119081 Oct 03 10:44:48.798689 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1790/3474] 10.222.0.27 () {60 vars in 1337 bytes} [Mon Oct 3 10:44:48 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 10:44:48.815900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:48.817573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:48.818600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:48.819110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:48.825849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.826657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.827148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.827267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.827595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.828148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.828341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.829881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.830587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.831235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.836161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.836620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.858762 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] HTTP exception thrown: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Request method failure captured: Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e HTTP/1.1 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr0B05uT2cWikLYohQIUkFJRQvjbZXpkVOUSrLPS7JalxdPlglf8FMV5FQEoGx4ha_Fklaue7IvVfbt_g9FfyTDbCKkvK5ligE-zoPmMfYqD8ehFjlhC8Khp3LV21aHaIVOSZ9I2ljoZyAjlZzLixDbYYehXa7_RLW-4Q-vgTRZiOjo Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.21 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7db7fc80d54a48f4833cf667e1df8a99 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db7fc80d54a48f4833cf667e1df8a99"}]}] Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7db7fc80d54a48f4833cf667e1df8a99 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceActionsV221TestJSON-1637968737-project Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: b5c8618f25ce4ba9a609f05fe603164a Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceActionsV221TestJSON-1637968737-project Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e'} Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:44:48.861495 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.868744 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.870164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Returning 404 to user: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:44:48.871300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6730945e-a4ee-4f69-b44b-4b3d5de23bef tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "DELETE /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 404 len: 111 microversion: 2.21 time: 0.056321 Oct 03 10:44:48.871651 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1791/3475] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:44:48 2022] DELETE /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:44:48.881613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:48.882317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] [instance: 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:48.891142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.892273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.892812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.894589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:48.894589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:48.894589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:48.920759 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] HTTP exception thrown: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Request method failure captured: Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e HTTP/1.1 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr0B05uT2cWikLYohQIUkFJRQvjbZXpkVOUSrLPS7JalxdPlglf8FMV5FQEoGx4ha_Fklaue7IvVfbt_g9FfyTDbCKkvK5ligE-zoPmMfYqD8ehFjlhC8Khp3LV21aHaIVOSZ9I2ljoZyAjlZzLixDbYYehXa7_RLW-4Q-vgTRZiOjo Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.21 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7db7fc80d54a48f4833cf667e1df8a99 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7db7fc80d54a48f4833cf667e1df8a99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7db7fc80d54a48f4833cf667e1df8a99"}]}] Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7db7fc80d54a48f4833cf667e1df8a99 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1637968737 Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceActionsV221TestJSON-1637968737-project Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: b5c8618f25ce4ba9a609f05fe603164a Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceActionsV221TestJSON-1637968737-project Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e'} Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.923073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] Returning 404 to user: Instance 26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24224075-5674-4768-b7ab-165916eb4662 tempest-InstanceActionsV221TestJSON-1637968737 tempest-InstanceActionsV221TestJSON-1637968737-project] 10.222.0.27 "GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e" status: 404 len: 111 microversion: 2.21 time: 0.048753 Oct 03 10:44:48.931289 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1792/3476] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:48 2022] GET /compute/v2.1/servers/26cbf8b6-6d40-47d3-b8dd-1629d0d2db7e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:44:49.053176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:49.054219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:49.063055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:49.065591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:49.067054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:49.068075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:49.068573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:49.069389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:49.326301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:49.336201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-63ccece8-b139-4246-8fa9-1219136a9f54 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.290484 Oct 03 10:44:49.337026 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1793/3477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:49 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:49.341894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f0cdf564-ebbe-43ad-942f-71040b648130 req-3f7f9136-bf84-4942-88f2-6bf7e60e36e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837040df-1826-4d27-adf2-e6532d7461f4", "tag": "c4d26b1d-b7d6-4a16-bc75-41277e8b2ee6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:49.354359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f0cdf564-ebbe-43ad-942f-71040b648130 req-3f7f9136-bf84-4942-88f2-6bf7e60e36e3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:49.355186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f0cdf564-ebbe-43ad-942f-71040b648130 req-3f7f9136-bf84-4942-88f2-6bf7e60e36e3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:49.355837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f0cdf564-ebbe-43ad-942f-71040b648130 req-3f7f9136-bf84-4942-88f2-6bf7e60e36e3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:49.378850 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f0cdf564-ebbe-43ad-942f-71040b648130 req-3f7f9136-bf84-4942-88f2-6bf7e60e36e3 service nova] Creating event network-changed:c4d26b1d-b7d6-4a16-bc75-41277e8b2ee6 for instance 837040df-1826-4d27-adf2-e6532d7461f4 on n-h2-858383-3 Oct 03 10:44:49.384344 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f0cdf564-ebbe-43ad-942f-71040b648130 req-3f7f9136-bf84-4942-88f2-6bf7e60e36e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045776 Oct 03 10:44:49.385302 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1794/3478] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:49.547558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:49.558221 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f230b43-bf1a-4235-9929-49224ce80291 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.745668 Oct 03 10:44:49.558221 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1685/3479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:48 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:49.577348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:49.578248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:49.609260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:49.609772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:49.610246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:49.617402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:49.620017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:49.620475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:49.883422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:49.898896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:49.900695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:49.902406 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c6d207a6-963c-4064-b7e1-9390737f49a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1752 microversion: 2.20 time: 0.337525 Oct 03 10:44:49.915864 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1795/3480] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:49 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1752 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:50.359845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:50.361541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:50.373145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:50.380057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:50.380883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:50.382561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:50.383292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:50.384424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:50.585303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:50.585869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:50.597933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:50.598768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:50.599252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:50.600567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:50.608443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:50.609190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:50.843757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:50.870266 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f9de3e25-1228-4a8a-ad8e-cd4bce047336 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.510837 Oct 03 10:44:50.871322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1686/3481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:50 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:50.932422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:50.933103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:50.939548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:50.940350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:50.940938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:50.942624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:50.942624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:50.942624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:51.146454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:51.154772 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a943a93a-e2bd-4c7b-ab0b-dcd8f4831ee6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.578984 Oct 03 10:44:51.168063 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1796/3482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:50 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:51.418905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-63a7fc9a-d577-4137-b319-8b7c1e5440cb req-0992e58d-0460-456a-9004-5b62f3f66bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ae4577-d2bb-4e45-a513-f885d98a8a36", "tag": "ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:51.438902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-63a7fc9a-d577-4137-b319-8b7c1e5440cb req-0992e58d-0460-456a-9004-5b62f3f66bb4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:51.439395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-63a7fc9a-d577-4137-b319-8b7c1e5440cb req-0992e58d-0460-456a-9004-5b62f3f66bb4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:51.439831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-63a7fc9a-d577-4137-b319-8b7c1e5440cb req-0992e58d-0460-456a-9004-5b62f3f66bb4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:51.457155 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-63a7fc9a-d577-4137-b319-8b7c1e5440cb req-0992e58d-0460-456a-9004-5b62f3f66bb4 service nova] Creating event network-changed:ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae for instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 on n-h1-858383-3 Oct 03 10:44:51.474684 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-63a7fc9a-d577-4137-b319-8b7c1e5440cb req-0992e58d-0460-456a-9004-5b62f3f66bb4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059297 Oct 03 10:44:51.475609 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1797/3483] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:44:51.480905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:51.527649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:51.533707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:51.537197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe3d9223-14bc-4978-b94a-6d067e42d65d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1754 microversion: 2.20 time: 0.608400 Oct 03 10:44:51.541217 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1687/3484] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:50 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1754 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:51.900905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:51.902223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:51.915081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:51.920049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:51.920982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:51.921988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:51.926802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:51.927574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:52.212163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:52.214472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:52.223374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:52.227037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:52.264148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:52.268990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:52.271009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:52.280522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:52.283728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:52.285457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:52.312299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:52.327255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e9f12e8-afca-4fa4-902f-0822f0f2e7b5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.429839 Oct 03 10:44:52.328207 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1798/3485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:51 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:52.567315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:52.569315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:52.584321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:52.588279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:52.589451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:52.590317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:52.591314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:52.592062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:52.593148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:52.898120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:52.941244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:52.944433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:52.947007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89415f5b-702d-493c-baf3-5b7f1800be2b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1754 microversion: 2.20 time: 0.383939 Oct 03 10:44:52.947814 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1799/3486] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:52 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1754 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:44:53.357294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:53.363286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:53.413660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:53.417806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:53.419374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:53.420487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:53.423812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:53.427528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:53.433970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:53.435657 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-21c2708b-904d-45df-91cd-405e87bd15fc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 1.242365 Oct 03 10:44:53.437897 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1688/3487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:52 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:53.743554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:53.790458 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ef61577a-a1fe-4152-ac4a-cf4b8c3471d4 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.439432 Oct 03 10:44:53.805495 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1800/3488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:53 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:53.982561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:53.983180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:53.994908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:53.995469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:53.995919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:53.996703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:53.997574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:54.001525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:54.460177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:54.462654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:54.463941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:54.473341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:54.478045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:54.478360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:54.480031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:54.480674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:54.481291 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-604b9e69-716a-4259-bfa1-c2b026a85546 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1754 microversion: 2.20 time: 0.502764 Oct 03 10:44:54.482814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:54.483819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1689/3489] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:53 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1754 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:54.496513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:54.506404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:54.540962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-16a45be8-d7b9-44d8-a49a-b6622f258e94 req-b451a0f8-216c-4dc4-94b4-503ee3d07a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837040df-1826-4d27-adf2-e6532d7461f4", "name": "network-vif-plugged", "status": "completed", "tag": "c4d26b1d-b7d6-4a16-bc75-41277e8b2ee6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:44:54.558866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16a45be8-d7b9-44d8-a49a-b6622f258e94 req-b451a0f8-216c-4dc4-94b4-503ee3d07a01 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:54.559702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16a45be8-d7b9-44d8-a49a-b6622f258e94 req-b451a0f8-216c-4dc4-94b4-503ee3d07a01 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:54.560599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16a45be8-d7b9-44d8-a49a-b6622f258e94 req-b451a0f8-216c-4dc4-94b4-503ee3d07a01 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:54.590319 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-16a45be8-d7b9-44d8-a49a-b6622f258e94 req-b451a0f8-216c-4dc4-94b4-503ee3d07a01 service nova] Creating event network-vif-plugged:c4d26b1d-b7d6-4a16-bc75-41277e8b2ee6 for instance 837040df-1826-4d27-adf2-e6532d7461f4 on n-h2-858383-3 Oct 03 10:44:54.606102 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-16a45be8-d7b9-44d8-a49a-b6622f258e94 req-b451a0f8-216c-4dc4-94b4-503ee3d07a01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071041 Oct 03 10:44:54.607334 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1690/3490] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:44:54.817751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:54.818607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:54.833941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:54.839062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:54.840351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:54.841901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:54.846365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:54.846984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:54.991701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:55.011085 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5623857c-79eb-4e56-be55-db6a0fbb9014 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.553308 Oct 03 10:44:55.026831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1801/3491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:54 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:55.390369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:55.401173 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb36d432-9958-49c2-a16c-c7dbda636f74 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1316 microversion: 2.1 time: 0.589668 Oct 03 10:44:55.405651 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1691/3492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:54 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:55.511481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:55.512198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:55.526894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:55.527752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:55.528426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:55.529337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:55.530311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:55.531290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:55.835087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:55.852205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:55.855813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:55.859798 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2f26da2a-3304-4f34-bf92-0af52e4f28a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1754 microversion: 2.20 time: 0.351038 Oct 03 10:44:55.862745 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1802/3493] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:55 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1754 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:56.041664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:56.042485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:56.058191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.068930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.069507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:56.072471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.073143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.075643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:56.434673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:56.435413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:56.459624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.463724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.474517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:56.477951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.480489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.482962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:56.498809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:56.771995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:56.796031 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58e7f686-9cbd-4f61-9340-a3ada68da8b3 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.758657 Oct 03 10:44:56.798642 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1692/3494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:56 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:56.810923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:56.834279 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6716082c-b2bd-4039-b8dc-49c944b8c3c7 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1465 microversion: 2.1 time: 0.404049 Oct 03 10:44:56.835386 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1803/3495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:56 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1465 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:44:56.868535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:56.869521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:56.891406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:56.892663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:56.904526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.905071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.911896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.912923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:56.914612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.918896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:56.919757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.924468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:56.924817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.925629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:56.927768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:56.932200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:57.337619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:57.352958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:57.355267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:57.356870 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d760624-0c2b-412d-a20b-66c66c54c399 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1754 microversion: 2.20 time: 0.470094 Oct 03 10:44:57.357820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1804/3496] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:56 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1754 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:57.830398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:57.831174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:57.847786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:57.850567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:57.851948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:57.853609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:57.855784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:57.857506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:58.026429 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d712ed4e-c348-416d-9e4c-ccc4a37c1f00 tempest-ServersOnMultiNodesTest-1839530785 tempest-ServersOnMultiNodesTest-1839530785-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1616 microversion: 2.1 time: 1.159479 Oct 03 10:44:58.028307 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1693/3497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:56 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1616 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:58.060853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:58.061393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:58.069180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:58.069884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:58.070335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:58.071056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:58.071570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:58.072154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:58.113706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:44:58.117779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:44:58.197078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:58.209361 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26ba890f-1c74-4669-b7ec-2aa3bbc82b2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.385266 Oct 03 10:44:58.210604 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1805/3498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:57 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:58.313563 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-586f9954-7b92-447c-a966-6045afa4f245 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 204 len: 0 microversion: 2.1 time: 0.260252 Oct 03 10:44:58.315423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1694/3499] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:44:58 2022] DELETE /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:44:58.333861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:58.335097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:58.343152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:58.343966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:58.344463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:58.345750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:58.346263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:58.346707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:58.396849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:58.399251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:58.423259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:58.424745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:58.425842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:58.427327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:58.430034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:58.430752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:58.747649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:58.780264 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32bbae72-33c3-4c15-8a1b-d922601155bf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1471 microversion: 2.1 time: 0.460176 Oct 03 10:44:58.787636 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1806/3500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:58 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1471 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:59.148497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:59.166523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:59.169753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:59.173042 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa0b34f4-4e60-4036-a298-c5acd34c5a2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1754 microversion: 2.20 time: 0.787926 Oct 03 10:44:59.174473 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1695/3501] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:44:58 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1754 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:44:59.238638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:59.239258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:59.254167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:59.257205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:59.257927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:59.258971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:59.260681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:59.261361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:59.526762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:44:59.536015 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f65fc0f6-2219-4575-b947-e8ca88b22ae1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.301807 Oct 03 10:44:59.539914 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1807/3502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:59 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:44:59.815706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:44:59.816747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:44:59.824460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:59.825071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:59.825479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:44:59.826363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:44:59.826824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:44:59.827254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:00.208432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:00.210066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:00.222075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:00.224237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:00.224865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:00.226014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:00.226682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:00.227316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:00.381377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:00.394354 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6fc63be-2d4f-40e4-8d3f-8d7f6484e641 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1471 microversion: 2.1 time: 0.585210 Oct 03 10:45:00.395302 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1696/3503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:44:59 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:00.401656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c291c54c-2ca5-4525-a8ad-9d7ef2873e1d req-1dfbe1a7-23ce-4a4b-8cc1-4031e048ced8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ae4577-d2bb-4e45-a513-f885d98a8a36", "name": "network-vif-plugged", "status": "completed", "tag": "ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:00.412608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c291c54c-2ca5-4525-a8ad-9d7ef2873e1d req-1dfbe1a7-23ce-4a4b-8cc1-4031e048ced8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:00.413323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c291c54c-2ca5-4525-a8ad-9d7ef2873e1d req-1dfbe1a7-23ce-4a4b-8cc1-4031e048ced8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:00.414413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c291c54c-2ca5-4525-a8ad-9d7ef2873e1d req-1dfbe1a7-23ce-4a4b-8cc1-4031e048ced8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:00.415113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:00.426969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:00.427182 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c291c54c-2ca5-4525-a8ad-9d7ef2873e1d req-1dfbe1a7-23ce-4a4b-8cc1-4031e048ced8 service nova] Creating event network-vif-plugged:ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae for instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 on n-h1-858383-3 Oct 03 10:45:00.428437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:00.429649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e94826d-55ac-43f2-af31-6984119950cf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.226856 Oct 03 10:45:00.430225 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1808/3504] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:00 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:00.432358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c291c54c-2ca5-4525-a8ad-9d7ef2873e1d req-1dfbe1a7-23ce-4a4b-8cc1-4031e048ced8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035848 Oct 03 10:45:00.433097 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1697/3505] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:00.565133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:00.565982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:00.581577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:00.582082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:00.582579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:00.583454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:00.583944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:00.585933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:00.820294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:00.834059 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2c8a160-e01b-48d9-ab37-5e82f0d37163 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.274420 Oct 03 10:45:00.834917 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1809/3506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:00 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:01.421137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:01.423120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:01.431855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:01.432622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:01.433274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:01.434410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:01.435051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:01.435648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:01.455729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:01.457112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:01.465478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:01.467227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:01.468014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:01.469144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:01.469959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:01.473137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:01.766980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:01.781248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:01.784563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:01.789789 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d3c7ad7-e1b2-4827-bdf9-9a7da4229ad4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.338207 Oct 03 10:45:01.794306 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1810/3507] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:01 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:01.861945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:01.863473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:01.873474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:01.876100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:01.877561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:01.878281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:01.881051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:01.881830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:01.882481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:02.082756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:02.095475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8e6f9f7-22be-4a34-a780-d97b1751f946 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1308 microversion: 2.1 time: 0.239895 Oct 03 10:45:02.096497 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1811/3508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:01 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:02.126172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:02.134704 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47db1276-bd11-44df-bbbc-2686b8f56e9a tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 200 len: 1429 microversion: 2.1 time: 0.717826 Oct 03 10:45:02.148931 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1698/3509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:01 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 1429 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:02.246893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-01df2a89-e73a-4530-897c-468352b72775 req-2d99c996-a52a-45d8-81f9-0edad93c10b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837040df-1826-4d27-adf2-e6532d7461f4", "name": "network-vif-deleted", "tag": "c4d26b1d-b7d6-4a16-bc75-41277e8b2ee6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:02.261542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01df2a89-e73a-4530-897c-468352b72775 req-2d99c996-a52a-45d8-81f9-0edad93c10b4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:02.262337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01df2a89-e73a-4530-897c-468352b72775 req-2d99c996-a52a-45d8-81f9-0edad93c10b4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:02.262953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01df2a89-e73a-4530-897c-468352b72775 req-2d99c996-a52a-45d8-81f9-0edad93c10b4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:02.290573 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-01df2a89-e73a-4530-897c-468352b72775 req-2d99c996-a52a-45d8-81f9-0edad93c10b4 service nova] Creating event network-vif-deleted:c4d26b1d-b7d6-4a16-bc75-41277e8b2ee6 for instance 837040df-1826-4d27-adf2-e6532d7461f4 on n-h2-858383-3 Oct 03 10:45:02.298734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-01df2a89-e73a-4530-897c-468352b72775 req-2d99c996-a52a-45d8-81f9-0edad93c10b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055422 Oct 03 10:45:02.318988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1812/3510] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:02.847822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:02.848683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:02.915215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:02.921899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:02.924912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:02.930312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-418123712", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "00c507a3-7614-42d8-931f-8efa1bcb2e1e"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:02.938995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:02.939969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:02.951478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:03.130705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] validate_networks() for [('00c507a3-7614-42d8-931f-8efa1bcb2e1e', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:45:03.285259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:03.298785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:03.301775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:03.303157 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d86e9e4-5095-4ef4-8736-b5c7fdac26bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.485241 Oct 03 10:45:03.316808 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1813/3511] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:02 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:03.316808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:03.316808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:03.324395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:03.324395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:03.324395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:03.324395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:03.324395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:03.324395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:03.696678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:03.711099 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91484c55-aa6d-4f84-ae83-abe9896eaa0f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1488 microversion: 2.1 time: 0.405693 Oct 03 10:45:03.711703 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1814/3512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:03 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1488 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:03.741127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:03.741763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 837040df-1826-4d27-adf2-e6532d7461f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:03.783453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:03.790754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:03.791233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:03.794776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:03.795919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:03.796144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:03.845884 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance 837040df-1826-4d27-adf2-e6532d7461f4 could not be found. Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 HTTP/1.1 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 837040df-1826-4d27-adf2-e6532d7461f4 could not be found. Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '837040df-1826-4d27-adf2-e6532d7461f4'} Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837040df-1826-4d27-adf2-e6532d7461f4 could not be found. Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837040df-1826-4d27-adf2-e6532d7461f4 could not be found. Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:03.850037 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837040df-1826-4d27-adf2-e6532d7461f4 could not be found. Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance 837040df-1826-4d27-adf2-e6532d7461f4 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95bd7a62-38c9-42bb-ab88-cf0ee070fae3 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4" status: 404 len: 111 microversion: 2.1 time: 0.136195 Oct 03 10:45:03.857237 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1815/3513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:03 2022] GET /compute/v2.1/servers/837040df-1826-4d27-adf2-e6532d7461f4 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:03.870908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:03.871489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:03.905477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:03.906486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:03.907819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:03.909019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:03.911823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:03.912624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:03.981624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lazy-loading 'flavor' on Instance uuid e3ae4577-d2bb-4e45-a513-f885d98a8a36 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:04.158155 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b41693ff-3af2-40b9-820f-c367b8f10092 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36/action" status: 202 len: 0 microversion: 2.1 time: 0.301112 Oct 03 10:45:04.161497 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1816/3514] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:45:03 2022] POST /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:45:04.201292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:04.201970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:04.220067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:04.220576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:04.225711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:04.226958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:04.227524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:04.228213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:04.313585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:04.475737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:04.559763 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8625653-21ba-4f08-a22e-db7313d78de2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 204 len: 0 microversion: 2.1 time: 0.395261 Oct 03 10:45:04.560736 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1817/3515] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:04 2022] DELETE /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:04.575276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:04.579296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:04.595443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:04.596306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:04.597885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:04.599513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:04.601604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:04.602307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:04.883826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:04.895494 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-640bb271-2415-4217-8e14-981711f1576a tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1496 microversion: 2.1 time: 0.331287 Oct 03 10:45:04.896310 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1818/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:04 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1496 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:04.903532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:04.912641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:04.926700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:04.927459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:04.928114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:04.929071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:04.929727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:04.930320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.097012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:45:05.101703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:45:05.102215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:45:05.102687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:45:05.103109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:45:05.122342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.123455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.131239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.132348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.133013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.133609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.161766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:05.171931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:05.172726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Getting quotas for project 7c7fcbccf58841f4bbdc411646392149. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:45:05.173679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:05.177380 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-16f627ef-7595-421c-a413-2ff77368d56b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.279913 Oct 03 10:45:05.180563 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1819/3517] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:04 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:05.182939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Getting quotas for user 14a652f8f3154ea58a332d83f5357f71 and project 7c7fcbccf58841f4bbdc411646392149. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:45:05.207213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:05.207843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:05.214402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.214893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.215336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.216069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.216536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.216999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.217705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Going to run 3 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:45:05.221976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:45:05.289767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=9b826fa5-cc46-4cfb-871e-dbfed29ac0a9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:45:05.343626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=82780639-acbe-4bcb-84dc-35ba1f3c1647,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:45:05.436547 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7175b09f-6d48-4e70-b32e-89fcd37465b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.828078 Oct 03 10:45:05.441304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:05.446061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1699/3518] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:45:05.452580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:05.454401 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec5ac6c4-3027-488b-806b-625271eb6491 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1473 microversion: 2.1 time: 0.259737 Oct 03 10:45:05.455003 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1820/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:05 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:05.461236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:05.462060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:05.497248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.498350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.498799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.501314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.501796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.503479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.533707 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b99a1fa-0741-4b6b-a105-c54917705db9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.086166 Oct 03 10:45:05.534666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1700/3520] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:45:05 2022] GET /compute/v2.1/servers => generated 1015 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:05.550592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cfb47bd5-ee09-4109-9753-02159cbbd3d0 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:05.552645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cfb47bd5-ee09-4109-9753-02159cbbd3d0 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:05.622870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cfb47bd5-ee09-4109-9753-02159cbbd3d0 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:05.633157 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cfb47bd5-ee09-4109-9753-02159cbbd3d0 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1222 microversion: 2.1 time: 0.086557 Oct 03 10:45:05.634217 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1821/3521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:05 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:05.934404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:05.935567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:05.963864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.965157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.966258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:05.967844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:05.969007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:05.970491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:06.217684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:06.219962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:06.238673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:06.240666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:06.242036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:06.245218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:06.247742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:06.248389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:06.409853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:06.437540 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65dd0cd0-da96-4d01-9cdf-3e3accc89590 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1496 microversion: 2.1 time: 0.512449 Oct 03 10:45:06.441968 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1701/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:05 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1496 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:06.479981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:06.481226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:06.509007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:06.524553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:06.529532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:06.534439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:06.536780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:06.539399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:06.737894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:06.751555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:06.758157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:06.765303 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-441a9af2-e51e-4440-addf-c2ad006abd65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.553506 Oct 03 10:45:06.766900 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1822/3523] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:06 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:06.784326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58741d5a-4af4-495d-aaf1-5b92589ec805 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:06.795400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-58741d5a-4af4-495d-aaf1-5b92589ec805 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:07.041226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58741d5a-4af4-495d-aaf1-5b92589ec805 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:07.060568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:07.070178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65fccf44-9dfc-4136-82d4-052e8e465870 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1473 microversion: 2.1 time: 0.595008 Oct 03 10:45:07.080733 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58741d5a-4af4-495d-aaf1-5b92589ec805 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1222 microversion: 2.1 time: 0.309361 Oct 03 10:45:07.082174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1823/3524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:06 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1222 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:07.096993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1702/3525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:06 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1473 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:07.471846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:07.473614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:07.517914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:07.519136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:07.528046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:07.532597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:07.533821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:07.537630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:07.823105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:07.827479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:07.873700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:07.882417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:07.886098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:07.889406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:07.892412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:07.895954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:08.679750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:08.704712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:08.715992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:08.721860 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fae403de-cf57-4360-8c93-7e6775c9195a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.923500 Oct 03 10:45:08.722502 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1703/3526] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:07 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:08.738093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:08.738825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:08.786892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:08.795684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:08.796964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:08.813300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:08.814661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:08.819510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:09.352530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:09.365304 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d35403b-ec5a-4f05-bfae-cd46a0e54121 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1473 microversion: 2.1 time: 0.641598 Oct 03 10:45:09.370971 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1704/3527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:08 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1473 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:09.402797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:09.407918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:09.425253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:09.430645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:09.431456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:09.432418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:09.437834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:09.438736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:09.506608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:09.529247 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b26d7ce9-5d07-43dc-a59b-bcead93ed655 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 200 len: 1479 microversion: 2.1 time: 2.061666 Oct 03 10:45:09.549767 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1824/3528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:07 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 1479 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:09.567512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-460427073"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:09.589130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:09.607845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:09.611993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:09.612750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:09.613697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:09.616369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:09.617101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:10.032245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:10.072125 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a90bd2a-feb0-47c2-be89-6757376ab2fc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1218 microversion: 2.1 time: 0.693082 Oct 03 10:45:10.080903 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1705/3529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:09 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1218 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:10.093497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:10.095464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:10.115749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:10.116687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:10.117423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:10.119655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:10.130037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:10.134071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:10.282926 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26507c67-bcc2-47b9-864d-fce036891d32 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36/action" status: 202 len: 0 microversion: 2.1 time: 0.716655 Oct 03 10:45:10.289953 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1825/3530] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:45:09 2022] POST /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:45:10.304099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2c425092-2667-46a0-868d-2e207e106d8e req-69de4d7c-f7eb-49b9-8902-cc45c7f489ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59698ccb-4f34-4887-b9d9-0531ee882bef", "name": "network-vif-deleted", "tag": "79bd76a9-60f1-4bd0-96c6-078da3b6cc6d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:10.355861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2c425092-2667-46a0-868d-2e207e106d8e req-69de4d7c-f7eb-49b9-8902-cc45c7f489ef service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:10.356420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2c425092-2667-46a0-868d-2e207e106d8e req-69de4d7c-f7eb-49b9-8902-cc45c7f489ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:10.360606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2c425092-2667-46a0-868d-2e207e106d8e req-69de4d7c-f7eb-49b9-8902-cc45c7f489ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:10.409423 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-2c425092-2667-46a0-868d-2e207e106d8e req-69de4d7c-f7eb-49b9-8902-cc45c7f489ef service nova] Creating event network-vif-deleted:79bd76a9-60f1-4bd0-96c6-078da3b6cc6d for instance 59698ccb-4f34-4887-b9d9-0531ee882bef on n-h1-858383-3 Oct 03 10:45:10.416810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2c425092-2667-46a0-868d-2e207e106d8e req-69de4d7c-f7eb-49b9-8902-cc45c7f489ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129061 Oct 03 10:45:10.418471 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1826/3531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:10.424244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-20e1eda1-1f82-43a2-839b-6778bf7c933e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2185e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:10.501745 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-20e1eda1-1f82-43a2-839b-6778bf7c933e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.081776 Oct 03 10:45:10.503348 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1827/3532] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:10 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:10.512035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:10.514331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:10.536902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:10.540062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:10.550211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:10.550211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:10.550211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:10.550211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:10.912009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:10.980352 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d0dfaca-de7e-4fc1-bda2-ae48eb2efde2 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1302 microversion: 2.1 time: 0.473108 Oct 03 10:45:10.982575 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1828/3533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:10 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1302 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:11.106868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:11.108057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:11.132265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:11.134312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:11.136793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:11.139969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:11.142427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:11.146233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:11.476814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:11.513468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72bf0cd7-9cfe-42db-b107-bd2c75f03630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1292 microversion: 2.1 time: 0.409263 Oct 03 10:45:11.528803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1829/3534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:11 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1292 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:11.540432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-11d859d6-d29b-4b3e-a70b-61e4163d42af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1ab4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:11.669334 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-11d859d6-d29b-4b3e-a70b-61e4163d42af tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.147956 Oct 03 10:45:11.671343 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1830/3535] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:11 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:11.785765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:11.805000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:11.822773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:11.824083 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-731d6a58-d219-4fe7-8f75-347e5d445e1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 1.741108 Oct 03 10:45:11.833571 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1706/3536] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:10 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:12.019292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:12.020444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:12.051800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:12.056472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:12.058673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:12.061787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:12.062550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:12.064462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:12.167856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:12.170852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:12.173419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:12.174660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid 59698ccb-4f34-4887-b9d9-0531ee882bef {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:12.348998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:12.363741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79520761-e1eb-4a1c-8edd-8a264b0cd944 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 200 len: 1307 microversion: 2.1 time: 0.354474 Oct 03 10:45:12.380258 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1831/3537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:12 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:12.544641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:12.545533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:12.575275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1333169434", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "383bcb71-f6df-4517-b677-5218add2e4a5"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:12.599376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:12.601426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:12.603419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:12.605192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:12.605928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:12.609851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:12.714409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] validate_networks() for [('383bcb71-f6df-4517-b677-5218add2e4a5', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:45:12.765502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:12.780887 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b42980f8-b5cf-4bfa-ac93-99792c0f1677 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1280 microversion: 2.1 time: 0.240684 Oct 03 10:45:12.782948 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1832/3538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:12 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:12.788291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3bb0e74-0227-4be1-a7e9-ceb57cc55dee tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e160a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:12.850250 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3bb0e74-0227-4be1-a7e9-ceb57cc55dee tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.065968 Oct 03 10:45:12.852080 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1833/3539] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:12 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:12.890682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:12.892004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:12.908403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:12.908974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:12.909421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:12.914645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:12.915179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:12.915624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.248261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:13.267795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:13.271714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:13.274139 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-69de1f97-c46c-468f-b4b4-53ca0c5b8cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.387497 Oct 03 10:45:13.293226 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1834/3540] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:12 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:13.408734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:13.410247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 59698ccb-4f34-4887-b9d9-0531ee882bef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:13.418866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.419462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.419967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.421498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.421498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.421885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.442872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance 59698ccb-4f34-4887-b9d9-0531ee882bef could not be found. Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef HTTP/1.1 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 59698ccb-4f34-4887-b9d9-0531ee882bef could not be found. Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '59698ccb-4f34-4887-b9d9-0531ee882bef'} Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59698ccb-4f34-4887-b9d9-0531ee882bef could not be found. Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59698ccb-4f34-4887-b9d9-0531ee882bef could not be found. Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:13.445409 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59698ccb-4f34-4887-b9d9-0531ee882bef could not be found. Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance 59698ccb-4f34-4887-b9d9-0531ee882bef could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7935d8e7-2758-4f3d-91f2-6ebb5b062796 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef" status: 404 len: 111 microversion: 2.1 time: 0.046083 Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1835/3541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:13 2022] GET /compute/v2.1/servers/59698ccb-4f34-4887-b9d9-0531ee882bef => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:13.464875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:13.481975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.482970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.483605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.487746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.488393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.489150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.561438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:13.821830 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b1d7360-cdb4-44b9-807b-bf2f20d7ed66 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 204 len: 0 microversion: 2.1 time: 0.369184 Oct 03 10:45:13.823603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1836/3542] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:13 2022] DELETE /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:13.832590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:13.834001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:13.842742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.843687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.844951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.845975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.846893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.847606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.880137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:13.947913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:13.956752 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd3afd6d-d1d4-482d-af51-e4bb4b49f669 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1280 microversion: 2.1 time: 0.131325 Oct 03 10:45:13.957958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1837/3543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:13 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:13.962990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:13.963601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:13.970700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.971199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.971650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:13.972374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:13.973501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:13.973501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:14.142119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:14.151041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-423036a9-0763-4206-a28f-7b5371d3f658 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1472 microversion: 2.1 time: 0.191935 Oct 03 10:45:14.157332 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1838/3544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:13 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:14.161211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d42d9fec-da5d-4f4c-83ef-e94a593220b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074ea8a430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:14.219797 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d42d9fec-da5d-4f4c-83ef-e94a593220b9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.065984 Oct 03 10:45:14.220686 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1839/3545] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:14 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:14.330486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:14.331058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:14.337705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:14.338695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:14.339139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:14.340043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:14.340521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:14.341011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:14.550911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:14.581029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:14.599699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:14.605717 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3954abf6-a627-4508-b7dc-e8028714cdda tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.278059 Oct 03 10:45:14.607609 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1840/3546] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:14 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:14.671926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:45:14.672882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:45:14.673040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:45:14.673432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:45:14.673846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:45:14.697643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:14.698227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:14.698753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:14.699740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:14.700701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:14.700942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:14.770040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Getting quotas for project 34334fcd5af44f5b981f35d2b5f2d8e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:45:14.788236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Getting quotas for user 2d4f521dd232484a93011b11b2844c07 and project 34334fcd5af44f5b981f35d2b5f2d8e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:45:14.832131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:45:14.837062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:45:14.857047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:14.915237 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22cfaddb-74a1-4999-b805-164d333f9e15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.450475 Oct 03 10:45:14.921829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1707/3547] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:45:14.928488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b31ef2f-d79a-4bb6-be01-237aca638761 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:14.929191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b31ef2f-d79a-4bb6-be01-237aca638761 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:14.994294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:14.995195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:15.022979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:15.024308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:15.027177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:15.028459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:15.029977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:15.035660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:15.073224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b31ef2f-d79a-4bb6-be01-237aca638761 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:15.082290 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b31ef2f-d79a-4bb6-be01-237aca638761 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1225 microversion: 2.1 time: 0.157279 Oct 03 10:45:15.100612 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1841/3548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:14 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:15.176000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:15.176851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:15.192423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:15.193589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:15.194100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:15.198294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:15.198919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:15.199436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:15.354598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:15.367498 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-deb021df-03d4-49d3-a6ed-81d1c4313b04 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1280 microversion: 2.1 time: 0.380025 Oct 03 10:45:15.376995 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1708/3549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:14 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1280 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:15.402888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1cf1f868-c312-4eb3-85b2-f8b824d95f95 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e199820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:15.484103 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1cf1f868-c312-4eb3-85b2-f8b824d95f95 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.100804 Oct 03 10:45:15.494283 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1709/3550] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:15 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:15.621913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:15.636463 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b12c1a53-cee1-4b7b-894c-a06c2f3ad3ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1472 microversion: 2.1 time: 0.465167 Oct 03 10:45:15.637425 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1842/3551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:15 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:15.658275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:15.659366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:15.699912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:15.715875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:15.718063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:15.720710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:15.722533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:15.725487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:16.113407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3931fb7f-aabf-4069-8300-697c035f59ba tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:16.114412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3931fb7f-aabf-4069-8300-697c035f59ba tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:16.260148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3931fb7f-aabf-4069-8300-697c035f59ba tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:16.274393 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3931fb7f-aabf-4069-8300-697c035f59ba tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1225 microversion: 2.1 time: 0.167241 Oct 03 10:45:16.275548 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1843/3552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:16 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1225 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:16.407173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:16.408271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:16.427181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:16.427628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:16.430648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:16.431850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:16.435886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:16.436822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:16.681286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:16.694541 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3a219195-96a3-461c-88cc-c32d8b77de20 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1280 microversion: 2.1 time: 0.305379 Oct 03 10:45:16.703144 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1844/3553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:16 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:16.710352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:16.727608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:16.729319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:16.730730 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5be2e924-1745-473b-9d83-ad93e41803bd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 1.078129 Oct 03 10:45:16.731414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1710/3554] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:15 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:16.740213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3aa1f41a-0c20-413d-a1cb-e33b511f042b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1bdd30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:16.751376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:16.752005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:16.779327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:16.789858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:16.790312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:16.791064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:16.791526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:16.791953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:16.859469 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3aa1f41a-0c20-413d-a1cb-e33b511f042b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.145509 Oct 03 10:45:16.868420 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1845/3555] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:16 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:16.885319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86ea1e3d-ed79-49cb-afa5-180b3bbd427d"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:16.888504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:16.909880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:16.910389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:16.910821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:16.921263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:16.921871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:16.922359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:17.536956 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c6a73979-6485-45f8-b56f-62f63979e9c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655478 Oct 03 10:45:17.552171 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1846/3556] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:45:16 2022] POST /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:17.568426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:17.579005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:17.596958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:17.599056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:17.602554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:17.605372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:17.606176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:17.607965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:17.880653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:17.893705 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3a1b47c8-00f5-4878-b2d5-8548cd885459 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1221 microversion: 2.1 time: 0.338487 Oct 03 10:45:17.921244 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1847/3557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:17 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1221 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:17.934773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:17.937593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:17.960825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:17.965025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:17.965854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:17.967278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:17.968435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:17.970326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:18.335587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:18.351633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad535689-cf1f-49f5-a384-1ca79fdc6c56 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.422713 Oct 03 10:45:18.356360 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1848/3558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:17 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:18.372035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:18.378760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:18.411761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:18.412697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:18.413471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:18.415362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:18.418409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:18.419334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:18.486501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:18.535570 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e7baf3b-bf28-4bdf-ac25-3207d690dad9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1472 microversion: 2.1 time: 1.802884 Oct 03 10:45:18.545351 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1711/3559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:16 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1472 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:18.613935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a713b646-559c-4a85-9f78-44112a4a6f43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e180700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:18.833127 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a713b646-559c-4a85-9f78-44112a4a6f43 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.272168 Oct 03 10:45:18.851829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1712/3560] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:18 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:18.861695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a731eb1f-fcb1-4542-9930-e4cb780935e1 req-c4cbf9f7-511c-40a1-920a-7cfd1699b65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ae4577-d2bb-4e45-a513-f885d98a8a36", "name": "network-vif-plugged", "status": "completed", "tag": "ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:18.917260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a731eb1f-fcb1-4542-9930-e4cb780935e1 req-c4cbf9f7-511c-40a1-920a-7cfd1699b65b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:18.918068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a731eb1f-fcb1-4542-9930-e4cb780935e1 req-c4cbf9f7-511c-40a1-920a-7cfd1699b65b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:18.918530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a731eb1f-fcb1-4542-9930-e4cb780935e1 req-c4cbf9f7-511c-40a1-920a-7cfd1699b65b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:18.979082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:19.001175 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a731eb1f-fcb1-4542-9930-e4cb780935e1 req-c4cbf9f7-511c-40a1-920a-7cfd1699b65b service nova] Creating event network-vif-plugged:ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae for instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 on n-h1-858383-3 Oct 03 10:45:19.017114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:19.029317 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a731eb1f-fcb1-4542-9930-e4cb780935e1 req-c4cbf9f7-511c-40a1-920a-7cfd1699b65b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175479 Oct 03 10:45:19.030701 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1713/3561] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:19.032279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:19.039030 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c749fcef-9e82-4909-8c31-30da9473b100 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.680812 Oct 03 10:45:19.044398 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1849/3562] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:18 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:19.061617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:19.061617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:19.090953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:19.091646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:19.092527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:19.094450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:19.095355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:19.096114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:19.388267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:19.392950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:19.410557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:19.411862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:19.413429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:19.419487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:19.420521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:19.422167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:19.524328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:19.547370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5c1ca159-a7ce-4b70-b9c0-dad2e153a841 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1277 microversion: 2.1 time: 0.512284 Oct 03 10:45:19.548749 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1714/3563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:19 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1277 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:19.601060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:19.602723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:19.617033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:19.618512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:19.620498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:19.621982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:19.623054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:19.623846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:19.659001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:19.940534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:19.951482 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82b62b02-86f7-48df-a4b6-ace4af70d4cf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.567402 Oct 03 10:45:19.952393 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1850/3564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:19 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:19.959040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c22307f-e4df-4429-8f82-eec0bfc9a70b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e121a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:20.053051 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c22307f-e4df-4429-8f82-eec0bfc9a70b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.097423 Oct 03 10:45:20.055060 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1851/3565] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:19 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:20.092880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:20.095761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:20.103896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:20.104391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:20.105044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:20.105856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:20.106503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:20.107093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:20.292609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:20.313132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:20.318775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:20.322640 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8f68cc9d-e618-4ef8-a693-1cf17d719334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.233505 Oct 03 10:45:20.324888 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1852/3566] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:20 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:20.366987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:20.381148 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2f5c686-1e08-42b1-872f-1b433d523a0f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1472 microversion: 2.1 time: 0.793026 Oct 03 10:45:20.382784 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1715/3567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:19 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1472 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:20.581424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:20.581921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:20.590203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:20.590709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:20.591149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:20.592314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:20.593055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:20.594292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:20.684760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:20.700013 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5fcdb7d-00dd-485b-a0c0-50439719eca5 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1295 microversion: 2.1 time: 0.122484 Oct 03 10:45:20.715079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1853/3568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:20 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1295 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:20.985920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:20.998326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:21.009450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.009957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.010406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.011254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.011740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.012723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.073572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f36dd27a-6a5f-458a-8d70-ca7f2a2fb61c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e232820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:21.189452 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f36dd27a-6a5f-458a-8d70-ca7f2a2fb61c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.122251 Oct 03 10:45:21.191795 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1854/3569] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:21 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:21.207532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f769a19c-670e-4a05-95cb-6ebcab9d3674 req-8398754b-5961-4995-a17c-a53df3bc8c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79c33b6-48e6-4dd6-877d-38df2afdfe84", "name": "network-vif-unplugged", "status": "completed", "tag": "eba7a7b4-aa69-43fa-b3b3-f61e0939458d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:21.219183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f769a19c-670e-4a05-95cb-6ebcab9d3674 req-8398754b-5961-4995-a17c-a53df3bc8c23 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.219664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f769a19c-670e-4a05-95cb-6ebcab9d3674 req-8398754b-5961-4995-a17c-a53df3bc8c23 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.220321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f769a19c-670e-4a05-95cb-6ebcab9d3674 req-8398754b-5961-4995-a17c-a53df3bc8c23 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.237079 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f769a19c-670e-4a05-95cb-6ebcab9d3674 req-8398754b-5961-4995-a17c-a53df3bc8c23 service nova] Creating event network-vif-unplugged:eba7a7b4-aa69-43fa-b3b3-f61e0939458d for instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 on n-h1-858383-3 Oct 03 10:45:21.246783 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f769a19c-670e-4a05-95cb-6ebcab9d3674 req-8398754b-5961-4995-a17c-a53df3bc8c23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044882 Oct 03 10:45:21.247700 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1855/3570] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:21.264870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b718bef6-e325-4e03-a33a-168ead29e8af req-ff235cce-9377-4ccf-8ea6-c5ea08e1ccaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79c33b6-48e6-4dd6-877d-38df2afdfe84", "name": "network-vif-deleted", "tag": "eba7a7b4-aa69-43fa-b3b3-f61e0939458d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:21.277039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b718bef6-e325-4e03-a33a-168ead29e8af req-ff235cce-9377-4ccf-8ea6-c5ea08e1ccaa service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.277531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b718bef6-e325-4e03-a33a-168ead29e8af req-ff235cce-9377-4ccf-8ea6-c5ea08e1ccaa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.278113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b718bef6-e325-4e03-a33a-168ead29e8af req-ff235cce-9377-4ccf-8ea6-c5ea08e1ccaa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.295218 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b718bef6-e325-4e03-a33a-168ead29e8af req-ff235cce-9377-4ccf-8ea6-c5ea08e1ccaa service nova] Creating event network-vif-deleted:eba7a7b4-aa69-43fa-b3b3-f61e0939458d for instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 on n-h1-858383-3 Oct 03 10:45:21.300806 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b718bef6-e325-4e03-a33a-168ead29e8af req-ff235cce-9377-4ccf-8ea6-c5ea08e1ccaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040141 Oct 03 10:45:21.302070 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1856/3571] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:21.355992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:21.362886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:21.383005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:21.398060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.398956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.399432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.405446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.406726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.407776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.610097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:21.623445 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d6d6300-8ee0-4029-b8b9-03cf1ddc5a77 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.650584 Oct 03 10:45:21.626814 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1716/3572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:20 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:21.636148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:21.642143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:21.653792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.654816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.655721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.659383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.659953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.660470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.722325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:21.735362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:21.737064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:21.738301 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc801659-ee54-4c3f-9b85-027c9b16ce28 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.391081 Oct 03 10:45:21.738868 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1857/3573] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:21 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:21.747837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:21.749187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:21.768106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.768604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.769068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.769771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:21.770291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:21.770718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:21.848020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:21.850121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:21.861400 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dd1b2df-6e7e-4880-a74d-0d939e3c0e72 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1430 microversion: 2.1 time: 0.233010 Oct 03 10:45:21.861618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5215c8e7-61e4-4e0a-addd-00a899512909 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1295 microversion: 2.1 time: 0.117305 Oct 03 10:45:21.862212 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1858/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:21 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:21.862836 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1717/3575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:21 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1430 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:22.227918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1c6b595-f695-44b9-be0e-dfb9ad68cf49 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1a4670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:22.330563 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1c6b595-f695-44b9-be0e-dfb9ad68cf49 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.126322 Oct 03 10:45:22.331790 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1859/3576] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:22 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:22.382870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:22.383856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:22.394421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:22.396242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:22.396942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:22.397553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:22.398045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:22.398884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:22.669887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:22.670825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:22.684032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:22.684364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:22.685132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:22.686062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:22.687008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:22.690796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.151096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.173110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.177089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.180606 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-10b3dee9-61bd-413a-acac-e1b9d8fb8335 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2949 microversion: 2.32 time: 0.801983 Oct 03 10:45:23.206880 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1718/3577] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:22 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2949 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:23.218685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:23.220451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:23.230190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.231712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.232614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.233718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.234955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.235612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.351360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.362204 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa6f5ce1-6c28-4f4d-a2a9-57f47721efbc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.699774 Oct 03 10:45:23.363361 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1860/3578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:22 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:23.369540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:23.370492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:23.379450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.380298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.381094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.382036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.382746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.383388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.414237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:23.480691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.493773 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-667d9574-8454-44ac-bef1-288d077b7ee0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1283 microversion: 2.1 time: 0.128518 Oct 03 10:45:23.494791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1861/3579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:23 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1283 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:23.503847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:23.504895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:23.514282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.515142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.515937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.517158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.517939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.518800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.566758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.567438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.567973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.568567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid d79c33b6-48e6-4dd6-877d-38df2afdfe84 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:23.622080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.631870 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02f83d9a-3367-461e-ae3c-c1acb1b2756f tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1306 microversion: 2.1 time: 0.135766 Oct 03 10:45:23.642081 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1862/3580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:23 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1306 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:23.642081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:23.642081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:23.655042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.656645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.657386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.658215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.658905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.659630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.769222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.787525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.806122 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd4a32dc-f2c8-4cb2-aaf5-9a9946957a02 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.171310 Oct 03 10:45:23.809177 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1863/3581] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:45:23 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3/os-interface => generated 1830 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:23.817764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8eb9b69-04ae-47e9-9e1e-624639dcb3e2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1605e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:23.832213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:23.838679 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb6d56aa-2357-4dff-9309-9dba96713f0e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.628454 Oct 03 10:45:23.843154 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1719/3582] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:23 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:23.850579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-397545a1-3872-4013-94b0-ef7e1a7fd17d req-6666dd26-365b-49a6-aefe-a74345aa7836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b826fa5-cc46-4cfb-871e-dbfed29ac0a9", "tag": "7e9029f2-2cad-4600-bb3d-1b3baa6da3df"}, {"name": "network-changed", "server_uuid": "82780639-acbe-4bcb-84dc-35ba1f3c1647", "tag": "8e5f5493-6924-41a5-b19b-c7ac4da657c5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:23.862940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-397545a1-3872-4013-94b0-ef7e1a7fd17d req-6666dd26-365b-49a6-aefe-a74345aa7836 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:23.863800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-397545a1-3872-4013-94b0-ef7e1a7fd17d req-6666dd26-365b-49a6-aefe-a74345aa7836 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:23.869541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-397545a1-3872-4013-94b0-ef7e1a7fd17d req-6666dd26-365b-49a6-aefe-a74345aa7836 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:23.883981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-397545a1-3872-4013-94b0-ef7e1a7fd17d req-6666dd26-365b-49a6-aefe-a74345aa7836 service nova] Creating event network-changed:7e9029f2-2cad-4600-bb3d-1b3baa6da3df for instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 on n-h2-858383-3 Oct 03 10:45:23.885008 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-397545a1-3872-4013-94b0-ef7e1a7fd17d req-6666dd26-365b-49a6-aefe-a74345aa7836 service nova] Creating event network-changed:8e5f5493-6924-41a5-b19b-c7ac4da657c5 for instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 on n-h1-858383-3 Oct 03 10:45:23.891304 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8eb9b69-04ae-47e9-9e1e-624639dcb3e2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.077649 Oct 03 10:45:23.892432 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1864/3583] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:23 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:23.902241 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-397545a1-3872-4013-94b0-ef7e1a7fd17d req-6666dd26-365b-49a6-aefe-a74345aa7836 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056631 Oct 03 10:45:23.902841 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1720/3584] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:24.389275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:24.391125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:24.398845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.399371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.400138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.401187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.401753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.402301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.523144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:24.524200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:24.550787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.552055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.552511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.553312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.558534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.558853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.562183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:24.574620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-906424db-bb64-4531-b228-7e8781240011 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.189628 Oct 03 10:45:24.589174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1865/3585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:24 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:24.659591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:24.660288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:24.667844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.668389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.668872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.670696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.670696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.670696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.707549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.708555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.709048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.709836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid d79c33b6-48e6-4dd6-877d-38df2afdfe84 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:24.736315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:24.762852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:24.763447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:24.772529 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d8f84934-06d7-4a42-8066-4200f9edcfb0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.255333 Oct 03 10:45:24.773179 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1721/3586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:24 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:24.773927 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4ca29d8-e44b-40da-a3a3-bdeb52e3dffd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1306 microversion: 2.1 time: 0.118756 Oct 03 10:45:24.774506 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1866/3587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:24 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1306 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:24.876967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:24.877867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:24.881124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:24.888089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.888580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.889115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.889825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:24.890279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:24.890824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:24.908095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0db5698b-708e-401a-9f8a-6548049c2690 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1a4160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:24.978601 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0db5698b-708e-401a-9f8a-6548049c2690 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.074631 Oct 03 10:45:24.989226 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1867/3588] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:24 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:25.284475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:25.324109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:25.332967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:25.345383 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53a08303-b175-44b1-b7cb-5f9e29f7b39c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.464126 Oct 03 10:45:25.368006 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1722/3589] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:24 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:25.604485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:25.615221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:25.639886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:25.641358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:25.642171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:25.643309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:25.650372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:25.652169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:25.797657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:25.799539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:25.817902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:25.818714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:25.819349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:25.820242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:25.820933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:25.821746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:25.890194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:25.891232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:25.891891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:25.893468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid d79c33b6-48e6-4dd6-877d-38df2afdfe84 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:26.059521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:26.092206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da2a9de9-502d-40d0-ae8b-da5bc7b4f48f tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.493889 Oct 03 10:45:26.096557 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1868/3590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:25 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:26.107461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:26.115985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:26.126499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:26.141476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:26.144606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:26.145463 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f575a76d-b9b9-430c-b207-66913dd7e3ad tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 200 len: 1306 microversion: 2.1 time: 0.352865 Oct 03 10:45:26.145920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:26.146317 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1723/3591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:25 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 1306 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:26.147128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:26.147819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:26.148481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:26.164835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9579772b-d68e-441b-b9bf-8e6165b33d2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e20c430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:26.271456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:26.395864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:26.407722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8730b394-2d70-4377-94b9-0077584c4370 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.308718 Oct 03 10:45:26.439143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1869/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:26 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:26.456972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-aa8efc90-917e-4288-bb9f-90e514ebd1c7 req-23be936f-dd4a-4f4d-9df9-ab1c257f11bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b79f8c7-aa92-4765-a563-5d9ca75918fc", "tag": "1112c4b6-4f49-4e3c-a31d-5ff6f906d579"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:26.485218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa8efc90-917e-4288-bb9f-90e514ebd1c7 req-23be936f-dd4a-4f4d-9df9-ab1c257f11bc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:26.488684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa8efc90-917e-4288-bb9f-90e514ebd1c7 req-23be936f-dd4a-4f4d-9df9-ab1c257f11bc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:26.491160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa8efc90-917e-4288-bb9f-90e514ebd1c7 req-23be936f-dd4a-4f4d-9df9-ab1c257f11bc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:26.499505 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9579772b-d68e-441b-b9bf-8e6165b33d2b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.351969 Oct 03 10:45:26.500800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1724/3593] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:26 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:26.516263 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-aa8efc90-917e-4288-bb9f-90e514ebd1c7 req-23be936f-dd4a-4f4d-9df9-ab1c257f11bc service nova] Creating event network-changed:1112c4b6-4f49-4e3c-a31d-5ff6f906d579 for instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc on n-h2-858383-3 Oct 03 10:45:26.517098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:26.517718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:26.527424 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-aa8efc90-917e-4288-bb9f-90e514ebd1c7 req-23be936f-dd4a-4f4d-9df9-ab1c257f11bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085784 Oct 03 10:45:26.529574 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1870/3594] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:26.541117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:26.541242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:26.541710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:26.543532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:26.544205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:26.546255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.129118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:27.144512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:27.186468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.190133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.195203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.199946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.203366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.204032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.296234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:27.333567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:27.346706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:27.349905 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a0d61a6-ec29-4396-9686-176d2f292608 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.847534 Oct 03 10:45:27.360093 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1725/3595] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:26 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:27.372449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:27.376061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: d79c33b6-48e6-4dd6-877d-38df2afdfe84] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:27.391806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.394298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.396065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.398185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.398824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.399539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.420978 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 could not be found. Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 HTTP/1.1 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 could not be found. Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'd79c33b6-48e6-4dd6-877d-38df2afdfe84'} Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 could not be found. Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 could not be found. Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:27.425079 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:27.436691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:27.436691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:27.436691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:27.436691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:27.436691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:27.436691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 could not be found. Oct 03 10:45:27.436691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:27.441226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance d79c33b6-48e6-4dd6-877d-38df2afdfe84 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:27.441778 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e87218ea-d3ba-4bd7-bbc9-698497916c46 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84" status: 404 len: 111 microversion: 2.1 time: 0.076104 Oct 03 10:45:27.456974 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1726/3596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:27 2022] GET /compute/v2.1/servers/d79c33b6-48e6-4dd6-877d-38df2afdfe84 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:27.486561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:27.487583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:27.501289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.509605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.510360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.511125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.511597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.512126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.663081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:27.678733 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80df5d44-34fb-497f-b024-29ecedc6e5b2 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.560591 Oct 03 10:45:27.680383 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1871/3597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:27 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:27.687204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:27.688002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:27.694654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.696418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.696892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.697617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.698122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.698544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.729463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:27.833587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:27.843178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5aa2e7ba-a30e-4384-b022-76b07b652d58 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.384686 Oct 03 10:45:27.844972 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1727/3598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:27 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:27.849993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab574220-977b-4d11-8cd3-d25800a8dc9d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074fc88b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:27.911329 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab574220-977b-4d11-8cd3-d25800a8dc9d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.064910 Oct 03 10:45:27.912191 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1728/3599] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:27 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:27.915701 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-921b804d-cbfa-4e4a-baef-193b15d8889b tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 204 len: 0 microversion: 2.1 time: 0.233609 Oct 03 10:45:27.916797 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1872/3600] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:27 2022] DELETE /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:27.928306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:27.929809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:27.938172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.939359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.940318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.941549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:27.942602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:27.943110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:27.975974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:28.106466 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12a5de52-97d5-4b2c-93d1-b6067ed047ab tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 204 len: 0 microversion: 2.1 time: 0.183588 Oct 03 10:45:28.107071 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1729/3601] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:27 2022] DELETE /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:28.116279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:28.117068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:28.125842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.126869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.127877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.131711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.131711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.131711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.301513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:28.310294 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f6a7a254-9d9d-4d2f-a524-f04937541119 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 200 len: 1474 microversion: 2.1 time: 0.198637 Oct 03 10:45:28.311510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1873/3602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:28 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 1474 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:28.391061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:28.392436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:28.399398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.399891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.400331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.401208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.401673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.402100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.571682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e948b9f0-5a55-4b96-97d0-e065134b3294 req-760c70b9-9b0a-4193-955b-f8086a7bea9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220aafa1-b139-49a8-9307-2ad2fcadf805", "tag": "498c686c-14e3-44f7-8dac-4b8162507b57"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:28.584079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e948b9f0-5a55-4b96-97d0-e065134b3294 req-760c70b9-9b0a-4193-955b-f8086a7bea9f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.584750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e948b9f0-5a55-4b96-97d0-e065134b3294 req-760c70b9-9b0a-4193-955b-f8086a7bea9f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.585363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e948b9f0-5a55-4b96-97d0-e065134b3294 req-760c70b9-9b0a-4193-955b-f8086a7bea9f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.599100 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e948b9f0-5a55-4b96-97d0-e065134b3294 req-760c70b9-9b0a-4193-955b-f8086a7bea9f service nova] Creating event network-changed:498c686c-14e3-44f7-8dac-4b8162507b57 for instance 220aafa1-b139-49a8-9307-2ad2fcadf805 on n-h1-858383-3 Oct 03 10:45:28.604501 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e948b9f0-5a55-4b96-97d0-e065134b3294 req-760c70b9-9b0a-4193-955b-f8086a7bea9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037081 Oct 03 10:45:28.605655 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1874/3603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:28.639804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:28.649000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:28.650461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:28.651644 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e81d0a42-d72d-4414-a038-be59e40ec06c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.265688 Oct 03 10:45:28.668750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1730/3604] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:28 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:28.708018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:28.709086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:28.715810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.716619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.718201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.721007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.722520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.723586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.880008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:28.880627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:28.897913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.898410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.898850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.899572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:28.900031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:28.911785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:28.915368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:28.927981 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9cf37b27-5115-4c89-99c1-33c6f91cbade tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.229414 Oct 03 10:45:28.929448 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1875/3605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:28 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:28.936885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e480332-ffe7-438c-8e71-2a6922d7c485 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e19f5e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:29.012994 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e480332-ffe7-438c-8e71-2a6922d7c485 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.082082 Oct 03 10:45:29.015230 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1876/3606] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:28 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:29.035036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-026c7475-423f-4d96-a84f-3e28bfb2b610 req-edba1be1-4307-45cc-b3f7-9751488c85cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b826fa5-cc46-4cfb-871e-dbfed29ac0a9", "name": "network-vif-plugged", "status": "completed", "tag": "7e9029f2-2cad-4600-bb3d-1b3baa6da3df"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:29.049838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-026c7475-423f-4d96-a84f-3e28bfb2b610 req-edba1be1-4307-45cc-b3f7-9751488c85cf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:29.050606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-026c7475-423f-4d96-a84f-3e28bfb2b610 req-edba1be1-4307-45cc-b3f7-9751488c85cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:29.051142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-026c7475-423f-4d96-a84f-3e28bfb2b610 req-edba1be1-4307-45cc-b3f7-9751488c85cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:29.067177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-026c7475-423f-4d96-a84f-3e28bfb2b610 req-edba1be1-4307-45cc-b3f7-9751488c85cf service nova] Creating event network-vif-plugged:7e9029f2-2cad-4600-bb3d-1b3baa6da3df for instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 on n-h2-858383-3 Oct 03 10:45:29.073179 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-026c7475-423f-4d96-a84f-3e28bfb2b610 req-edba1be1-4307-45cc-b3f7-9751488c85cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043278 Oct 03 10:45:29.074222 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1877/3607] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:29.213767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:29.226240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d4d8029-efcb-4677-98aa-06f3bf5858b3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.359041 Oct 03 10:45:29.227721 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1731/3608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:28 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:29.345586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:29.346482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:29.353037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:29.353930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:29.354745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:29.356007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:29.356760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:29.357311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:29.638832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:29.666293 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc03648c-69ed-45c7-ada3-412e5d4a40ca tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 200 len: 1474 microversion: 2.1 time: 0.329131 Oct 03 10:45:29.667488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1878/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:29 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:29.705997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:29.707737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:29.718504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:29.719674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:29.720311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:29.721359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:29.721797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:29.722751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:29.963105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:29.964234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:29.987664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:29.988163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:29.988599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:29.997580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:29.998068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:29.998506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:30.170686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:30.181077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:30.183203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:30.184964 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13f854f6-4e4f-48db-8304-a1c0769576e6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.487951 Oct 03 10:45:30.186179 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1732/3610] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:29 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:30.192195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fa666dd-0eda-43f2-903b-ad893aab11b2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1eb040>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:30.249449 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3fa666dd-0eda-43f2-903b-ad893aab11b2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.058368 Oct 03 10:45:30.250293 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1733/3611] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:30 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:30.264757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:30.265558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:30.273608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:30.274449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:30.275491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:30.276295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:30.276873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:30.277382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:30.284554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:30.339671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:30.351503 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a68b3eef-9c83-4617-a490-c89bdb47a5f7 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.392768 Oct 03 10:45:30.355471 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1879/3612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:29 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:30.527470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:30.551164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df0be7d6-3e58-46f0-a748-9223a577fcc4 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.290946 Oct 03 10:45:30.552239 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1734/3613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:30 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:30.689018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a539462f-8811-46ce-96d6-d53b0b929292 req-ad7ab5cb-d161-4701-9559-c6a313e953e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523b4e6e-c8ab-449f-93e0-f365ddeaf011", "name": "network-vif-deleted", "tag": "47f4d3d0-9fcb-4d2b-8dd3-cc2ec22907c1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:30.703859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:30.704478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:30.713168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a539462f-8811-46ce-96d6-d53b0b929292 req-ad7ab5cb-d161-4701-9559-c6a313e953e6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:30.713651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a539462f-8811-46ce-96d6-d53b0b929292 req-ad7ab5cb-d161-4701-9559-c6a313e953e6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:30.714080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a539462f-8811-46ce-96d6-d53b0b929292 req-ad7ab5cb-d161-4701-9559-c6a313e953e6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:30.722285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:30.722285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:30.722988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:30.723693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:30.723814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:30.725600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:30.730811 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a539462f-8811-46ce-96d6-d53b0b929292 req-ad7ab5cb-d161-4701-9559-c6a313e953e6 service nova] Creating event network-vif-deleted:47f4d3d0-9fcb-4d2b-8dd3-cc2ec22907c1 for instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 on n-h2-858383-3 Oct 03 10:45:30.736085 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a539462f-8811-46ce-96d6-d53b0b929292 req-ad7ab5cb-d161-4701-9559-c6a313e953e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050802 Oct 03 10:45:30.744138 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1880/3614] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:30.798325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:30.807073 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2c0adee-30a8-4753-af9a-9f63835daeb5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 200 len: 1432 microversion: 2.1 time: 0.109190 Oct 03 10:45:30.807977 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1735/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:30 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 1432 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:31.212415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:31.213142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:31.227435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.230255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.231708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.235170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.240465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.244253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.267194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a4be96e-593c-4c63-8db4-ed52899c113b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1b9ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:31.349011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:31.353732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a4be96e-593c-4c63-8db4-ed52899c113b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.091056 Oct 03 10:45:31.354408 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1736/3616] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:31 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:31.377175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:31.378410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:31.390758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.391836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.392500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.395158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.395863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.396532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.576648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:31.602359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:31.610516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:31.616622 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2b047ce-c6eb-4c85-947a-94bdced127a5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.408742 Oct 03 10:45:31.617476 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1881/3617] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:31 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:31.626926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:31.629582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:31.639382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:31.646648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.647141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.647579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.648278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.651068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.651503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.651759 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0009b617-80b4-447a-8130-932441133d23 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.278533 Oct 03 10:45:31.667779 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1737/3618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:31 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:31.837440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:31.853169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82a0f2f9-e696-4962-a13e-a21148ce1ed9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.233568 Oct 03 10:45:31.854385 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1882/3619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:31 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:31.856158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:31.857398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:31.866928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.867432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.867875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.868637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.869096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.869537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.920849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:31.921339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:31.922349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:31.922903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid 523b4e6e-c8ab-449f-93e0-f365ddeaf011 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:31.990470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:32.016352 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c5fb5772-56cc-4473-9268-5b86521539df tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 200 len: 1308 microversion: 2.1 time: 0.187043 Oct 03 10:45:32.017910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1738/3620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:31 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:32.373335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-690d3a2c-374b-4c78-b0aa-8365c3ea0b58 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1ab550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:32.464178 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-690d3a2c-374b-4c78-b0aa-8365c3ea0b58 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.097160 Oct 03 10:45:32.465961 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1883/3621] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:32 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:32.537467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:32.540545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:32.548275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:32.549127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:32.550408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:32.551354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:32.552091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:32.552879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:32.600551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'flavor' on Instance uuid 3b71dd5c-ef34-4807-90a2-7c03aec69537 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:32.647112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:32.648354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:32.670234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:32.671894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:32.673549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:32.677293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:32.680642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:32.681918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:32.982456 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc236037-c370-41ec-a313-591f395621de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/action" status: 200 len: 32 microversion: 2.1 time: 0.449566 Oct 03 10:45:33.004507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:33.006037 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1739/3622] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:45:32 2022] POST /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/action => generated 32 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:45:33.020375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:33.029730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:33.037502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:33.047176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.047572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:33.047756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.048193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.048960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.049419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.049847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.051052 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b72de3d-8839-46f1-99a2-39aeb83638db tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.411100 Oct 03 10:45:33.060072 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1884/3623] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:32 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:33.088418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:33.090106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:33.111688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.112187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.113644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.115310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.116186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.116905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.467317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:33.483177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dff9768f-eedf-4f09-9d30-fdd291257877 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.421513 Oct 03 10:45:33.484924 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1885/3624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:33 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:33.489914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:33.490595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:33.506636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.507296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.507848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.508692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.509394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.509902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.894248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:33.906917 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f02cd92-a6dd-4b8a-9fa9-ca6559bb025c tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.898267 Oct 03 10:45:33.909326 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1740/3625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:33 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:33.933612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:33.934522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 523b4e6e-c8ab-449f-93e0-f365ddeaf011] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:33.942253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.942749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.943198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.943917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:33.944378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:33.944974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:33.965451 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 could not be found. Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 HTTP/1.1 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 could not be found. Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '523b4e6e-c8ab-449f-93e0-f365ddeaf011'} Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 could not be found. Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 could not be found. Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:33.968575 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 could not be found. Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance 523b4e6e-c8ab-449f-93e0-f365ddeaf011 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-562c3807-784e-425d-aabb-ac4b789440cd tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011" status: 404 len: 111 microversion: 2.1 time: 0.043170 Oct 03 10:45:33.974347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1741/3626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:33 2022] GET /compute/v2.1/servers/523b4e6e-c8ab-449f-93e0-f365ddeaf011 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:33.982595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-45f79108-312f-4c13-88b4-d359ecbd569b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1b9700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:34.002902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:34.026450 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f25c4806-ef9e-4e90-bdb6-93e72b0b778d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.539648 Oct 03 10:45:34.033801 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1886/3627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:33 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:34.042089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:34.046998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:34.063652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.066957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.070965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.072788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.075281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.080199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.084402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-45f79108-312f-4c13-88b4-d359ecbd569b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.109272 Oct 03 10:45:34.085033 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1742/3628] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:33 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:34.095786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:34.096411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:34.112236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.112743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.118410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.119451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.120101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.121032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.462094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:34.471926 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8e6bd68c-3551-446e-98ca-e45186c22f4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1474 microversion: 2.1 time: 0.434880 Oct 03 10:45:34.472866 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1887/3629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:34 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:34.485391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e78294a1-2951-42a6-b928-4aafb3192720 req-45207a21-f816-4930-b385-6627d171a8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b79f8c7-aa92-4765-a563-5d9ca75918fc", "name": "network-vif-plugged", "status": "completed", "tag": "1112c4b6-4f49-4e3c-a31d-5ff6f906d579"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:34.497807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e78294a1-2951-42a6-b928-4aafb3192720 req-45207a21-f816-4930-b385-6627d171a8cf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.498338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e78294a1-2951-42a6-b928-4aafb3192720 req-45207a21-f816-4930-b385-6627d171a8cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.498874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e78294a1-2951-42a6-b928-4aafb3192720 req-45207a21-f816-4930-b385-6627d171a8cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.518645 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e78294a1-2951-42a6-b928-4aafb3192720 req-45207a21-f816-4930-b385-6627d171a8cf service nova] Creating event network-vif-plugged:1112c4b6-4f49-4e3c-a31d-5ff6f906d579 for instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc on n-h2-858383-3 Oct 03 10:45:34.525467 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e78294a1-2951-42a6-b928-4aafb3192720 req-45207a21-f816-4930-b385-6627d171a8cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050839 Oct 03 10:45:34.526414 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1888/3630] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:34.532569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:34.533678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:34.544845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.545949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.547406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.548150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.548618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.549082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.897643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:34.909437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:34.911767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:34.913371 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5b1cff9f-6fb3-4f95-87da-f61cb344a3a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.827396 Oct 03 10:45:34.914765 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1743/3631] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:34 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:34.938723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:34.939669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:34.946519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.947524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.948278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:34.949856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:34.950961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:34.951973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:35.185344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:35.207214 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-862572b5-6afe-4419-95f9-6b55bebd1f89 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.679143 Oct 03 10:45:35.208797 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1889/3632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:34 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:35.217332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:35.220148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:35.260486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:35.262321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:35.263947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:35.267032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:35.268166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:35.269912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:35.614522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:35.614522 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0fa35904-7017-49f9-83bf-69fc046852e6 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.640686 Oct 03 10:45:35.614522 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1744/3633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:34 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:35.614522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9075abf-b9aa-429e-b131-d96296a9cc2f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e20c1f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:35.617535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:35.622954 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5b4cd05-804a-493a-89de-90fe8909a885 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.410399 Oct 03 10:45:35.645245 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1890/3634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:35 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:35.653619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:35.654929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:35.679016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:35.679867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:35.681942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:35.682881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:35.683570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:35.684162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:35.699132 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9075abf-b9aa-429e-b131-d96296a9cc2f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.122287 Oct 03 10:45:35.706279 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1745/3635] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:35 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:35.801481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c1dfc9d7-0ea5-42f4-b32f-c03674b39611 req-601f1f86-2717-4afa-82ed-8e85cac0093e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff887894-ecab-428b-b626-90b9642b09fc", "name": "network-vif-deleted", "tag": "e0ad5a7d-5d3b-46e2-97d3-d4ed81f0fb64"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:35.830644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c1dfc9d7-0ea5-42f4-b32f-c03674b39611 req-601f1f86-2717-4afa-82ed-8e85cac0093e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:35.831314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c1dfc9d7-0ea5-42f4-b32f-c03674b39611 req-601f1f86-2717-4afa-82ed-8e85cac0093e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:35.831884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c1dfc9d7-0ea5-42f4-b32f-c03674b39611 req-601f1f86-2717-4afa-82ed-8e85cac0093e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:35.853096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:35.853373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c1dfc9d7-0ea5-42f4-b32f-c03674b39611 req-601f1f86-2717-4afa-82ed-8e85cac0093e service nova] Creating event network-vif-deleted:e0ad5a7d-5d3b-46e2-97d3-d4ed81f0fb64 for instance ff887894-ecab-428b-b626-90b9642b09fc on n-h1-858383-3 Oct 03 10:45:35.862027 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c1dfc9d7-0ea5-42f4-b32f-c03674b39611 req-601f1f86-2717-4afa-82ed-8e85cac0093e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068794 Oct 03 10:45:35.867626 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1746/3636] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:35.867836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-92c74860-e8e4-4b1b-879d-c6f31a92a429 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1432 microversion: 2.1 time: 0.220267 Oct 03 10:45:35.868893 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1891/3637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:35 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1432 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:35.960252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:35.962326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:35.976590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:35.980108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:35.980883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:35.984529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:35.985225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:35.985884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.256162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:36.257104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:36.271517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:36.272026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:36.272496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.274339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:36.275314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:36.276308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.526480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:36.541771 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a37ed6b-bf49-4f88-a78f-1bc4298be6a9 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.292038 Oct 03 10:45:36.542848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1892/3638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:36 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:36.585994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9643bc10-a494-4ab5-84cc-34f728647fba req-fab44eef-0e87-4d25-aa0f-614d25ebe55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82780639-acbe-4bcb-84dc-35ba1f3c1647", "name": "network-vif-plugged", "status": "completed", "tag": "8e5f5493-6924-41a5-b19b-c7ac4da657c5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:36.606056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9643bc10-a494-4ab5-84cc-34f728647fba req-fab44eef-0e87-4d25-aa0f-614d25ebe55d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:36.606725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9643bc10-a494-4ab5-84cc-34f728647fba req-fab44eef-0e87-4d25-aa0f-614d25ebe55d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:36.610494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9643bc10-a494-4ab5-84cc-34f728647fba req-fab44eef-0e87-4d25-aa0f-614d25ebe55d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.615349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:36.626882 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9643bc10-a494-4ab5-84cc-34f728647fba req-fab44eef-0e87-4d25-aa0f-614d25ebe55d service nova] Creating event network-vif-plugged:8e5f5493-6924-41a5-b19b-c7ac4da657c5 for instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 on n-h1-858383-3 Oct 03 10:45:36.634241 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9643bc10-a494-4ab5-84cc-34f728647fba req-fab44eef-0e87-4d25-aa0f-614d25ebe55d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053604 Oct 03 10:45:36.635490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1893/3639] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:36.641576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:36.644742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:36.646080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:36.646957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:36.647705 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-30fc4fac-e5c0-4e46-ac75-c61038fc078e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.702700 Oct 03 10:45:36.655414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:36.656820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:36.657437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.658315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:36.659090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:36.659712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.661433 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1747/3640] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:35 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:36.689563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:36.693935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:36.705866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:36.706877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:36.707896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.709417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:36.715123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:36.718451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:36.903611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:36.919875 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9fdc4d96-f27f-454f-bc51-05e4701eb01b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1322 microversion: 2.1 time: 0.279619 Oct 03 10:45:36.922585 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1894/3641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:36 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:36.931243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71e05697-2f8e-4d5a-b491-0ddc53a8fb24 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e2329d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:37.016618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-71e05697-2f8e-4d5a-b491-0ddc53a8fb24 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.092026 Oct 03 10:45:37.029583 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1895/3642] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:36 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:37.032479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:37.033640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:37.044024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.045065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.046203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:37.048091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.048980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.049799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:37.077316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:37.094242 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4a6565d-d26e-4481-a245-fb41df28e2d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.430020 Oct 03 10:45:37.095601 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1748/3643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:36 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:37.162046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:37.176422 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4fcf911-5d98-466a-9ad9-3235b68a5afc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1432 microversion: 2.1 time: 0.150363 Oct 03 10:45:37.177808 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1896/3644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:37 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1432 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:37.568032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:37.568743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:37.583605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.584652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.585791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:37.589433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.590191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.591728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:37.705796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:37.706849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:37.718529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.719173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.719694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:37.720431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.721360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.721721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:37.817987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:37.838207 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26c1bbbb-cfa6-4a4a-ad3d-721cf3aae59c tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.274557 Oct 03 10:45:37.839483 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1749/3645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:37 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:37.919117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:37.934244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:37.935965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:37.938935 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-87dd74b3-96da-45dc-9400-55b9d7e06ff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.239271 Oct 03 10:45:37.949386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:37.952153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:37.958897 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1897/3646] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:37 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:37.980054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.982816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.983677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:37.985718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:37.986838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:37.987754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.047745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9123ce6e-7d85-4159-80f6-352123588a4d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e17e280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:38.129830 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9123ce6e-7d85-4159-80f6-352123588a4d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.090545 Oct 03 10:45:38.130842 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1898/3647] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:38 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:38.148819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:38.149731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:38.158780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.159464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.160002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.160857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.161540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.162075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.286541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:38.304266 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-291c374b-66f0-4440-8fd1-683e2a945c49 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 200 len: 1516 microversion: 2.1 time: 0.362996 Oct 03 10:45:38.304909 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1750/3648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:37 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:38.310840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:38.311662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:38.320118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.320855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.321537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.322481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.323181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.323794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.407755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.409618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.410946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.411899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid ff887894-ecab-428b-b626-90b9642b09fc {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:38.472331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:38.482583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:38.488617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c9d4da2f-fa61-4f61-9a21-be98b1c98581 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.344285 Oct 03 10:45:38.494468 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1899/3649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:38 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:38.498820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:38.502435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:38.509232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.509456 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8b5ccb9f-863e-486b-9302-82b79ac4c777 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1308 microversion: 2.1 time: 0.202856 Oct 03 10:45:38.509953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.528550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.528550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.528550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.528550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.529258 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1751/3650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:38 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:38.731009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:38.741620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-613b5fe9-95c7-46e2-beda-1035250534a5 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1322 microversion: 2.1 time: 0.247389 Oct 03 10:45:38.744311 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1900/3651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:38 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:38.882620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:38.886742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:38.905480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.906431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.908494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.910471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.912488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.913258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.936529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:38.972122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:38.972122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:38.984883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.985509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.986059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:38.988141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:38.989854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:38.991241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.188797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:39.201924 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d876573a-00f3-4464-8340-57178911f0d0 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.324360 Oct 03 10:45:39.203747 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1752/3652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:38 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:39.211342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b1f7e7ba-0fb0-4164-9df3-057f4d964a11 req-9e4063fe-333b-432f-99b7-1a5cc5236ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "name": "network-vif-plugged", "status": "completed", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:39.228382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b1f7e7ba-0fb0-4164-9df3-057f4d964a11 req-9e4063fe-333b-432f-99b7-1a5cc5236ef1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.229523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b1f7e7ba-0fb0-4164-9df3-057f4d964a11 req-9e4063fe-333b-432f-99b7-1a5cc5236ef1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.230578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b1f7e7ba-0fb0-4164-9df3-057f4d964a11 req-9e4063fe-333b-432f-99b7-1a5cc5236ef1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.241302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:39.250422 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b1f7e7ba-0fb0-4164-9df3-057f4d964a11 req-9e4063fe-333b-432f-99b7-1a5cc5236ef1 service nova] Creating event network-vif-plugged:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:45:39.252822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:39.254577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:39.256179 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e8f88c5-7f29-4a80-bd68-f734cd0bad50 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.292128 Oct 03 10:45:39.259165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1901/3653] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:38 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:39.260008 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b1f7e7ba-0fb0-4164-9df3-057f4d964a11 req-9e4063fe-333b-432f-99b7-1a5cc5236ef1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052855 Oct 03 10:45:39.264946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec9eb761-fc72-4206-be94-f5120dde78d9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1604c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:39.270237 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1753/3654] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:39.318863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec9eb761-fc72-4206-be94-f5120dde78d9 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.058434 Oct 03 10:45:39.320035 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1902/3655] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:39 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:39.547353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:39.548167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:39.564337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:39.565901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:39.567746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.579894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.580706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.581538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.582720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.583496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.584250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.593472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.598401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.598401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.598950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.601661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.645413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:39.689355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.689874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.690802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.691606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid ff887894-ecab-428b-b626-90b9642b09fc {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:39.773134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:39.785373 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b7985cd-e382-4877-88d2-dc0860df082e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 200 len: 1308 microversion: 2.1 time: 0.225421 Oct 03 10:45:39.785373 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1903/3656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:39 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:39.789112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:39.793036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:39.798630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.799137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.799594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.800810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:39.800810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:39.801182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:39.955796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:39.971365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e152e2c7-c7e4-4b68-80cd-418c9faf213b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.453022 Oct 03 10:45:39.991245 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1754/3657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:39 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:40.045127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:40.064322 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8e82d7fb-9082-40f6-b518-5383f3aec8aa tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1322 microversion: 2.1 time: 0.279720 Oct 03 10:45:40.081946 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1904/3658] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:39 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:40.228422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:40.229250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:40.242929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.243736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.244438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:40.245415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.246332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.247359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:40.293007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:40.293538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:40.304579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.307334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.307872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:40.308609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.309976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.310434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:40.594711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:40.599641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:40.605609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:40.606599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:40.608016 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e41207a9-1e11-44c5-9a6e-f0d2d037e025 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.319737 Oct 03 10:45:40.608979 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1905/3659] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:40 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:40.613742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b2ea2b95-77f4-4d06-98a7-c77599c7d246 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e25f940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:40.643660 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9aea5f29-c196-42d0-adef-04829b20d380 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.401231 Oct 03 10:45:40.645665 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1755/3660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:40 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:40.664331 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b2ea2b95-77f4-4d06-98a7-c77599c7d246 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1437 microversion: 2.1 time: 0.054018 Oct 03 10:45:40.665079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1906/3661] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:40 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1437 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:40.824829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:40.825356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: ff887894-ecab-428b-b626-90b9642b09fc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:40.832413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.832937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.833383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:40.834088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.834543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.834967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:40.857993 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance ff887894-ecab-428b-b626-90b9642b09fc could not be found. Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc HTTP/1.1 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ff887894-ecab-428b-b626-90b9642b09fc could not be found. Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ff887894-ecab-428b-b626-90b9642b09fc'} Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff887894-ecab-428b-b626-90b9642b09fc could not be found. Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff887894-ecab-428b-b626-90b9642b09fc could not be found. Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:40.859675 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff887894-ecab-428b-b626-90b9642b09fc could not be found. Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance ff887894-ecab-428b-b626-90b9642b09fc could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-838b4afb-2570-4bb3-826d-70db16004476 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc" status: 404 len: 111 microversion: 2.1 time: 0.040558 Oct 03 10:45:40.864624 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1756/3662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:40 2022] GET /compute/v2.1/servers/ff887894-ecab-428b-b626-90b9642b09fc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:40.879461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1557fd8c-2d3e-430a-a1b1-3e78a5dc5fa5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:40.914109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:40.925724 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1557fd8c-2d3e-430a-a1b1-3e78a5dc5fa5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/a98ab6c6-9894-424b-bd26-70ff2e9d2f93" status: 204 len: 0 microversion: 2.1 time: 0.057551 Oct 03 10:45:40.926857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1907/3663] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 10:45:40 2022] DELETE /compute/v2.1/os-server-groups/a98ab6c6-9894-424b-bd26-70ff2e9d2f93 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:40.939179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:40.940066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:40.952096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.953603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.954408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:40.955641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:40.956452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:40.957232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.003972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.004997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.012027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.012204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:41.012888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.013686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.014736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.015396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.015996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.115254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:41.135463 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed5860a5-5e27-4e7a-89b3-91cf0c91d167 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 204 len: 0 microversion: 2.1 time: 0.203497 Oct 03 10:45:41.139964 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1757/3664] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:40 2022] DELETE /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:41.144206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.145007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.151696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.152403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.153054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.153962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.154605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.155209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.224550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.233587 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26cf51c0-395c-4bc5-9e55-6c80e26884f7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.237611 Oct 03 10:45:41.234215 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1908/3665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:40 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:41.238725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.239229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.245612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.246411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.247089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.248015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.248693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.249430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.281947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:41.366675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.376473 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-acebaff6-af28-4f09-a03d-062f9547ea63 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1515 microversion: 2.1 time: 0.239129 Oct 03 10:45:41.377115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1758/3666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:41.382820 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-451b9949-6e7f-4d69-ae3d-8ea1916f4d98 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 204 len: 0 microversion: 2.1 time: 0.147212 Oct 03 10:45:41.383595 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1909/3667] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:41 2022] DELETE /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:41.392910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.393747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.399941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.400649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.401052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.401574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.402011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.402864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.403333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.403769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.407934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.409784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.409784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.409784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.410123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.410480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.575489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.588141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.589937 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f444a448-de85-4faa-8f2d-37a16039784a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 200 len: 1515 microversion: 2.1 time: 0.189564 Oct 03 10:45:41.592956 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1910/3668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:41.600096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6ea8ff99-50bc-42d6-834c-ca710367cc36 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1474 microversion: 2.1 time: 0.211803 Oct 03 10:45:41.601340 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1759/3669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1474 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:41.616187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.616645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.623298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.623751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.624183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.625467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.625922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.626338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.653469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:41.663626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.665227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.675179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.675849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.676596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.677791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.678515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.679203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.738625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-181d5b63-30b9-4b13-96e9-6939022c7877 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 204 len: 0 microversion: 2.1 time: 0.126674 Oct 03 10:45:41.745078 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1911/3670] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:41 2022] DELETE /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:41.746693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.748253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.760248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.760749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.761239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.761952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.762412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.762841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.854947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.870410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.872728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.875248 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19d6f32c-48d9-485f-8269-3be4711b6cdf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.217909 Oct 03 10:45:41.875732 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1760/3671] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:41.880265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8949bf51-9c1f-4dae-9edf-ac8755a517e1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1b99d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.934572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:41.938654 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8949bf51-9c1f-4dae-9edf-ac8755a517e1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1446 microversion: 2.1 time: 0.060595 Oct 03 10:45:41.939634 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1761/3672] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1446 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:41.943570 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc36003e-fd68-4da5-8252-5ab610911a7e tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.202603 Oct 03 10:45:41.944931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:41.945550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:41.953193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.953674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.954110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.955085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:41.955370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:41.955833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:41.961145 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1912/3673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:41.966198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f584c9b7-48e0-407d-929d-08ca289836db tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e17eee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:42.013861 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f584c9b7-48e0-407d-929d-08ca289836db tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 200 len: 1446 microversion: 2.1 time: 0.051589 Oct 03 10:45:42.014446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1913/3674] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 1446 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:42.030620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d3a7a40-112a-42bf-b2d8-c63d78f2f520 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e23d310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:42.119391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:42.128461 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c08e2825-9ccb-4e49-8b2e-b8b16e22da69 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 200 len: 1521 microversion: 2.1 time: 0.186776 Oct 03 10:45:42.128461 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1762/3675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:41 2022] GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:42.264700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:42.265469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:42.271767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.272289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.272793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.273506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.273964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.274395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.463912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:42.477232 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81a4e957-c3f2-43f4-b050-3c7c143c5c36 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.216396 Oct 03 10:45:42.479663 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1763/3676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:42 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:42.522233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5cd8fb34-19c9-4b8a-9e87-758b8a4e3db9 req-4e5458e2-56ab-4e65-aad5-82055c0926ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220aafa1-b139-49a8-9307-2ad2fcadf805", "name": "network-vif-plugged", "status": "completed", "tag": "498c686c-14e3-44f7-8dac-4b8162507b57"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:42.536325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5cd8fb34-19c9-4b8a-9e87-758b8a4e3db9 req-4e5458e2-56ab-4e65-aad5-82055c0926ca service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.537264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5cd8fb34-19c9-4b8a-9e87-758b8a4e3db9 req-4e5458e2-56ab-4e65-aad5-82055c0926ca service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.537996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5cd8fb34-19c9-4b8a-9e87-758b8a4e3db9 req-4e5458e2-56ab-4e65-aad5-82055c0926ca service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.553242 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5cd8fb34-19c9-4b8a-9e87-758b8a4e3db9 req-4e5458e2-56ab-4e65-aad5-82055c0926ca service nova] Creating event network-vif-plugged:498c686c-14e3-44f7-8dac-4b8162507b57 for instance 220aafa1-b139-49a8-9307-2ad2fcadf805 on n-h1-858383-3 Oct 03 10:45:42.558663 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5cd8fb34-19c9-4b8a-9e87-758b8a4e3db9 req-4e5458e2-56ab-4e65-aad5-82055c0926ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046759 Oct 03 10:45:42.559544 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1764/3677] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:42.591125 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d3a7a40-112a-42bf-b2d8-c63d78f2f520 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 204 len: 0 microversion: 2.1 time: 0.564271 Oct 03 10:45:42.591984 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1914/3678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:42 2022] DELETE /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:45:42.603798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:42.605249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:42.612588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.613114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.613542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.614230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.614679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.615100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.627584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:42.628202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:42.634838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.635234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.635678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.636380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.636868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.637300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.650325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:42.757986 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7868dc1-4ac0-41db-8692-f38f43566da2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 204 len: 0 microversion: 2.1 time: 0.157959 Oct 03 10:45:42.759093 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1765/3679] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:42 2022] DELETE /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:42.806805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:42.815696 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e5f6ee37-712a-483d-ac88-b2bf3d735f9e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1474 microversion: 2.1 time: 0.192078 Oct 03 10:45:42.816259 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1915/3680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:42 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1474 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:42.879590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-840473308", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "154cf415-1c40-42a9-bfa5-99c4a7b477bb"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:42.911209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:42.911898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:42.919239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.919823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.920458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.921934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:42.922464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:42.923837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:42.947239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] validate_networks() for [('154cf415-1c40-42a9-bfa5-99c4a7b477bb', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:45:43.087608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:43.097459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:43.098931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:43.100129 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a341a0e-22ea-4f48-b38a-dd8dfda6cd60 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.192857 Oct 03 10:45:43.100696 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1916/3681] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:42 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:43.105222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:43.106050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:43.113027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.113523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.113970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.114677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.115147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.115581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.276291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:43.289861 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15aab607-5fb8-454e-983b-b07fd8aacb96 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.187246 Oct 03 10:45:43.290679 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1917/3682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:43 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:43.298946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:43.299893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:43.308084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.308859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.309636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.310395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.311479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.311479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.434583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:45:43.435545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:45:43.436032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:45:43.436449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:45:43.437086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:45:43.450905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.451339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.451744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.453039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.453501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.454609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.474381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:45:43.480046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Getting quotas for user 51cf916cbc904a6a97066fe7af1b3bae and project 8fb0ac0c3b6341dfabb4df863ccefeb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:45:43.489554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:43.493845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:45:43.496268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:45:43.503525 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c8e555a1-0bf2-4910-9982-9320b757cbcc tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 200 len: 1521 microversion: 2.1 time: 0.211563 Oct 03 10:45:43.504288 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1918/3683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:43 2022] GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:43.508800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:43.509412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:43.520063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.521263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.522319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.523842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.524997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.525761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.565496 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7028fdbf-391b-4956-852b-bf482290c017 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690422 Oct 03 10:45:43.573425 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1766/3684] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:45:43.578498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6166bdd7-9f22-44f5-9f47-31d8ad09ff6b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:43.579250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6166bdd7-9f22-44f5-9f47-31d8ad09ff6b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:43.710933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6166bdd7-9f22-44f5-9f47-31d8ad09ff6b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:43.729331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6166bdd7-9f22-44f5-9f47-31d8ad09ff6b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1207 microversion: 2.1 time: 0.153263 Oct 03 10:45:43.732265 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1767/3685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:43 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1207 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:43.757454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:43.767671 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-694285ff-ac71-4b6d-a092-64e633a1516b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.262400 Oct 03 10:45:43.775376 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1919/3686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:43 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:43.850632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:43.852332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:43.874506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.875471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.876191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:43.877090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:43.877701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:43.878413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.139398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:44.144254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:44.150265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:44.168383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.169384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.170567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.172457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.173113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.173713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.178018 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e3b72b9-3225-4a33-aeb0-d6944265d6cb tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1474 microversion: 2.1 time: 0.334264 Oct 03 10:45:44.182389 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1768/3687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:43 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:44.204205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:44.438674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:44.445533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-754e98ac-6ce5-4e05-8027-1ba2ac209f8e req-9b17674e-34b6-4de1-a428-8f98d1aaf704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b826fa5-cc46-4cfb-871e-dbfed29ac0a9", "name": "network-vif-deleted", "tag": "7e9029f2-2cad-4600-bb3d-1b3baa6da3df"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:44.451817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:44.454242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:44.455473 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8f16894d-4074-40d9-a12a-baac6703f286 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.327251 Oct 03 10:45:44.456035 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1920/3688] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:44 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:44.468222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-754e98ac-6ce5-4e05-8027-1ba2ac209f8e req-9b17674e-34b6-4de1-a428-8f98d1aaf704 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.470651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-754e98ac-6ce5-4e05-8027-1ba2ac209f8e req-9b17674e-34b6-4de1-a428-8f98d1aaf704 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.471644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-754e98ac-6ce5-4e05-8027-1ba2ac209f8e req-9b17674e-34b6-4de1-a428-8f98d1aaf704 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.500225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:44.510725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:44.518593 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-754e98ac-6ce5-4e05-8027-1ba2ac209f8e req-9b17674e-34b6-4de1-a428-8f98d1aaf704 service nova] Creating event network-vif-deleted:7e9029f2-2cad-4600-bb3d-1b3baa6da3df for instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 on n-h2-858383-3 Oct 03 10:45:44.527656 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-754e98ac-6ce5-4e05-8027-1ba2ac209f8e req-9b17674e-34b6-4de1-a428-8f98d1aaf704 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212804 Oct 03 10:45:44.528951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.529465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.532018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.533137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.535519 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1769/3689] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:44.538556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.540831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.546197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:44.547770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:44.569256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.572025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.573913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.574923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.575610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.576285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.671162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.672492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.673611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.674804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lazy-loading 'fault' on Instance uuid 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:44.755868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:44.758269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:44.769394 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e015bd03-855e-4e00-819d-9c548a379ad9 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 200 len: 1312 microversion: 2.1 time: 0.231884 Oct 03 10:45:44.770473 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1770/3690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:44 2022] GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:44.789186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:44.790988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:44.818996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.821530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.822374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.825761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.826545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.827013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.887873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:44.905535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbd5ff51-cb75-4bb3-830d-4eb6d19a0366 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.413366 Oct 03 10:45:44.906553 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1921/3691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:44 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:44.918698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:44.920294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:44.923945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:44.935358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b07ca20-b631-4b69-8839-ca8ea384727d tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1203 microversion: 2.1 time: 0.163329 Oct 03 10:45:44.936223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1771/3692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:44 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:44.946267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.946976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.947878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:44.948965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:44.949606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:44.950300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.114399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:45.128836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d56218bc-524d-41b6-b12f-08e8cd15f476 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.217446 Oct 03 10:45:45.129864 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1922/3693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:44 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:45.202796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:45.203409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:45.210585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.211076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.211511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.212202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.212659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.213133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.370204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:45.385184 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81bc6739-3543-454e-97d0-57dec443a92d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1474 microversion: 2.1 time: 0.186018 Oct 03 10:45:45.386951 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1772/3694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:45 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1474 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:45.491165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:45.492146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:45.504015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.505255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.506058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.507245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.507717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.508553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.688543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:45.698130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:45.699867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:45.701162 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-331238eb-e9a1-491c-b268-eccfe7b8252e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1810 microversion: 2.20 time: 0.219099 Oct 03 10:45:45.701634 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1923/3695] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:45 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:45.796452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:45.797139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:45.804413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.804935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.805371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.806088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.806515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.806932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.829351 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] HTTP exception thrown: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 HTTP/1.1 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '9b826fa5-cc46-4cfb-871e-dbfed29ac0a9'} Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.830932 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 404 to user: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-85c094be-f9ed-409b-ab8b-2608e5f3ca80 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 404 len: 111 microversion: 2.1 time: 0.040053 Oct 03 10:45:45.836402 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1773/3696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:45 2022] GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:45.843092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:45.849077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:45.850018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:45.855578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.856049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.856484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.857235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.857688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.858113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.938533 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-18a119de-761d-4620-9416-e8591b53e630 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.099270 Oct 03 10:45:45.939120 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1924/3697] 10.222.0.27 () {58 vars in 1230 bytes} [Mon Oct 3 10:45:45 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:45:45.940372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:45.941025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:45.947290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.947792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.948235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.949036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.949503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.949940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.952436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8827fa7-f09c-43cf-81b3-289a2e81ee82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8827fa7-f09c-43cf-81b3-289a2e81ee82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: action_args: {} Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 03 10:45:45.956951 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8827fa7-f09c-43cf-81b3-289a2e81ee82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8827fa7-f09c-43cf-81b3-289a2e81ee82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009786 Oct 03 10:45:45.967238 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1925/3698] 10.222.0.27 () {58 vars in 1182 bytes} [Mon Oct 3 10:45:45 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:45:45.969775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:45.975512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:45.976326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:45.983252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.983787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.984226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:45.985005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:45.985449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:45.985875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.020698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:45:46.052924 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12e1f1a2-45ba-4d78-b59f-3c4ea711d60e tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.086868 Oct 03 10:45:46.053932 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1926/3699] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:45:45 2022] GET /compute/v2.1/servers => generated 681 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:46.066140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.066770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:46.073924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.074423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.074862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.076229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.076869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.077373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.140482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.160528 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-911b8b35-f4d9-419f-bc26-d1537ec9dd15 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.226102 Oct 03 10:45:46.164244 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1774/3700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:45 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:46.173120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.186595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.187833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.servers [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Removing options 'limit' from query {{(pid=122270) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 10:45:46.188810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:46.193201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.196045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.196553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.197048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.197715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.198384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.198888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.202560 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-be6eb91d-1614-4cb1-974c-f93f924a96f6 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1259 microversion: 2.1 time: 0.147580 Oct 03 10:45:46.203785 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1927/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:46.209215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.210190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:46.216668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.217711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.218675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.219663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.220349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.221042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.251519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:45:46.289850 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e77d931c-6f5b-4032-ba4e-ac8bc30bbf42 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.122820 Oct 03 10:45:46.300045 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1775/3702] 10.222.0.27 () {58 vars in 1144 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:46.305409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4128cfe-1b79-473b-9476-32a4207bc99d tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4128cfe-1b79-473b-9476-32a4207bc99d tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi '-1' Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 03 10:45:46.310578 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 03 10:45:46.315755 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.318476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4128cfe-1b79-473b-9476-32a4207bc99d tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:46.319582 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a4128cfe-1b79-473b-9476-32a4207bc99d tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.018085 Oct 03 10:45:46.320483 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1776/3703] 10.222.0.27 () {58 vars in 1142 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:45:46.333601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20b7db56-eabf-4bf4-985b-7b056d86cb35 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20b7db56-eabf-4bf4-985b-7b056d86cb35 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: action_args: {} Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'testing' Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 03 10:45:46.341636 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20b7db56-eabf-4bf4-985b-7b056d86cb35 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20b7db56-eabf-4bf4-985b-7b056d86cb35 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016177 Oct 03 10:45:46.349458 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1777/3704] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:45:46.354671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f04c7a25-9371-4380-9696-c550b72fee15 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.361038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f04c7a25-9371-4380-9696-c550b72fee15 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.361936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f04c7a25-9371-4380-9696-c550b72fee15 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:46.369324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.servers [None req-f04c7a25-9371-4380-9696-c550b72fee15 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Flavor 'non_existing_flavor' could not be found {{(pid=122270) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 03 10:45:46.370700 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f04c7a25-9371-4380-9696-c550b72fee15 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.020172 Oct 03 10:45:46.371405 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1778/3705] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:45:46.386525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.394058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.395170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:46.403896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.404904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.406062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.407545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.408110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.408584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.440552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.451487 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7dfe66c6-e376-4521-856d-99fcb8d49ddf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.246384 Oct 03 10:45:46.452080 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1928/3706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:46.466983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.467597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:46.482867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.484663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.485460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.486386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.487036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.487686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.544981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-473771a4-1669-4847-987c-fe77f311b3dd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.163769 Oct 03 10:45:46.546923 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1779/3707] 10.222.0.27 () {58 vars in 1174 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:45:46.561351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.578089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.582615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:46.596411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.598082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.599093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.600331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.601083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.601741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.668408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.678253 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-83bb761a-2201-4893-be5d-2e6e77f59b4c tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1474 microversion: 2.1 time: 0.223324 Oct 03 10:45:46.680811 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1929/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1474 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:46.729614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.730671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:46.740919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.741765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.742290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.742477 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c76b1b07-93ca-4b45-86b8-4ed0e7784d1a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.187045 Oct 03 10:45:46.743494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.743678 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1780/3709] 10.222.0.27 () {58 vars in 1184 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:45:46.744109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.744631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.761163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:46.768578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.769922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:46.777296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.777985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.778600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.779781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.780309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.781505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.832190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:45:46.887510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.898422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:46.899494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:46.900187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:46.940280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.953503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.957279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:46.961318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-74b63c8e-2719-4762-965a-7b794bf9a163 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1797 microversion: 2.20 time: 0.234407 Oct 03 10:45:46.962488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1930/3710] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1797 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:45:47.184101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.184978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:47.191324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.191889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.192337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.193071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.193532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.193965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.375199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:47.387572 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c1b2d16b-7d30-4c48-bbeb-df3bb8dd3128 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.207550 Oct 03 10:45:47.388358 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1931/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:47 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:47.396606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.397258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:47.403478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.404592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.405101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.406371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.406831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.407252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.483060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:47.496702 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7baad34-2094-46fa-b681-0015b54950c2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1265 microversion: 2.1 time: 0.106634 Oct 03 10:45:47.498367 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1932/3712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:47 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:47.507097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.508270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:47.520064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.521148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.522085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.523512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.524510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.525447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.557811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8561e96c-34a1-43d3-8037-3ad77690fd19 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.801196 Oct 03 10:45:47.557811 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1781/3713] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:45:46 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:47.593309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0c4d925-f29c-43fc-9a12-0a778d7278ff tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.598542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0c4d925-f29c-43fc-9a12-0a778d7278ff tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:47.599893 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0c4d925-f29c-43fc-9a12-0a778d7278ff tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010701 Oct 03 10:45:47.603353 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1782/3714] 10.222.0.27 () {58 vars in 1178 bytes} [Mon Oct 3 10:45:47 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:45:47.615174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.620487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:47.621514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Searching by: {'deleted': False, 'project_id': '7c7fcbccf58841f4bbdc411646392149'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:45:47.628649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.629453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.630053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.630942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.631602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.632194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.679813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:45:47.722717 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7970a8d2-9631-4171-96e0-e4e8f69d3849 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.113004 Oct 03 10:45:47.723561 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1783/3715] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:45:47 2022] GET /compute/v2.1/servers => generated 681 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:47.737684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.738683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:47.745658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.746300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.747339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.747675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.748234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.748760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.786858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:47.799833 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a83ce9c4-1ac0-49fc-8b96-692bc326932b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.298729 Oct 03 10:45:47.800475 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1933/3716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:47 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:47.806438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.807076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:47.819319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.819925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.820377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.821162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.821748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.822537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.843657 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] HTTP exception thrown: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 HTTP/1.1 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '9b826fa5-cc46-4cfb-871e-dbfed29ac0a9'} Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:47.845311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 404 to user: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-382be7c8-c9a9-4668-9c4b-1f5e73699f25 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 404 len: 111 microversion: 2.1 time: 0.044857 Oct 03 10:45:47.853957 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1934/3717] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:47 2022] DELETE /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:47.859108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:47.860112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:47.866840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.867325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.867758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.868463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:47.868975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:47.869373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:47.902507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:48.020443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12244d50-491f-4fcc-b6f7-158dfd154c82 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "DELETE /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 204 len: 0 microversion: 2.1 time: 0.167745 Oct 03 10:45:48.021402 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1935/3718] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:47 2022] DELETE /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:48.032027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:48.033166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:48.042995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.043748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.044286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.045253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.045787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.046908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.079268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:48.107593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:48.194806 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8355a26-aaa2-48f2-930b-4107d95484af tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 204 len: 0 microversion: 2.1 time: 0.166842 Oct 03 10:45:48.199006 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1936/3719] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:48 2022] DELETE /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:48.207570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:48.208709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:48.217752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.220257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.220648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.222159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.222943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.223780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.250367 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] HTTP exception thrown: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 HTTP/1.1 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '9b826fa5-cc46-4cfb-871e-dbfed29ac0a9'} Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:48.252590 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 404 to user: Instance 9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7056d5eb-f660-408d-b896-0404956d95cd tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9" status: 404 len: 111 microversion: 2.1 time: 0.053794 Oct 03 10:45:48.261196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1937/3720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:48 2022] GET /compute/v2.1/servers/9b826fa5-cc46-4cfb-871e-dbfed29ac0a9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:45:48.271548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:48.272335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:48.285345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.286368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.287394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.288676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.289865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.290724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.303813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:48.315063 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-73d55543-6094-4018-ac7c-16964d71c7a5 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1474 microversion: 2.1 time: 0.589657 Oct 03 10:45:48.316488 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1784/3721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:47 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1474 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:48.414745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:48.415385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:48.434651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.435433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.436114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.437135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.437816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.438553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.525159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:48.542978 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bef37073-1625-4b8d-ac29-207669faf603 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1521 microversion: 2.1 time: 0.277360 Oct 03 10:45:48.544702 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1938/3722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:48 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:48.557907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:48.561484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:48.581527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.583108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.584325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.586101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.587394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.594106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.707256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:48.720335 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f80ea0b-501f-4811-94df-04f0898c2ef4 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1265 microversion: 2.1 time: 0.173277 Oct 03 10:45:48.721210 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1939/3723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:48 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:48.833481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0e8ccd97-6552-40f1-b893-e9dc7aaac8a5 req-a366ebff-aa7a-4a54-b003-d324bd72c29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefa13c2-df74-4e2f-b73d-b848254cf657", "name": "network-vif-deleted", "tag": "289f924a-d021-4bfb-a113-f4990b842c1c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:48.851656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0e8ccd97-6552-40f1-b893-e9dc7aaac8a5 req-a366ebff-aa7a-4a54-b003-d324bd72c29c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.853109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0e8ccd97-6552-40f1-b893-e9dc7aaac8a5 req-a366ebff-aa7a-4a54-b003-d324bd72c29c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.854129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0e8ccd97-6552-40f1-b893-e9dc7aaac8a5 req-a366ebff-aa7a-4a54-b003-d324bd72c29c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.873775 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0e8ccd97-6552-40f1-b893-e9dc7aaac8a5 req-a366ebff-aa7a-4a54-b003-d324bd72c29c service nova] Creating event network-vif-deleted:289f924a-d021-4bfb-a113-f4990b842c1c for instance eefa13c2-df74-4e2f-b73d-b848254cf657 on n-h1-858383-3 Oct 03 10:45:48.880610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0e8ccd97-6552-40f1-b893-e9dc7aaac8a5 req-a366ebff-aa7a-4a54-b003-d324bd72c29c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054595 Oct 03 10:45:48.881634 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1940/3724] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:48.887385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:48.888310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:48.899192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.899948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.900657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:48.901659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:48.902856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:48.903742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:49.073855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:49.100157 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f925e35-3a62-4a2e-b6c1-bc6a304067f3 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1325 microversion: 2.1 time: 0.686848 Oct 03 10:45:49.100157 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1785/3725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:48 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1325 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:49.158961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:49.173220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a5028c5-f814-4b66-82be-4654e709eeb4 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.289589 Oct 03 10:45:49.174079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1941/3726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:48 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:49.342537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:49.344105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:49.354984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:49.355477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:49.355912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:49.356617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:49.357693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:49.358114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:49.431867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:49.442544 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c55e4a8e-9181-4515-8c49-54bf3f511f79 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1432 microversion: 2.1 time: 0.104604 Oct 03 10:45:49.443142 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1786/3727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:49 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1432 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:49.581696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:49.583326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:49.593295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:49.597021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:49.598808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:49.600012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:49.600804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:49.601482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:49.753655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:49.754679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:49.769091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:49.770594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:49.771239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:49.772233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:49.772893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:49.773488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:49.861017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:49.869807 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1105f5f9-d5ad-469b-b1ef-83ca7f7a6a10 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1521 microversion: 2.1 time: 0.296134 Oct 03 10:45:49.870755 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1942/3728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:49 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:50.049871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:50.058087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-07d4899b-b3ec-43d1-8e7a-539acbf95ff2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.317108 Oct 03 10:45:50.058691 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1787/3729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:49 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:50.137227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:50.138216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:50.149367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.149660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.150400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.151511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.151976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.153565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.203185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:50.205006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:50.221044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.221778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.222683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.223593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.224238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.224886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.396705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:50.411000 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6987f02a-8a26-4567-8ed4-646ab61d6bfb tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1522 microversion: 2.1 time: 0.287009 Oct 03 10:45:50.414462 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1943/3730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:50 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:50.444181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:50.444979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:50.463931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.464606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.465563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.476520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.477588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.478658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.530806 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] HTTP exception thrown: Action 999 not found Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Request method failure captured: Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805/os-instance-actions/999 HTTP/1.1 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr043AOQO9IzKrUKdEU3-ykjeaiZbjqFAvR-qUYdbsoZfJ7gqbiyB8xobyXn0pGB9LLG_LPh-TWnIgjvuP11NN1vgZ7niaeXXTdfAeyOrExKVeZwEDfuuHXwaEBTUvJLOUcaXIxKnisr3OIBpba69mgXj1qB1Yg5ZFqGeY0EZal5F2A Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 34334fcd5af44f5b981f35d2b5f2d8e1 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34334fcd5af44f5b981f35d2b5f2d8e1"}]}] Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 34334fcd5af44f5b981f35d2b5f2d8e1 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceActionsNegativeTestJSON-1827758866-project Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2d4f521dd232484a93011b11b2844c07 Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1827758866-project Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: exception: Action 999 not found Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '220aafa1-b139-49a8-9307-2ad2fcadf805', 'id': '999'} Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 03 10:45:50.537088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.542169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Returning 404 to user: Action 999 not found {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:50.542169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed3d0213-c006-404e-bbad-58f747f03996 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.106715 Oct 03 10:45:50.542169 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1944/3731] 10.222.0.27 () {58 vars in 1308 bytes} [Mon Oct 3 10:45:50 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805/os-instance-actions/999 => generated 66 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:45:50.549820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:50.550422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:50.560519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.562431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.562997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.564263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.565159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.566486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.605011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.605011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.605484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.606109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:50.656385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:50.676711 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f8a99d3-b312-4d6f-8131-4106e70dc8b1 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1308 microversion: 2.1 time: 0.134804 Oct 03 10:45:50.678408 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1945/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:50 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:50.688976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6ef6778-fdb3-4411-a90e-96655b817524 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '.version_select at 0x7f074e287550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:50.689789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f6ef6778-fdb3-4411-a90e-96655b817524 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 9ad2b21e-3618-4c61-b570-e0e6ee561f85] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:50.696121 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-f6ef6778-fdb3-4411-a90e-96655b817524 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] HTTP exception thrown: Instance 9ad2b21e-3618-4c61-b570-e0e6ee561f85 could not be found. Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6ef6778-fdb3-4411-a90e-96655b817524 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Request method failure captured: Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/9ad2b21e-3618-4c61-b570-e0e6ee561f85/os-instance-actions HTTP/1.1 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr043AOQO9IzKrUKdEU3-ykjeaiZbjqFAvR-qUYdbsoZfJ7gqbiyB8xobyXn0pGB9LLG_LPh-TWnIgjvuP11NN1vgZ7niaeXXTdfAeyOrExKVeZwEDfuuHXwaEBTUvJLOUcaXIxKnisr3OIBpba69mgXj1qB1Yg5ZFqGeY0EZal5F2A Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 34334fcd5af44f5b981f35d2b5f2d8e1 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34334fcd5af44f5b981f35d2b5f2d8e1"}]}] Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 34334fcd5af44f5b981f35d2b5f2d8e1 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceActionsNegativeTestJSON-1827758866-project Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2d4f521dd232484a93011b11b2844c07 Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1827758866-project Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 9ad2b21e-3618-4c61-b570-e0e6ee561f85 could not be found. Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '9ad2b21e-3618-4c61-b570-e0e6ee561f85'} Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad2b21e-3618-4c61-b570-e0e6ee561f85 could not be found. Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:50.698204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad2b21e-3618-4c61-b570-e0e6ee561f85 could not be found. Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad2b21e-3618-4c61-b570-e0e6ee561f85 could not be found. Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6ef6778-fdb3-4411-a90e-96655b817524 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Returning 404 to user: Instance 9ad2b21e-3618-4c61-b570-e0e6ee561f85 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:50.706836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f6ef6778-fdb3-4411-a90e-96655b817524 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/9ad2b21e-3618-4c61-b570-e0e6ee561f85/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.018017 Oct 03 10:45:50.710739 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1946/3733] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 3 10:45:50 2022] GET /compute/v2.1/servers/9ad2b21e-3618-4c61-b570-e0e6ee561f85/os-instance-actions => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:50.721293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:50.722338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:50.725976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:50.734352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.735079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.735739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.736497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.737236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:50.737831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:50.797844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:50.950889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95ed2bb6-9e64-4f7e-acb5-424c23964652 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "DELETE /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 204 len: 0 microversion: 2.1 time: 0.233563 Oct 03 10:45:50.956966 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1947/3734] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:50 2022] DELETE /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:45:50.968946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:50.969957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:50.997755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:50.998946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.001768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.006545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.008651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.008651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.033923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:51.055175 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9c232912-cbea-478f-9b76-d3386f89bdf6 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.859722 Oct 03 10:45:51.071601 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1788/3735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:50 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:51.078491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:51.079665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:51.089383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.089880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.090321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.091069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.091528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.091966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.328095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:51.340015 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5266b484-c66f-41c0-beca-83e06b011d2a tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1521 microversion: 2.1 time: 0.380918 Oct 03 10:45:51.341349 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1948/3736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:50 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:51.349876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3b95f24f-abb6-4e20-81ef-e236a3024655 req-d6e66158-757a-496b-b67b-125124c7fb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19597ad5-1d81-4e4d-8f6b-a0ecb551f42e", "name": "network-vif-deleted", "tag": "fecbfa54-c2f0-4482-a247-6bd804d352a2"}, {"server_uuid": "e3ae4577-d2bb-4e45-a513-f885d98a8a36", "name": "network-vif-deleted", "tag": "ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:51.372026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b95f24f-abb6-4e20-81ef-e236a3024655 req-d6e66158-757a-496b-b67b-125124c7fb7c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.372026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b95f24f-abb6-4e20-81ef-e236a3024655 req-d6e66158-757a-496b-b67b-125124c7fb7c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.372482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b95f24f-abb6-4e20-81ef-e236a3024655 req-d6e66158-757a-496b-b67b-125124c7fb7c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.396146 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3b95f24f-abb6-4e20-81ef-e236a3024655 req-d6e66158-757a-496b-b67b-125124c7fb7c service nova] Creating event network-vif-deleted:fecbfa54-c2f0-4482-a247-6bd804d352a2 for instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e on n-h1-858383-3 Oct 03 10:45:51.396810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3b95f24f-abb6-4e20-81ef-e236a3024655 req-d6e66158-757a-496b-b67b-125124c7fb7c service nova] Creating event network-vif-deleted:ac00fc3c-6c2e-4cfb-9c4c-0babc68ff0ae for instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 on n-h1-858383-3 Oct 03 10:45:51.416097 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3b95f24f-abb6-4e20-81ef-e236a3024655 req-d6e66158-757a-496b-b67b-125124c7fb7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071958 Oct 03 10:45:51.417147 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1949/3737] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:51.424339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:51.425710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:51.434922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.435426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.435870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.437330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.437806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.438241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.541342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:51.557656 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a6d47b80-47f4-4ba3-8a2b-ed1d9d2df216 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1528 microversion: 2.1 time: 0.484779 Oct 03 10:45:51.558258 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1789/3738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:51 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1528 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:51.714201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:51.714933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:51.730920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:51.736426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.737169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.737911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.739123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.739933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.745003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.760600 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-73bda38d-b5a6-44dc-8238-c08fd95edbcd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.337163 Oct 03 10:45:51.761691 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1950/3739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:51 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:51.821701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:51.822569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:51.823367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:51.824157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:51.902826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:51.915196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12bacbad-2a42-4e09-aacf-27fb6e9fad85 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 200 len: 1308 microversion: 2.1 time: 0.207527 Oct 03 10:45:51.916000 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1790/3740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:51 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:52.061489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-bb4633e3-41a5-4d1d-8cd5-2a8116449b80 req-30eee2de-6edd-4e23-9d03-40391a591880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b79f8c7-aa92-4765-a563-5d9ca75918fc", "name": "network-vif-deleted", "tag": "1112c4b6-4f49-4e3c-a31d-5ff6f906d579"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:52.072455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bb4633e3-41a5-4d1d-8cd5-2a8116449b80 req-30eee2de-6edd-4e23-9d03-40391a591880 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.074607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bb4633e3-41a5-4d1d-8cd5-2a8116449b80 req-30eee2de-6edd-4e23-9d03-40391a591880 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.075139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bb4633e3-41a5-4d1d-8cd5-2a8116449b80 req-30eee2de-6edd-4e23-9d03-40391a591880 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.086290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:52.087676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:52.100048 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-bb4633e3-41a5-4d1d-8cd5-2a8116449b80 req-30eee2de-6edd-4e23-9d03-40391a591880 service nova] Creating event network-vif-deleted:1112c4b6-4f49-4e3c-a31d-5ff6f906d579 for instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc on n-h2-858383-3 Oct 03 10:45:52.104108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.105567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.108020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.110314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.111419 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-bb4633e3-41a5-4d1d-8cd5-2a8116449b80 req-30eee2de-6edd-4e23-9d03-40391a591880 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123376 Oct 03 10:45:52.111877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.112959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.113826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1951/3741] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:52.367277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:52.369029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:52.375256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.375739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.376445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.377624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.378110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.378543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.380899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:52.383560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:52.418986 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-968ec5fe-65ec-4efe-a057-fb2a2f554648 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1735 microversion: 2.1 time: 0.342994 Oct 03 10:45:52.419986 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1791/3742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:52 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:52.422844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.423366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.424287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.424757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lazy-loading 'fault' on Instance uuid 82780639-acbe-4bcb-84dc-35ba1f3c1647 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:52.487654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:52.500386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c5986953-b837-4b00-a63f-baa203e21ee3 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1312 microversion: 2.1 time: 0.138290 Oct 03 10:45:52.501407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1952/3743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:52 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1312 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:52.592294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:52.592469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:52.610750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.611276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.611819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.612833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.613475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.614166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.802852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:52.804435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:52.825607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.826770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.831654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:52.836082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:52.837663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:52.840132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.174040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:53.204149 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c32a373-6de4-4fb4-b82a-4d0837c6bc88 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1528 microversion: 2.1 time: 0.616642 Oct 03 10:45:53.220977 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1792/3744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:52 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1528 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:53.223364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:53.229343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:53.237445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c9f646fb-edf2-4624-86af-4d9ee96ce0ca tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.452644 Oct 03 10:45:53.238121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:53.238744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:53.239247 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1953/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:52 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:53.255202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.255853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.256547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.257781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.258477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.259135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.276587 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e could not be found. Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e HTTP/1.1 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e could not be found. Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '19597ad5-1d81-4e4d-8f6b-a0ecb551f42e'} Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e could not be found. Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e could not be found. Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:53.278780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e could not be found. Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance 19597ad5-1d81-4e4d-8f6b-a0ecb551f42e could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:53.285930 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5258d5c6-3eac-4fad-8ebd-666930a164b0 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e" status: 404 len: 111 microversion: 2.1 time: 0.062368 Oct 03 10:45:53.287082 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1793/3746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:53 2022] GET /compute/v2.1/servers/19597ad5-1d81-4e4d-8f6b-a0ecb551f42e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:53.303384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:53.306226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: eefa13c2-df74-4e2f-b73d-b848254cf657] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:53.317661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.318258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.319336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.320135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.320661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.321496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.341098 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance eefa13c2-df74-4e2f-b73d-b848254cf657 could not be found. Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 HTTP/1.1 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance eefa13c2-df74-4e2f-b73d-b848254cf657 could not be found. Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'eefa13c2-df74-4e2f-b73d-b848254cf657'} Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefa13c2-df74-4e2f-b73d-b848254cf657 could not be found. Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefa13c2-df74-4e2f-b73d-b848254cf657 could not be found. Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:53.344133 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.349398 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:53.349398 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:53.349398 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:53.349398 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:53.349398 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:53.349398 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefa13c2-df74-4e2f-b73d-b848254cf657 could not be found. Oct 03 10:45:53.349398 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:53.352239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance eefa13c2-df74-4e2f-b73d-b848254cf657 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:53.354435 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-101f1451-3b3b-421e-84bd-f32cab16d459 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657" status: 404 len: 111 microversion: 2.1 time: 0.062756 Oct 03 10:45:53.355758 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1954/3747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:53 2022] GET /compute/v2.1/servers/eefa13c2-df74-4e2f-b73d-b848254cf657 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:45:53.366732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-efb90bcd-a3a4-4923-9984-56e9662b2808 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:53.391465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:53.418210 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-efb90bcd-a3a4-4923-9984-56e9662b2808 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/2d1769a0-dd55-4b57-a6f7-dcc670dfe3d6" status: 204 len: 0 microversion: 2.1 time: 0.057438 Oct 03 10:45:53.419160 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1794/3748] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 10:45:53 2022] DELETE /compute/v2.1/os-server-groups/2d1769a0-dd55-4b57-a6f7-dcc670dfe3d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:53.431063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:53.432025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:53.447654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.448241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.448754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.449907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.450078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:53.450359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.452088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:53.453378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.470031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.471085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.472541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.473983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.474838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.475755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.559698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:53.711659 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3298fccf-7b73-4309-bf80-5466cc2bec01 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 204 len: 0 microversion: 2.1 time: 0.285356 Oct 03 10:45:53.712752 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1955/3749] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:45:53 2022] DELETE /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:45:53.721147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1ad1fc39-b4f8-4fd7-96e8-3790234bb192 req-d6b9e00c-9a30-4e90-9872-3c4be6f69511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82780639-acbe-4bcb-84dc-35ba1f3c1647", "name": "network-vif-deleted", "tag": "8e5f5493-6924-41a5-b19b-c7ac4da657c5"}, {"name": "network-changed", "server_uuid": "dfef0178-3b0e-44b0-97ff-e7dba3539e08", "tag": "12756a18-f2d9-42df-bdac-bcae3625574d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:53.744092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1ad1fc39-b4f8-4fd7-96e8-3790234bb192 req-d6b9e00c-9a30-4e90-9872-3c4be6f69511 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.745491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1ad1fc39-b4f8-4fd7-96e8-3790234bb192 req-d6b9e00c-9a30-4e90-9872-3c4be6f69511 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.746276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1ad1fc39-b4f8-4fd7-96e8-3790234bb192 req-d6b9e00c-9a30-4e90-9872-3c4be6f69511 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.779838 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1ad1fc39-b4f8-4fd7-96e8-3790234bb192 req-d6b9e00c-9a30-4e90-9872-3c4be6f69511 service nova] Creating event network-vif-deleted:8e5f5493-6924-41a5-b19b-c7ac4da657c5 for instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 on n-h1-858383-3 Oct 03 10:45:53.784162 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1ad1fc39-b4f8-4fd7-96e8-3790234bb192 req-d6b9e00c-9a30-4e90-9872-3c4be6f69511 service nova] Creating event network-changed:12756a18-f2d9-42df-bdac-bcae3625574d for instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 on n-h2-858383-3 Oct 03 10:45:53.799060 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1ad1fc39-b4f8-4fd7-96e8-3790234bb192 req-d6b9e00c-9a30-4e90-9872-3c4be6f69511 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.083912 Oct 03 10:45:53.799686 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1956/3750] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:53.805654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:53.806847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:53.815815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.816313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.816751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.817471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.818172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.818810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.890674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:53.905064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.905619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.906478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.906963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lazy-loading 'fault' on Instance uuid 82780639-acbe-4bcb-84dc-35ba1f3c1647 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:45:53.931400 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1dbd539f-e110-4aa4-af71-05bf5ccd9ef3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1715 microversion: 2.1 time: 0.490782 Oct 03 10:45:53.938096 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1795/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:53 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1715 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:53.951704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:53.953129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:53.963234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.964196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.964907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:53.966075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:53.966801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:53.967467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.018420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a652f8f3154ea58a332d83f5357f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fcbccf58841f4bbdc411646392149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:54.045348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec7ba79e-60fc-497c-99ca-dc728370fb50 tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 200 len: 1312 microversion: 2.1 time: 0.244065 Oct 03 10:45:54.052706 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1957/3752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:53 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:54.222663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:54.224654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:54.225514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:54.231214 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a6a473c-62f7-4025-88e4-239f56b0bc6d tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1472 microversion: 2.1 time: 0.291605 Oct 03 10:45:54.231795 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1796/3753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:53 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1472 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:54.237748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:54.238763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:54.245589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.246180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.246701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.247490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.248017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.248863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.262420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.263011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.263506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.264357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.265715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.266233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.330506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4f521dd232484a93011b11b2844c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34334fcd5af44f5b981f35d2b5f2d8e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:54.339534 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4c8ac65-56d5-42bc-8410-fc1ffb0511f2 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 200 len: 1310 microversion: 2.1 time: 0.106088 Oct 03 10:45:54.340435 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1797/3754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:54 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:54.346607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:54.347552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:54.359757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.360500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.361176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.362527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.363171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.364289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.423143 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Cannot 'detach_volume' instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 while it is in vm_state rescued Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments/86ea1e3d-ed79-49cb-afa5-180b3bbd427d HTTP/1.1 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: exception: Cannot 'detach_volume' instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 while it is in vm_state rescued Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '3b71dd5c-ef34-4807-90a2-7c03aec69537', 'id': '86ea1e3d-ed79-49cb-afa5-180b3bbd427d'} Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 while it is in vm_state rescued Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:54.425935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 while it is in vm_state rescued Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 409 to user: Cannot 'detach_volume' instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 while it is in vm_state rescued {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:54.430599 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c8e73c20-4a7d-4f1f-bd82-6748c3dcc220 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments/86ea1e3d-ed79-49cb-afa5-180b3bbd427d" status: 409 len: 152 microversion: 2.1 time: 0.213307 Oct 03 10:45:54.431227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1958/3755] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:45:54 2022] DELETE /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments/86ea1e3d-ed79-49cb-afa5-180b3bbd427d => generated 152 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:45:54.441831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:54.442372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:54.459067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.460266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.461102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.462580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.463814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.464205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.601158 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b70a1604-f93a-4d30-9a3f-04e4ffff44d9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/action" status: 202 len: 0 microversion: 2.1 time: 0.162508 Oct 03 10:45:54.606156 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1959/3756] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:45:54 2022] POST /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:45:54.619797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:54.620568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:54.631659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.632918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.633987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.635492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:54.636557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:54.637686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:54.645195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:54.664720 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ab7cb40-1e03-4e2e-a4af-ce0a92fdcb8f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.322561 Oct 03 10:45:54.666207 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1798/3757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:54 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:54.852839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:54.861830 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54725432-5208-42a9-bcfd-d6004d97829f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1723 microversion: 2.1 time: 0.253792 Oct 03 10:45:54.862411 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1960/3758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:54 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:55.071388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:55.072010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 82780639-acbe-4bcb-84dc-35ba1f3c1647] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:55.079072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.079572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.080020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.080736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.081227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.081665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.097035 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] HTTP exception thrown: Instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 could not be found. Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 HTTP/1.1 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 could not be found. Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '82780639-acbe-4bcb-84dc-35ba1f3c1647'} Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 could not be found. Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 could not be found. Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.098510 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 could not be found. Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 404 to user: Instance 82780639-acbe-4bcb-84dc-35ba1f3c1647 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5c6e9660-bbc5-441d-9b7f-ed3864992ebf tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647" status: 404 len: 111 microversion: 2.1 time: 0.032657 Oct 03 10:45:55.102927 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1799/3759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:55 2022] GET /compute/v2.1/servers/82780639-acbe-4bcb-84dc-35ba1f3c1647 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:45:55.108704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:55.109348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] [instance: 8b79f8c7-aa92-4765-a563-5d9ca75918fc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:55.116383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.116874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.117338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.118046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.118500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.118927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.134650 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] HTTP exception thrown: Instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc could not be found. Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Request method failure captured: Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc HTTP/1.1 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr0uUwqW0xCBFgSABCKqdPBdoeQ5BfHkcMSWhpfMYSjJcKVqhT2dpdkRaN7Tl2mM0uPAOV2w0uAs-qEyphxICDlHOKRo0cthakJPgrb2uSc4l0kT1Q7_kkz_EI7gUjCE3Z2HQwwLoApj1fcSeu4pGfSFyHhJ7i3pa2wuDywBM5CB0so Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c7fcbccf58841f4bbdc411646392149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c7fcbccf58841f4bbdc411646392149"}]}] Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c7fcbccf58841f4bbdc411646392149 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-594727761 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 14a652f8f3154ea58a332d83f5357f71 Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListServersNegativeTestJSON-594727761-project Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc could not be found. Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '8b79f8c7-aa92-4765-a563-5d9ca75918fc'} Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc could not be found. Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc could not be found. Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.136358 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc could not be found. Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] Returning 404 to user: Instance 8b79f8c7-aa92-4765-a563-5d9ca75918fc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b70fe62-305e-43bb-8784-45d371c7959b tempest-ListServersNegativeTestJSON-594727761 tempest-ListServersNegativeTestJSON-594727761-project] 10.222.0.27 "GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc" status: 404 len: 111 microversion: 2.1 time: 0.032982 Oct 03 10:45:55.147938 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1961/3760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:55 2022] GET /compute/v2.1/servers/8b79f8c7-aa92-4765-a563-5d9ca75918fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:45:55.279209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:55.280016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:55.287473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.288140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.289742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.290480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.291137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.291582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.370812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:55.371380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] [instance: 220aafa1-b139-49a8-9307-2ad2fcadf805] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:55.378732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.379233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.379712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.380469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.381275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.381701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.398882 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] HTTP exception thrown: Instance 220aafa1-b139-49a8-9307-2ad2fcadf805 could not be found. Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Request method failure captured: Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 HTTP/1.1 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr043AOQO9IzKrUKdEU3-ykjeaiZbjqFAvR-qUYdbsoZfJ7gqbiyB8xobyXn0pGB9LLG_LPh-TWnIgjvuP11NN1vgZ7niaeXXTdfAeyOrExKVeZwEDfuuHXwaEBTUvJLOUcaXIxKnisr3OIBpba69mgXj1qB1Yg5ZFqGeY0EZal5F2A Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 34334fcd5af44f5b981f35d2b5f2d8e1 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34334fcd5af44f5b981f35d2b5f2d8e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34334fcd5af44f5b981f35d2b5f2d8e1"}]}] Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 34334fcd5af44f5b981f35d2b5f2d8e1 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1827758866 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-InstanceActionsNegativeTestJSON-1827758866-project Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2d4f521dd232484a93011b11b2844c07 Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1827758866-project Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 220aafa1-b139-49a8-9307-2ad2fcadf805 could not be found. Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '220aafa1-b139-49a8-9307-2ad2fcadf805'} Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220aafa1-b139-49a8-9307-2ad2fcadf805 could not be found. Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220aafa1-b139-49a8-9307-2ad2fcadf805 could not be found. Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.400545 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220aafa1-b139-49a8-9307-2ad2fcadf805 could not be found. Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] Returning 404 to user: Instance 220aafa1-b139-49a8-9307-2ad2fcadf805 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ecdba395-c375-4200-8406-c08399d11871 tempest-InstanceActionsNegativeTestJSON-1827758866 tempest-InstanceActionsNegativeTestJSON-1827758866-project] 10.222.0.27 "GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805" status: 404 len: 111 microversion: 2.1 time: 0.037597 Oct 03 10:45:55.406782 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1962/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:55 2022] GET /compute/v2.1/servers/220aafa1-b139-49a8-9307-2ad2fcadf805 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:45:55.651807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:55.660141 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ea3a9a3-2ffb-4dd4-992d-7cade0f6ece9 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1472 microversion: 2.1 time: 0.389163 Oct 03 10:45:55.660948 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1800/3762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:55 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:55.698816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:55.699595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:55.707347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.708110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.708865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.710093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.710887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.711841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.828021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3f4c1edc-20d0-4611-8eaf-17be36e37404 req-15935866-3df7-4716-9e62-1edfcbcba8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220aafa1-b139-49a8-9307-2ad2fcadf805", "name": "network-vif-deleted", "tag": "498c686c-14e3-44f7-8dac-4b8162507b57"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:55.839087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3f4c1edc-20d0-4611-8eaf-17be36e37404 req-15935866-3df7-4716-9e62-1edfcbcba8d0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.839872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3f4c1edc-20d0-4611-8eaf-17be36e37404 req-15935866-3df7-4716-9e62-1edfcbcba8d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.840508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3f4c1edc-20d0-4611-8eaf-17be36e37404 req-15935866-3df7-4716-9e62-1edfcbcba8d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.857538 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3f4c1edc-20d0-4611-8eaf-17be36e37404 req-15935866-3df7-4716-9e62-1edfcbcba8d0 service nova] Creating event network-vif-deleted:498c686c-14e3-44f7-8dac-4b8162507b57 for instance 220aafa1-b139-49a8-9307-2ad2fcadf805 on n-h1-858383-3 Oct 03 10:45:55.865104 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3f4c1edc-20d0-4611-8eaf-17be36e37404 req-15935866-3df7-4716-9e62-1edfcbcba8d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041762 Oct 03 10:45:55.866840 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1801/3763] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:55.887680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:55.889051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:55.897897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.899767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.900436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.901553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:55.902218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:55.902661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:55.976458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:55.988649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ae41bb4-efd8-439c-a1c1-e95b64bfe929 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.294419 Oct 03 10:45:55.988649 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1963/3764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:55 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:56.531508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:56.561658 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9fdd01cf-7773-4211-b387-5e178e94cdc3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1723 microversion: 2.1 time: 0.678430 Oct 03 10:45:56.564455 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1802/3765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:55 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1723 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:45:56.703836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:56.704725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:56.706442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:56.712985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:56.713487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:56.713933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:56.714651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:56.715262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:56.715551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:56.872796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:56.882344 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19e71b94-6199-4f2b-8aab-f5764e1a77db tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1472 microversion: 2.1 time: 0.184041 Oct 03 10:45:56.883153 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1964/3766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:56 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:57.012185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:57.012998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:57.018543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:57.026205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.026577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.027124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.027912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.028450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.028987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.154863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:57.155538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:57.166262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.167057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.167782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.168651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.169216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.169716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.203843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:45:57.310375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-64b64098-410f-4d8d-9cc4-c745e8e7d8c2 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 204 len: 0 microversion: 2.42 time: 0.294245 Oct 03 10:45:57.311087 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1965/3767] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:45:57 2022] DELETE /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:45:57.322685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:57.323002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:57.329530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.330138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.330696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.331421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.331878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.332310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.556785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:57.575344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:57.577464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:57.579234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-36c60a34-ee02-47a6-ae87-6dbdcc329c78 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2955 microversion: 2.42 time: 0.262267 Oct 03 10:45:57.580113 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1966/3768] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:57 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2955 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:57.594116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:57.594997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:57.601736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.602472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.603107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.603986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.604605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.605220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.622025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:57.632003 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d03f9e1b-f3d7-4885-8b37-3f509253e557 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.623985 Oct 03 10:45:57.633241 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1803/3769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:57 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:57.787644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:57.803029 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd762e31-8913-4f89-9a01-f7ce46553a87 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1723 microversion: 2.1 time: 0.213398 Oct 03 10:45:57.804032 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1967/3770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:57 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:57.907070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:57.908400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:57.913479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:57.922987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.924153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.925092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:57.926740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:57.928139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:57.929214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.070100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d8d90de8-354c-4810-9f59-070bac47b6ab req-72b96b70-b628-4e52-85eb-6cb7a8b12d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfef0178-3b0e-44b0-97ff-e7dba3539e08", "name": "network-vif-plugged", "status": "completed", "tag": "12756a18-f2d9-42df-bdac-bcae3625574d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:58.089034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8d90de8-354c-4810-9f59-070bac47b6ab req-72b96b70-b628-4e52-85eb-6cb7a8b12d41 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.089875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8d90de8-354c-4810-9f59-070bac47b6ab req-72b96b70-b628-4e52-85eb-6cb7a8b12d41 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.090660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8d90de8-354c-4810-9f59-070bac47b6ab req-72b96b70-b628-4e52-85eb-6cb7a8b12d41 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.116025 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d8d90de8-354c-4810-9f59-070bac47b6ab req-72b96b70-b628-4e52-85eb-6cb7a8b12d41 service nova] Creating event network-vif-plugged:12756a18-f2d9-42df-bdac-bcae3625574d for instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 on n-h2-858383-3 Oct 03 10:45:58.124826 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d8d90de8-354c-4810-9f59-070bac47b6ab req-72b96b70-b628-4e52-85eb-6cb7a8b12d41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064357 Oct 03 10:45:58.125850 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1968/3771] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:45:58.407588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-446e51e9-4630-488a-8bc3-5b738bb9db5e req-8fbf8d65-36f3-459f-805c-76a17e1a4b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8a08d3-3b84-458e-aa9f-1941ac2386c8", "name": "network-vif-deleted", "tag": "9a481fa9-ba9e-468a-8c8d-ada1db6b9976"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:45:58.422315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-446e51e9-4630-488a-8bc3-5b738bb9db5e req-8fbf8d65-36f3-459f-805c-76a17e1a4b53 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.422881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-446e51e9-4630-488a-8bc3-5b738bb9db5e req-8fbf8d65-36f3-459f-805c-76a17e1a4b53 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.423447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-446e51e9-4630-488a-8bc3-5b738bb9db5e req-8fbf8d65-36f3-459f-805c-76a17e1a4b53 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.428573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:45:58.437860 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-446e51e9-4630-488a-8bc3-5b738bb9db5e req-8fbf8d65-36f3-459f-805c-76a17e1a4b53 service nova] Creating event network-vif-deleted:9a481fa9-ba9e-468a-8c8d-ada1db6b9976 for instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 on n-h2-858383-3 Oct 03 10:45:58.443183 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-446e51e9-4630-488a-8bc3-5b738bb9db5e req-8fbf8d65-36f3-459f-805c-76a17e1a4b53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042236 Oct 03 10:45:58.443796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1969/3772] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:45:58.505286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:58.516351 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d12b8b4-5577-4895-9a77-59fa66f47fbf tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1472 microversion: 2.1 time: 0.613171 Oct 03 10:45:58.516979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1804/3773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:57 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:58.625140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:58.626428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:58.634326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.635198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.635855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.636666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.637231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.638251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.664709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:58.664709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:58.671211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.671870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.672408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.673189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.673931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.674429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.942251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:58.952512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:58.954019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:58.955995 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f0b8a77-392d-4a3c-a53c-7f0cb478273e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2955 microversion: 2.42 time: 0.335766 Oct 03 10:45:58.956811 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1970/3774] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:58 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2955 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:45:58.967535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:58.968058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:58.978942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.979449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.979901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:58.980656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:58.981233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:58.982378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:59.175167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:59.185474 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b41b40dd-01ef-4fc0-9326-95ab1614199d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1723 microversion: 2.1 time: 0.227278 Oct 03 10:45:59.190100 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1971/3775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:58 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:59.253634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:45:59.265124 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b2c3b1b-8f50-49b1-a381-0654037c6720 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.609760 Oct 03 10:45:59.265744 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1805/3776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:58 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:45:59.549119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:59.550493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:45:59.561738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:59.562351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:59.562935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:59.563822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:45:59.564432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:45:59.565678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:45:59.992621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:45:59.994045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:00.003084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:00.008420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:00.019606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:00.020869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:00.021596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:00.022305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:00.054399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:00.067061 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7de5a464-dee8-48b0-b319-51f56c9761bc tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1430 microversion: 2.1 time: 0.527051 Oct 03 10:46:00.067672 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1972/3777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:45:59 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1430 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:00.214425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:00.217141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:00.230971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:00.231789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:00.232815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:00.234456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:00.235142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:00.235812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:00.507058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:00.523497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:00.525817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:00.527583 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f93cc8fa-cda1-44b5-b134-759aea5a0074 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2955 microversion: 2.42 time: 0.539002 Oct 03 10:46:00.528758 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1806/3778] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:45:59 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2955 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:00.536886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:00.538312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:00.551148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:00.552280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:00.552980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:00.554878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:00.556560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:00.561145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:00.691772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:00.706922 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d8b8fd2b-74d3-4675-90c9-eb08dfe52764 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1723 microversion: 2.1 time: 0.499035 Oct 03 10:46:00.721746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1973/3779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:00 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1723 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:01.109874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:01.110635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:01.134854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:01.136465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:01.136965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:01.137738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:01.138218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:01.138661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:01.309471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:01.314551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:01.315129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:01.315881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lazy-loading 'fault' on Instance uuid bf8a08d3-3b84-458e-aa9f-1941ac2386c8 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:46:01.421265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9b6cf965ae4084b9b42de13417e90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784dad77eab8442e85f2141e9641ca22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:01.431259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c28da187-e6f4-4ccc-a224-eb0c38e60617 tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 200 len: 1306 microversion: 2.1 time: 0.327932 Oct 03 10:46:01.432635 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1974/3780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:01 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 1306 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:46:01.489344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:01.502791 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33c76330-ae3b-498d-98ac-cda972ca9f65 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.972522 Oct 03 10:46:01.505991 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1807/3781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:00 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:01.581238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:01.602058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:01.629853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:01.631506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:01.632628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:01.634266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:01.636550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:01.637684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:01.736295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:01.737336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:01.756492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:01.760254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:01.761181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:01.762198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:01.765085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:01.766286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.143867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:02.158918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:02.161629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:02.165301 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-00fd1acc-a2d2-4047-a38e-50d3f6ceaf8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2955 microversion: 2.42 time: 0.591378 Oct 03 10:46:02.206789 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1975/3782] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:01 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2955 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:02.215447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7581a5f2-4682-4dd3-87ae-9a3687f58425 req-770c4b7b-cb36-4e8a-9ba3-0a0047360353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-unplugged", "status": "completed", "tag": "829b5797-cf23-4334-85f8-8196dcc8acd1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:02.239864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7581a5f2-4682-4dd3-87ae-9a3687f58425 req-770c4b7b-cb36-4e8a-9ba3-0a0047360353 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:02.241091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7581a5f2-4682-4dd3-87ae-9a3687f58425 req-770c4b7b-cb36-4e8a-9ba3-0a0047360353 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:02.242147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7581a5f2-4682-4dd3-87ae-9a3687f58425 req-770c4b7b-cb36-4e8a-9ba3-0a0047360353 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.273928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7581a5f2-4682-4dd3-87ae-9a3687f58425 req-770c4b7b-cb36-4e8a-9ba3-0a0047360353 service nova] Creating event network-vif-unplugged:829b5797-cf23-4334-85f8-8196dcc8acd1 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:02.283113 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7581a5f2-4682-4dd3-87ae-9a3687f58425 req-770c4b7b-cb36-4e8a-9ba3-0a0047360353 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074455 Oct 03 10:46:02.284108 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1976/3783] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:02.481017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:02.490245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:02.493434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] [instance: bf8a08d3-3b84-458e-aa9f-1941ac2386c8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:02.498377 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-acb525a8-b605-4652-973b-c65bf24bc2d3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1729 microversion: 2.1 time: 0.767062 Oct 03 10:46:02.501611 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1808/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:01 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1729 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:02.506897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:02.507758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:02.509766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.510848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:02.511694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:02.512574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.531233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:02.532574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:02.545555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:02.547159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:02.549046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.551490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:02.553455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:02.555130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.564051 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] HTTP exception thrown: Instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 could not be found. Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Request method failure captured: Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 HTTP/1.1 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOryQWnZE1Dkvo-fngBbyywm3bg0--KjYJj33OUvvAlV15adqCdHT447zE8ImDNg6xTwRDC8209SRPMjSLOaRuBiePnl8udUHm1eyYYfoTwHe16JOd3GwTROiQVpAg9nYBYUzcVUS0hDMUfGzA_jSQFdxkbUN48i8EN1GXORPPurmN6c Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_784dad77eab8442e85f2141e9641ca22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/784dad77eab8442e85f2141e9641ca22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/784dad77eab8442e85f2141e9641ca22"}]}] Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 784dad77eab8442e85f2141e9641ca22 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698272532 Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3e9b6cf965ae4084b9b42de13417e90e Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersOnMultiNodesTest-1698272532-project Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 could not be found. Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'bf8a08d3-3b84-458e-aa9f-1941ac2386c8'} Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 could not be found. Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 could not be found. Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:02.576892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:02.582182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:02.582182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:02.582182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:02.582182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:02.582182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:02.582182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 could not be found. Oct 03 10:46:02.582182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:02.587635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] Returning 404 to user: Instance bf8a08d3-3b84-458e-aa9f-1941ac2386c8 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:02.589074 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e296c53-f22a-433d-9211-a2b3e2392e2e tempest-ServersOnMultiNodesTest-1698272532 tempest-ServersOnMultiNodesTest-1698272532-project] 10.222.0.27 "GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8" status: 404 len: 111 microversion: 2.1 time: 0.128000 Oct 03 10:46:02.589942 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1977/3785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:02 2022] GET /compute/v2.1/servers/bf8a08d3-3b84-458e-aa9f-1941ac2386c8 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:02.602338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:02.602834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:02.618524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:02.621188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:02.621757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.622514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:02.622971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:02.623502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:02.752305 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e605383d-94cc-4a61-b4fa-7983d83f6ffe tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156990 Oct 03 10:46:02.761020 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1978/3786] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:46:02 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:03.221029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:03.222264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:03.243203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:03.245391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:03.248327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:03.249387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:03.251602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:03.252840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:03.504510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:03.529228 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-415516b0-416c-41c8-b790-98914576f533 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1307 microversion: 2.1 time: 0.989838 Oct 03 10:46:03.531124 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1809/3787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:02 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1307 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:03.832274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:03.843976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:03.845740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:03.848466 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d39a7de-a874-4378-9ac2-7cbc3409ae40 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2955 microversion: 2.42 time: 0.646438 Oct 03 10:46:03.849958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1979/3788] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:03 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2955 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:04.563129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:04.563881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:04.582304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:04.582892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:04.589797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:04.591007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:04.592253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:04.594339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:04.618947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bc7bc7ab-7029-4ba6-a8e0-ef27e77d927e req-0e5591c1-ada9-400d-856c-44b07482a60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-unplugged", "status": "completed", "tag": "12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:04.656668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bc7bc7ab-7029-4ba6-a8e0-ef27e77d927e req-0e5591c1-ada9-400d-856c-44b07482a60a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:04.665288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bc7bc7ab-7029-4ba6-a8e0-ef27e77d927e req-0e5591c1-ada9-400d-856c-44b07482a60a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:04.665821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bc7bc7ab-7029-4ba6-a8e0-ef27e77d927e req-0e5591c1-ada9-400d-856c-44b07482a60a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:04.692538 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bc7bc7ab-7029-4ba6-a8e0-ef27e77d927e req-0e5591c1-ada9-400d-856c-44b07482a60a service nova] Creating event network-vif-unplugged:12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:04.710803 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bc7bc7ab-7029-4ba6-a8e0-ef27e77d927e req-0e5591c1-ada9-400d-856c-44b07482a60a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.368698 Oct 03 10:46:04.711758 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1810/3789] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:04.896349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:04.897100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:04.918254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:04.918748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:04.919379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:04.920490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:04.923017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:04.924344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:05.167979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:05.180932 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26f4321c-523c-4f8e-9d6a-7f23d48d3c7b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1488 microversion: 2.1 time: 0.622308 Oct 03 10:46:05.182849 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1980/3790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:04 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1488 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:05.192150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-bd3ea886-ebb4-4802-8a0c-0e82a4519b47 req-ea2f0894-cce3-47c1-992a-1795a798b61a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b71dd5c-ef34-4807-90a2-7c03aec69537", "tag": "ea7b3416-8f70-4236-bf50-c70b14cc3af9"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:05.212414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bd3ea886-ebb4-4802-8a0c-0e82a4519b47 req-ea2f0894-cce3-47c1-992a-1795a798b61a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:05.213792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bd3ea886-ebb4-4802-8a0c-0e82a4519b47 req-ea2f0894-cce3-47c1-992a-1795a798b61a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:05.214633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bd3ea886-ebb4-4802-8a0c-0e82a4519b47 req-ea2f0894-cce3-47c1-992a-1795a798b61a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:05.240656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-bd3ea886-ebb4-4802-8a0c-0e82a4519b47 req-ea2f0894-cce3-47c1-992a-1795a798b61a service nova] Creating event network-changed:ea7b3416-8f70-4236-bf50-c70b14cc3af9 for instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 on n-h2-858383-3 Oct 03 10:46:05.250891 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-bd3ea886-ebb4-4802-8a0c-0e82a4519b47 req-ea2f0894-cce3-47c1-992a-1795a798b61a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065342 Oct 03 10:46:05.252871 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1981/3791] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:05.266486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2114466331"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:05.272408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:05.285476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:05.286695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:05.287710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:05.288287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:05.289789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:05.293834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:05.299632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:05.300060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:05.301665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:05.303146 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ab978c3-af07-4828-a8a3-28a425f70207 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2934 microversion: 2.42 time: 0.411101 Oct 03 10:46:05.321677 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1811/3792] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:04 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2934 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:46:05.649776 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1b5954f-d8e8-475a-ad85-b70e9c32e3ab tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "POST /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08/action" status: 202 len: 0 microversion: 2.1 time: 0.394597 Oct 03 10:46:05.652391 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1982/3793] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:46:05 2022] POST /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:46:05.669032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e83697d-14a9-4615-8c61-27daa39591cc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1ebc10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:05.746050 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e83697d-14a9-4615-8c61-27daa39591cc tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad" status: 200 len: 1412 microversion: 2.1 time: 0.082517 Oct 03 10:46:05.750285 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1812/3794] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:05 2022] GET /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:05.777097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12fde11a-c8b6-49cd-9601-604c8fd8ffc2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074eb1c280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:05.888246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12fde11a-c8b6-49cd-9601-604c8fd8ffc2 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad" status: 200 len: 1412 microversion: 2.1 time: 0.118228 Oct 03 10:46:05.889763 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1983/3795] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:05 2022] GET /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:05.915981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9828e21-40fc-497d-b6ff-161e4d3b0ccd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e22de50>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:06.142185 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9828e21-40fc-497d-b6ff-161e4d3b0ccd tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad" status: 204 len: 0 microversion: 2.1 time: 0.231542 Oct 03 10:46:06.146558 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1813/3796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:05 2022] DELETE /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:46:06.152077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c85ebb6e-e1a1-4eaa-b8c5-2bbb1f798637 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f07575018b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:06.185052 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c85ebb6e-e1a1-4eaa-b8c5-2bbb1f798637 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Image not found. Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c85ebb6e-e1a1-4eaa-b8c5-2bbb1f798637 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad HTTP/1.1 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: exception: Image not found. Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad'} Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 10:46:06.188643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad could not be found. Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c85ebb6e-e1a1-4eaa-b8c5-2bbb1f798637 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Image not found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c85ebb6e-e1a1-4eaa-b8c5-2bbb1f798637 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad" status: 404 len: 62 microversion: 2.1 time: 0.042861 Oct 03 10:46:06.203961 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1984/3797] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:06 2022] GET /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:46:06.213205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:06.213205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:06.225502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:06.226237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:06.226730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:06.227648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:06.228319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:06.228794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:06.239493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:06.361709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:06.362853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:06.370856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:06.371636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:06.372324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:06.373312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:06.374074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:06.374765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:06.777465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:06.790840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:06.792329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:06.793670 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-449210ed-b40f-475a-8450-297b5ad103b8 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2934 microversion: 2.42 time: 0.437450 Oct 03 10:46:06.800973 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1985/3798] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:06 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2934 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:46:07.269177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-717ad9d2-d2cf-49a2-9161-3ec5a454523b req-702ff83f-a9cf-4f32-8bd3-d74804b96527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b71dd5c-ef34-4807-90a2-7c03aec69537", "tag": "ea7b3416-8f70-4236-bf50-c70b14cc3af9"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:07.284939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-717ad9d2-d2cf-49a2-9161-3ec5a454523b req-702ff83f-a9cf-4f32-8bd3-d74804b96527 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:07.285461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-717ad9d2-d2cf-49a2-9161-3ec5a454523b req-702ff83f-a9cf-4f32-8bd3-d74804b96527 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:07.285873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-717ad9d2-d2cf-49a2-9161-3ec5a454523b req-702ff83f-a9cf-4f32-8bd3-d74804b96527 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:07.306560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:07.311868 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-717ad9d2-d2cf-49a2-9161-3ec5a454523b req-702ff83f-a9cf-4f32-8bd3-d74804b96527 service nova] Creating event network-changed:ea7b3416-8f70-4236-bf50-c70b14cc3af9 for instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 on n-h2-858383-3 Oct 03 10:46:07.319788 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-717ad9d2-d2cf-49a2-9161-3ec5a454523b req-702ff83f-a9cf-4f32-8bd3-d74804b96527 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054167 Oct 03 10:46:07.325481 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1986/3799] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:07.341956 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-666e99a1-24a1-421c-83b9-911ab18e3c93 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1500 microversion: 2.1 time: 1.143552 Oct 03 10:46:07.351522 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1814/3800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:06 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1500 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:07.644558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d6fab59e-e20d-485d-acf2-4db4563b331d req-acf96f8a-e39f-49e8-99a1-4f1de7b3ab76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-unplugged", "status": "completed", "tag": "1a182135-8788-4ba3-9eac-9ff7eb73a8c8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:07.658744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:07.672749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d6fab59e-e20d-485d-acf2-4db4563b331d req-acf96f8a-e39f-49e8-99a1-4f1de7b3ab76 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:07.673275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d6fab59e-e20d-485d-acf2-4db4563b331d req-acf96f8a-e39f-49e8-99a1-4f1de7b3ab76 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:07.674323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d6fab59e-e20d-485d-acf2-4db4563b331d req-acf96f8a-e39f-49e8-99a1-4f1de7b3ab76 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:07.712070 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d6fab59e-e20d-485d-acf2-4db4563b331d req-acf96f8a-e39f-49e8-99a1-4f1de7b3ab76 service nova] Creating event network-vif-unplugged:1a182135-8788-4ba3-9eac-9ff7eb73a8c8 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:07.722321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d6fab59e-e20d-485d-acf2-4db4563b331d req-acf96f8a-e39f-49e8-99a1-4f1de7b3ab76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085203 Oct 03 10:46:07.725432 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1987/3801] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:07.843880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:07.844526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:07.864531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:07.865188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:07.868368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:07.869857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:07.870766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:07.871586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:08.317764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:08.361204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:08.364884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:08.368126 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4018099a-e8ac-4e4e-b983-168954c67899 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2913 microversion: 2.42 time: 0.532737 Oct 03 10:46:08.371221 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1815/3802] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:07 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2913 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:08.379534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:08.380662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:08.411925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:08.413513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:08.414718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:08.416822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:08.417321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:08.418980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:08.636116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:08.647633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-98a0d5d8-dcb1-4464-88c2-99d1247b9b1e tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1506 microversion: 2.1 time: 0.274915 Oct 03 10:46:08.648819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1988/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:08 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:46:08.965259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c1f8b53c-2c88-43ce-8e51-1c9615b67fcc req-7cc160b3-5f1a-4b61-953a-ca40284951a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-deleted", "tag": "5db7d0c4-80d9-4ba7-945d-4a98f691fe43"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:08.979507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1f8b53c-2c88-43ce-8e51-1c9615b67fcc req-7cc160b3-5f1a-4b61-953a-ca40284951a8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:08.980261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1f8b53c-2c88-43ce-8e51-1c9615b67fcc req-7cc160b3-5f1a-4b61-953a-ca40284951a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:08.980684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1f8b53c-2c88-43ce-8e51-1c9615b67fcc req-7cc160b3-5f1a-4b61-953a-ca40284951a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:09.000401 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c1f8b53c-2c88-43ce-8e51-1c9615b67fcc req-7cc160b3-5f1a-4b61-953a-ca40284951a8 service nova] Creating event network-vif-deleted:5db7d0c4-80d9-4ba7-945d-4a98f691fe43 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:09.016400 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c1f8b53c-2c88-43ce-8e51-1c9615b67fcc req-7cc160b3-5f1a-4b61-953a-ca40284951a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055703 Oct 03 10:46:09.018591 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1989/3804] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:09.082350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d278bed-0c20-418e-beb5-9958ac686cf9 tempest-ExtensionsTest-1217559925 tempest-ExtensionsTest-1217559925-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:09.084870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d278bed-0c20-418e-beb5-9958ac686cf9 tempest-ExtensionsTest-1217559925 tempest-ExtensionsTest-1217559925-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.341079 Oct 03 10:46:09.086176 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1816/3805] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 3 10:46:08 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:09.100261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7bee88d0-256d-46d1-aa6e-84c7db3e5450 tempest-ExtensionsTest-1217559925 tempest-ExtensionsTest-1217559925-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:09.110476 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7bee88d0-256d-46d1-aa6e-84c7db3e5450 tempest-ExtensionsTest-1217559925 tempest-ExtensionsTest-1217559925-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.017934 Oct 03 10:46:09.112443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1990/3806] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 3 10:46:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:09.408381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:09.410004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:09.419087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:09.419603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:09.420649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:09.423382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:09.424177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:09.424815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:09.676950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:09.680496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:09.698247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:09.705154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:09.706053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:09.707124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:09.707874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:09.708641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:09.975968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:09.986577 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66d42a10-7f72-4989-84bf-c4ba703b9942 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1488 microversion: 2.1 time: 0.314610 Oct 03 10:46:09.987152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1991/3807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:09 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1488 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:46:09.992177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4a8b62ba-e884-4647-aeb1-e7c47c830f62 req-3ca36faa-918d-4bcc-91a3-e323ca6f9fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-unplugged", "status": "completed", "tag": "5db7d0c4-80d9-4ba7-945d-4a98f691fe43"}, {"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-unplugged", "status": "completed", "tag": "b7af86eb-5635-45d8-9283-b672d13a9bae"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:10.027611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4a8b62ba-e884-4647-aeb1-e7c47c830f62 req-3ca36faa-918d-4bcc-91a3-e323ca6f9fe7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.031413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4a8b62ba-e884-4647-aeb1-e7c47c830f62 req-3ca36faa-918d-4bcc-91a3-e323ca6f9fe7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.035245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4a8b62ba-e884-4647-aeb1-e7c47c830f62 req-3ca36faa-918d-4bcc-91a3-e323ca6f9fe7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.040900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:10.062246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:10.066877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4a8b62ba-e884-4647-aeb1-e7c47c830f62 req-3ca36faa-918d-4bcc-91a3-e323ca6f9fe7 service nova] Creating event network-vif-unplugged:5db7d0c4-80d9-4ba7-945d-4a98f691fe43 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:10.071726 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4a8b62ba-e884-4647-aeb1-e7c47c830f62 req-3ca36faa-918d-4bcc-91a3-e323ca6f9fe7 service nova] Creating event network-vif-unplugged:b7af86eb-5635-45d8-9283-b672d13a9bae for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:10.078217 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4a8b62ba-e884-4647-aeb1-e7c47c830f62 req-3ca36faa-918d-4bcc-91a3-e323ca6f9fe7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.089517 Oct 03 10:46:10.086744 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1992/3808] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:10.111940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:10.123413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:10.124055 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-092b11dc-2abf-4470-8d3c-0b9f116a5d75 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2753 microversion: 2.42 time: 0.717963 Oct 03 10:46:10.130479 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1817/3809] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:09 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2753 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:10.155749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.156228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:10.163861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.164635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.165335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.166093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.166558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.166992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.198287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:46:10.366520 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1edba16-d2bb-41cc-a2fb-361d8cbdc235 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 204 len: 0 microversion: 2.1 time: 0.231226 Oct 03 10:46:10.367155 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1818/3810] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:10 2022] DELETE /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:46:10.396382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f381f39-b1a4-4de2-b550-d61697475b8c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e1e0820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.435818 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6f381f39-b1a4-4de2-b550-d61697475b8c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Image not found. Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f381f39-b1a4-4de2-b550-d61697475b8c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad HTTP/1.1 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad'} Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad to delete Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad could not be found. Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:10.438683 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:46:10.444214 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:10.448822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f381f39-b1a4-4de2-b550-d61697475b8c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:10.450542 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f381f39-b1a4-4de2-b550-d61697475b8c tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad" status: 404 len: 62 microversion: 2.1 time: 0.068936 Oct 03 10:46:10.452047 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1819/3811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:10 2022] DELETE /compute/v2.1/images/6b75ce16-6fbb-46c8-8efa-fd88ff4ed3ad => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:46:10.464280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.464507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.465491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:10.471794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.472305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.473313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.474541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.476169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.478247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.493444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.494702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.495318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.496871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.497409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.497931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.509986 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1375754b-7b1d-450a-997e-8456c31826ae tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.421224 Oct 03 10:46:10.510970 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1993/3812] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:46:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:10.523994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.528371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.529131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.529780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.531338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.531980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.532578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.541702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:46:10.579203 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75f59c4b-bddd-46bb-8b95-a4b4bbe7f583 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-858383-3" status: 200 len: 578 microversion: 2.1 time: 0.058925 Oct 03 10:46:10.580403 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1994/3813] 10.222.0.27 () {58 vars in 1172 bytes} [Mon Oct 3 10:46:10 2022] GET /compute/v2.1/os-services?host=n-d-858383-3 => generated 578 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:10.596903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.604435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.605214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.605427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.606149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.606603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.607032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.669476 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.compute.api [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Instance is already in deleting state, ignoring this request Oct 03 10:46:10.674398 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3811032d-6dae-4d7c-8f96-5c26933105a8 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 204 len: 0 microversion: 2.1 time: 0.213946 Oct 03 10:46:10.677264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1820/3814] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:10 2022] DELETE /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:46:10.686660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.687287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:10.704966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.705908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.706136 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61a11e54-dcf6-422c-bff8-1b55815c2bb8 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.115144 Oct 03 10:46:10.707416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.707742 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1995/3815] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 10:46:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:10.708571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.709820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.710516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.727587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:10.734150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.735024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.735518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.736284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:10.736749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:10.737299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:10.778513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24878ce8-025c-4020-aaae-841b7c27c5d7 tempest-ServicesAdminTestJSON-1853797523 tempest-ServicesAdminTestJSON-1853797523-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.057822 Oct 03 10:46:10.779152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1996/3816] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:46:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:10.981169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:10.993887 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96deee37-8269-4b12-b6b4-feaa11c2f66b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1494 microversion: 2.1 time: 0.311431 Oct 03 10:46:10.994477 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1821/3817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:10 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1494 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:11.175013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:11.176083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:11.193662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ab7c21f4-bc65-461c-b222-829ab36366d6 req-adab5da0-d212-4e30-a32d-a02aa8cf84e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-deleted", "tag": "b7af86eb-5635-45d8-9283-b672d13a9bae"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:11.205071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:11.205685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:11.206813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:11.207643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:11.208110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:11.208544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:11.212539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ab7c21f4-bc65-461c-b222-829ab36366d6 req-adab5da0-d212-4e30-a32d-a02aa8cf84e3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:11.215241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ab7c21f4-bc65-461c-b222-829ab36366d6 req-adab5da0-d212-4e30-a32d-a02aa8cf84e3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:11.216013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ab7c21f4-bc65-461c-b222-829ab36366d6 req-adab5da0-d212-4e30-a32d-a02aa8cf84e3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:11.258435 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ab7c21f4-bc65-461c-b222-829ab36366d6 req-adab5da0-d212-4e30-a32d-a02aa8cf84e3 service nova] Creating event network-vif-deleted:b7af86eb-5635-45d8-9283-b672d13a9bae for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:11.273935 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ab7c21f4-bc65-461c-b222-829ab36366d6 req-adab5da0-d212-4e30-a32d-a02aa8cf84e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083348 Oct 03 10:46:11.281553 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1822/3818] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:11.550999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:11.565472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:11.572124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:11.573728 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e7225e79-7c25-45ff-bd00-250b73d4c998 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2707 microversion: 2.42 time: 0.414509 Oct 03 10:46:11.608979 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1997/3819] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:11 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2707 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:12.044399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:12.046143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:12.069574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:12.070192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:12.070878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:12.080529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:12.093303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:12.093957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:12.186971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e1aacd33-5423-404c-aded-f4edf226b6be req-59af1c17-cfe6-4a2e-a524-c875fa2b1a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfef0178-3b0e-44b0-97ff-e7dba3539e08", "name": "network-vif-plugged", "status": "completed", "tag": "12756a18-f2d9-42df-bdac-bcae3625574d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:12.220241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e1aacd33-5423-404c-aded-f4edf226b6be req-59af1c17-cfe6-4a2e-a524-c875fa2b1a02 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:12.221354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e1aacd33-5423-404c-aded-f4edf226b6be req-59af1c17-cfe6-4a2e-a524-c875fa2b1a02 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:12.222167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e1aacd33-5423-404c-aded-f4edf226b6be req-59af1c17-cfe6-4a2e-a524-c875fa2b1a02 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:12.241842 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e1aacd33-5423-404c-aded-f4edf226b6be req-59af1c17-cfe6-4a2e-a524-c875fa2b1a02 service nova] Creating event network-vif-plugged:12756a18-f2d9-42df-bdac-bcae3625574d for instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 on n-h2-858383-3 Oct 03 10:46:12.251078 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e1aacd33-5423-404c-aded-f4edf226b6be req-59af1c17-cfe6-4a2e-a524-c875fa2b1a02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070412 Oct 03 10:46:12.252472 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1998/3820] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:12.614628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:12.615563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:12.632515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:12.633058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:12.633555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:12.634540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:12.637496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:12.638154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:13.051006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:13.067565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:13.070722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:13.079543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:13.086246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-133da92e-2cd3-4125-9ad7-fe332ebf3349 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2415 microversion: 2.42 time: 0.464389 Oct 03 10:46:13.104887 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 1999/3821] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:12 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2415 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:13.106977 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5c9ef9ad-43d0-438e-99b4-110348b1973f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1494 microversion: 2.1 time: 1.074260 Oct 03 10:46:13.107583 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1823/3822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:12 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1494 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:13.989820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d48e3338-0fad-4e1c-ac9f-c041648fe2f7 req-e7e03323-7a7c-4633-bd14-7f1b5ba07504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-deleted", "tag": "829b5797-cf23-4334-85f8-8196dcc8acd1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:14.020281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d48e3338-0fad-4e1c-ac9f-c041648fe2f7 req-e7e03323-7a7c-4633-bd14-7f1b5ba07504 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:14.020761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d48e3338-0fad-4e1c-ac9f-c041648fe2f7 req-e7e03323-7a7c-4633-bd14-7f1b5ba07504 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:14.026611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d48e3338-0fad-4e1c-ac9f-c041648fe2f7 req-e7e03323-7a7c-4633-bd14-7f1b5ba07504 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:14.076026 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d48e3338-0fad-4e1c-ac9f-c041648fe2f7 req-e7e03323-7a7c-4633-bd14-7f1b5ba07504 service nova] Creating event network-vif-deleted:829b5797-cf23-4334-85f8-8196dcc8acd1 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:14.091527 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d48e3338-0fad-4e1c-ac9f-c041648fe2f7 req-e7e03323-7a7c-4633-bd14-7f1b5ba07504 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105533 Oct 03 10:46:14.095633 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2000/3823] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:14.126772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:14.127466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:14.140163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:14.149756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:14.150743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:14.151386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:14.152258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:14.167904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:14.170119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:14.173710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:14.194292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:14.195478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:14.195928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:14.199811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:14.200685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:14.202855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:15.071452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cf916cbc904a6a97066fe7af1b3bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb0ac0c3b6341dfabb4df863ccefeb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:15.103274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:15.116022 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2e1c6f8e-2d8a-47b4-a7b7-3478f0218e86 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 200 len: 1494 microversion: 2.1 time: 0.979060 Oct 03 10:46:15.117810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2001/3824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:14 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 1494 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:15.128400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:15.128400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:15.128400 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-320edac0-0d70-4db6-a0e5-2178e57e5b8f tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2256 microversion: 2.42 time: 0.998698 Oct 03 10:46:15.128400 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1824/3825] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:14 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2256 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:46:16.148844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.155382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: dfef0178-3b0e-44b0-97ff-e7dba3539e08] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:16.161416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.162189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:16.166064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.166641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.167104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.167846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.168454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.168930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.177328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.177810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.181068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.198286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.198746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.199240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.215233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 could not be found. Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 HTTP/1.1 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 could not be found. Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'dfef0178-3b0e-44b0-97ff-e7dba3539e08'} Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 could not be found. Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 could not be found. Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.218255 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.222774 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.222774 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.222774 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.222774 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.222774 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 could not be found. Oct 03 10:46:16.222774 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.225095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.226254 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b0c55e23-242f-46ef-90e3-3a7f269406b1 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08" status: 404 len: 111 microversion: 2.1 time: 0.082200 Oct 03 10:46:16.230886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1825/3826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:16 2022] GET /compute/v2.1/servers/dfef0178-3b0e-44b0-97ff-e7dba3539e08 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:46:16.238023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d637b1ac-f2d0-4754-a7bd-c3118a1cec63 req-74a3e507-35e0-4918-8816-9304ff1a38c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfef0178-3b0e-44b0-97ff-e7dba3539e08", "name": "network-vif-deleted", "tag": "12756a18-f2d9-42df-bdac-bcae3625574d"}, {"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-deleted", "tag": "12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:16.250168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d637b1ac-f2d0-4754-a7bd-c3118a1cec63 req-74a3e507-35e0-4918-8816-9304ff1a38c1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.251176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d637b1ac-f2d0-4754-a7bd-c3118a1cec63 req-74a3e507-35e0-4918-8816-9304ff1a38c1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.251855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d637b1ac-f2d0-4754-a7bd-c3118a1cec63 req-74a3e507-35e0-4918-8816-9304ff1a38c1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.285012 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d637b1ac-f2d0-4754-a7bd-c3118a1cec63 req-74a3e507-35e0-4918-8816-9304ff1a38c1 service nova] Creating event network-vif-deleted:12756a18-f2d9-42df-bdac-bcae3625574d for instance dfef0178-3b0e-44b0-97ff-e7dba3539e08 on n-h2-858383-3 Oct 03 10:46:16.286706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d637b1ac-f2d0-4754-a7bd-c3118a1cec63 req-74a3e507-35e0-4918-8816-9304ff1a38c1 service nova] Creating event network-vif-deleted:12eb03c6-9d2e-4bc8-9ca3-be6302f05dfa for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:16.299718 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d637b1ac-f2d0-4754-a7bd-c3118a1cec63 req-74a3e507-35e0-4918-8816-9304ff1a38c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067226 Oct 03 10:46:16.303064 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1826/3827] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:16.313660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e20dfaff-f1e6-4892-821d-1b3c1f0c3e89 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e119a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.359885 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e20dfaff-f1e6-4892-821d-1b3c1f0c3e89 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Image not found. Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e20dfaff-f1e6-4892-821d-1b3c1f0c3e89 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 HTTP/1.1 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '046481e7-be2a-4793-a833-4a22149a6f01'} Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 046481e7-be2a-4793-a833-4a22149a6f01 to delete Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 046481e7-be2a-4793-a833-4a22149a6f01 could not be found. Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.364669 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:46:16.369631 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.372817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e20dfaff-f1e6-4892-821d-1b3c1f0c3e89 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.374524 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e20dfaff-f1e6-4892-821d-1b3c1f0c3e89 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01" status: 404 len: 62 microversion: 2.1 time: 0.068904 Oct 03 10:46:16.378562 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1827/3828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:16 2022] DELETE /compute/v2.1/images/046481e7-be2a-4793-a833-4a22149a6f01 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:46:16.384152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.385454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:16.397333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.398211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.398932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.399808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.400412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.401032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.439439 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 HTTP/1.1 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'e3ae4577-d2bb-4e45-a513-f885d98a8a36'} Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:16.443830 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.451451 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48ecb81a-d711-4cfb-a80b-0bdebdc0500b tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 404 len: 111 microversion: 2.1 time: 0.068978 Oct 03 10:46:16.458001 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1828/3829] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:16 2022] DELETE /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:16.469928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.470807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: e3ae4577-d2bb-4e45-a513-f885d98a8a36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:16.480950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.481460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.481915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.482716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.483760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.484526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.503781 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 HTTP/1.1 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'e3ae4577-d2bb-4e45-a513-f885d98a8a36'} Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.507212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Instance e3ae4577-d2bb-4e45-a513-f885d98a8a36 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-daa59c0e-e623-4c06-8248-a9cd35a5ab18 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36" status: 404 len: 111 microversion: 2.1 time: 0.048171 Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1829/3830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:16 2022] GET /compute/v2.1/servers/e3ae4577-d2bb-4e45-a513-f885d98a8a36 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:16.520945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-27cd97eb-9095-44d7-8276-b5c21d1a25e0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e0af3a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.553902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-27cd97eb-9095-44d7-8276-b5c21d1a25e0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Image not found. Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-27cd97eb-9095-44d7-8276-b5c21d1a25e0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 HTTP/1.1 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b6aab562-1fb0-40e3-a5a2-23eecf523313'} Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b6aab562-1fb0-40e3-a5a2-23eecf523313 to delete Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6aab562-1fb0-40e3-a5a2-23eecf523313 could not be found. Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.573702 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-27cd97eb-9095-44d7-8276-b5c21d1a25e0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.578577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-27cd97eb-9095-44d7-8276-b5c21d1a25e0 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313" status: 404 len: 62 microversion: 2.1 time: 0.060810 Oct 03 10:46:16.582011 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1830/3831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:16 2022] DELETE /compute/v2.1/images/b6aab562-1fb0-40e3-a5a2-23eecf523313 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:46:16.590950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.593405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:16.611306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.612792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.613574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.614826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.615927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.617790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.644676 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 HTTP/1.1 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '951eaf6a-7c9d-4f81-b5eb-d01ef0d59243'} Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:16.646703 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bcb5aab1-c221-4dd9-b6e8-3ef7dd62aec7 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 404 len: 111 microversion: 2.1 time: 0.066238 Oct 03 10:46:16.651011 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1831/3832] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:16 2022] DELETE /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:16.661706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.662495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:16.671658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.672399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.673056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.677479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.678311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.679095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.702593 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 HTTP/1.1 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '951eaf6a-7c9d-4f81-b5eb-d01ef0d59243'} Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.704818 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.709962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.709962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.709962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.709962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.709962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. Oct 03 10:46:16.709962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.711732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Instance 951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.712898 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a4e64dd9-1fa4-40b5-a511-8be336c02f09 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243" status: 404 len: 111 microversion: 2.1 time: 0.055797 Oct 03 10:46:16.713787 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1832/3833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:16 2022] GET /compute/v2.1/servers/951eaf6a-7c9d-4f81-b5eb-d01ef0d59243 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:16.738903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6c61a91-c83f-4db1-9006-366703350f98 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '.version_select at 0x7f074e0af1f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.787778 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e6c61a91-c83f-4db1-9006-366703350f98 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Image not found. Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6c61a91-c83f-4db1-9006-366703350f98 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f HTTP/1.1 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: exception: Image not found. Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '8dacb99f-9db8-4162-b72a-b096cf9c137f'} Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8dacb99f-9db8-4162-b72a-b096cf9c137f to delete Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8dacb99f-9db8-4162-b72a-b096cf9c137f could not be found. Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.790437 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 10:46:16.794677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.810232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6c61a91-c83f-4db1-9006-366703350f98 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Image not found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.813901 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6c61a91-c83f-4db1-9006-366703350f98 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f" status: 404 len: 62 microversion: 2.1 time: 0.092939 Oct 03 10:46:16.814615 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1833/3834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:16 2022] DELETE /compute/v2.1/images/8dacb99f-9db8-4162-b72a-b096cf9c137f => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:46:16.826850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.827358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:16.857554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.858945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.859695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.861465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:16.862150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:16.862778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:16.904063 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 HTTP/1.1 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '59342ad5-604b-486f-9d3f-aaf03ef28462'} Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:16.908659 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:16.920910 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:16.934408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:16.936995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-02a5c7a9-2a20-41ad-ba09-17940252086f tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "DELETE /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 404 len: 111 microversion: 2.1 time: 0.116295 Oct 03 10:46:16.939153 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1834/3835] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:16 2022] DELETE /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:16.976576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:16.980568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] [instance: 59342ad5-604b-486f-9d3f-aaf03ef28462] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:17.019378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:17.021421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:17.021622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:17.022038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:17.037376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:17.039283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:17.041912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:17.044248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:17.050232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:17.054245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-29830c39-32d6-460e-983c-54c7ec9a6f28 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 2210 microversion: 2.42 time: 0.898063 Oct 03 10:46:17.067231 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2002/3836] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:16 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 2210 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:17.157520 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] HTTP exception thrown: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Request method failure captured: Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 HTTP/1.1 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxp4lv2axRIZJpKC198ToHXiBvAQXOWRva_qK6c4a9vWrkFqhWk1FgO2ghc4XauocTGoaDzWRoUDnT5Ou93-fFFbd0xzcxTPADg77R-cB1OXlVR_hyiZXhsS1gE48q99EHC8czBcveuv1ST2nNuehVFWWuySGssp0pmJrc4FjVII8c Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8fb0ac0c3b6341dfabb4df863ccefeb1"}]}] Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ImagesTestJSON-311954049 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 8fb0ac0c3b6341dfabb4df863ccefeb1 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ImagesTestJSON-311954049 Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 51cf916cbc904a6a97066fe7af1b3bae Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ImagesTestJSON-311954049-project Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '59342ad5-604b-486f-9d3f-aaf03ef28462'} Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:17.161741 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:17.170609 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:17.170609 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:17.170609 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:17.170609 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:17.170609 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. Oct 03 10:46:17.170609 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:17.174230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] Returning 404 to user: Instance 59342ad5-604b-486f-9d3f-aaf03ef28462 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:17.176884 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1417c626-fe39-4440-b8c2-8ab4019d5007 tempest-ImagesTestJSON-311954049 tempest-ImagesTestJSON-311954049-project] 10.222.0.27 "GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462" status: 404 len: 111 microversion: 2.1 time: 0.229865 Oct 03 10:46:17.179492 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1835/3837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:16 2022] GET /compute/v2.1/servers/59342ad5-604b-486f-9d3f-aaf03ef28462 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:18.110194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:18.112139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:18.124670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:18.131240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:18.132215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:18.133176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:18.133805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:18.134934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:18.337487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:18.371287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:18.384304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:18.387200 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58ead8f6-1115-48f4-8850-1fb75a318adc tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.281214 Oct 03 10:46:18.390562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2003/3838] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:18 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:18.424282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b192d87c-bd78-453d-ac10-cbc65e05c756 req-cda2bcd4-a56a-4fda-af14-b96b43f715ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a920cd6-3c5a-43c2-8780-1af59b41162f", "name": "network-vif-deleted", "tag": "1a182135-8788-4ba3-9eac-9ff7eb73a8c8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:18.449981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b192d87c-bd78-453d-ac10-cbc65e05c756 req-cda2bcd4-a56a-4fda-af14-b96b43f715ff service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:18.450986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b192d87c-bd78-453d-ac10-cbc65e05c756 req-cda2bcd4-a56a-4fda-af14-b96b43f715ff service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:18.452421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b192d87c-bd78-453d-ac10-cbc65e05c756 req-cda2bcd4-a56a-4fda-af14-b96b43f715ff service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:18.498291 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b192d87c-bd78-453d-ac10-cbc65e05c756 req-cda2bcd4-a56a-4fda-af14-b96b43f715ff service nova] Creating event network-vif-deleted:1a182135-8788-4ba3-9eac-9ff7eb73a8c8 for instance 4a920cd6-3c5a-43c2-8780-1af59b41162f on n-h2-858383-3 Oct 03 10:46:18.515270 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b192d87c-bd78-453d-ac10-cbc65e05c756 req-cda2bcd4-a56a-4fda-af14-b96b43f715ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095162 Oct 03 10:46:18.518941 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1836/3839] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:19.448987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:19.450201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:19.509459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:19.517950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:19.518522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:19.519293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:19.519770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:19.520200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:19.892167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:19.912519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:19.917497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:19.922474 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-55840d36-8642-42e3-96fc-7e3a4f6df7ae tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.482295 Oct 03 10:46:19.924058 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2004/3840] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:19 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:20.956065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:20.957015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:20.975475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:20.976054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:20.976741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:20.979743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:20.984228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:20.985196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:21.225303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:21.246215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:21.254177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:21.259932 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-499a19c7-e7a1-418f-bc3b-cfeebd8195ad tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.308629 Oct 03 10:46:21.264944 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1837/3841] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:20 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:22.298993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:22.299626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:22.314336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:22.327745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:22.334506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:22.335367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:22.336158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:22.336639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:22.337106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:22.726329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:22.756061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:22.759253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:22.768545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c62a846e-d4e0-4f17-8232-1dd9cd7503d0 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.475117 Oct 03 10:46:22.770167 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2005/3842] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:22 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:23.209918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1360698067", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "496fe5d5-6627-47bd-9d0e-936d950fb5c3"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:23.350150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] validate_networks() for [('496fe5d5-6627-47bd-9d0e-936d950fb5c3', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:46:23.815688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:23.818998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:23.848144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:23.849366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:23.852681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:23.853662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:23.855188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:23.857966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:24.222997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:24.248677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:24.266155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:24.269257 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-49572f21-e1bc-4483-a8bb-d9bf756510fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.473976 Oct 03 10:46:24.272242 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2006/3843] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:23 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:25.069374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:46:25.072155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:46:25.072155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:46:25.072155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:46:25.072155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:46:25.074365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:25.098774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:25.099431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:25.101921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:25.103120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:25.106260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:25.107042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:25.166231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Getting quotas for project 0636ed42cbed435aaee6b88d8978b98b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:46:25.194462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Getting quotas for user c1cf2098bc1f4abe8e7ba06e0390b990 and project 0636ed42cbed435aaee6b88d8978b98b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:46:25.214403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Going to run 2 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:46:25.219305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 14bb672b-6bb5-4b7f-bc11-8e692117e154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:46:25.262271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=14bb672b-6bb5-4b7f-bc11-8e692117e154,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:46:25.316927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:25.322989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:25.343026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:25.343724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:25.344172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:25.344928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:25.350188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:25.356783 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b49f494-d5f5-40aa-8cfd-bb131f95cac8 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.901660 Oct 03 10:46:25.357714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:25.358876 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1838/3844] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:46:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:46:25.374073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:25.389624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:25.392430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Searching by: {'deleted': False, 'project_id': '0636ed42cbed435aaee6b88d8978b98b'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:46:25.444598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:25.447723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:25.448226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:25.452321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:25.456446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:25.459558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:25.523216 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc3b5b1a-249b-4b03-9c98-97b4dcca9575 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.154974 Oct 03 10:46:25.528273 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1839/3845] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:46:25 2022] GET /compute/v2.1/servers => generated 677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:25.549371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53bcb913-b735-47da-a801-5add6eafff93 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:25.552668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53bcb913-b735-47da-a801-5add6eafff93 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:25.734271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:25.746148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:25.767657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:25.769935 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43852788-a351-4130-b6fd-b3718f8e1414 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.463027 Oct 03 10:46:25.771424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53bcb913-b735-47da-a801-5add6eafff93 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:25.772759 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2007/3846] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:25 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:46:25.787910 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53bcb913-b735-47da-a801-5add6eafff93 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1220 microversion: 2.1 time: 0.247191 Oct 03 10:46:25.790213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1840/3847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:25 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1220 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:46:26.820621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:26.824816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:26.838610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:26.839827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:26.840876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:26.843072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:26.843387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-400df20c-ffa7-4a98-bc3c-69d522d36727 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:26.844137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-400df20c-ffa7-4a98-bc3c-69d522d36727 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:26.845255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:26.846307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:27.026362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-400df20c-ffa7-4a98-bc3c-69d522d36727 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:27.046278 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-400df20c-ffa7-4a98-bc3c-69d522d36727 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1220 microversion: 2.1 time: 0.207536 Oct 03 10:46:27.048187 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1841/3848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:26 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:27.263834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:27.282740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:27.345861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:27.347334 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1736b141-1dc3-41f6-a489-6eeba463c4d3 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.530854 Oct 03 10:46:27.363957 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2008/3849] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:26 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:28.082198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:28.085216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:28.114999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:28.121382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:28.122621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:28.128982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:28.130724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:28.131292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:28.390578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:28.394882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:28.428453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:28.430431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:28.430909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:28.433173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:28.433451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:28.436626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:28.439461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:28.441247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:28.452965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a7c6bc3f-f156-4b29-a566-a291cde994da tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1216 microversion: 2.1 time: 0.374799 Oct 03 10:46:28.456183 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1842/3850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:28 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1216 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:46:28.737446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:28.782110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:28.791507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:28.797453 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d83b42e9-289a-48e1-9d9c-48ce548513e9 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.422260 Oct 03 10:46:28.801490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2009/3851] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:28 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:29.480337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:29.483590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:29.510690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:29.520322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:29.524583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:29.529035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:29.529602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:29.531841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:29.781979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:29.816788 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6bae4b96-831a-445f-bf5d-1163a9cf285c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1272 microversion: 2.1 time: 0.340245 Oct 03 10:46:29.819957 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1843/3852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:29 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:29.834506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:29.835692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:29.852411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:29.854721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:29.857519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:29.876040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:29.878431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:29.880092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:30.089731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:30.106517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:30.111509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:30.114808 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4443e2d7-20a7-44a0-bd61-adaf25704aec tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.287258 Oct 03 10:46:30.119247 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2010/3853] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:29 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:30.850536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:30.852298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:30.878795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:30.879308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:30.879774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:30.885199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:30.885903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:30.887337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:31.095941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:31.110119 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3309099-d7c3-43c6-8fea-ec13e28f4d25 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1278 microversion: 2.1 time: 0.265791 Oct 03 10:46:31.111880 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1844/3854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:30 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:31.151292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:31.151958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:31.171463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:31.173077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:31.176944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:31.178256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:31.183066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:31.198766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:31.735636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:31.760905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:31.766969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:31.769151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ffd31f18-f98a-4d62-8aec-7939916e2b31 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.623791 Oct 03 10:46:31.771014 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2011/3855] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:31 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:32.153547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:32.159361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:32.193230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:32.194420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:32.197833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:32.203319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:32.204849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:32.208794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:32.802725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:32.804078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:32.828980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:32.832158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:32.834229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:32.835022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:32.835502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:32.841529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:33.012124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:33.032235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:33.034523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:33.036553 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77292a5a-daa8-448f-a861-08c2c1357e55 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.238304 Oct 03 10:46:33.042519 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2012/3856] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:32 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:46:33.273824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:33.297860 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f7035be-0302-4080-a739-54c575ca55cf tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 1.160938 Oct 03 10:46:33.312806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1845/3857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:32 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:34.074356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:34.074990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:34.098994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:34.099546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:34.101109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:34.101876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:34.108409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:34.110236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:34.308322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e2670df-2baa-49ab-862e-e1293fe3f758 tempest-FloatingIPDetailsNegativeTestJSON-1381284806 tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project] Calling method '.version_select at 0x7f074eb04700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:34.371925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:34.383592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:34.395566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:34.402286 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-45795cf4-a5d9-4dff-8930-2dc147f16591 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.335094 Oct 03 10:46:34.405407 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1846/3858] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:34 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:34.424318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:34.430143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:34.450731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:34.451610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:34.452358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:34.453312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:34.454641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:34.457522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:34.564973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-9e2670df-2baa-49ab-862e-e1293fe3f758 tempest-FloatingIPDetailsNegativeTestJSON-1381284806 tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c could not be found", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:46:34.567038 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-9e2670df-2baa-49ab-862e-e1293fe3f758 tempest-FloatingIPDetailsNegativeTestJSON-1381284806 tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project] HTTP exception thrown: Floating IP not found for ID 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e2670df-2baa-49ab-862e-e1293fe3f758 tempest-FloatingIPDetailsNegativeTestJSON-1381284806 tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project] Request method failure captured: Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-floating-ips/520cfd9d-4210-4fe1-ac9a-0bf09ca1456c HTTP/1.1 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr2J7CWWhTXtv4LCMHS2S6Hsh_J9pIojiRi-1aB-MeswjosQ4Mm0YEisM3yqj1_jbalCzlqe2wqCDe0ninhtewHkTGOjBFfyGsyyq_QgiEd06sDeqLzz7GdGf3S86vwYKsLBorWFUt5fpo8sjVtGUlvd9KlGRhgciLmxge__hWWFa1I Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 12031c071bee463fb7e238e393ddde68 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1381284806 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12031c071bee463fb7e238e393ddde68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_12031c071bee463fb7e238e393ddde68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/12031c071bee463fb7e238e393ddde68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12031c071bee463fb7e238e393ddde68"}]}] Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1381284806 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 12031c071bee463fb7e238e393ddde68 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1381284806 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: ecd4e4e09db54d2582dd7b7477fca100 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: exception: Floating IP not found for ID 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '520cfd9d-4210-4fe1-ac9a-0bf09ca1456c'} Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:46:34.585923 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c could not be found Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b6b1a3e-2b14-45d7-a00f-ac252e867473'] Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c. Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c Oct 03 10:46:34.592280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:34.600796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e2670df-2baa-49ab-862e-e1293fe3f758 tempest-FloatingIPDetailsNegativeTestJSON-1381284806 tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project] Returning 404 to user: Floating IP not found for ID 520cfd9d-4210-4fe1-ac9a-0bf09ca1456c {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:34.602054 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e2670df-2baa-49ab-862e-e1293fe3f758 tempest-FloatingIPDetailsNegativeTestJSON-1381284806 tempest-FloatingIPDetailsNegativeTestJSON-1381284806-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/520cfd9d-4210-4fe1-ac9a-0bf09ca1456c" status: 404 len: 111 microversion: 2.1 time: 0.944188 Oct 03 10:46:34.603194 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2013/3859] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 10:46:33 2022] GET /compute/v2.1/os-floating-ips/520cfd9d-4210-4fe1-ac9a-0bf09ca1456c => generated 111 bytes in 946 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:34.612683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9f061c77-ce34-42e6-8c88-29db1b585ae2 req-e0d2bbab-8e70-471d-b11b-046049b11653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bb672b-6bb5-4b7f-bc11-8e692117e154", "tag": "47c12223-2ffc-42b3-92d8-6b7cb7c11ab7"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:34.635975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9f061c77-ce34-42e6-8c88-29db1b585ae2 req-e0d2bbab-8e70-471d-b11b-046049b11653 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:34.636847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9f061c77-ce34-42e6-8c88-29db1b585ae2 req-e0d2bbab-8e70-471d-b11b-046049b11653 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:34.637537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9f061c77-ce34-42e6-8c88-29db1b585ae2 req-e0d2bbab-8e70-471d-b11b-046049b11653 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:34.664660 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9f061c77-ce34-42e6-8c88-29db1b585ae2 req-e0d2bbab-8e70-471d-b11b-046049b11653 service nova] Creating event network-changed:47c12223-2ffc-42b3-92d8-6b7cb7c11ab7 for instance 14bb672b-6bb5-4b7f-bc11-8e692117e154 on n-h1-858383-3 Oct 03 10:46:34.709816 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9f061c77-ce34-42e6-8c88-29db1b585ae2 req-e0d2bbab-8e70-471d-b11b-046049b11653 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105054 Oct 03 10:46:34.714417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2014/3860] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:35.160002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:35.172955 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-987adff4-9909-4bd7-bf03-e1a7e48dddb1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.764282 Oct 03 10:46:35.173987 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1847/3861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:34 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:35.436266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:35.437062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:35.456939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:35.461220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:35.462965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:35.465933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:35.468000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:35.473176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:35.489135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:35.674482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:35.681627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:35.697574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:35.714497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:35.715507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:35.717224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:35.719019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:35.719961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:35.720968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:35.840286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:35.852400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:35.881374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:35.886842 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a87e95b-9e31-4907-a929-4498dc54482e tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.454979 Oct 03 10:46:35.895206 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2015/3862] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:35 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:35.925558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'services' on Instance uuid 3b71dd5c-ef34-4807-90a2-7c03aec69537 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:46:36.111876 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7a668798-6366-4687-8e7f-311f9bfe9870 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments/86ea1e3d-ed79-49cb-afa5-180b3bbd427d" status: 202 len: 0 microversion: 2.1 time: 0.445408 Oct 03 10:46:36.113255 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1848/3863] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:46:35 2022] DELETE /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments/86ea1e3d-ed79-49cb-afa5-180b3bbd427d => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:46:36.123247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:36.127212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:36.153532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:36.158991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:36.160809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:36.164312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:36.166018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:36.168632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:36.210776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:36.211657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:36.230790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:36.231551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:36.234150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:36.235967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:36.239736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:36.240445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:36.313554 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee8a4384-94b2-4f36-b5e0-febd58c5aed7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195200 Oct 03 10:46:36.329889 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2016/3864] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:36 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:36.720637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:36.734929 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bfb037a1-e37a-4965-848b-188b167aa66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.531603 Oct 03 10:46:36.751092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1849/3865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:36 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:36.835396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6ad03a43-382c-4c4d-817e-16f8b5793099 req-e593b6e2-1e62-4851-96ad-94cdae1afe8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0caf5248-3dde-4ffa-869a-dee1047b769a", "tag": "23796852-c642-4aa3-b641-4116949e7dc6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:36.878014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ad03a43-382c-4c4d-817e-16f8b5793099 req-e593b6e2-1e62-4851-96ad-94cdae1afe8d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:36.883473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ad03a43-382c-4c4d-817e-16f8b5793099 req-e593b6e2-1e62-4851-96ad-94cdae1afe8d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:36.885195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ad03a43-382c-4c4d-817e-16f8b5793099 req-e593b6e2-1e62-4851-96ad-94cdae1afe8d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:36.924964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:36.925343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6ad03a43-382c-4c4d-817e-16f8b5793099 req-e593b6e2-1e62-4851-96ad-94cdae1afe8d service nova] Creating event network-changed:23796852-c642-4aa3-b641-4116949e7dc6 for instance 0caf5248-3dde-4ffa-869a-dee1047b769a on n-h1-858383-3 Oct 03 10:46:36.926337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:36.937213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:36.938114 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6ad03a43-382c-4c4d-817e-16f8b5793099 req-e593b6e2-1e62-4851-96ad-94cdae1afe8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107580 Oct 03 10:46:36.938888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:36.943141 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2017/3866] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:36.944180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:36.945200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:36.945798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:36.946374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:37.029147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:37.035654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:37.041484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:37.048299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:37.049691 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9634512a-8f51-4af5-b9c2-942d911a43d6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.128618 Oct 03 10:46:37.050337 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1850/3867] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:36 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:46:37.330457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:37.334952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:37.366449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:37.367767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:37.368813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:37.370143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:37.370720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:37.372281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:37.436292 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b84641f4-0ce0-4af1-b779-cf57e163413e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112331 Oct 03 10:46:37.441502 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2018/3868] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:37 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:37.758869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:37.760094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:37.773946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:37.778055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:37.778759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:37.780248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:37.780940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:37.782549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:38.082812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:38.083435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:38.106826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=67 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:38.124819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:38.127286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:38.129772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:38.133455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:38.134457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:38.135885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:38.159423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:38.167462 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-541fe09c-6e93-4921-909d-c3dc0073499b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.412488 Oct 03 10:46:38.173876 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1851/3869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:37 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:38.449032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:38.451590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:38.462293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:38.468679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:38.469446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:38.477872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:38.481050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:38.481777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:38.534491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:38.550742 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a4c7d38-5e11-42da-9f07-175e7003a86b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105630 Oct 03 10:46:38.550975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:38.551669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1852/3870] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:38 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:38.555789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:38.559545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5c4dd45-47bb-444f-a550-62b7e1f423ba tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.483169 Oct 03 10:46:38.561809 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2019/3871] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:38 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:39.191599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:39.192221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:39.212435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:39.213194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:39.213824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:39.214729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:39.215355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:39.215953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:39.565528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:39.568733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:39.590273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:39.590924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:39.591353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:39.592185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:39.595891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:39.598046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:39.691687 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c9fd3cf8-983a-4194-8c4b-855d0670cf00 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128240 Oct 03 10:46:39.693845 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2020/3872] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:39 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:39.725223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:39.727313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:39.738540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:39.739040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:39.739482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:39.740436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:39.740929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:39.741396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:39.948255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:39.971203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:39.972687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:39.973957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-109c964d-0e5a-428d-9902-d875567b98ea tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.279132 Oct 03 10:46:39.974530 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2021/3873] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:39 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:40.301555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:40.311956 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8435e0e-cd7c-4f4e-ac47-f1559fcebf8a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 1.123995 Oct 03 10:46:40.317560 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1853/3874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:39 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:40.716003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:40.726091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:40.749739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:40.750253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:40.768032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:40.768941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:40.769434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:40.769876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:40.889205 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38c15ea0-c145-4ef6-baa5-37b6403a61be tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186979 Oct 03 10:46:40.889818 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2022/3875] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:40 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:41.008958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:41.009618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:41.020352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:41.020899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:41.021351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:41.022099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:41.022572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:41.023005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:41.222203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:41.248300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:41.249959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:41.251233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1df2d85a-3f9c-47d6-8008-910ce813296a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.246368 Oct 03 10:46:41.254257 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1854/3876] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:41 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:41.347206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:41.347932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:41.365054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:41.365893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:41.368489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:41.373928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:41.379672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:41.381048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:41.835126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:41.855217 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9be0b321-fd5b-4bfc-beb8-d3786ecad54c tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.513689 Oct 03 10:46:41.859588 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2023/3877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:41 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:41.903793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:41.909543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:41.928482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:41.933372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:41.934735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:41.937723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:41.938776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:41.942108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:42.022501 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a8372f3d-be93-453a-90f5-f5ea51d5a70b tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124528 Oct 03 10:46:42.023463 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1855/3878] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:41 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:42.283378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:42.284350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:42.297579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:42.299141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:42.299911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:42.301997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:42.302942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:42.303730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:42.765589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:42.781795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:42.783842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:42.785900 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-55ff2987-11ec-4477-be13-34a4a95a18c1 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.509307 Oct 03 10:46:42.787096 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2024/3879] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:42 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:42.889136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:42.896124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:42.907756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:42.915058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:42.917140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:42.920103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:42.920877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:42.923828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:43.037097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:43.042391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:43.065767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:43.066644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:43.069396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:43.080298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:43.081836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:43.082309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:43.194943 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-87b04725-64ea-4dbe-8089-375a00c2b288 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159796 Oct 03 10:46:43.195650 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2025/3880] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:43 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:43.342087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:43.362759 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3b98f80-c150-4935-8472-6c351713a6a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.478090 Oct 03 10:46:43.373369 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1856/3881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:42 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:43.814945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:43.815902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:43.842225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:43.843135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:43.843904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:43.845080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:43.845897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:43.846659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:44.078933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:44.094764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:44.100439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:44.103589 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-03a2ebcc-39a1-46cf-b1f3-efaa9b084428 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.292750 Oct 03 10:46:44.105339 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2026/3882] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:43 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:44.207920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:44.211055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:44.237676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:44.239207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:44.241638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:44.244905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:44.245711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:44.246649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:44.333688 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16170d67-b9d5-4f06-aacd-a88411473525 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129793 Oct 03 10:46:44.337312 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1857/3883] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:44 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:44.387741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:44.389530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:44.404406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:44.405812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:44.409295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:44.411663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:44.415058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:44.415834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:44.903300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:44.915711 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8cd026d9-db2a-4ea6-9ec6-91370819a24d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.532024 Oct 03 10:46:44.921096 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2027/3884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:44 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:45.134509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:45.135148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:45.149059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:45.149566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:45.155876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:45.157127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:45.157831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:45.158770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:45.390121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:45.394575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:45.424916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:45.427183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:45.431460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a5a185c-fa24-4e1c-9a5e-e124c634ce88 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.302603 Oct 03 10:46:45.435196 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1858/3885] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:45 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:45.444933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:45.455607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:45.466670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:45.471511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:45.472134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:45.473066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:45.473883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:45.480198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:45.550729 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93eb7329-e19e-4652-ae9d-ca9001e34ccd tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111539 Oct 03 10:46:45.552821 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1859/3886] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:45 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:45.560595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c15d43a3-68f3-4e8b-aefa-3a00f54f0bea req-e79e9ec5-eaed-45e2-8a89-07e81bd69547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bb672b-6bb5-4b7f-bc11-8e692117e154", "name": "network-vif-plugged", "status": "completed", "tag": "47c12223-2ffc-42b3-92d8-6b7cb7c11ab7"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:45.573442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c15d43a3-68f3-4e8b-aefa-3a00f54f0bea req-e79e9ec5-eaed-45e2-8a89-07e81bd69547 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:45.574371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c15d43a3-68f3-4e8b-aefa-3a00f54f0bea req-e79e9ec5-eaed-45e2-8a89-07e81bd69547 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:45.575047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c15d43a3-68f3-4e8b-aefa-3a00f54f0bea req-e79e9ec5-eaed-45e2-8a89-07e81bd69547 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:45.591150 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c15d43a3-68f3-4e8b-aefa-3a00f54f0bea req-e79e9ec5-eaed-45e2-8a89-07e81bd69547 service nova] Creating event network-vif-plugged:47c12223-2ffc-42b3-92d8-6b7cb7c11ab7 for instance 14bb672b-6bb5-4b7f-bc11-8e692117e154 on n-h1-858383-3 Oct 03 10:46:45.601433 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c15d43a3-68f3-4e8b-aefa-3a00f54f0bea req-e79e9ec5-eaed-45e2-8a89-07e81bd69547 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046131 Oct 03 10:46:45.602426 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1860/3887] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:45.940284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:45.941615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:45.958187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:45.969656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:45.970140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:45.970905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:45.971377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:45.975808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:46.015444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09f49c6c-b635-4ee0-a4b3-463afc33477d tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074ea8f5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1003385311", "description": "tempest-description-240826047"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:46.269301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:46.284955 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc70b114-0702-4698-a770-1087a83b29fc tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.349268 Oct 03 10:46:46.285554 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1861/3888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:45 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:46:46.366862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09f49c6c-b635-4ee0-a4b3-463afc33477d tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.083464 Oct 03 10:46:46.372699 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2028/3889] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:46:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:46.396863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19fc6d0e-06a5-4599-9a64-0731ad3f94a4 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074e270670>, body: {"security_group_rule": {"parent_group_id": "aface880-1605-43c4-8248-a1d97c9fff34", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:46.477099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:46.478350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:46.494315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:46.494959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:46.496184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:46.497596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:46.498739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:46.499438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:46.679890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:46.696651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:46.699139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:46.707863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f53d3cfc-0bd0-4de0-8cac-b897a2cde234 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.238399 Oct 03 10:46:46.708649 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2029/3890] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:46 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:46.718007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:46.723518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:46.738407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:46.739581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:46.741023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:46.743008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:46.743951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:46.745097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:46.788504 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f0e32f7-0713-42e4-923a-71e9e43dd3c5 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078531 Oct 03 10:46:46.790124 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2030/3891] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:46:46 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:46:46.830388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19fc6d0e-06a5-4599-9a64-0731ad3f94a4 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.445838 Oct 03 10:46:46.840268 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1862/3892] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:46:46 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:46.847265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca73b555-9b37-4c49-a28c-d6c4ea4d4f9c tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074e2d1e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-169437088", "description": "tempest-description-2113516729"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:46.928359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:46.931292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:46.944820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:46.945333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:46.945782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:46.946580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:46.946973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:46.947414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.042670 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Cannot 'reboot' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action HTTP/1.1 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 28 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: {"reboot": {"type": "HARD"}} Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'reboot' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '309241dd-9390-48da-b52c-521667f3808c', 'body': {'reboot': {'type': 'HARD'}}} Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 309241dd-9390-48da-b52c-521667f3808c in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:46:47.048124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 409 to user: Cannot 'reboot' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7726d131-508a-4f85-8c40-268482ff3e0a tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action" status: 409 len: 145 microversion: 2.1 time: 0.126022 Oct 03 10:46:47.055656 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1863/3893] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:46:46 2022] POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action => generated 145 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:46:47.061572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:47.064354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:47.090306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.091467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.094106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.095840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.097030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.098558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.155738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca73b555-9b37-4c49-a28c-d6c4ea4d4f9c tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.314923 Oct 03 10:46:47.164439 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2031/3894] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:46:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:47.169933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-33393f5c-c6ac-41eb-b1f2-79be8d587f4c tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074ec18c10>, body: {"security_group_rule": {"parent_group_id": "8c3bf4b3-6c2c-41d3-8db1-6d939c14abc5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:47.181767 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Cannot 'rebuild' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action HTTP/1.1 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 65 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'rebuild' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '309241dd-9390-48da-b52c-521667f3808c', 'body': {'rebuild': {'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f'}}} Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 309241dd-9390-48da-b52c-521667f3808c in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:46:47.183542 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:47.188445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 409 to user: Cannot 'rebuild' instance 309241dd-9390-48da-b52c-521667f3808c while it is in vm_state rescued {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:47.190178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-016ffd6b-d3f2-4776-a61f-72b6efa602c9 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action" status: 409 len: 146 microversion: 2.1 time: 0.127835 Oct 03 10:46:47.197293 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1864/3895] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:46:47 2022] POST /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c/action => generated 146 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:46:47.219776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:47.220285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:47.227911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.228532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.228893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.229669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.230135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.230727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.313922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:46:47.474387 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-33393f5c-c6ac-41eb-b1f2-79be8d587f4c tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.308207 Oct 03 10:46:47.475000 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2032/3896] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:46:47 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:47.487521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:47.488059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:47.506011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.506532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.507029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.509227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.509717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.513220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.568271 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-98395f8d-ec07-488e-a52c-303b417c18e1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 204 len: 0 microversion: 2.1 time: 0.368155 Oct 03 10:46:47.569205 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1865/3897] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:47 2022] DELETE /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:46:47.584366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ec30c6c-c937-40aa-9dd2-5c96240396c9 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074e2a3ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1741005576", "description": "tempest-description-1590323011"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:47.869945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:47.904573 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ec30c6c-c937-40aa-9dd2-5c96240396c9 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.333372 Oct 03 10:46:47.913655 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1866/3898] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:46:47 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:47.914031 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d2488c9c-3bc7-4fa5-b054-dac16bf20c68 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.426187 Oct 03 10:46:47.914031 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2033/3899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:47 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:47.914495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:47.914495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:47.923351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.923863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.924375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.925250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.926616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.926915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:47.927561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:47.928654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.945947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.947100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.947561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:47.948282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:47.953209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:47.953719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:48.087933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:48.099693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:48.101286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:48.103291 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-804d8ad5-654e-446d-a079-21bf93ed3c0c tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.193084 Oct 03 10:46:48.104134 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2034/3900] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:47 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:48.110401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88954803-906e-4051-b6e9-e188c9148423 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074eb041f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-361583934", "description": "tempest-description-1893796720"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:48.477529 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-88954803-906e-4051-b6e9-e188c9148423 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.372200 Oct 03 10:46:48.478180 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2035/3901] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:46:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:48.497115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff844293-c192-432b-a03f-b36aedce929d tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074e21f940>, body: {"security_group_rule": {"parent_group_id": "08ddb742-72eb-4b47-818e-43a2b09f3cdf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "af8fe80c-cd3f-4b2d-aaf1-ce2909c403a6"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:48.573618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:48.583984 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce45da17-4272-412a-882e-8e96af6de161 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1689 microversion: 2.1 time: 0.676830 Oct 03 10:46:48.587997 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1867/3902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:47 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1689 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:48.937908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:48.938675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:48.948039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:48.953202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:48.953949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:48.959639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:48.960611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:48.961852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:48.990539 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff844293-c192-432b-a03f-b36aedce929d tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.497257 Oct 03 10:46:48.991364 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2036/3903] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:46:48 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:49.022978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-421f0c76-03f7-4ff1-acfd-813d03578839 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f0757582a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2114332117", "description": "tempest-description-393760220"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:49.333094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:49.350940 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d8625b07-6da5-46d7-84d5-93152c90b4a6 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.414459 Oct 03 10:46:49.361784 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-421f0c76-03f7-4ff1-acfd-813d03578839 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.344567 Oct 03 10:46:49.363280 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2037/3904] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:46:49 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:49.368426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:49.369743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:49.378957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:49.380961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:49.382121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:49.383298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:49.384580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:49.385466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:49.405075 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1868/3905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:48 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:49.414612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:49.415284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-786adacc-9d2a-4c73-a9fa-d7618c65b559 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074e271940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1671837325", "description": "tempest-description-1819214415"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:49.491457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:49.522247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:49.525456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:49.527844 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5c63a8eb-8d36-4e66-a10d-9757fa0a26fa tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.162588 Oct 03 10:46:49.530181 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2038/3906] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:49 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:49.550270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-362797c1-9844-4c04-9ecd-5abba3ddf95d req-3eccba94-d939-4b14-89a3-ba46a2017c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0caf5248-3dde-4ffa-869a-dee1047b769a", "name": "network-vif-plugged", "status": "completed", "tag": "23796852-c642-4aa3-b641-4116949e7dc6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:49.624205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-362797c1-9844-4c04-9ecd-5abba3ddf95d req-3eccba94-d939-4b14-89a3-ba46a2017c0b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:49.630020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-362797c1-9844-4c04-9ecd-5abba3ddf95d req-3eccba94-d939-4b14-89a3-ba46a2017c0b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:49.630466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-362797c1-9844-4c04-9ecd-5abba3ddf95d req-3eccba94-d939-4b14-89a3-ba46a2017c0b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:49.647500 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-362797c1-9844-4c04-9ecd-5abba3ddf95d req-3eccba94-d939-4b14-89a3-ba46a2017c0b service nova] Creating event network-vif-plugged:23796852-c642-4aa3-b641-4116949e7dc6 for instance 0caf5248-3dde-4ffa-869a-dee1047b769a on n-h1-858383-3 Oct 03 10:46:49.656307 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-362797c1-9844-4c04-9ecd-5abba3ddf95d req-3eccba94-d939-4b14-89a3-ba46a2017c0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114138 Oct 03 10:46:49.657999 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2039/3907] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:46:49.666047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:49.666973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:49.679708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:49.680408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:49.681134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:49.682573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:49.683392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:49.684011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:49.871001 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-786adacc-9d2a-4c73-a9fa-d7618c65b559 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.464714 Oct 03 10:46:49.871716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1869/3908] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:46:49 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:49.890966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb12b3d4-18e4-45ef-b4c2-d3a1976e407a tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074e1e0f70>, body: {"security_group_rule": {"parent_group_id": "ec6aee1c-5221-4162-8c01-3c5cb6f83cd6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ec4804c7-1290-4c9a-bbb7-326b2890a59d"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:49.954619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:49.975853 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b2c2ee39-a3ed-4106-8a15-27663adeebcb tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1689 microversion: 2.1 time: 0.315046 Oct 03 10:46:49.977057 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2040/3909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:49 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1689 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:50.326139 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb12b3d4-18e4-45ef-b4c2-d3a1976e407a tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.441106 Oct 03 10:46:50.326749 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1870/3910] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:46:49 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:50.343058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12664423-efec-4299-b5a9-19fd9a6185d3 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074ec3edc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:50.382350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:50.382986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:50.426291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:50.432091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:50.432599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:50.433471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:50.434051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:50.434756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:50.801468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:50.811830 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4022024f-5833-43b3-a138-2072b831b66f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1320 microversion: 2.1 time: 0.434311 Oct 03 10:46:50.813492 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1871/3911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:50 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:50.826003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:50.827163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:50.834574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:50.836022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:50.836713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:50.837796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:50.838620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:50.839556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:50.977275 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12664423-efec-4299-b5a9-19fd9a6185d3 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ec4804c7-1290-4c9a-bbb7-326b2890a59d" status: 202 len: 0 microversion: 2.1 time: 0.641464 Oct 03 10:46:50.978398 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2041/3912] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:46:50 2022] DELETE /compute/v2.1/os-security-groups/ec4804c7-1290-4c9a-bbb7-326b2890a59d => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:46:50.985950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:50.986453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:50.990172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:51.018571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:51.021323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.021833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.022276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.023010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.023468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.023901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.024472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:51.032656 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7008f2d7-eed5-4b93-9af8-e213e2507002 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.217762 Oct 03 10:46:51.033504 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1872/3913] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:50 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:51.038507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c812f4b0-805f-4db5-bcca-cba780af8d02 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074e2214c0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:51.142845 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-239142cd-4056-4545-829f-48d66291d105 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments/b1485466-9653-440c-a34e-39c1d2249679" status: 200 len: 194 microversion: 2.20 time: 0.163050 Oct 03 10:46:51.147358 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2042/3914] 10.222.0.27 () {60 vars in 1454 bytes} [Mon Oct 3 10:46:50 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments/b1485466-9653-440c-a34e-39c1d2249679 => generated 194 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:51.153089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:51.153728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:51.163456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.163957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.170258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.171148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.171982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.172431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.271377 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c812f4b0-805f-4db5-bcca-cba780af8d02 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/ec6aee1c-5221-4162-8c01-3c5cb6f83cd6" status: 200 len: 247 microversion: 2.1 time: 0.227098 Oct 03 10:46:51.283160 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1873/3915] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:46:51 2022] GET /compute/v2.1/os-security-groups/ec6aee1c-5221-4162-8c01-3c5cb6f83cd6 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:51.292434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:51.292983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:51.312939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.315156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.317066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.319842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.321849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.323858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.508784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lazy-loading 'services' on Instance uuid 46b2f725-65f5-4190-a0db-43ed8788b274 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:46:51.645895 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3beea7d-4f7b-46b1-b008-35c44870067f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments/b1485466-9653-440c-a34e-39c1d2249679" status: 202 len: 0 microversion: 2.20 time: 0.361350 Oct 03 10:46:51.646752 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1874/3916] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 3 10:46:51 2022] DELETE /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments/b1485466-9653-440c-a34e-39c1d2249679 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:46:51.664952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcd66255-97e1-4099-a9d9-68cf60862a83 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074e221af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-588525805", "description": "tempest-description-1467636539"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:51.707375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:51.717179 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d6e979f-d231-4200-831c-b67ada98d550 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1689 microversion: 2.1 time: 0.568447 Oct 03 10:46:51.729608 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2043/3917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:51 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1689 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:51.736158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7d0662d-407d-4a45-9a9b-690f95970e66 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ec3eaf0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:51.806018 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7d0662d-407d-4a45-9a9b-690f95970e66 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/f5618c9d-710d-489c-b72c-794bbc413f61" status: 200 len: 662 microversion: 2.1 time: 0.074762 Oct 03 10:46:51.806613 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2044/3918] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:51 2022] GET /compute/v2.1/images/f5618c9d-710d-489c-b72c-794bbc413f61 => generated 662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:51.833873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:51.840748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:51.856887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.857952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.861376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.864318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:51.865882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:51.867672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:51.973814 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15b2eb62-b6b7-4a74-9514-84686370093e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.166084 Oct 03 10:46:51.974423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2045/3919] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:46:51 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:52.000827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff5f71ab-d5d5-4115-9f6c-26d39c9d99fc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074eb68310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:52.089851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff5f71ab-d5d5-4115-9f6c-26d39c9d99fc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/f5618c9d-710d-489c-b72c-794bbc413f61" status: 200 len: 662 microversion: 2.1 time: 0.114371 Oct 03 10:46:52.090538 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2046/3920] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:51 2022] GET /compute/v2.1/images/f5618c9d-710d-489c-b72c-794bbc413f61 => generated 662 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:52.115067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:52.115686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:52.136963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.137713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.138455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:52.139071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.139528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.139955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:52.397958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:52.411035 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79f17c8d-88ad-4302-bed0-49c03965ced0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 200 len: 1508 microversion: 2.1 time: 0.319465 Oct 03 10:46:52.412974 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2047/3921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:52 2022] GET /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:52.419565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:52.421210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:52.430111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.430934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.431478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:52.432269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.432974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.433619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:52.525864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:52.539560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:52.558177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:52.559953 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d82cd0dc-297c-41d8-9d3e-c7bdecb2579d tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1605 microversion: 2.42 time: 0.144217 Oct 03 10:46:52.563675 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2048/3922] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:52 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1605 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:52.589685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:52.593757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 14bb672b-6bb5-4b7f-bc11-8e692117e154] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:52.610110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.610905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.612421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:52.613260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.613745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.614174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:52.834273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:52.850065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-075e7985-6278-46ee-b4d3-6317bb782ed0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/14bb672b-6bb5-4b7f-bc11-8e692117e154" status: 200 len: 1508 microversion: 2.1 time: 0.284754 Oct 03 10:46:52.850678 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2049/3923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:52 2022] GET /compute/v2.1/servers/14bb672b-6bb5-4b7f-bc11-8e692117e154 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:52.855486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:52.856048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:52.883764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.884749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.885501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:52.886545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:52.887259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:52.888112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.050537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:53.060742 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee891ab3-915a-48ea-8857-a301b254e189 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1621 microversion: 2.1 time: 0.208441 Oct 03 10:46:53.074816 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2050/3924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:52 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1621 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:53.085817 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dcd66255-97e1-4099-a9d9-68cf60862a83 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.437648 Oct 03 10:46:53.086413 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1875/3925] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:46:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:53.096640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:53.097488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 14bb672b-6bb5-4b7f-bc11-8e692117e154] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:53.098619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:53.105188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.106068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.106727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.107734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.108403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.109070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.111524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:53.143487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 14bb672b-6bb5-4b7f-bc11-8e692117e154] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:46:53.156163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.156683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.157161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.157897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.158361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.164976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.308473 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e99b2bcd-2a55-4157-964b-f9b15ba90bd9 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "DELETE /compute/v2.1/servers/14bb672b-6bb5-4b7f-bc11-8e692117e154" status: 204 len: 0 microversion: 2.1 time: 0.225335 Oct 03 10:46:53.312065 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2051/3926] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:53 2022] DELETE /compute/v2.1/servers/14bb672b-6bb5-4b7f-bc11-8e692117e154 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:46:53.327048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62aeaca6-4b17-4d72-a14b-29023b8805cf tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f075751e700>, body: {"security_group_rule": {"parent_group_id": "a8fc8e64-f01b-44be-925b-1b29bc26c123", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:53.345338 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-678156c5-096f-4894-bea4-cb96c794b1d1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.251322 Oct 03 10:46:53.346618 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1876/3927] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:46:53 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:53.351914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:53.352810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:53.360810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.361644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.362311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.363306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.364000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.364929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.414124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 0caf5248-3dde-4ffa-869a-dee1047b769a] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:46:53.659316 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c07ef6e9-cb0a-4721-ba8c-cc7bb97d1a2d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a" status: 204 len: 0 microversion: 2.1 time: 0.311119 Oct 03 10:46:53.661342 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1877/3928] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:46:53 2022] DELETE /compute/v2.1/servers/0caf5248-3dde-4ffa-869a-dee1047b769a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:46:53.673387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ace35807-9199-4d94-b9a0-c45ebaf3bafd req-6c36cc9d-0864-4182-adc1-b9c9b8c765b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b71dd5c-ef34-4807-90a2-7c03aec69537", "name": "network-vif-deleted", "tag": "ea7b3416-8f70-4236-bf50-c70b14cc3af9"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:53.683277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:53.686951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ace35807-9199-4d94-b9a0-c45ebaf3bafd req-6c36cc9d-0864-4182-adc1-b9c9b8c765b3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.687555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ace35807-9199-4d94-b9a0-c45ebaf3bafd req-6c36cc9d-0864-4182-adc1-b9c9b8c765b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.688108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ace35807-9199-4d94-b9a0-c45ebaf3bafd req-6c36cc9d-0864-4182-adc1-b9c9b8c765b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.705371 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ace35807-9199-4d94-b9a0-c45ebaf3bafd req-6c36cc9d-0864-4182-adc1-b9c9b8c765b3 service nova] Creating event network-vif-deleted:ea7b3416-8f70-4236-bf50-c70b14cc3af9 for instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 on n-h2-858383-3 Oct 03 10:46:53.711876 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ace35807-9199-4d94-b9a0-c45ebaf3bafd req-6c36cc9d-0864-4182-adc1-b9c9b8c765b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048975 Oct 03 10:46:53.712948 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1878/3929] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:53.718928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:53.720020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:53.728098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.728720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.729330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.730268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.730856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.731499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.757400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:53.771664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:53.771664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:53.771664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:53.772403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lazy-loading 'fault' on Instance uuid 4a920cd6-3c5a-43c2-8780-1af59b41162f {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:46:53.801495 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62aeaca6-4b17-4d72-a14b-29023b8805cf tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.486448 Oct 03 10:46:53.802319 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2052/3930] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:46:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:53.816330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc544eaf-9297-4b37-ae36-f6ca7b90461f tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Action: 'create', calling method: .version_select at 0x7f074ea8fca0>, body: {"security_group_rule": {"parent_group_id": "a8fc8e64-f01b-44be-925b-1b29bc26c123", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:53.873398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:53.883604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:53.886609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9836fe6921cc4c5cb042178421a3fa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307b309d45e147b4ad14412e1266217e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:53.889673 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa09023d-134b-4709-8dd4-0567567c24b6 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 200 len: 1610 microversion: 2.42 time: 0.174881 Oct 03 10:46:53.891098 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1879/3931] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:53 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 1610 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:46:54.092647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:54.096523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:54.121670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:54.125558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:54.127900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:54.129390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:54.134926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:54.137760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:54.256981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:54.259632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:54.260617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:54.261604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'fault' on Instance uuid 3b71dd5c-ef34-4807-90a2-7c03aec69537 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:46:54.341098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:54.368826 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-97d77cc9-71c4-45c6-a99b-cb42d650b3b7 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 200 len: 1334 microversion: 2.1 time: 0.277808 Oct 03 10:46:54.369958 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1880/3932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:54 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 1334 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:54.398642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1470013072", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "496fe5d5-6627-47bd-9d0e-936d950fb5c3"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:54.415017 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc544eaf-9297-4b37-ae36-f6ca7b90461f tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.604287 Oct 03 10:46:54.417550 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2053/3933] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:46:53 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:54.436654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:54.480074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:54.515820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:54.517116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:54.517116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:54.535848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:54.536817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:54.538661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:54.542843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] validate_networks() for [('496fe5d5-6627-47bd-9d0e-936d950fb5c3', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:46:54.580943 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-178a5287-f253-42bb-8788-62d616fb8e4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161842 Oct 03 10:46:54.584192 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2054/3934] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:46:54 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:54.590129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14432981-3642-401e-9ec0-b4fc9e2eb5c6 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074ea8f430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:54.736592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14432981-3642-401e-9ec0-b4fc9e2eb5c6 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/a8fc8e64-f01b-44be-925b-1b29bc26c123" status: 200 len: 664 microversion: 2.1 time: 0.150712 Oct 03 10:46:54.737575 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2055/3935] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:46:54 2022] GET /compute/v2.1/os-security-groups/a8fc8e64-f01b-44be-925b-1b29bc26c123 => generated 664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:54.754186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9e6e74f-840a-4cb7-b936-1d6e35ab19b6 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea8fc10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:54.860049 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9e6e74f-840a-4cb7-b936-1d6e35ab19b6 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/a1a96d48-c7b6-47b8-840a-bf765b2ec9a0" status: 200 len: 661 microversion: 2.1 time: 0.117654 Oct 03 10:46:54.864537 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2056/3936] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:54 2022] GET /compute/v2.1/images/a1a96d48-c7b6-47b8-840a-bf765b2ec9a0 => generated 661 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:54.871341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6498939c-e073-4686-8762-4d5c943549d5 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074eb900d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.181841 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6498939c-e073-4686-8762-4d5c943549d5 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/c23794ed-3f45-4af1-b3a1-09a22a45935a" status: 202 len: 0 microversion: 2.1 time: 0.314998 Oct 03 10:46:55.184105 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2057/3937] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 3 10:46:54 2022] DELETE /compute/v2.1/os-security-group-rules/c23794ed-3f45-4af1-b3a1-09a22a45935a => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:46:55.194221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-23d897d1-b28c-4a4c-aaca-0c61bd6bd988 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074eb68f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.276611 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-23d897d1-b28c-4a4c-aaca-0c61bd6bd988 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/a1a96d48-c7b6-47b8-840a-bf765b2ec9a0" status: 200 len: 661 microversion: 2.1 time: 0.091168 Oct 03 10:46:55.281780 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2058/3938] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:55 2022] GET /compute/v2.1/images/a1a96d48-c7b6-47b8-840a-bf765b2ec9a0 => generated 661 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:55.292978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.293761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:55.320034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.320531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.322515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.323273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.323734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.324168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.360005 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] HTTP exception thrown: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Request method failure captured: Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f HTTP/1.1 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrvVvZxBNx821YC2ryidlF_44GAgIADafMGWqOyQKCLVbrVyeuTuTpQIksz675pTQz05coMPWdJpRIXQyl8U0l_4txwDgE8DDY0UvVD_vZIQXpAF8WC5bspPjL5wjR8ag8PLpBYvh8KHXNBIolfb5nrZCLEfYaFV391VpDEWbsVpikQ Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.42 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 307b309d45e147b4ad14412e1266217e Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/307b309d45e147b4ad14412e1266217e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_307b309d45e147b4ad14412e1266217e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/307b309d45e147b4ad14412e1266217e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/307b309d45e147b4ad14412e1266217e"}]}] Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 307b309d45e147b4ad14412e1266217e Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TaggedBootDevicesTest_v242-138080166-project Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9836fe6921cc4c5cb042178421a3fa00 Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TaggedBootDevicesTest_v242-138080166-project Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '4a920cd6-3c5a-43c2-8780-1af59b41162f'} Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.362136 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:46:55.369254 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.374994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Returning 404 to user: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:55.376615 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e0acbb1-8f00-4a78-922b-202a8383df27 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 404 len: 111 microversion: 2.42 time: 0.093272 Oct 03 10:46:55.377928 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2059/3939] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:46:55 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:46:55.385898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ade011b5-ee7e-4beb-a5ac-8b74a5242ebe tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074eb04310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.456183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:46:55.456682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:46:55.457228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:46:55.457582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:46:55.458334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:46:55.476334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.478090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.479035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.480271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.481048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.481687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.505995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Getting quotas for project 0636ed42cbed435aaee6b88d8978b98b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:46:55.515127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Getting quotas for user c1cf2098bc1f4abe8e7ba06e0390b990 and project 0636ed42cbed435aaee6b88d8978b98b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:46:55.537066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Going to run 2 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:46:55.545762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 19b89356-c153-436c-863a-62534d52da17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:46:55.605532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=19b89356-c153-436c-863a-62534d52da17,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:46:55.696978 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ade011b5-ee7e-4beb-a5ac-8b74a5242ebe tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a8fc8e64-f01b-44be-925b-1b29bc26c123" status: 202 len: 0 microversion: 2.1 time: 0.317122 Oct 03 10:46:55.698848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2060/3940] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:46:55 2022] DELETE /compute/v2.1/os-security-groups/a8fc8e64-f01b-44be-925b-1b29bc26c123 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:46:55.705845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdcccc5c-31a9-4fba-bfb2-ec1aa39f8c11 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '.version_select at 0x7f074ea8f670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.710353 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86a361e0-3749-47b3-83f2-be7b5c12ef66 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.338574 Oct 03 10:46:55.711699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1881/3941] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:46:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1341 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 03 10:46:55.719306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.720664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 3b71dd5c-ef34-4807-90a2-7c03aec69537] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:55.745606 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cdcccc5c-31a9-4fba-bfb2-ec1aa39f8c11 tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080641269" status: 204 len: 0 microversion: 2.42 time: 0.045388 Oct 03 10:46:55.746955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.747261 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2061/3942] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080641269 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:46:55.750733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.751743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.753983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.755878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.758767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.775523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.786640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:55.805015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.805532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.806794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.812521 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 could not be found. Oct 03 10:46:55.818582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 HTTP/1.1 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 could not be found. Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3b71dd5c-ef34-4807-90a2-7c03aec69537'} Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 could not be found. Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 could not be found. Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.821332 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 could not be found. Oct 03 10:46:55.826219 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:55.826901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.826901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.828634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 404 to user: Instance 3b71dd5c-ef34-4807-90a2-7c03aec69537 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:55.829778 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-157b7e1a-6f85-4b98-a400-f4a2b377118d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537" status: 404 len: 111 microversion: 2.1 time: 0.116593 Oct 03 10:46:55.830642 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1882/3943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:55 2022] GET /compute/v2.1/servers/3b71dd5c-ef34-4807-90a2-7c03aec69537 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:55.842690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b897eeb-f487-4c63-86d5-bcab9ab723ba tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074e119310>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.888991 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b47be818-4e3c-46bb-b6dc-a4a8dea040a3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140230 Oct 03 10:46:55.889615 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2062/3944] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:46:55 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:55.917998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:55.932957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:55.934485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Searching by: {'deleted': False, 'project_id': '0636ed42cbed435aaee6b88d8978b98b'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:46:55.982654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.983369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.984411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:55.985233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:55.985822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:55.986797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:56.004396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG neutronclient.v2_0.client [None req-0b897eeb-f487-4c63-86d5-bcab9ab723ba tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist", "detail": ""}} {{(pid=122270) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:46:56.005212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.security_group_api [None req-0b897eeb-f487-4c63-86d5-bcab9ab723ba tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Neutron security group ec4804c7-1290-4c9a-bbb7-326b2890a59d not found {{(pid=122270) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:46:56.005614 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-0b897eeb-f487-4c63-86d5-bcab9ab723ba tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] HTTP exception thrown: Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist Oct 03 10:46:56.005614 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-f52fc432-efb6-4b63-b093-09eed10c5b1a'] Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b897eeb-f487-4c63-86d5-bcab9ab723ba tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Request method failure captured: Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-security-groups/ec4804c7-1290-4c9a-bbb7-326b2890a59d HTTP/1.1 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr2VBl9Exgi35C2a9e2FV66gsULSvBlsojl24hnSyXtcegBFkIrdS556CLRquvKo3KVZ6NWheOgDUhQYRHAg2tHZwl6qeC1UF8KFO_EDR48U2qF59kpoztzz38jcYnQIXUXlu3G_qVj46eA9NxH6XwZtnc9lZoE7Q4Qtzzmv1mZqbew Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d71940eb0bbb40dfa97231ec8e16ee8d Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-72310304 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d71940eb0bbb40dfa97231ec8e16ee8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d71940eb0bbb40dfa97231ec8e16ee8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d71940eb0bbb40dfa97231ec8e16ee8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d71940eb0bbb40dfa97231ec8e16ee8d"}]}] Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupRulesTestJSON-72310304 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d71940eb0bbb40dfa97231ec8e16ee8d Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-72310304 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupRulesTestJSON-72310304-project Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d4dfe8daf62c4597befdd1f54b431c76 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupRulesTestJSON-72310304-project Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: exception: Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-f52fc432-efb6-4b63-b093-09eed10c5b1a'] Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ec4804c7-1290-4c9a-bbb7-326b2890a59d'} Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:46:56.008461 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f52fc432-efb6-4b63-b093-09eed10c5b1a'] Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f52fc432-efb6-4b63-b093-09eed10c5b1a'] Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f52fc432-efb6-4b63-b093-09eed10c5b1a'] Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f52fc432-efb6-4b63-b093-09eed10c5b1a'] Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b897eeb-f487-4c63-86d5-bcab9ab723ba tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Returning 404 to user: Security group ec4804c7-1290-4c9a-bbb7-326b2890a59d does not exist Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: Neutron server returns request_ids: ['req-f52fc432-efb6-4b63-b093-09eed10c5b1a'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0b897eeb-f487-4c63-86d5-bcab9ab723ba tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ec4804c7-1290-4c9a-bbb7-326b2890a59d" status: 404 len: 194 microversion: 2.1 time: 0.172829 Oct 03 10:46:56.015411 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1883/3945] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:46:55 2022] DELETE /compute/v2.1/os-security-groups/ec4804c7-1290-4c9a-bbb7-326b2890a59d => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:46:56.020821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c0ef3fb2-c1ee-421f-9676-f0fcbc1d3eea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '.version_select at 0x7f074e0af310>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:56.048585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:46:56.065471 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c0ef3fb2-c1ee-421f-9676-f0fcbc1d3eea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885762128" status: 202 len: 0 microversion: 2.1 time: 0.053109 Oct 03 10:46:56.066139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1884/3946] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:46:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885762128 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:46:56.073036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-533a0b47-e4f9-4001-8b94-c796e6998d79 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074e2f6670>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:56.098249 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2f2e19c-e8ab-49d0-99e3-e458f7d6f5b2 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.201084 Oct 03 10:46:56.098980 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2063/3947] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:46:55 2022] GET /compute/v2.1/servers => generated 1337 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:56.134559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eb809f7b-304a-429a-91bc-c04404d6e086 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:56.135407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb809f7b-304a-429a-91bc-c04404d6e086 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:56.255272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb809f7b-304a-429a-91bc-c04404d6e086 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:56.264684 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eb809f7b-304a-429a-91bc-c04404d6e086 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1218 microversion: 2.1 time: 0.144872 Oct 03 10:46:56.282551 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2064/3948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:56 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:56.903277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:56.914894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:56.934813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:56.938259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:56.940418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:56.941469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:56.942547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:56.944219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:56.997011 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a2879c4-cb87-4837-9153-c1f71110139d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098062 Oct 03 10:46:57.000788 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2065/3949] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:46:56 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:57.012105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28670db7-3919-466f-9dad-7002c6fa4d4d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ff21ee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:57.092640 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28670db7-3919-466f-9dad-7002c6fa4d4d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/1938b249-7368-40a1-bd5e-4bb9d273b2a4" status: 200 len: 662 microversion: 2.1 time: 0.088903 Oct 03 10:46:57.095027 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2066/3950] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:57 2022] GET /compute/v2.1/images/1938b249-7368-40a1-bd5e-4bb9d273b2a4 => generated 662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:57.110969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e10a48a-1624-404b-abfb-71b8acab24a5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f219a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:57.179126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e10a48a-1624-404b-abfb-71b8acab24a5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/1938b249-7368-40a1-bd5e-4bb9d273b2a4" status: 200 len: 662 microversion: 2.1 time: 0.072631 Oct 03 10:46:57.193683 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2067/3951] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:46:57 2022] GET /compute/v2.1/images/1938b249-7368-40a1-bd5e-4bb9d273b2a4 => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:57.308594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:57.308819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:57.331109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:57.331809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:57.332333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:57.333772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:57.335274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:57.335774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:57.418891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:46:57.531372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-533a0b47-e4f9-4001-8b94-c796e6998d79 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ec6aee1c-5221-4162-8c01-3c5cb6f83cd6" status: 202 len: 0 microversion: 2.1 time: 1.463948 Oct 03 10:46:57.533460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1885/3952] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:46:56 2022] DELETE /compute/v2.1/os-security-groups/ec6aee1c-5221-4162-8c01-3c5cb6f83cd6 => generated 0 bytes in 1466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:46:57.540175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-153577827", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:57.555580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:57.565104 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa35a592-3107-4f1f-ace1-e02786a7e787 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1222 microversion: 2.1 time: 0.273213 Oct 03 10:46:57.569090 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2068/3953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:57 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1222 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:57.593570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8dfbf21e-b786-4dd8-bfc8-d3df160fc124 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074ff21ee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:57.789777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:46:58.995127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:46:58.995781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:46:58.996191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:46:58.996750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:46:58.997448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:46:59.008690 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8dfbf21e-b786-4dd8-bfc8-d3df160fc124 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/af8fe80c-cd3f-4b2d-aaf1-ce2909c403a6" status: 202 len: 0 microversion: 2.1 time: 1.438143 Oct 03 10:46:59.010540 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2069/3954] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:46:57 2022] DELETE /compute/v2.1/os-security-groups/af8fe80c-cd3f-4b2d-aaf1-ce2909c403a6 => generated 0 bytes in 1441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:46:59.018014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:59.024465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:59.038411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:59.047241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:59.048016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:59.050457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:59.057795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:59.058875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:59.070454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:59.071717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:59.075134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:59.079052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:59.084636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:59.087724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:59.173533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Getting quotas for project 4164ebc4b3a84b3186b9222c7dbdaada. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:46:59.194429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Getting quotas for user 0b0afdfbd1534404a5a89913268a3117 and project 4164ebc4b3a84b3186b9222c7dbdaada. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:46:59.203050 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1904e38-1577-49fb-9886-ad501044dcc3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191069 Oct 03 10:46:59.211909 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2070/3955] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:46:59 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:46:59.226681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:46:59.237365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:46:59.238913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ef858b8f-0457-4d8e-994f-468342c52df2 req-81d4faf9-3cbc-4260-a27b-c6e22d2b0c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bb672b-6bb5-4b7f-bc11-8e692117e154", "name": "network-vif-deleted", "tag": "47c12223-2ffc-42b3-92d8-6b7cb7c11ab7"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:46:59.276057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ef858b8f-0457-4d8e-994f-468342c52df2 req-81d4faf9-3cbc-4260-a27b-c6e22d2b0c70 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:59.285147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ef858b8f-0457-4d8e-994f-468342c52df2 req-81d4faf9-3cbc-4260-a27b-c6e22d2b0c70 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:59.285737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ef858b8f-0457-4d8e-994f-468342c52df2 req-81d4faf9-3cbc-4260-a27b-c6e22d2b0c70 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:59.339224 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ef858b8f-0457-4d8e-994f-468342c52df2 req-81d4faf9-3cbc-4260-a27b-c6e22d2b0c70 service nova] Creating event network-vif-deleted:47c12223-2ffc-42b3-92d8-6b7cb7c11ab7 for instance 14bb672b-6bb5-4b7f-bc11-8e692117e154 on n-h1-858383-3 Oct 03 10:46:59.355918 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ef858b8f-0457-4d8e-994f-468342c52df2 req-81d4faf9-3cbc-4260-a27b-c6e22d2b0c70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140218 Oct 03 10:46:59.360903 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2071/3956] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:46:59.366346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:59.367214 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f2b2fd4-3c8a-4d4e-bfa5-352eb6b64268 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830223 Oct 03 10:46:59.373527 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1886/3957] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:46:59.397466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e2842971-80b0-43a7-b9e4-e434ff227b6b tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074e2c9700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:46:59.406362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:46:59.448275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:59.458920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:59.469419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:59.473473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:46:59.474536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:46:59.478712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:46:59.795629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:46:59.832086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff7e697a-ade5-4625-bf46-ca3095d1da26 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1276 microversion: 2.1 time: 0.469487 Oct 03 10:46:59.838542 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2072/3958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:46:59 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1276 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:46:59.854329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-426770621", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:00.018652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:47:00.473229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:47:00.473667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:47:00.474260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:47:00.474741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:47:00.475324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:47:00.492595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:00.498942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:00.500023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:00.500858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:00.501298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:00.502002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:00.565706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Getting quotas for project 4164ebc4b3a84b3186b9222c7dbdaada. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:47:00.577472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Getting quotas for user 0b0afdfbd1534404a5a89913268a3117 and project 4164ebc4b3a84b3186b9222c7dbdaada. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:47:00.626242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:47:00.632641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:47:00.798887 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [550b53d0-5cd9-45fe-b521-894f231f725e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 10:47:01.055460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e2842971-80b0-43a7-b9e4-e434ff227b6b tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/08ddb742-72eb-4b47-818e-43a2b09f3cdf" status: 202 len: 0 microversion: 2.1 time: 1.679840 Oct 03 10:47:01.061035 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1887/3959] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:46:59 2022] DELETE /compute/v2.1/os-security-groups/08ddb742-72eb-4b47-818e-43a2b09f3cdf => generated 0 bytes in 1686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:47:01.067155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:01.085844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:01.112523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:01.113427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:01.114318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:01.115892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:01.116973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:01.118173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:01.301298 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e1be04e-597a-4252-8d6c-544436953c74 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.237814 Oct 03 10:47:01.302966 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1888/3960] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:47:01 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:47:01.326524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:01.327481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:01.398379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:01.401767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:01.402667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:01.406839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:01.407760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:01.408629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:01.750563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:01.781361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9f665fc-f5fe-4a5a-a218-c80a2d4e9e6b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1276 microversion: 2.1 time: 0.473334 Oct 03 10:47:01.784503 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1889/3961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:01 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1276 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:01.796913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fbe71350-a686-43e0-9ca6-fc4dc0e5ae96 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074e48e310>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:01.815012 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [550b53d0-5cd9-45fe-b521-894f231f725e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 58398. Oct 03 10:47:01.824721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82a741b5-dda4-494b-bb16-7355522b1ffc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.983828 Oct 03 10:47:01.826210 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2073/3962] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:47:01.849913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-eb098970-2799-4028-a700-2c174b732719 req-c9ed92a7-24ff-4e19-a9c1-afffd558787c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0caf5248-3dde-4ffa-869a-dee1047b769a", "name": "network-vif-deleted", "tag": "23796852-c642-4aa3-b641-4116949e7dc6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:01.890262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-eb098970-2799-4028-a700-2c174b732719 req-c9ed92a7-24ff-4e19-a9c1-afffd558787c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:01.892125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-eb098970-2799-4028-a700-2c174b732719 req-c9ed92a7-24ff-4e19-a9c1-afffd558787c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:01.892699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-eb098970-2799-4028-a700-2c174b732719 req-c9ed92a7-24ff-4e19-a9c1-afffd558787c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:01.945934 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-eb098970-2799-4028-a700-2c174b732719 req-c9ed92a7-24ff-4e19-a9c1-afffd558787c service nova] Creating event network-vif-deleted:23796852-c642-4aa3-b641-4116949e7dc6 for instance 0caf5248-3dde-4ffa-869a-dee1047b769a on n-h1-858383-3 Oct 03 10:47:01.979317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-eb098970-2799-4028-a700-2c174b732719 req-c9ed92a7-24ff-4e19-a9c1-afffd558787c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144545 Oct 03 10:47:01.982984 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2074/3963] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:02.003567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-729e9e26-24a4-4f09-b5df-84b0069f5adf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:02.007189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-729e9e26-24a4-4f09-b5df-84b0069f5adf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:02.032335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:02.149521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-729e9e26-24a4-4f09-b5df-84b0069f5adf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:02.161617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-729e9e26-24a4-4f09-b5df-84b0069f5adf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1217 microversion: 2.1 time: 0.174707 Oct 03 10:47:02.162292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2075/3964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:01 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:02.316340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:02.319217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:02.338994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:02.339814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:02.344188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:02.345290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:02.346657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:02.347287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:02.495611 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-93073af8-8227-4895-a616-2ee27c076268 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167541 Oct 03 10:47:02.498363 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2076/3965] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:47:02 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:47:02.806074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:02.807036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:02.819184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:02.820482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:02.823880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:02.824929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:02.826103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:02.827786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:03.006683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:03.037699 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d945c0af-f29a-4e9f-9e6a-098cabee5d73 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1276 microversion: 2.1 time: 0.233418 Oct 03 10:47:03.039897 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2077/3966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:02 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:03.199588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:03.203210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:03.233109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:03.233618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:03.234073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:03.234810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:03.239801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:03.243948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:03.437211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:03.449902 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df307b77-a4ef-49b0-a99a-59ec32627373 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1269 microversion: 2.1 time: 0.257144 Oct 03 10:47:03.452623 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2078/3967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:03 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:03.512426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:03.515254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:03.541525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:03.545666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:03.546293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:03.552714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:03.553707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:03.554415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:03.631706 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c942956-becb-431b-a6d6-a60a61ce3102 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.123147 Oct 03 10:47:03.632613 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2079/3968] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:47:03 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:04.059737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:04.070787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:04.085245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:04.085736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:04.086378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:04.087272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:04.087907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:04.089165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:04.125823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:47:04.267129 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b52730b-7f33-4f0f-a44b-1ac6b56201c0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 204 len: 0 microversion: 2.20 time: 0.216559 Oct 03 10:47:04.267755 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2080/3969] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:47:04 2022] DELETE /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 10:47:04.278942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:04.280540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:04.291967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:04.292491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:04.292969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:04.293796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:04.294827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:04.295568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:04.392358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fbe71350-a686-43e0-9ca6-fc4dc0e5ae96 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/8c3bf4b3-6c2c-41d3-8db1-6d939c14abc5" status: 202 len: 0 microversion: 2.1 time: 2.604659 Oct 03 10:47:04.395153 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1890/3970] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:47:01 2022] DELETE /compute/v2.1/os-security-groups/8c3bf4b3-6c2c-41d3-8db1-6d939c14abc5 => generated 0 bytes in 2610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:47:04.411589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:04.415367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:04.448263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:04.449820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:04.451332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:04.453064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:04.454234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:04.455362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:04.704994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:04.715037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-513169a7-a313-4b22-beda-a6e85bf4067d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.445199 Oct 03 10:47:04.715558 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2081/3971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:04 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:04.724827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b614f15c-dad3-457e-a938-f08177627100 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] Calling method '.version_select at 0x7f074f2163a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:05.045099 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b614f15c-dad3-457e-a938-f08177627100 tempest-SecurityGroupRulesTestJSON-72310304 tempest-SecurityGroupRulesTestJSON-72310304-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/aface880-1605-43c4-8248-a1d97c9fff34" status: 202 len: 0 microversion: 2.1 time: 0.326042 Oct 03 10:47:05.045910 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2082/3972] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:47:04 2022] DELETE /compute/v2.1/os-security-groups/aface880-1605-43c4-8248-a1d97c9fff34 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:47:05.051211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:05.052163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:05.086231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.086807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.088972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:05.089791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.090554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.094724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:05.556963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:05.573559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:05.585096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:05.586778 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9ed9af4-8f33-4876-ab21-fb96ab57ade6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 1.188269 Oct 03 10:47:05.587067 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1891/3973] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:04 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:05.591927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:05.592426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:05.618246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.619023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.619594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:05.620557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.621183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.621963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:05.635581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:05.643924 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] HTTP exception thrown: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Request method failure captured: Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f HTTP/1.1 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrvVvZxBNx821YC2ryidlF_44GAgIADafMGWqOyQKCLVbrVyeuTuTpQIksz675pTQz05coMPWdJpRIXQyl8U0l_4txwDgE8DDY0UvVD_vZIQXpAF8WC5bspPjL5wjR8ag8PLpBYvh8KHXNBIolfb5nrZCLEfYaFV391VpDEWbsVpikQ Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.42 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 307b309d45e147b4ad14412e1266217e Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/307b309d45e147b4ad14412e1266217e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_307b309d45e147b4ad14412e1266217e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/307b309d45e147b4ad14412e1266217e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/307b309d45e147b4ad14412e1266217e"}]}] Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 307b309d45e147b4ad14412e1266217e Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TaggedBootDevicesTest_v242-138080166-project Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 9836fe6921cc4c5cb042178421a3fa00 Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TaggedBootDevicesTest_v242-138080166-project Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '4a920cd6-3c5a-43c2-8780-1af59b41162f'} Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:47:05.646304 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.652070 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.653664 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fca6c558-4de8-42b5-a67f-23e2c6d0d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1275 microversion: 2.1 time: 0.599878 Oct 03 10:47:05.653664 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2083/3974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:05 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1275 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:05.655692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Returning 404 to user: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:47:05.657018 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f0bfeac7-3fee-424d-89eb-24a65797789a tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 404 len: 111 microversion: 2.42 time: 0.068958 Oct 03 10:47:05.661254 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1892/3975] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:47:05 2022] DELETE /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:47:05.666621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:05.667492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] [instance: 4a920cd6-3c5a-43c2-8780-1af59b41162f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:05.680480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.682329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.683734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:05.686699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.687914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.690080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:05.715268 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] HTTP exception thrown: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Request method failure captured: Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f HTTP/1.1 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrvVvZxBNx821YC2ryidlF_44GAgIADafMGWqOyQKCLVbrVyeuTuTpQIksz675pTQz05coMPWdJpRIXQyl8U0l_4txwDgE8DDY0UvVD_vZIQXpAF8WC5bspPjL5wjR8ag8PLpBYvh8KHXNBIolfb5nrZCLEfYaFV391VpDEWbsVpikQ Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.42 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 307b309d45e147b4ad14412e1266217e Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/307b309d45e147b4ad14412e1266217e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_307b309d45e147b4ad14412e1266217e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/307b309d45e147b4ad14412e1266217e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/307b309d45e147b4ad14412e1266217e"}]}] Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 307b309d45e147b4ad14412e1266217e Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-138080166 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TaggedBootDevicesTest_v242-138080166-project Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9836fe6921cc4c5cb042178421a3fa00 Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TaggedBootDevicesTest_v242-138080166-project Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '4a920cd6-3c5a-43c2-8780-1af59b41162f'} Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.718778 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. Oct 03 10:47:05.723859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:05.727368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] Returning 404 to user: Instance 4a920cd6-3c5a-43c2-8780-1af59b41162f could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:47:05.729323 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27e1816b-bf9c-41c0-ae33-1e1ca056963b tempest-TaggedBootDevicesTest_v242-138080166 tempest-TaggedBootDevicesTest_v242-138080166-project] 10.222.0.27 "GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f" status: 404 len: 111 microversion: 2.42 time: 0.067061 Oct 03 10:47:05.733424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2084/3976] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:05 2022] GET /compute/v2.1/servers/4a920cd6-3c5a-43c2-8780-1af59b41162f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:47:05.745712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:05.746636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:05.754921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.755856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.756548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:05.758935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:05.759716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:05.760385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:06.615552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:06.616098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:06.626977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:06.629848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:06.631048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:06.638426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:06.639146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:06.639914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:06.663635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:06.692282 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-89fa63fd-7ca6-4920-9f8d-10b9c635af9b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.951483 Oct 03 10:47:06.707168 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1893/3977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:05 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:06.731315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:06.732693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:06.746979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:06.747912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:06.750014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:06.751758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:06.761310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:06.762241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:06.981476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:06.992907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:07.004686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:07.006366 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6164350f-3de7-4ae4-8e8d-988a5eb4def9 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.395779 Oct 03 10:47:07.007475 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2085/3978] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:06 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:07.359881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:07.378016 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6810aac3-d60d-47a4-8981-385444db8232 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1275 microversion: 2.1 time: 0.655941 Oct 03 10:47:07.393009 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1894/3979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:06 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1275 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:07.577136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-998a0130-5e9e-4a10-ba6d-cd5893133db7 req-84a370d3-715b-4f61-95d9-2eaf6af6ea67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b89356-c153-436c-863a-62534d52da17", "tag": "5af8f9e4-0854-463a-af18-e536a2b0fb01"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:07.597378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-998a0130-5e9e-4a10-ba6d-cd5893133db7 req-84a370d3-715b-4f61-95d9-2eaf6af6ea67 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:07.597500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-998a0130-5e9e-4a10-ba6d-cd5893133db7 req-84a370d3-715b-4f61-95d9-2eaf6af6ea67 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:07.597887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-998a0130-5e9e-4a10-ba6d-cd5893133db7 req-84a370d3-715b-4f61-95d9-2eaf6af6ea67 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:07.634105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-998a0130-5e9e-4a10-ba6d-cd5893133db7 req-84a370d3-715b-4f61-95d9-2eaf6af6ea67 service nova] Creating event network-changed:5af8f9e4-0854-463a-af18-e536a2b0fb01 for instance 19b89356-c153-436c-863a-62534d52da17 on n-h2-858383-3 Oct 03 10:47:07.650456 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-998a0130-5e9e-4a10-ba6d-cd5893133db7 req-84a370d3-715b-4f61-95d9-2eaf6af6ea67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077091 Oct 03 10:47:07.651508 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2086/3980] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:07.735645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:07.736371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:07.745001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:07.761635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:07.762366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:07.763836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:07.764504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:07.765163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:08.036203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:08.037161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:08.063631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:08.064654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:08.067378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:08.068259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:08.069727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:08.070606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:08.863912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:08.882766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:08.885811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:08.893784 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fbf04232-bc26-43e4-a265-52d8492cd84f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.861257 Oct 03 10:47:08.895323 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2087/3981] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:08 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:08.909492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:08.910467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:08.932631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:08.943842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:08.944700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:08.945728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:08.946419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:08.947077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:09.140398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:09.216207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:09.383857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:09.400537 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f4fcf9a-0207-46c1-99f1-376d7061849c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1275 microversion: 2.1 time: 0.495774 Oct 03 10:47:09.405872 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2088/3982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:08 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1275 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:09.932549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:09.937506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:09.963944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:09.964920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:09.966220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:09.967572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:09.968265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:09.969180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:10.038508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:10.052167 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f188ca49-3796-45f3-88d6-828df90f2394 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 2.318074 Oct 03 10:47:10.053180 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1895/3983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:07 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:10.434336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:10.436481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:10.455226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:10.456942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:10.458532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:10.462217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:10.463590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:10.466797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:10.508227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:10.512649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:10.532080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:10.534386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:10.542387 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec00ee08-e474-4648-a539-34c1cc394fab tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1725 microversion: 2.20 time: 0.618780 Oct 03 10:47:10.543145 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2089/3984] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:09 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1725 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:11.084348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:11.085273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:11.098407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:11.106067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:11.107167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:11.108391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:11.110276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:11.113778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:11.114377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:11.524167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:11.532983 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6bfe010-33af-4bfd-98f6-216680023673 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.453077 Oct 03 10:47:11.539213 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2090/3985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:11 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:11.545008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3de5a7db-88cc-4a5e-9e87-e3bffede1a31 req-6f2172fb-cea2-4630-a7b2-31a5ba22b7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "name": "network-vif-unplugged", "status": "completed", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:11.549200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:11.597008 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae86eb4d-9762-4203-b8c4-6f7e5468f293 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 1.163515 Oct 03 10:47:11.601516 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1896/3986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:10 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:11.615446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:11.616053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:11.630978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3de5a7db-88cc-4a5e-9e87-e3bffede1a31 req-6f2172fb-cea2-4630-a7b2-31a5ba22b7d4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:11.635147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3de5a7db-88cc-4a5e-9e87-e3bffede1a31 req-6f2172fb-cea2-4630-a7b2-31a5ba22b7d4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:11.635617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3de5a7db-88cc-4a5e-9e87-e3bffede1a31 req-6f2172fb-cea2-4630-a7b2-31a5ba22b7d4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:11.650614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:11.651217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:11.653258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:11.661034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:11.661689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:11.662254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:11.665313 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3de5a7db-88cc-4a5e-9e87-e3bffede1a31 req-6f2172fb-cea2-4630-a7b2-31a5ba22b7d4 service nova] Creating event network-vif-unplugged:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:47:11.676340 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3de5a7db-88cc-4a5e-9e87-e3bffede1a31 req-6f2172fb-cea2-4630-a7b2-31a5ba22b7d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135235 Oct 03 10:47:11.678471 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2091/3987] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:12.455169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:12.469061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:12.470923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:12.474735 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48ee6aa9-852e-4dd3-81ff-a35cd7a07625 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1657 microversion: 2.20 time: 0.871256 Oct 03 10:47:12.477094 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1897/3988] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:11 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1657 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:12.630661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:12.631897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:12.638489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:12.649394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:12.650419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:12.653751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:12.656879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:12.657603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:12.659844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:12.660208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:12.660908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:12.661995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:12.662466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:12.662852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:12.663200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:12.663667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:12.666707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:12.992068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:13.004329 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c545f7cb-e8b5-4858-8228-241e85ff554f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.378541 Oct 03 10:47:13.004972 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2092/3989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:12 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:13.024321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:13.024867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:13.053212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:13.054940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:13.056561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:13.060299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:13.063727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:13.065410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:13.115151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:47:13.252693 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-924bc53b-69ca-4e01-92b5-8c134ee767de tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 204 len: 0 microversion: 2.1 time: 0.246325 Oct 03 10:47:13.253229 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2093/3990] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:47:13 2022] DELETE /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:47:13.262126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:13.265701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:13.284743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:13.285480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:13.286116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:13.287195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:13.287819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:13.288417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:13.635615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:13.647984 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3be3e75c-bedd-46bc-9da8-3e91958ee8ac tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1507 microversion: 2.1 time: 0.390049 Oct 03 10:47:13.648580 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2094/3991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:13 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:13.667717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:13.668362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:13.689406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:13.691323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:13.693302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:13.695570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:13.699055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:13.699531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:13.788585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:13.802546 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0c4f4b7f-79b3-48d2-b05c-eea5ab5ae3d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 1.157495 Oct 03 10:47:13.807926 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1898/3992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:12 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:13.894260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-998234b0-32d2-4c57-a2bb-7733253b9519 req-dd040c52-1fb7-4154-afce-b0f49f384d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2926209a-84e5-454b-987c-684755e5c0dc", "tag": "8b4da610-22a1-4396-99b9-c457313375d5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:13.917137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:13.926979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-998234b0-32d2-4c57-a2bb-7733253b9519 req-dd040c52-1fb7-4154-afce-b0f49f384d49 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:13.927472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-998234b0-32d2-4c57-a2bb-7733253b9519 req-dd040c52-1fb7-4154-afce-b0f49f384d49 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:13.936075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:13.937351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-998234b0-32d2-4c57-a2bb-7733253b9519 req-dd040c52-1fb7-4154-afce-b0f49f384d49 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:13.944402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:13.945744 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4689c17d-8c88-4244-b38f-43b20d9bbda6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1657 microversion: 2.20 time: 0.290714 Oct 03 10:47:13.961432 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2095/3993] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:13 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1657 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:13.975109 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-998234b0-32d2-4c57-a2bb-7733253b9519 req-dd040c52-1fb7-4154-afce-b0f49f384d49 service nova] Creating event network-changed:8b4da610-22a1-4396-99b9-c457313375d5 for instance 2926209a-84e5-454b-987c-684755e5c0dc on n-h1-858383-3 Oct 03 10:47:13.991371 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-998234b0-32d2-4c57-a2bb-7733253b9519 req-dd040c52-1fb7-4154-afce-b0f49f384d49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103036 Oct 03 10:47:14.001431 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1899/3994] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:14.029767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:14.030989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:14.039581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:14.040345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:14.041092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:14.042058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:14.042756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:14.043429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:14.345737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:14.364240 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d6f7140-79b7-4f2e-9ec9-b0db4d1c0237 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.337147 Oct 03 10:47:14.381570 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2096/3995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:14 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:14.677319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:14.678143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:14.694914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:14.698760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:14.701275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:14.702655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:14.705557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:14.706376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:14.832034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:14.833355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:14.848516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:14.849320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:14.850110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:14.851023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:14.851708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:14.852352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:15.369550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:15.382410 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d65c329-c9a2-478f-bd77-1d02b719d641 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.554137 Oct 03 10:47:15.391341 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2097/3996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:14 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:15.396658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:15.401600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:15.436530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:15.439417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:15.446974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:15.448024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:15.448679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:15.449344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:15.554301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:15.556164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:15.562292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:15.565867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lazy-loading 'fault' on Instance uuid 46b2f725-65f5-4190-a0db-43ed8788b274 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:47:15.735065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:15.750911 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0d4c24bd-ef1c-4665-8170-e70225ca29a3 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1507 microversion: 2.1 time: 1.077951 Oct 03 10:47:15.751901 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1900/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:14 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1507 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:15.769959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:15.773470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:15.774098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:15.779325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:15.780787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:15.781969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ecf6503e-0975-40b1-8c96-a3030e374d75 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 200 len: 1372 microversion: 2.20 time: 0.389264 Oct 03 10:47:15.782535 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2098/3998] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:15 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 1372 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:15.810535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:15.819980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:15.824160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:15.824976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:15.825497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:15.825937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:16.361457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-57d8801c-879d-4cf2-b9e4-93f0920930b3 req-ef477fb0-9f2f-4d23-abce-ffa6852977c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b2f725-65f5-4190-a0db-43ed8788b274", "name": "network-vif-deleted", "tag": "31dc8105-dbd3-40c8-ae7c-f03071336230"}, {"name": "network-changed", "server_uuid": "d4fe7879-6f32-4d3b-8038-a4f40f154995", "tag": "873702af-4840-46a1-b693-3ceb18ce3a18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:16.399238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-57d8801c-879d-4cf2-b9e4-93f0920930b3 req-ef477fb0-9f2f-4d23-abce-ffa6852977c8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:16.399767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-57d8801c-879d-4cf2-b9e4-93f0920930b3 req-ef477fb0-9f2f-4d23-abce-ffa6852977c8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:16.400442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-57d8801c-879d-4cf2-b9e4-93f0920930b3 req-ef477fb0-9f2f-4d23-abce-ffa6852977c8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:16.454244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-57d8801c-879d-4cf2-b9e4-93f0920930b3 req-ef477fb0-9f2f-4d23-abce-ffa6852977c8 service nova] Creating event network-vif-deleted:31dc8105-dbd3-40c8-ae7c-f03071336230 for instance 46b2f725-65f5-4190-a0db-43ed8788b274 on n-h1-858383-3 Oct 03 10:47:16.457281 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-57d8801c-879d-4cf2-b9e4-93f0920930b3 req-ef477fb0-9f2f-4d23-abce-ffa6852977c8 service nova] Creating event network-changed:873702af-4840-46a1-b693-3ceb18ce3a18 for instance d4fe7879-6f32-4d3b-8038-a4f40f154995 on n-h2-858383-3 Oct 03 10:47:16.483568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-57d8801c-879d-4cf2-b9e4-93f0920930b3 req-ef477fb0-9f2f-4d23-abce-ffa6852977c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.130663 Oct 03 10:47:16.485853 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2099/3999] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:47:16.494266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:16.495513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:16.503557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:16.504592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:16.505291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:16.506348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:16.507048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:16.507711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:16.856363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:16.884354 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dcbe9a20-e62e-49f8-99d8-f8d331663b04 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.396497 Oct 03 10:47:16.887273 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2100/4000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:16 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:16.897648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:16.898385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:16.905667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:16.906213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:16.906652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:16.907565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:16.908059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:16.908494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:17.138680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:17.147101 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-008bdfe8-9463-42c8-8e69-f8f86d5aea1d tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1507 microversion: 2.1 time: 0.258669 Oct 03 10:47:17.162390 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2101/4001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:16 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:17.162390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:17.162390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:17.182783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:17.182783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:17.182783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:17.182783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:17.182783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:17.182783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:17.213204 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] HTTP exception thrown: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Request method failure captured: Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 HTTP/1.1 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrx4QorrGoZ7GhxuPcwBF1RH6T4-0_FtHwIkSu8PZZZ2nVa5NJZRco87YzAWYXscrjktvD56PKeW4CSSeGruZXoIb95aaSqQSrbLlBXl1Q8hdi8AFGBF3hkVoFowDBn3fSsauc7VB6sXVkDQ68a28C1J99C6_A4gKyvvOdfvSPbXgjk Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}] Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 95e90959ca07488e9a3960f7e49c99f1 Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '46b2f725-65f5-4190-a0db-43ed8788b274'} Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:17.218652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Returning 404 to user: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-db9c3199-bca3-45ef-b315-e637abc47af3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 404 len: 111 microversion: 2.20 time: 0.073602 Oct 03 10:47:17.227970 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2102/4002] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:17 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:47:17.239462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce9d01fe-9fab-4dd0-aca4-c525f89bc515 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '.version_select at 0x7f074e2d1430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:17.249402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:17.265174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a37bc916-046e-4d30-bd3c-4fd20721240f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 1.511061 Oct 03 10:47:17.281644 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1901/4003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:15 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:17.289197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce9d01fe-9fab-4dd0-aca4-c525f89bc515 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357729622" status: 204 len: 0 microversion: 2.20 time: 0.057782 Oct 03 10:47:17.295787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2103/4004] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:47:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357729622 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:47:17.907463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:17.908076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:17.920332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:17.920872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:17.921325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:17.922079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:17.922510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:17.922983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:18.196541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:18.197928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:18.216077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:18.216743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:18.217336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:18.218174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:18.218743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:18.219279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:18.428526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:18.442816 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3adbd067-3fdd-4193-ba0e-095632cbcb12 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1507 microversion: 2.1 time: 0.255643 Oct 03 10:47:18.443935 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2104/4005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:18 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:18.450217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa171f31-05bf-4fe1-ab4a-73df858874b1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'create', calling method: .version_select at 0x7f074ec0e3a0>, body: {"keypair": {"name": "tempest-keypair-1758916157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBToaSfISsBHLk7qMx/cPDjjeS8CFwT2n4nH7qygmNWlV5UzAatY35KSpPsrDP5ONR9sw9hz1m46W6+CvV3rbeD7Rnl9rhQ7P1vyN2eUosEqD+SKwum4brdaCwltPJrKQ=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:18.472717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fa171f31-05bf-4fe1-ab4a-73df858874b1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:47:18.481024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fa171f31-05bf-4fe1-ab4a-73df858874b1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for user 95e90959ca07488e9a3960f7e49c99f1 and project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:47:18.523692 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa171f31-05bf-4fe1-ab4a-73df858874b1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.076844 Oct 03 10:47:18.524810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2105/4006] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:47:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:47:18.548821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:18.551409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:18.600818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:18.603279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:18.605252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:18.609331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:18.610320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:18.611977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:18.943737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:18.957195 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-968cb293-7bac-470d-81c2-dd61b49d114d tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 1.053725 Oct 03 10:47:18.958497 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1902/4007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:17 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:18.965119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b73e1272-9b3a-46c1-bdfa-7b2a322ab3e3 req-9681766e-281e-4a15-82f5-9f5d5f884915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b89356-c153-436c-863a-62534d52da17", "name": "network-vif-plugged", "status": "completed", "tag": "5af8f9e4-0854-463a-af18-e536a2b0fb01"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:18.983635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b73e1272-9b3a-46c1-bdfa-7b2a322ab3e3 req-9681766e-281e-4a15-82f5-9f5d5f884915 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:18.984467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b73e1272-9b3a-46c1-bdfa-7b2a322ab3e3 req-9681766e-281e-4a15-82f5-9f5d5f884915 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:18.985168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b73e1272-9b3a-46c1-bdfa-7b2a322ab3e3 req-9681766e-281e-4a15-82f5-9f5d5f884915 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:19.009353 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b73e1272-9b3a-46c1-bdfa-7b2a322ab3e3 req-9681766e-281e-4a15-82f5-9f5d5f884915 service nova] Creating event network-vif-plugged:5af8f9e4-0854-463a-af18-e536a2b0fb01 for instance 19b89356-c153-436c-863a-62534d52da17 on n-h2-858383-3 Oct 03 10:47:19.018102 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b73e1272-9b3a-46c1-bdfa-7b2a322ab3e3 req-9681766e-281e-4a15-82f5-9f5d5f884915 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056915 Oct 03 10:47:19.019392 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1903/4008] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:19.053037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-dda2c50d-4b86-40ad-aa2f-a47df0e88072 req-b1fbe2fe-71b5-4368-ae3f-88de9f53345a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74014a1-fb90-45e3-ba2d-71fdddefa20d", "tag": "ae3e817d-c947-4bc6-bdd3-d9aef8449dbb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:19.097437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dda2c50d-4b86-40ad-aa2f-a47df0e88072 req-b1fbe2fe-71b5-4368-ae3f-88de9f53345a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:19.098026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:19.099045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dda2c50d-4b86-40ad-aa2f-a47df0e88072 req-b1fbe2fe-71b5-4368-ae3f-88de9f53345a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:19.099677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dda2c50d-4b86-40ad-aa2f-a47df0e88072 req-b1fbe2fe-71b5-4368-ae3f-88de9f53345a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:19.109033 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe1b29dd-4583-413a-9d57-a507724988b2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.582657 Oct 03 10:47:19.109929 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2106/4009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:18 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:19.127966 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-dda2c50d-4b86-40ad-aa2f-a47df0e88072 req-b1fbe2fe-71b5-4368-ae3f-88de9f53345a service nova] Creating event network-changed:ae3e817d-c947-4bc6-bdd3-d9aef8449dbb for instance a74014a1-fb90-45e3-ba2d-71fdddefa20d on n-h1-858383-3 Oct 03 10:47:19.140884 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-dda2c50d-4b86-40ad-aa2f-a47df0e88072 req-b1fbe2fe-71b5-4368-ae3f-88de9f53345a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119000 Oct 03 10:47:19.142626 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1904/4010] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:19.473531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:19.474844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:19.492730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:19.497672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:19.500888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:19.503308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:19.504161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:19.513551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:19.978134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:19.996647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:20.000950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:20.015732 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-496923ac-0ef8-4df3-98d0-38ad3d36c15e tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1507 microversion: 2.1 time: 0.546669 Oct 03 10:47:20.030434 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2107/4011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:19 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1507 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:20.032651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:20.033381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:20.034033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:20.040846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:20.041566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:20.042186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:20.048845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:20.140183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:20.141140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:20.149095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:20.149915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:20.150538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:20.151444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:20.152106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:20.152716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:20.193927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:20.879101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:20.901205 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-162cb2d2-7af0-4bb6-b371-b39279513288 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.920306 Oct 03 10:47:20.902567 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1905/4012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:19 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:21.115710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:21.125094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-667a0c35-e858-4e48-8ab0-d7c797e4a76e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.992495 Oct 03 10:47:21.125925 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2108/4013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:20 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:21.178750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-baa829e4-47a9-49f7-8e9f-1e84355a51c1 req-b6a87a15-eca8-4126-91fd-67ed1213472d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309241dd-9390-48da-b52c-521667f3808c", "name": "network-vif-deleted", "tag": "ec92c056-8195-41fa-bb3d-6c81f4fbd9db"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:21.191148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-baa829e4-47a9-49f7-8e9f-1e84355a51c1 req-b6a87a15-eca8-4126-91fd-67ed1213472d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:21.191933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-baa829e4-47a9-49f7-8e9f-1e84355a51c1 req-b6a87a15-eca8-4126-91fd-67ed1213472d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:21.192539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-baa829e4-47a9-49f7-8e9f-1e84355a51c1 req-b6a87a15-eca8-4126-91fd-67ed1213472d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:21.218242 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-baa829e4-47a9-49f7-8e9f-1e84355a51c1 req-b6a87a15-eca8-4126-91fd-67ed1213472d service nova] Creating event network-vif-deleted:ec92c056-8195-41fa-bb3d-6c81f4fbd9db for instance 309241dd-9390-48da-b52c-521667f3808c on n-h1-858383-3 Oct 03 10:47:21.225210 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-baa829e4-47a9-49f7-8e9f-1e84355a51c1 req-b6a87a15-eca8-4126-91fd-67ed1213472d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050714 Oct 03 10:47:21.226448 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2109/4014] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:21.481253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:21.483275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:21.496522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:21.498010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:21.498706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:21.499660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:21.500326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:21.500971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:21.598540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:21.607704 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ddc4905-6d48-4472-a5dc-96c5e3f31867 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1465 microversion: 2.1 time: 0.555836 Oct 03 10:47:21.618500 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1906/4015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:21 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1465 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:21.934163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:21.934823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:21.944711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:21.945319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:21.945668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:21.946375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:21.946828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:21.947255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:22.152423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:22.154295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:22.169766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:22.169766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:22.170569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:22.172188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:22.173276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:22.174683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:22.384880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:22.400552 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68c2fdf6-03cf-4161-8776-17145190ec89 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.470660 Oct 03 10:47:22.416431 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2110/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:21 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:22.504740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:22.529262 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-914c1c00-9703-457d-ad7b-a6c2edb2373b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.377856 Oct 03 10:47:22.530232 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1907/4017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:22 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:22.632325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:22.633160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:22.650477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:22.652172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:22.652867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:22.654241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:22.655940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:22.656593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:22.718280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:22.719336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:22.720074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:22.720862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'fault' on Instance uuid 309241dd-9390-48da-b52c-521667f3808c {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:47:22.929888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:22.940715 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51cb2b85-30c0-47c0-8efd-c650959cf286 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 200 len: 1311 microversion: 2.1 time: 0.312186 Oct 03 10:47:22.944518 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2111/4018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:22 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 1311 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:23.442962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:23.443601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:23.455776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:23.456376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:23.456834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:23.457591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:23.458062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:23.458500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:23.491590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1438810722", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "286e8ba7-7a3d-4c56-bfbe-bbee9243b57d"}], "security_groups": [{"name": "tempest-securitygroup--1677486893"}], "key_name": "tempest-keypair-1758916157", "user_data": "}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:23.547371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:23.712090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:23.723897 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b68f3f3-fd35-4557-94c9-2df1f2ff575f tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.286572 Oct 03 10:47:23.725632 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1908/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:23 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:23.730893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:23.731769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:23.739411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:23.740201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:23.740989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:23.741971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:23.742668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:23.743352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:23.918925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:23.929375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63752b48-c79a-4381-9c66-4f150fb32325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.202390 Oct 03 10:47:23.930562 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1909/4020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:23 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:23.970771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:23.971703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: 309241dd-9390-48da-b52c-521667f3808c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:23.977843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:23.980579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:23.981481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:23.982299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:23.983207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:23.983847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:23.984447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:24.021656 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Instance 309241dd-9390-48da-b52c-521667f3808c could not be found. Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c HTTP/1.1 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 309241dd-9390-48da-b52c-521667f3808c could not be found. Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '309241dd-9390-48da-b52c-521667f3808c'} Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309241dd-9390-48da-b52c-521667f3808c could not be found. Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309241dd-9390-48da-b52c-521667f3808c could not be found. Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:24.023801 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309241dd-9390-48da-b52c-521667f3808c could not be found. Oct 03 10:47:24.029379 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:47:24.032126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 404 to user: Instance 309241dd-9390-48da-b52c-521667f3808c could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:47:24.033385 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22f48687-590f-43a8-9157-24f4f1babebf tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c" status: 404 len: 111 microversion: 2.1 time: 0.069265 Oct 03 10:47:24.038150 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1910/4021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:23 2022] GET /compute/v2.1/servers/309241dd-9390-48da-b52c-521667f3808c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:47:24.045334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:24.046233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:24.056505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:24.057047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:24.057703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:24.058653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:24.059111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:24.060268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:24.105103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:47:24.130993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] validate_networks() for [('286e8ba7-7a3d-4c56-bfbe-bbee9243b57d', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:47:24.267977 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-67e03d6b-2347-4682-8d74-17ffcfbdfea1 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 204 len: 0 microversion: 2.1 time: 0.226868 Oct 03 10:47:24.269088 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1911/4022] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:47:24 2022] DELETE /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:47:24.278828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:24.280023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:24.288318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:24.288859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:24.289347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:24.290350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:24.291009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:24.291740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:24.679053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:24.706987 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bfe6cca2-ee65-46d8-84ac-50a41ab64699 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.430787 Oct 03 10:47:24.710354 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1912/4023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:24 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:24.765358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:24.768953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:24.793287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:24.794134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:24.794788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:24.797613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:24.798355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:24.798973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:25.325616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:25.339485 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea6c95be-c5f5-4794-89a0-5911163e93d1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.593279 Oct 03 10:47:25.352942 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1913/4024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:24 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:25.360866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:25.360866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:25.369970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:25.370791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:25.371438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:25.372287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:25.373089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:25.373705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:25.499711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:47:25.502120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:47:25.502952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:47:25.503602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:47:25.504253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:47:25.514304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:25.515208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:25.516100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:25.517758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:25.518484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:25.519146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:25.542221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:47:25.549966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Getting quotas for user 95e90959ca07488e9a3960f7e49c99f1 and project 29993b8d4e9e4a9f8b78c398561fdd10. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:47:25.569062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:47:25.571864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:47:25.645810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e9c20de4-20d1-44a3-976e-3d6d87533063 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.157485 Oct 03 10:47:25.649463 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2112/4025] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:47:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:47:25.660481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-26f0eabc-ec08-449c-ab2c-22df5b8a1531 req-d2ddeaba-c3f4-4389-b475-4516008172cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fe7879-6f32-4d3b-8038-a4f40f154995", "name": "network-vif-plugged", "status": "completed", "tag": "873702af-4840-46a1-b693-3ceb18ce3a18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:25.679694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-26f0eabc-ec08-449c-ab2c-22df5b8a1531 req-d2ddeaba-c3f4-4389-b475-4516008172cf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:25.680355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-26f0eabc-ec08-449c-ab2c-22df5b8a1531 req-d2ddeaba-c3f4-4389-b475-4516008172cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:25.680975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-26f0eabc-ec08-449c-ab2c-22df5b8a1531 req-d2ddeaba-c3f4-4389-b475-4516008172cf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:25.696709 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-26f0eabc-ec08-449c-ab2c-22df5b8a1531 req-d2ddeaba-c3f4-4389-b475-4516008172cf service nova] Creating event network-vif-plugged:873702af-4840-46a1-b693-3ceb18ce3a18 for instance d4fe7879-6f32-4d3b-8038-a4f40f154995 on n-h2-858383-3 Oct 03 10:47:25.704714 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-26f0eabc-ec08-449c-ab2c-22df5b8a1531 req-d2ddeaba-c3f4-4389-b475-4516008172cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053746 Oct 03 10:47:25.706533 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2113/4026] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:25.716358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d5e11d5-0129-4a67-94be-acedaad59b7e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:25.717325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d5e11d5-0129-4a67-94be-acedaad59b7e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:25.793270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d5e11d5-0129-4a67-94be-acedaad59b7e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:25.802232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d5e11d5-0129-4a67-94be-acedaad59b7e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:25.804035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d5e11d5-0129-4a67-94be-acedaad59b7e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:25.805479 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d5e11d5-0129-4a67-94be-acedaad59b7e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1282 microversion: 2.20 time: 0.095969 Oct 03 10:47:25.806606 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2114/4027] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:25 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:25.816006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:25.816917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:25.826707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:25.827643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:25.828359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:25.829362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:25.830107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:25.830767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:26.117531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:26.131034 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5a37acd-e7c7-4956-9f7e-e34234b0e520 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.323139 Oct 03 10:47:26.131624 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2115/4028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:25 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:26.243628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:26.259851 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba0acb7b-9f94-419a-9bf1-1e96acad9205 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.916644 Oct 03 10:47:26.260666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1914/4029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:25 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:26.369580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:26.370588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:26.382822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:26.383326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:26.383773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:26.386121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:26.389572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:26.392662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:26.652236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:26.669458 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2696460-e6a4-49ca-8c09-d6248eb0f71e tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.302726 Oct 03 10:47:26.670417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2116/4030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:26 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:26.836928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:26.838714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:26.852075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:26.852915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:26.853808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:26.854770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:26.855796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:26.857212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:27.011150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:27.026662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:27.029790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:27.030991 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-333030f0-ba54-4d34-adf6-dda0ff7efafb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1334 microversion: 2.20 time: 0.199749 Oct 03 10:47:27.035291 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1915/4031] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:26 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1334 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:27.162598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:27.163556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:27.176364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:27.178977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:27.179550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:27.181458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:27.182181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:27.182882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:27.293101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:27.295091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:27.321192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:27.323098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:27.325770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:27.328463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:27.330003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:27.332494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:27.807871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:27.819953 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4dac75c-74b7-47e4-9cb4-ee189295f297 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.663218 Oct 03 10:47:27.828099 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2117/4032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:27 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:27.836292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:27.837380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:27.852172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:27.855996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:27.856785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:27.857920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:27.859043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:27.859701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:28.224426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:28.256877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5926784-43af-41d3-af4f-60a3a5e302f0 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.425708 Oct 03 10:47:28.258803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2118/4033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:27 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:28.266829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ad85ef2b-5ab0-4266-9f62-ce154e84bcf0 req-fc656969-9b51-43b4-a7fe-f98b1da8c8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2926209a-84e5-454b-987c-684755e5c0dc", "name": "network-vif-plugged", "status": "completed", "tag": "8b4da610-22a1-4396-99b9-c457313375d5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:28.291167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ad85ef2b-5ab0-4266-9f62-ce154e84bcf0 req-fc656969-9b51-43b4-a7fe-f98b1da8c8fd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:28.291820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ad85ef2b-5ab0-4266-9f62-ce154e84bcf0 req-fc656969-9b51-43b4-a7fe-f98b1da8c8fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:28.292267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ad85ef2b-5ab0-4266-9f62-ce154e84bcf0 req-fc656969-9b51-43b4-a7fe-f98b1da8c8fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:28.318313 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ad85ef2b-5ab0-4266-9f62-ce154e84bcf0 req-fc656969-9b51-43b4-a7fe-f98b1da8c8fd service nova] Creating event network-vif-plugged:8b4da610-22a1-4396-99b9-c457313375d5 for instance 2926209a-84e5-454b-987c-684755e5c0dc on n-h1-858383-3 Oct 03 10:47:28.325895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ad85ef2b-5ab0-4266-9f62-ce154e84bcf0 req-fc656969-9b51-43b4-a7fe-f98b1da8c8fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065388 Oct 03 10:47:28.327066 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2119/4034] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:28.333367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:28.334381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:28.346439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:28.348013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:28.349171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:28.350787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:28.351660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:28.352312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:28.384532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:28.394124 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04bcd83a-3ac8-4d21-96c7-31e47fc0e39e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 1.111548 Oct 03 10:47:28.402029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1916/4035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:27 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:28.495805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:28.511225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:28.514051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:28.515814 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ddc723f4-17a9-47cf-ab48-b7189c8ee9fc tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1340 microversion: 2.20 time: 0.187329 Oct 03 10:47:28.529735 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2120/4036] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:28 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:28.852252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:28.852973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:28.875093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:28.875917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:28.876449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:28.877338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:28.877935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:28.878452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:29.337803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:29.338311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:29.353619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:29.361299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:29.362471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:29.363897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:29.364631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:29.365486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:29.423287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:47:29.658775 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b2f3fcf-0bbb-4285-ad4f-d49f61f262e3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 204 len: 0 microversion: 2.32 time: 0.769442 Oct 03 10:47:29.665370 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2121/4037] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:47:28 2022] DELETE /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:47:29.679505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:29.683880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:29.707960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:29.709936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:29.710410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:29.712699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:29.717841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:29.718565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:29.764558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:29.789692 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52ec555f-884a-4fb6-93a0-e5458633792f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1520 microversion: 2.1 time: 0.942696 Oct 03 10:47:29.791362 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1917/4038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:28 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1520 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:29.801149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:29.801771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:29.814486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:29.814982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:29.820247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:29.821259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:29.821617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:29.822062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:29.998532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:30.017615 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9461bb61-497b-4581-be80-10616f04d0ce tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1318 microversion: 2.1 time: 0.350186 Oct 03 10:47:30.032821 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2122/4039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:29 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:30.041361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:30.041992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:30.052575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.053408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.054061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:30.055543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.056549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.057246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:30.168317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:30.179659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:30.179659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:30.180846 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a045653b-8d20-4c50-93cc-01b58780b82d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1340 microversion: 2.20 time: 0.156074 Oct 03 10:47:30.181783 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2123/4040] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:30 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1340 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:30.317765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:30.332302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2023ea57-06a2-42fc-984e-d719bc6f7928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.538700 Oct 03 10:47:30.334826 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1918/4041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:29 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:30.352152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:30.354602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:30.381368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.389705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.390363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:30.391389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.392122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.393793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:30.539135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-806a3b08-379f-4204-b560-e723123ab037 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Action: 'create', calling method: .version_select at 0x7f074f264550>, body: {"keypair": {"name": "tempest-keypair-1317987556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATooApTSL43T1ETm0HKqZBLkdkC5rbNEHyAKOUsppDbJIPSOWZSJKh4oiAuwZq5Nl5HmgbRk2IX1JFTfy8fdTm7O2u+gLsUNhDcCmTDgyTONyesCDG19zeFmAe9pAsa0A=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:30.598700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-806a3b08-379f-4204-b560-e723123ab037 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Getting quotas for project 387e024349a64433a7f8850c45ed956a. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:47:30.609644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-806a3b08-379f-4204-b560-e723123ab037 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Getting quotas for user fb8dcc199c80470a81c458f1e8860487 and project 387e024349a64433a7f8850c45ed956a. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:47:30.650202 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-806a3b08-379f-4204-b560-e723123ab037 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.467446 Oct 03 10:47:30.650831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2124/4042] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:47:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:30.661989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-36e50ad2-182b-4083-a8cc-7bf2a0401f26 req-13a75980-c7b2-42f5-8d5d-56372018fe90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74014a1-fb90-45e3-ba2d-71fdddefa20d", "name": "network-vif-plugged", "status": "completed", "tag": "ae3e817d-c947-4bc6-bdd3-d9aef8449dbb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:30.685700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36e50ad2-182b-4083-a8cc-7bf2a0401f26 req-13a75980-c7b2-42f5-8d5d-56372018fe90 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.692694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36e50ad2-182b-4083-a8cc-7bf2a0401f26 req-13a75980-c7b2-42f5-8d5d-56372018fe90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.698858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36e50ad2-182b-4083-a8cc-7bf2a0401f26 req-13a75980-c7b2-42f5-8d5d-56372018fe90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:30.711939 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-36e50ad2-182b-4083-a8cc-7bf2a0401f26 req-13a75980-c7b2-42f5-8d5d-56372018fe90 service nova] Creating event network-vif-plugged:ae3e817d-c947-4bc6-bdd3-d9aef8449dbb for instance a74014a1-fb90-45e3-ba2d-71fdddefa20d on n-h1-858383-3 Oct 03 10:47:30.730224 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-36e50ad2-182b-4083-a8cc-7bf2a0401f26 req-13a75980-c7b2-42f5-8d5d-56372018fe90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076659 Oct 03 10:47:30.731875 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2125/4043] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:30.737733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-517b1ea5-a295-4540-a6c8-c634792a4523 req-a4a99c33-2add-4403-b9f8-60336360906c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4", "name": "network-vif-deleted", "tag": "a30f35d1-8f30-4892-95ea-375d6270fb11"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:30.750111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-517b1ea5-a295-4540-a6c8-c634792a4523 req-a4a99c33-2add-4403-b9f8-60336360906c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.751209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-517b1ea5-a295-4540-a6c8-c634792a4523 req-a4a99c33-2add-4403-b9f8-60336360906c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.752025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-517b1ea5-a295-4540-a6c8-c634792a4523 req-a4a99c33-2add-4403-b9f8-60336360906c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:30.782225 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-517b1ea5-a295-4540-a6c8-c634792a4523 req-a4a99c33-2add-4403-b9f8-60336360906c service nova] Creating event network-vif-deleted:a30f35d1-8f30-4892-95ea-375d6270fb11 for instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 on n-h2-858383-3 Oct 03 10:47:30.787895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-517b1ea5-a295-4540-a6c8-c634792a4523 req-a4a99c33-2add-4403-b9f8-60336360906c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054465 Oct 03 10:47:30.788909 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2126/4044] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:30.829724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:30.831970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:30.858261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.860482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.861134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:30.863562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:30.864472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:30.865475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.018961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.028077 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e508efaa-303b-4854-8d35-b92f2e8a4e2f tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1478 microversion: 2.1 time: 0.215739 Oct 03 10:47:31.032510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2127/4045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:30 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1478 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:31.048424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:31.049238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:31.073740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.073740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.073740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.073740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.073740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.073740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.246184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.262057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.264716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.266542 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3aa93b5f-94f7-49f2-94f2-38ab411418c4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2955 microversion: 2.32 time: 0.930715 Oct 03 10:47:31.272609 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1919/4046] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:30 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2955 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:31.299913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:31.302417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:31.322301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.323054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.323521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.324403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.327287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.327935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.580113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.596141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8f0201ee-84c6-4e30-8c46-ffe464a7b501 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1506 microversion: 2.1 time: 0.552051 Oct 03 10:47:31.598397 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2128/4047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:31 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:31.612882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:31.615458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:31.633529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.634407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.635681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.640148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.643047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.643047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.690615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:31.739346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.748416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:31.752226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.754046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:31.755735 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-30b101fe-a09d-45f6-a83a-3d958e580334 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.481048 Oct 03 10:47:31.776890 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1920/4048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:31 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:31.795801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:31.805632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 19b89356-c153-436c-863a-62534d52da17] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:31.818994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.820028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.820574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:31.821437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:31.822128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:31.822824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.098819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:32.111533 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c8c17af1-9308-453e-86de-de5d32eb7052 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17" status: 200 len: 1506 microversion: 2.1 time: 0.321760 Oct 03 10:47:32.125433 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1921/4049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:31 2022] GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:32.125673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:32.125799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:32.125799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:32.138900 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1213738b-9152-484b-bd79-da7ccb66607a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1317 microversion: 2.1 time: 0.537529 Oct 03 10:47:32.150287 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2129/4050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:31 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:32.167383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.167893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.168341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.169269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.169741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.170177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.170614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:32.171320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 19b89356-c153-436c-863a-62534d52da17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:32.187505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.189372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.191312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.194606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.195453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.197310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.254986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 19b89356-c153-436c-863a-62534d52da17] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:47:32.308114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.311925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.313984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.317372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'fault' on Instance uuid f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:47:32.391801 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f1c7a0e-7f08-41b2-8e1d-2280ade3b8ad tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17" status: 204 len: 0 microversion: 2.1 time: 0.239878 Oct 03 10:47:32.402162 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2130/4051] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:47:32 2022] DELETE /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:47:32.415555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:32.417013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:32.438188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.438697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.439268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.439877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.440339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.441131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.761089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:32.771843 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-970f1f76-3e0d-4d66-ab5e-24ad1d553ea2 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1311 microversion: 2.1 time: 0.656841 Oct 03 10:47:32.777084 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1922/4052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:32 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1311 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:32.788689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:32.790397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:32.800144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.800914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.801490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.802457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:32.803570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:32.804601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:32.847077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:47:32.980521 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a027c4da-9228-4c68-b74f-831c08917df1 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 204 len: 0 microversion: 2.1 time: 0.201115 Oct 03 10:47:32.982614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1923/4053] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:47:32 2022] DELETE /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:47:32.991889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:32.993097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:33.011749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:33.012754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:33.013596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:33.014598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:33.015325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:33.015986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:33.480111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:33.501846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:33.503512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:33.507500 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d95fb5bd-6818-4c27-91a9-63fe8f29e7a1 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2955 microversion: 2.32 time: 1.106763 Oct 03 10:47:33.513859 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2131/4054] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:32 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2955 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:33.534192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:33.535146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 19b89356-c153-436c-863a-62534d52da17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:33.546241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:33.546839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:33.547390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:33.548349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:33.549105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:33.549754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:33.937887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:33.948605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:33.951418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:33.952734 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e66a226-f114-4fe1-9a6f-d62f44f7e41d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.967911 Oct 03 10:47:33.953440 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1924/4055] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:32 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:33.958371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:33.959094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:33.965550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:33.966131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:33.966672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:33.967453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:33.967969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:33.968461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.065937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:34.079911 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02cc7808-395c-4433-8b01-80c36905271a tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17" status: 200 len: 1512 microversion: 2.1 time: 0.564314 Oct 03 10:47:34.080505 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2132/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:33 2022] GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17 => generated 1512 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:34.099479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:34.100588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:34.124640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.125494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.126276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.127372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.132484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.133529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.202921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.204073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.205144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.206482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lazy-loading 'fault' on Instance uuid f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:47:34.470226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ac39f90b0744a39c356ef7d846e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893e3d1c38654bed94f89dfd0532340e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:34.479513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-476df1e3-2b57-4d6c-bb9a-c22f27163397 tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 200 len: 1311 microversion: 2.1 time: 0.397680 Oct 03 10:47:34.482311 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2133/4057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:34 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 1311 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:34.539400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:34.549831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:34.554238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:34.562423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.562952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.565199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.567027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.570306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.570501 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-36533658-7996-4ba0-b75b-8075e5b10bf2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1465 microversion: 2.1 time: 0.615789 Oct 03 10:47:34.571091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.585923 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1925/4058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:33 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1465 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:34.598674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-31dd0e8f-3fb7-4734-be7c-63c36259fa1b req-57f57d80-257f-493c-b6e2-58603785c625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:34.614055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-31dd0e8f-3fb7-4734-be7c-63c36259fa1b req-57f57d80-257f-493c-b6e2-58603785c625 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.614543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-31dd0e8f-3fb7-4734-be7c-63c36259fa1b req-57f57d80-257f-493c-b6e2-58603785c625 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.614994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-31dd0e8f-3fb7-4734-be7c-63c36259fa1b req-57f57d80-257f-493c-b6e2-58603785c625 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.628145 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-31dd0e8f-3fb7-4734-be7c-63c36259fa1b req-57f57d80-257f-493c-b6e2-58603785c625 service nova] Creating event network-changed:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h1-858383-3 Oct 03 10:47:34.633857 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-31dd0e8f-3fb7-4734-be7c-63c36259fa1b req-57f57d80-257f-493c-b6e2-58603785c625 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046531 Oct 03 10:47:34.635894 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1926/4059] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:34.642581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:34.646105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:34.660254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.665343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.665939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:34.666740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:34.667211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:34.667870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:35.320192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:35.330479 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2bc8f07f-9383-44c2-8d74-3805a81ac6ed tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 200 len: 1467 microversion: 2.1 time: 0.692924 Oct 03 10:47:35.340741 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1927/4060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:34 2022] GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 1467 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:35.369300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:35.370108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:35.390456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:35.391097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:35.391746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:35.392560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:35.393190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:35.394023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:35.532886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:35.589541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:35.617642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:35.623315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:35.624916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fad97a2f-aa6a-4b86-841b-5c9f12476dbd tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2955 microversion: 2.32 time: 1.090841 Oct 03 10:47:35.626002 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2134/4061] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:34 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2955 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:47:35.636396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:35.637583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 19b89356-c153-436c-863a-62534d52da17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:35.644984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:35.645806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:35.646506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:35.647646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:35.648346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:35.649030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.071234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:36.081246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:36.083267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:36.084797 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3f08c279-4e62-44c4-b723-b8c9e0b5b3e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.752367 Oct 03 10:47:36.085465 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1928/4062] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:35 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:36.110150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-599503497"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:36.114400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:36.122513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:36.123043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:36.123525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.124236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:36.124679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:36.125283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.206478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:36.227487 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39471978-49fa-44f4-8911-0e873c57e5a5 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17" status: 200 len: 1512 microversion: 2.1 time: 0.599419 Oct 03 10:47:36.231766 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2135/4063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:35 2022] GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17 => generated 1512 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:36.239511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:36.240577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] [instance: f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:36.247891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:36.249090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:36.250268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.251274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:36.252018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:36.252756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.322410 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] HTTP exception thrown: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 could not be found. Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Request method failure captured: Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 HTTP/1.1 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOryL5G2-yTRjh1RphMtC_EXrOJOF-dZD_9JWNSpQg93oAg25cMZNodXe2Gq_LAiNKv0r5drn6I4gkBPBiwOpQ0HVHCQkCo_D8hP-dhZt-if3BX81gpVTYJ7QfROK-zko8lZ9P6Pq7ZNNqgobXJR-kt_vPbOy2GZ1qOeFsk48-D4rpYs Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/893e3d1c38654bed94f89dfd0532340e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/893e3d1c38654bed94f89dfd0532340e"}]}] Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 893e3d1c38654bed94f89dfd0532340e Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802589530 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 21ac39f90b0744a39c356ef7d846e2b8 Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802589530-project Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 could not be found. Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4'} Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 could not be found. Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 could not be found. Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:36.333777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 could not be found. Oct 03 10:47:36.342174 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:36.347662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] Returning 404 to user: Instance f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:47:36.351787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5089e6c1-e5f4-4b6b-8894-a9c2ee86a4ea tempest-ServerRescueNegativeTestJSON-1802589530 tempest-ServerRescueNegativeTestJSON-1802589530-project] 10.222.0.27 "GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4" status: 404 len: 111 microversion: 2.1 time: 0.116463 Oct 03 10:47:36.357415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2136/4064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:36 2022] GET /compute/v2.1/servers/f6ee2d69-2e76-4625-b5f5-d5b6c954d3f4 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:47:36.510141 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d9b0eff-af5f-4f2f-bbad-37c7c0dc7f58 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "POST /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995/action" status: 202 len: 0 microversion: 2.1 time: 0.405935 Oct 03 10:47:36.514227 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1929/4065] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:47:36 2022] POST /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:47:36.526828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad8d63c9-1ad0-42ac-b94f-e1f901b072d8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f18c700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:36.650879 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad8d63c9-1ad0-42ac-b94f-e1f901b072d8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.129670 Oct 03 10:47:36.660785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:36.661646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:36.664298 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2137/4066] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:36 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:36.679717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:36.680645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ec4fed82-86e2-4592-b0cc-317b5806510b req-4a2721b5-99f4-44bb-9f4a-ee4bbf7319d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b89356-c153-436c-863a-62534d52da17", "name": "network-vif-deleted", "tag": "5af8f9e4-0854-463a-af18-e536a2b0fb01"}, {"server_uuid": "2926209a-84e5-454b-987c-684755e5c0dc", "name": "network-vif-deleted", "tag": "8b4da610-22a1-4396-99b9-c457313375d5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:36.681105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:36.681788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.682771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:36.683484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:36.685626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.706276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ec4fed82-86e2-4592-b0cc-317b5806510b req-4a2721b5-99f4-44bb-9f4a-ee4bbf7319d4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:36.709757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ec4fed82-86e2-4592-b0cc-317b5806510b req-4a2721b5-99f4-44bb-9f4a-ee4bbf7319d4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:36.710496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ec4fed82-86e2-4592-b0cc-317b5806510b req-4a2721b5-99f4-44bb-9f4a-ee4bbf7319d4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:36.738341 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ec4fed82-86e2-4592-b0cc-317b5806510b req-4a2721b5-99f4-44bb-9f4a-ee4bbf7319d4 service nova] Creating event network-vif-deleted:5af8f9e4-0854-463a-af18-e536a2b0fb01 for instance 19b89356-c153-436c-863a-62534d52da17 on n-h2-858383-3 Oct 03 10:47:36.738859 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ec4fed82-86e2-4592-b0cc-317b5806510b req-4a2721b5-99f4-44bb-9f4a-ee4bbf7319d4 service nova] Creating event network-vif-deleted:8b4da610-22a1-4396-99b9-c457313375d5 for instance 2926209a-84e5-454b-987c-684755e5c0dc on n-h1-858383-3 Oct 03 10:47:36.759189 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ec4fed82-86e2-4592-b0cc-317b5806510b req-4a2721b5-99f4-44bb-9f4a-ee4bbf7319d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082886 Oct 03 10:47:36.765977 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2138/4067] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:37.022414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3158c3f1-b25e-46f5-9b9b-dc0154a41ac1 req-b8f2696c-64c4-4921-afe1-8ab2e321cf57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-unplugged", "status": "completed", "tag": "274f027e-bcda-4a01-8a4f-7c02cb37e040"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:37.033987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3158c3f1-b25e-46f5-9b9b-dc0154a41ac1 req-b8f2696c-64c4-4921-afe1-8ab2e321cf57 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:37.041565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3158c3f1-b25e-46f5-9b9b-dc0154a41ac1 req-b8f2696c-64c4-4921-afe1-8ab2e321cf57 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:37.042288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3158c3f1-b25e-46f5-9b9b-dc0154a41ac1 req-b8f2696c-64c4-4921-afe1-8ab2e321cf57 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:37.080319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3158c3f1-b25e-46f5-9b9b-dc0154a41ac1 req-b8f2696c-64c4-4921-afe1-8ab2e321cf57 service nova] Creating event network-vif-unplugged:274f027e-bcda-4a01-8a4f-7c02cb37e040 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:37.088254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3158c3f1-b25e-46f5-9b9b-dc0154a41ac1 req-b8f2696c-64c4-4921-afe1-8ab2e321cf57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071847 Oct 03 10:47:37.089478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2139/4068] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:47:37.112549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:37.113304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:37.131673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:37.132066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:37.133223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:37.134864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:37.135516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:37.136123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:37.789283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:37.797584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:37.799474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:37.800964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:37.802415 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89c24774-f8ab-4637-983c-48e0a9c245ad tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.696028 Oct 03 10:47:37.808536 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2140/4069] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:37 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:37.819089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:37.819717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 19b89356-c153-436c-863a-62534d52da17] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:37.835630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:37.836210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:37.836567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:37.837102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:37.837831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:37.838475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:37.838710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:37.842137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:37.845071 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d495c5f-e4e2-4a9c-85fc-73bf6b56b01f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2934 microversion: 2.32 time: 1.191123 Oct 03 10:47:37.846911 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1930/4070] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:36 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2934 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:47:37.855789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1197641b-2815-4080-8868-8e3625976a0c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea4e310>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:37.875715 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] HTTP exception thrown: Instance 19b89356-c153-436c-863a-62534d52da17 could not be found. Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Request method failure captured: Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17 HTTP/1.1 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr1-VQ0ASeVaRWchKjzt5f611J2qQzNljLBn5HPPeNwP7cVxC-YhCFVrjVhXAeTvoC-3qiv4oY-DgaKbN7FDHAMJ0KeG_hnPfksMqqVJPDD69xkVCtHI6K-SdkGkJKooEJmKn0pXWOMIRADnnEQNyhNi7j26sA9WDZqHwr15zlqeBdc Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 0636ed42cbed435aaee6b88d8978b98b Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MultipleCreateTestJSON-170428816 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0636ed42cbed435aaee6b88d8978b98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0636ed42cbed435aaee6b88d8978b98b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0636ed42cbed435aaee6b88d8978b98b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0636ed42cbed435aaee6b88d8978b98b"}]}] Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MultipleCreateTestJSON-170428816 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 0636ed42cbed435aaee6b88d8978b98b Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MultipleCreateTestJSON-170428816 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MultipleCreateTestJSON-170428816-project Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: c1cf2098bc1f4abe8e7ba06e0390b990 Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MultipleCreateTestJSON-170428816-project Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 19b89356-c153-436c-863a-62534d52da17 could not be found. Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '19b89356-c153-436c-863a-62534d52da17'} Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b89356-c153-436c-863a-62534d52da17 could not be found. Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b89356-c153-436c-863a-62534d52da17 could not be found. Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:37.877505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b89356-c153-436c-863a-62534d52da17 could not be found. Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Returning 404 to user: Instance 19b89356-c153-436c-863a-62534d52da17 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7f02f0e-3fef-4c36-be74-9489a5135d99 tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17" status: 404 len: 111 microversion: 2.1 time: 0.069044 Oct 03 10:47:37.888463 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2141/4071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:37 2022] GET /compute/v2.1/servers/19b89356-c153-436c-863a-62534d52da17 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:47:37.892740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:37.893393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:37.895472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:37.912638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:37.913210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:37.913604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:37.914321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:37.915228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:37.915837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:37.955829 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1197641b-2815-4080-8868-8e3625976a0c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.106706 Oct 03 10:47:37.958066 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1931/4072] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:37 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:38.089735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1cf2098bc1f4abe8e7ba06e0390b990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0636ed42cbed435aaee6b88d8978b98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:38.148315 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-83742f85-dd0e-4148-925a-93466c42d6eb tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 200 len: 1470 microversion: 2.1 time: 0.258099 Oct 03 10:47:38.167334 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2142/4073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:37 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:38.525859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "bbb3808f-c643-4004-943c-c63667728ecf"}], "security_groups": [{"name": "tempest-securitygroup--589726973"}], "key_name": "tempest-keypair-1317987556", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:38.844428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:38.846423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:38.867012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:38.868279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:38.869534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:38.871513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:38.873258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:38.873931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:38.994363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] validate_networks() for [('bbb3808f-c643-4004-943c-c63667728ecf', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:47:39.825429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:39.838561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:39.841459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:39.844234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4dbf210-5ddf-4bb3-a81b-c9ef4e278dd7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 1.008612 Oct 03 10:47:39.845411 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2143/4074] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:38 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:39.878409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:39.881145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:39.895594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:39.896662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:39.897359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:39.898362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:39.899042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:39.899954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.302962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:40.321650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:40.327026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:40.330983 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c9330be-9070-4ea4-be3d-4c28363d64ee tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2913 microversion: 2.32 time: 0.456973 Oct 03 10:47:40.333305 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2144/4075] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:39 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2913 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:40.382339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8d42f4c-f85c-496b-b968-0642a769251b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1e7dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:40.513721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8d42f4c-f85c-496b-b968-0642a769251b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.142975 Oct 03 10:47:40.517175 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2145/4076] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:40 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:40.531101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-unplugged", "status": "completed", "tag": "32bd2338-d1b6-42fd-b856-25db395ef05c"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-unplugged", "status": "completed", "tag": "3308c5b3-42cc-478c-a7ed-eb3a91f256f4"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-unplugged", "status": "completed", "tag": "431054ce-fa85-4a93-921c-f45394fb158e"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-unplugged", "status": "completed", "tag": "728b9d45-bcb3-4720-a1ae-79eec1829570"}, {"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-unplugged", "status": "completed", "tag": "3ffca724-9017-4dbe-b9e6-d315e9ca8f10"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:40.545370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:40.545849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:40.546672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.592602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Creating event network-vif-unplugged:32bd2338-d1b6-42fd-b856-25db395ef05c for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:40.594313 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Creating event network-vif-unplugged:3308c5b3-42cc-478c-a7ed-eb3a91f256f4 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:40.595175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Creating event network-vif-unplugged:431054ce-fa85-4a93-921c-f45394fb158e for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:40.596578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Creating event network-vif-unplugged:728b9d45-bcb3-4720-a1ae-79eec1829570 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:40.598267 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] Creating event network-vif-unplugged:3ffca724-9017-4dbe-b9e6-d315e9ca8f10 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:40.610574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:47:40.611279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:47:40.611971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:47:40.612711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:47:40.613402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:47:40.617476 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-239d2637-52e8-49c2-b54e-67ae6b3aed36 req-bbb37bd2-aadc-408d-8590-32f7186084fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.090221 Oct 03 10:47:40.631579 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2146/4077] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:40.637077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=16 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:40.643840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:40.644599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:40.646240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] [instance: 2926209a-84e5-454b-987c-684755e5c0dc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:40.652513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:40.656379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:40.656591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.657496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:40.658421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:40.659657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.660591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:40.661183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:40.662287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:40.662909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.663473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.688802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] HTTP exception thrown: Instance 2926209a-84e5-454b-987c-684755e5c0dc could not be found. Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Request method failure captured: Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc HTTP/1.1 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr1-VQ0ASeVaRWchKjzt5f611J2qQzNljLBn5HPPeNwP7cVxC-YhCFVrjVhXAeTvoC-3qiv4oY-DgaKbN7FDHAMJ0KeG_hnPfksMqqVJPDD69xkVCtHI6K-SdkGkJKooEJmKn0pXWOMIRADnnEQNyhNi7j26sA9WDZqHwr15zlqeBdc Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 0636ed42cbed435aaee6b88d8978b98b Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MultipleCreateTestJSON-170428816 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0636ed42cbed435aaee6b88d8978b98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0636ed42cbed435aaee6b88d8978b98b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0636ed42cbed435aaee6b88d8978b98b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0636ed42cbed435aaee6b88d8978b98b"}]}] Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MultipleCreateTestJSON-170428816 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 0636ed42cbed435aaee6b88d8978b98b Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MultipleCreateTestJSON-170428816 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MultipleCreateTestJSON-170428816-project Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: c1cf2098bc1f4abe8e7ba06e0390b990 Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MultipleCreateTestJSON-170428816-project Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 2926209a-84e5-454b-987c-684755e5c0dc could not be found. Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '2926209a-84e5-454b-987c-684755e5c0dc'} Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2926209a-84e5-454b-987c-684755e5c0dc could not be found. Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2926209a-84e5-454b-987c-684755e5c0dc could not be found. Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:47:40.691047 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:40.696336 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:47:40.696336 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:47:40.696336 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:47:40.696336 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:47:40.696336 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:47:40.696336 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2926209a-84e5-454b-987c-684755e5c0dc could not be found. Oct 03 10:47:40.696336 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:47:40.700643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] Returning 404 to user: Instance 2926209a-84e5-454b-987c-684755e5c0dc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:47:40.701810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb8c4cee-0927-4a6b-b2a8-96ba9252ac8b tempest-MultipleCreateTestJSON-170428816 tempest-MultipleCreateTestJSON-170428816-project] 10.222.0.27 "GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc" status: 404 len: 111 microversion: 2.1 time: 0.068728 Oct 03 10:47:40.706764 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2147/4078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:40 2022] GET /compute/v2.1/servers/2926209a-84e5-454b-987c-684755e5c0dc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:47:40.738050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Getting quotas for project 387e024349a64433a7f8850c45ed956a. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:47:40.753067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Getting quotas for user fb8dcc199c80470a81c458f1e8860487 and project 387e024349a64433a7f8850c45ed956a. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:47:40.791704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:47:40.794930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:47:40.877039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:40.877596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:40.891881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:40.892405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:40.897118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.898116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:40.903280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:40.903906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:40.923158 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-058905dd-bac7-477b-9858-5262bea16521 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.410050 Oct 03 10:47:40.927642 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1932/4079] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:47:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:47:40.946780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-656e5f8e-7473-4e5d-935b-743bf0399205 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:40.950570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-656e5f8e-7473-4e5d-935b-743bf0399205 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:41.431883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:41.441565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:41.446623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:41.463527 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02d7b842-6035-4e2f-a1e3-88e85e13255e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.591820 Oct 03 10:47:41.468223 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2148/4080] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:40 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:41.477206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:41.478127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:41.513375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:41.519077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:41.520316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:41.523615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:41.527618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:41.529090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:41.626830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-656e5f8e-7473-4e5d-935b-743bf0399205 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:41.638938 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-656e5f8e-7473-4e5d-935b-743bf0399205 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1226 microversion: 2.1 time: 0.706068 Oct 03 10:47:41.648297 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1933/4081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:40 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1226 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:41.653649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3d7cb84-fc98-43d9-b913-78b048af098d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e3a00d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:41.739984 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3d7cb84-fc98-43d9-b913-78b048af098d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.090403 Oct 03 10:47:41.749649 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1934/4082] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:41 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:41.948899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:41.954755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:41.974637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:41.984403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:41.993018 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-74e7c7de-c1f7-4664-92ab-ce3db9e90cdf tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2913 microversion: 2.32 time: 0.522701 Oct 03 10:47:42.010273 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2149/4083] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:41 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2913 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:42.496123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:42.497801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:42.516391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:42.517212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:42.520858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:42.521882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:42.522557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:42.523573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:42.667148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-31771404-a756-48af-b670-db1c75ac6894 req-16e12f68-b8d5-4ece-a67c-7ad01c37ab93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fe7879-6f32-4d3b-8038-a4f40f154995", "name": "network-vif-plugged", "status": "completed", "tag": "873702af-4840-46a1-b693-3ceb18ce3a18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:42.683584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-31771404-a756-48af-b670-db1c75ac6894 req-16e12f68-b8d5-4ece-a67c-7ad01c37ab93 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:42.684029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-31771404-a756-48af-b670-db1c75ac6894 req-16e12f68-b8d5-4ece-a67c-7ad01c37ab93 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:42.684490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-31771404-a756-48af-b670-db1c75ac6894 req-16e12f68-b8d5-4ece-a67c-7ad01c37ab93 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:42.711180 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-31771404-a756-48af-b670-db1c75ac6894 req-16e12f68-b8d5-4ece-a67c-7ad01c37ab93 service nova] Creating event network-vif-plugged:873702af-4840-46a1-b693-3ceb18ce3a18 for instance d4fe7879-6f32-4d3b-8038-a4f40f154995 on n-h2-858383-3 Oct 03 10:47:42.723616 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-31771404-a756-48af-b670-db1c75ac6894 req-16e12f68-b8d5-4ece-a67c-7ad01c37ab93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060815 Oct 03 10:47:42.724397 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2150/4084] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:47:42.745662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:42.747443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:42.765771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:42.774051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:42.775314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:42.782837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:42.783758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:42.784425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:43.308217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:43.325929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:43.327596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:43.339809 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6bc09ff6-1076-44d2-953b-77adadd53b96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.848045 Oct 03 10:47:43.340945 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1935/4085] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:42 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:43.351534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-825338e8-7703-4642-9e0f-85e79d8302f4 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e2f6f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:43.461493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-825338e8-7703-4642-9e0f-85e79d8302f4 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.119430 Oct 03 10:47:43.462930 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1936/4086] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:43 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:43.474043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:43.478462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:43.501235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:43.501726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:43.502174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:43.503162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:43.503639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:43.505794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:43.537827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:43.567082 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53ccfd55-7f4c-40bd-bcf6-fff1e3ae6ca5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1278 microversion: 2.1 time: 0.832224 Oct 03 10:47:43.567198 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2151/4087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:42 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1278 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:44.370361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:44.370861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:44.385481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:44.386810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:44.387925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:44.390039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:44.391191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:44.392512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:45.238876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:45.259551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:45.264126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:45.271334 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9484122-cb0e-40b7-bc02-ca9ca7453a5a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.905181 Oct 03 10:47:45.275552 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2152/4088] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:44 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:47:45.293166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a44d2ec-acb0-403a-8a6c-79ba63581ce8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f337790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:45.408054 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a44d2ec-acb0-403a-8a6c-79ba63581ce8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.129709 Oct 03 10:47:45.416878 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2153/4089] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:45 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:45.429308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:45.430690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:45.460611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:45.461138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:45.465821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:45.466598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:45.467264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:45.467720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:45.752488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:45.774420 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c592e89-663e-44c0-a4f1-51e45ac221b8 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1284 microversion: 2.1 time: 0.353379 Oct 03 10:47:45.775076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2154/4090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:45 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:45.798764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-91d9dc5e-a32d-4226-8ead-c3288861d4f0 req-e79b2cb1-20b0-4f41-9bbc-7bbc47083066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-deleted", "tag": "3ffca724-9017-4dbe-b9e6-d315e9ca8f10"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:45.846664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-91d9dc5e-a32d-4226-8ead-c3288861d4f0 req-e79b2cb1-20b0-4f41-9bbc-7bbc47083066 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:45.847542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-91d9dc5e-a32d-4226-8ead-c3288861d4f0 req-e79b2cb1-20b0-4f41-9bbc-7bbc47083066 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:45.848194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-91d9dc5e-a32d-4226-8ead-c3288861d4f0 req-e79b2cb1-20b0-4f41-9bbc-7bbc47083066 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:45.885896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-91d9dc5e-a32d-4226-8ead-c3288861d4f0 req-e79b2cb1-20b0-4f41-9bbc-7bbc47083066 service nova] Creating event network-vif-deleted:3ffca724-9017-4dbe-b9e6-d315e9ca8f10 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:45.934862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-91d9dc5e-a32d-4226-8ead-c3288861d4f0 req-e79b2cb1-20b0-4f41-9bbc-7bbc47083066 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135027 Oct 03 10:47:45.939054 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2155/4091] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:45.954636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:45.968933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:45.973983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d9c5a7f7-c561-42fc-88a5-e4fdae0faa47 req-9d0ae304-00a8-4953-94e5-84b56d7b47ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "name": "network-vif-plugged", "status": "completed", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:45.986829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:45.994448 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40867f32-de65-40d2-aa4f-dbf11c6412e0 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2866 microversion: 2.32 time: 2.530189 Oct 03 10:47:46.020816 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1937/4092] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:43 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2866 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:46.021098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d9c5a7f7-c561-42fc-88a5-e4fdae0faa47 req-9d0ae304-00a8-4953-94e5-84b56d7b47ed service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:46.030113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d9c5a7f7-c561-42fc-88a5-e4fdae0faa47 req-9d0ae304-00a8-4953-94e5-84b56d7b47ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:46.031881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d9c5a7f7-c561-42fc-88a5-e4fdae0faa47 req-9d0ae304-00a8-4953-94e5-84b56d7b47ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:46.051204 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d9c5a7f7-c561-42fc-88a5-e4fdae0faa47 req-9d0ae304-00a8-4953-94e5-84b56d7b47ed service nova] Creating event network-vif-plugged:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h1-858383-3 Oct 03 10:47:46.060051 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d9c5a7f7-c561-42fc-88a5-e4fdae0faa47 req-9d0ae304-00a8-4953-94e5-84b56d7b47ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117630 Oct 03 10:47:46.061496 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2156/4093] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:46.307291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:46.313614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:46.322097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:46.327073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:46.327926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:46.329649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:46.329649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:46.330146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:46.425277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbb602ce-2106-4f1a-a13e-5472c7980dd6 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f07541c03a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:46.503763 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bbb602ce-2106-4f1a-a13e-5472c7980dd6 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.083722 Oct 03 10:47:46.514550 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2157/4094] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:46 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:47:46.805309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:46.806537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:46.824208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:46.826218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:46.827482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:46.830673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:46.831423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:46.831964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:47.165182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:47.174031 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7245da04-ca87-470c-8678-60e175ee3a5c tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1351 microversion: 2.1 time: 0.373853 Oct 03 10:47:47.176720 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2158/4095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:46 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1351 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:47.182164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:47.183397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:47.203975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:47.205219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:47.205664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:47.206678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:47.207349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:47.207965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:47.564985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:47.579685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:47.581257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:47.585254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b7f2fd4f-e030-4854-915f-337554618126 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2579 microversion: 2.32 time: 0.407084 Oct 03 10:47:47.600808 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2159/4096] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:47 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2579 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:47.600808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59f16c23-8708-4254-aa2a-0d49b8f11b4b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1853a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:47.659056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59f16c23-8708-4254-aa2a-0d49b8f11b4b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.069162 Oct 03 10:47:47.671768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:47.680352 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2160/4097] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:47 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:47.681929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:47.684744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:47.686967 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a019436c-41e4-4560-b245-f0bdf5b9e0ca tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 1.383855 Oct 03 10:47:47.688084 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1938/4098] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:46 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:48.243138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:48.243994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:48.257777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:48.258293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:48.259021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:48.260069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:48.260710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:48.261378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:48.427890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8aad58fb-8938-4c42-9bf0-dcb73ebed76f req-487712e3-1bed-41fc-814c-9441776d7cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-deleted", "tag": "728b9d45-bcb3-4720-a1ae-79eec1829570"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:48.450040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8aad58fb-8938-4c42-9bf0-dcb73ebed76f req-487712e3-1bed-41fc-814c-9441776d7cee service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:48.450543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8aad58fb-8938-4c42-9bf0-dcb73ebed76f req-487712e3-1bed-41fc-814c-9441776d7cee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:48.453230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8aad58fb-8938-4c42-9bf0-dcb73ebed76f req-487712e3-1bed-41fc-814c-9441776d7cee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:48.482386 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8aad58fb-8938-4c42-9bf0-dcb73ebed76f req-487712e3-1bed-41fc-814c-9441776d7cee service nova] Creating event network-vif-deleted:728b9d45-bcb3-4720-a1ae-79eec1829570 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:48.501543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8aad58fb-8938-4c42-9bf0-dcb73ebed76f req-487712e3-1bed-41fc-814c-9441776d7cee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078249 Oct 03 10:47:48.502543 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1939/4099] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:48.619232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:48.619943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:48.644392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:48.645290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:48.646001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:48.647250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:48.648040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:48.649371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:48.659683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:48.663137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:48.679138 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a6f73a7a-d6cb-499d-b7bd-a535caeb755d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1351 microversion: 2.1 time: 0.440008 Oct 03 10:47:48.685805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2161/4100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:48 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1351 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:48.695415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d61193c1-fe1f-4338-8247-ef54168a6df9 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e546430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:48.825518 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d61193c1-fe1f-4338-8247-ef54168a6df9 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.136413 Oct 03 10:47:48.834150 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2162/4101] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:48 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:48.857250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:48.860362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:48.879970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:48.895825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:48.897190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:48.910892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:48.916201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:48.917522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:49.725637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:49.747310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:49.750380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:49.753822 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-46f4b47a-5fbe-4255-9176-4d982b623e2d tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1408 microversion: 2.20 time: 0.920555 Oct 03 10:47:49.768467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:49.778593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:49.784277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:49.799868 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7902a4c-160f-4364-a68e-0a25ad348785 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2418 microversion: 2.32 time: 1.184697 Oct 03 10:47:49.800781 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1940/4102] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:48 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2418 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:47:49.805714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2163/4103] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:48 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1408 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:49.806246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b3333dab-dabf-4194-b157-081ec0e995c2 req-2646e1f7-78b7-4213-8c0a-8bc956fc7945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19491ab9-9855-4602-b203-1c3bfd401b12", "tag": "2f907708-8c09-4378-a5b4-86d8b19c1353"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:49.820954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:49.821612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:49.827016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b3333dab-dabf-4194-b157-081ec0e995c2 req-2646e1f7-78b7-4213-8c0a-8bc956fc7945 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:49.828029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b3333dab-dabf-4194-b157-081ec0e995c2 req-2646e1f7-78b7-4213-8c0a-8bc956fc7945 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:49.830710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b3333dab-dabf-4194-b157-081ec0e995c2 req-2646e1f7-78b7-4213-8c0a-8bc956fc7945 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:49.841295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:49.845258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:49.846093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:49.847059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:49.847521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:49.848401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:49.855346 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b3333dab-dabf-4194-b157-081ec0e995c2 req-2646e1f7-78b7-4213-8c0a-8bc956fc7945 service nova] Creating event network-changed:2f907708-8c09-4378-a5b4-86d8b19c1353 for instance 19491ab9-9855-4602-b203-1c3bfd401b12 on n-h2-858383-3 Oct 03 10:47:49.875184 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b3333dab-dabf-4194-b157-081ec0e995c2 req-2646e1f7-78b7-4213-8c0a-8bc956fc7945 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072247 Oct 03 10:47:49.875835 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1941/4104] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:49.882088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b13d904-bb52-477f-be6c-60ecd322c692 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e221310>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:49.971765 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b13d904-bb52-477f-be6c-60ecd322c692 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.094187 Oct 03 10:47:49.978735 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1942/4105] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:49 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:50.261419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:50.298818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44c8ad1e-ae16-42e7-be4a-8c2d69a4db51 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1351 microversion: 2.1 time: 0.488589 Oct 03 10:47:50.325792 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2164/4106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:49 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1351 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:50.789574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:50.790584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:50.794045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:50.818855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:50.819551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:50.820191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:50.821116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:50.823586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:50.824233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:50.835579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:50.837738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:50.867202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:50.867959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:50.871909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:50.872695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:50.873305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:50.873748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:51.631452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:51.638423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:51.680736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:51.687966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:51.692216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-64c63e02-963c-4956-b2a7-0a638f8aa7ac tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2371 microversion: 2.32 time: 0.861384 Oct 03 10:47:51.708692 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2165/4107] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:50 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2371 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:47:51.719078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d90e1b49-105b-4ef9-a901-c7a73a03c54b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e513820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:51.805851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d90e1b49-105b-4ef9-a901-c7a73a03c54b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.095745 Oct 03 10:47:51.811520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:51.820641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:51.826752 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2166/4108] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:51 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:51.846402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:51.857562 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7a205fef-3c61-44df-8ae1-eb0484568f09 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1601 microversion: 2.20 time: 1.064385 Oct 03 10:47:51.857794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-62ed110a-0255-4f25-9cb7-f39b419216b2 req-87f13832-25e1-40e7-a1b3-4efbf0406cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-deleted", "tag": "32bd2338-d1b6-42fd-b856-25db395ef05c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:51.858803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1943/4109] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:50 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1601 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:51.871183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:51.877855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:51.907949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-62ed110a-0255-4f25-9cb7-f39b419216b2 req-87f13832-25e1-40e7-a1b3-4efbf0406cac service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:51.907949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-62ed110a-0255-4f25-9cb7-f39b419216b2 req-87f13832-25e1-40e7-a1b3-4efbf0406cac service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:51.919840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-62ed110a-0255-4f25-9cb7-f39b419216b2 req-87f13832-25e1-40e7-a1b3-4efbf0406cac service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:51.920340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:51.921536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:51.927154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:51.929432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:51.932526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:51.933560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:51.985845 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-62ed110a-0255-4f25-9cb7-f39b419216b2 req-87f13832-25e1-40e7-a1b3-4efbf0406cac service nova] Creating event network-vif-deleted:32bd2338-d1b6-42fd-b856-25db395ef05c for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:52.008734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-62ed110a-0255-4f25-9cb7-f39b419216b2 req-87f13832-25e1-40e7-a1b3-4efbf0406cac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176132 Oct 03 10:47:52.009904 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2167/4110] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:52.042677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:52.052096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:52.063745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:52.064643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:52.066951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:52.068112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:52.071598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:52.073589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:52.455929 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1389c221-ea83-474f-89de-5e346ba2f178 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.443377 Oct 03 10:47:52.456391 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2168/4111] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:47:52 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-interface => generated 285 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:47:52.753625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:52.754255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:52.773616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:52.774144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:52.774597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:52.775341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:52.775800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:52.776236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:53.124964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:53.136672 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-180e6be9-bd37-45db-95d6-ee0f241dbf15 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1351 microversion: 2.1 time: 1.275431 Oct 03 10:47:53.156565 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1944/4112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:51 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1351 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:53.162537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-173fa8f5-9e1d-484d-a608-04c8b02e22fd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f56f550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:53.241471 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-173fa8f5-9e1d-484d-a608-04c8b02e22fd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.083114 Oct 03 10:47:53.244540 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1945/4113] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:53 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:53.417234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:53.438681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:53.441732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:53.442973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-92b2c6de-d8dc-48c4-9734-7b3578129bf8 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2257 microversion: 2.32 time: 0.693725 Oct 03 10:47:53.451195 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2169/4114] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:52 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2257 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:47:54.165608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:54.166068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:54.187333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:54.192039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:54.196155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:54.200787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:54.205351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:54.206190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:54.206944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:54.257712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76a8eb7a-d6d9-4c05-957a-de639c53ad9e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e5634c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:54.353171 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-76a8eb7a-d6d9-4c05-957a-de639c53ad9e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.099166 Oct 03 10:47:54.361739 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2170/4115] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:54 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:54.483053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:54.484043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:54.504505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:54.509155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:54.509672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:54.510429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:54.514076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:54.520371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:55.001335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:55.021233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:55.023120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:55.030887 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-307e2348-3266-4154-9835-a0988d2743b6 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2210 microversion: 2.32 time: 0.552246 Oct 03 10:47:55.034527 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2171/4116] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:54 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2210 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:55.340045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7fbaf1e3-a467-427c-a1d5-ddd8e95866fe req-dcd11891-883a-4794-8b9c-9c8e4a1aefd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19491ab9-9855-4602-b203-1c3bfd401b12", "name": "network-vif-plugged", "status": "completed", "tag": "2f907708-8c09-4378-a5b4-86d8b19c1353"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:55.361876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7fbaf1e3-a467-427c-a1d5-ddd8e95866fe req-dcd11891-883a-4794-8b9c-9c8e4a1aefd3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:55.362437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7fbaf1e3-a467-427c-a1d5-ddd8e95866fe req-dcd11891-883a-4794-8b9c-9c8e4a1aefd3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:55.362836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7fbaf1e3-a467-427c-a1d5-ddd8e95866fe req-dcd11891-883a-4794-8b9c-9c8e4a1aefd3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:55.396478 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7fbaf1e3-a467-427c-a1d5-ddd8e95866fe req-dcd11891-883a-4794-8b9c-9c8e4a1aefd3 service nova] Creating event network-vif-plugged:2f907708-8c09-4378-a5b4-86d8b19c1353 for instance 19491ab9-9855-4602-b203-1c3bfd401b12 on n-h2-858383-3 Oct 03 10:47:55.410490 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7fbaf1e3-a467-427c-a1d5-ddd8e95866fe req-dcd11891-883a-4794-8b9c-9c8e4a1aefd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074227 Oct 03 10:47:55.417795 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2172/4117] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:55.431088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6eb360f4-482c-4585-845f-c2a1ebb8f909 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e21f940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:55.547054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:55.555100 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78195279-96e7-4f77-8b5a-c88d352cd8cf tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1351 microversion: 2.1 time: 1.395813 Oct 03 10:47:55.559641 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1946/4118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:54 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1351 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:55.571659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-2c8c8633-4853-484d-97aa-1e481d08805e req-64efa7a8-b4b0-4874-b463-65799f85294f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-deleted", "tag": "3308c5b3-42cc-478c-a7ed-eb3a91f256f4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:55.581361 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6eb360f4-482c-4585-845f-c2a1ebb8f909 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.161877 Oct 03 10:47:55.582592 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2173/4119] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:55 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:55.605095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2c8c8633-4853-484d-97aa-1e481d08805e req-64efa7a8-b4b0-4874-b463-65799f85294f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:55.605883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2c8c8633-4853-484d-97aa-1e481d08805e req-64efa7a8-b4b0-4874-b463-65799f85294f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:55.606501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2c8c8633-4853-484d-97aa-1e481d08805e req-64efa7a8-b4b0-4874-b463-65799f85294f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:55.628480 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-2c8c8633-4853-484d-97aa-1e481d08805e req-64efa7a8-b4b0-4874-b463-65799f85294f service nova] Creating event network-vif-deleted:3308c5b3-42cc-478c-a7ed-eb3a91f256f4 for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:47:55.640994 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-2c8c8633-4853-484d-97aa-1e481d08805e req-64efa7a8-b4b0-4874-b463-65799f85294f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073431 Oct 03 10:47:55.641906 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1947/4120] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:56.068466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:56.073492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:56.105548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:56.110118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:56.111214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:56.112184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:56.112780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:56.113358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:56.538989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:56.555776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:56.557320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:56.558643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa2b2b63-9a4d-48e1-9f25-cb59f45c2020 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 2053 microversion: 2.32 time: 0.499204 Oct 03 10:47:56.572819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2174/4121] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:56 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 2053 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:56.597043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:56.597704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:56.605401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:56.605910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:56.606356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:56.607069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:56.607525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:56.607952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:56.738212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1854887786", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": "none"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:56.856972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:47:56.858357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:47:56.859659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:47:56.860906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:47:56.862371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:47:56.879638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:56.880420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:56.881097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:56.882251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:56.883021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:56.884191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:56.921797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Getting quotas for project 2be9145ee08d490e87426199a983b16b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:47:56.930104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Getting quotas for user d2906fee8eef489f9745ca57fd949ede and project 2be9145ee08d490e87426199a983b16b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:47:56.950908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:47:56.954019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:47:56.967012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:56.985074 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-067b4b0d-53b7-4f74-8940-6bef782c738a tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1351 microversion: 2.1 time: 0.391967 Oct 03 10:47:56.985720 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2175/4122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:56 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1351 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:56.998691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0948a000-d809-468d-b2ca-9703131bed49 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f07574ee3a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:57.079323 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b967d71a-cc0f-412a-afaa-66f7178066bc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.593837 Oct 03 10:47:57.079995 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1948/4123] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 03 10:47:57.098494 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0948a000-d809-468d-b2ca-9703131bed49 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.111624 Oct 03 10:47:57.104689 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2176/4124] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:56 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:57.112573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7cd765b1-ef0f-43b0-b1a7-57f97bc9adbc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:57.113233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7cd765b1-ef0f-43b0-b1a7-57f97bc9adbc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:57.568446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7cd765b1-ef0f-43b0-b1a7-57f97bc9adbc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:57.577115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7cd765b1-ef0f-43b0-b1a7-57f97bc9adbc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:57.578811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7cd765b1-ef0f-43b0-b1a7-57f97bc9adbc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:57.582254 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7cd765b1-ef0f-43b0-b1a7-57f97bc9adbc tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1278 microversion: 2.54 time: 0.486861 Oct 03 10:47:57.582846 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1949/4125] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:57 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1278 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:57.596961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:57.596961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:57.615453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:57.619541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:57.622595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:57.627782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:57.630415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:57.631172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:57.928456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d255e883-edca-4621-9a81-52edc11c91b5 req-cf7e53d4-bb2c-42ab-b0c2-db34c2127bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:47:57.967640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d255e883-edca-4621-9a81-52edc11c91b5 req-cf7e53d4-bb2c-42ab-b0c2-db34c2127bd4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:57.968149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d255e883-edca-4621-9a81-52edc11c91b5 req-cf7e53d4-bb2c-42ab-b0c2-db34c2127bd4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:57.968694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d255e883-edca-4621-9a81-52edc11c91b5 req-cf7e53d4-bb2c-42ab-b0c2-db34c2127bd4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:58.019716 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d255e883-edca-4621-9a81-52edc11c91b5 req-cf7e53d4-bb2c-42ab-b0c2-db34c2127bd4 service nova] Creating event network-changed:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h1-858383-3 Oct 03 10:47:58.044092 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d255e883-edca-4621-9a81-52edc11c91b5 req-cf7e53d4-bb2c-42ab-b0c2-db34c2127bd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121415 Oct 03 10:47:58.044822 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1950/4126] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:47:58.092784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:58.101054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:58.128233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:58.128799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:58.129512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:58.130265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:58.132798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:58.133294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:58.504380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:58.515616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:58.525980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:58.528325 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d9c3752-c5b4-4c6f-bba4-263f9cc14787 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1985 microversion: 2.32 time: 0.940410 Oct 03 10:47:58.530061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2177/4127] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:57 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1985 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:58.552343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2214247e-4ee1-4af4-9535-863ae5f711c0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f721f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:58.644921 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2214247e-4ee1-4af4-9535-863ae5f711c0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.112906 Oct 03 10:47:58.654887 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2178/4128] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:58 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:58.675094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:58.677771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:58.695189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:58.695958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:58.696611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:58.698385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:58.700671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:58.702371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:58.727217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:47:58.910478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:58.930129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:58.932510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:58.936185 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44151f6b-74f8-4d22-be7d-9ff59ecd5343 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1330 microversion: 2.54 time: 0.280063 Oct 03 10:47:58.938160 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2179/4129] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:58 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1330 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:47:59.247528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:47:59.259511 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11a3fb8d-492e-4d51-b10a-59ff347ccede tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1542 microversion: 2.1 time: 1.213212 Oct 03 10:47:59.261000 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1951/4130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:47:58 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1542 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:47:59.287061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:59.288585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:59.315754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:59.319905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:59.322193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:59.324892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:59.334057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:59.335505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:59.592663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:47:59.593327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:47:59.628703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:59.632229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:59.633914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:59.637774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:47:59.639659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:47:59.641163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:47:59.892938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-18afa0b2-ddf3-4245-81b5-80c4804b93d6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.611258 Oct 03 10:47:59.894698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2180/4131] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:47:59 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12/os-interface => generated 285 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:47:59.900302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59fd2c71-d9cc-4660-9b83-ae39d42d41f0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f721b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:00.001453 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59fd2c71-d9cc-4660-9b83-ae39d42d41f0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.101768 Oct 03 10:48:00.018460 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2181/4132] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:47:59 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:00.053179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:00.053956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:00.062254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:00.062832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:00.063426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:00.064377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:00.064978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:00.065808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:00.314631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:00.328958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:00.338580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:00.342086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0d67cccd-0ac7-4208-b9e7-f54147b3166e tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1336 microversion: 2.54 time: 0.319028 Oct 03 10:48:00.349346 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2182/4133] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:00 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1336 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:00.607454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1e24addf-483b-426e-9b79-cfc07aee73a1 req-3ac9d72d-ab38-42dd-ab06-decbd8b77e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c468f4c-dc50-41ee-883e-47f3cbf052a3", "name": "network-vif-deleted", "tag": "431054ce-fa85-4a93-921c-f45394fb158e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:00.638913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1e24addf-483b-426e-9b79-cfc07aee73a1 req-3ac9d72d-ab38-42dd-ab06-decbd8b77e9f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:00.650488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1e24addf-483b-426e-9b79-cfc07aee73a1 req-3ac9d72d-ab38-42dd-ab06-decbd8b77e9f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:00.652073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:00.652778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1e24addf-483b-426e-9b79-cfc07aee73a1 req-3ac9d72d-ab38-42dd-ab06-decbd8b77e9f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:00.677172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:00.683604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:00.696454 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26b7497c-d965-483f-b018-3a31f95bf026 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 1.125808 Oct 03 10:48:00.697333 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1e24addf-483b-426e-9b79-cfc07aee73a1 req-3ac9d72d-ab38-42dd-ab06-decbd8b77e9f service nova] Creating event network-vif-deleted:431054ce-fa85-4a93-921c-f45394fb158e for instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 on n-h2-858383-3 Oct 03 10:48:00.700678 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1952/4134] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:47:59 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:00.719613 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1e24addf-483b-426e-9b79-cfc07aee73a1 req-3ac9d72d-ab38-42dd-ab06-decbd8b77e9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116794 Oct 03 10:48:00.722124 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2183/4135] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:48:01.028754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e1894195-eade-4c17-8771-57f7505e55fd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f0d9700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:01.194973 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e1894195-eade-4c17-8771-57f7505e55fd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.175137 Oct 03 10:48:01.197021 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1953/4136] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:01 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:01.379624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:01.381659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:01.399626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:01.400127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:01.405429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:01.407829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:01.410019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:01.410684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:01.741972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:01.742760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:01.776104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:01.780179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:01.781422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:01.785399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:01.787794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:01.788691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:01.863003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:01.873954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:01.875611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:01.883512 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a678ceca-e4f1-4d2d-aa2a-bddb6f62f280 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1336 microversion: 2.54 time: 0.505163 Oct 03 10:48:01.884574 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2184/4137] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:01 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1336 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:01.916798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:01.933436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:01.939933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:01.942939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f842625a-0d06-4baf-b735-60110ecc50fe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.205989 Oct 03 10:48:01.959158 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1954/4138] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:01 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:02.212181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea6d985b-dc68-4051-b26c-5b6f86662a83 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e513ca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:02.338279 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea6d985b-dc68-4051-b26c-5b6f86662a83 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.130535 Oct 03 10:48:02.339385 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2185/4139] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:02 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:02.916332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:02.917419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:02.932979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:02.934729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:02.935356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:02.938406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:02.939680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:02.940240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:02.992817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:02.993661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:03.042209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:03.044996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:03.047207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:03.051839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:03.053641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:03.056472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:03.292364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:03.310114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:03.314351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:03.317817 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1c17436c-fcf9-406b-8cee-c877b6a1d8f4 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1336 microversion: 2.54 time: 0.406441 Oct 03 10:48:03.332935 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1955/4140] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:02 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1336 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:03.355221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-631e76da-9eac-4656-885e-905037093bd9 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e391550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:03.510674 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-631e76da-9eac-4656-885e-905037093bd9 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.159689 Oct 03 10:48:03.512574 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1956/4141] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:03 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:03.676462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:03.700756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:03.705040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:03.712617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4935ba74-a8ff-42e9-aa2f-2faa4769b5c2 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.734110 Oct 03 10:48:03.714463 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2186/4142] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:02 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:03.934082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-501ff99e-e26f-4aa7-8493-0212d5bef896 req-130f1e01-0e0f-4ddf-811f-64c772b86cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19491ab9-9855-4602-b203-1c3bfd401b12", "tag": "2f907708-8c09-4378-a5b4-86d8b19c1353"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:03.963852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-501ff99e-e26f-4aa7-8493-0212d5bef896 req-130f1e01-0e0f-4ddf-811f-64c772b86cf3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:03.968938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-501ff99e-e26f-4aa7-8493-0212d5bef896 req-130f1e01-0e0f-4ddf-811f-64c772b86cf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:03.969635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-501ff99e-e26f-4aa7-8493-0212d5bef896 req-130f1e01-0e0f-4ddf-811f-64c772b86cf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:04.006240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-501ff99e-e26f-4aa7-8493-0212d5bef896 req-130f1e01-0e0f-4ddf-811f-64c772b86cf3 service nova] Creating event network-changed:2f907708-8c09-4378-a5b4-86d8b19c1353 for instance 19491ab9-9855-4602-b203-1c3bfd401b12 on n-h2-858383-3 Oct 03 10:48:04.025859 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-501ff99e-e26f-4aa7-8493-0212d5bef896 req-130f1e01-0e0f-4ddf-811f-64c772b86cf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099818 Oct 03 10:48:04.030133 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1957/4143] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:04.354786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:04.356359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:04.385994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-844bdbd3-cc83-44b6-a5ce-03c16b498c67 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-960455853", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:04.393182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:04.394471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:04.395580 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-844bdbd3-cc83-44b6-a5ce-03c16b498c67 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] HTTP exception thrown: min_count must be <= max_count Oct 03 10:48:04.397881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:04.398643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-844bdbd3-cc83-44b6-a5ce-03c16b498c67 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Request method failure captured: Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 183 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3jDaBkEI_P8e7t-3vgn90CE-MQbH24rha-KXARLPD5u-MgO6GBlii9grVnjPPqkT6e8JQW-jCAYzRuSyVIj4hxCeVDuwwvXiHFamxn_1Cqzb3GK5nN9hTpYa7OBs3-C_Nr6PfbC3TNf0Owtt7qh63NtziSMvCTDU78-aVxts_--D0 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}] Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 020de02572b447d6983bbce8ccd3e828 Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-960455853", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: exception: min_count must be <= max_count Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-960455853', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 03 10:48:04.403204 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.409968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:04.409968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:04.415363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-844bdbd3-cc83-44b6-a5ce-03c16b498c67 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Returning 400 to user: min_count must be <= max_count {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:04.416551 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-844bdbd3-cc83-44b6-a5ce-03c16b498c67 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.314920 Oct 03 10:48:04.426094 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2187/4144] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:04 2022] POST /compute/v2.1/servers => generated 74 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:48:04.527272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4aa001f2-541a-41dc-800d-e3a7fa9160ad tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e56c310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:04.586491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:04.604187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:04.606269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:04.611553 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2527bac-c335-447f-9a13-5bbbe1ade3d8 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1357 microversion: 2.54 time: 0.263541 Oct 03 10:48:04.630459 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1958/4145] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:04 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:04.633799 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4aa001f2-541a-41dc-800d-e3a7fa9160ad tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.110307 Oct 03 10:48:04.642422 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2188/4146] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:04 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:04.653616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5dc52dc4-0e23-4d0d-b568-e9c6fbde65c0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Action: 'create', calling method: .version_select at 0x7f074e562700>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-131668252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDywAFukektE83IAlWSeqCBazjjYK/erKreVj431hjuo0+XYSr+vktJ0Y2+OYBc/VXdxelgIsoAT8s31U3lHO0Z7WoaW1WoOd3wCxo8GB9orNbiiVw5TNndtDko/lB3klA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:04.653872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d1d8eb5-f1cf-4ca9-b614-25e354a88600 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-60084822", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "max_count": 0}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d1d8eb5-f1cf-4ca9-b614-25e354a88600 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Request method failure captured: Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 166 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3jDaBkEI_P8e7t-3vgn90CE-MQbH24rha-KXARLPD5u-MgO6GBlii9grVnjPPqkT6e8JQW-jCAYzRuSyVIj4hxCeVDuwwvXiHFamxn_1Cqzb3GK5nN9hTpYa7OBs3-C_Nr6PfbC3TNf0Owtt7qh63NtziSMvCTDU78-aVxts_--D0 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}] Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 020de02572b447d6983bbce8ccd3e828 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-60084822", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "max_count": 0}} Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-60084822', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'max_count': 0}}} Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 0 Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:48:04.669092 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 03 10:48:04.674867 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:04.686131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d1d8eb5-f1cf-4ca9-b614-25e354a88600 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:04.687433 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d1d8eb5-f1cf-4ca9-b614-25e354a88600 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.055906 Oct 03 10:48:04.688142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5dc52dc4-0e23-4d0d-b568-e9c6fbde65c0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Getting quotas for project 2be9145ee08d490e87426199a983b16b. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:48:04.688589 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1959/4147] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:04 2022] POST /compute/v2.1/servers => generated 130 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:48:04.705532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5dc52dc4-0e23-4d0d-b568-e9c6fbde65c0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Getting quotas for user d2906fee8eef489f9745ca57fd949ede and project 2be9145ee08d490e87426199a983b16b. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:48:04.750576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:04.751203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:04.767065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5dc52dc4-0e23-4d0d-b568-e9c6fbde65c0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.118088 Oct 03 10:48:04.769478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2189/4148] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Oct 3 10:48:04 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 10:48:04.780910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:04.783893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-131668252", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:04.784967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:04.787395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:04.789289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:04.790598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:04.791263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:04.791886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:04.803433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:04.805862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:04.806330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:04.807092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:04.807560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:04.807993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:05.034959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:48:05.035384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:48:05.035866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:48:05.036282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:48:05.036701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:48:05.168335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:05.191626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:05.193663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:05.197533 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f79cbc0-8252-4193-99ca-c5815b36d48f tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.451240 Oct 03 10:48:05.198516 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1960/4149] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:04 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:05.209858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a37c9f5-5164-494e-a883-53e49a1057ac tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1323607518", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "max_count": 2.5}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a37c9f5-5164-494e-a883-53e49a1057ac tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Request method failure captured: Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 170 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3jDaBkEI_P8e7t-3vgn90CE-MQbH24rha-KXARLPD5u-MgO6GBlii9grVnjPPqkT6e8JQW-jCAYzRuSyVIj4hxCeVDuwwvXiHFamxn_1Cqzb3GK5nN9hTpYa7OBs3-C_Nr6PfbC3TNf0Owtt7qh63NtziSMvCTDU78-aVxts_--D0 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}] Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 020de02572b447d6983bbce8ccd3e828 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1323607518", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "max_count": 2.5}} Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1323607518', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'max_count': 2.5}}} Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 2.5 Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:48:05.220160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.225865 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.229256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:05.230533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a37c9f5-5164-494e-a883-53e49a1057ac tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:05.234021 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a37c9f5-5164-494e-a883-53e49a1057ac tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032982 Oct 03 10:48:05.235943 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1961/4150] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:48:05.238704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:05.238704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:05.238704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:05.239493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:05.240081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:05.240621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:05.296787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a224d980-7abf-44a6-8a16-d92672a06b2f tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "POST /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19/action" status: 202 len: 1139 microversion: 2.54 time: 0.518424 Oct 03 10:48:05.300677 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2190/4151] 10.222.0.27 () {62 vars in 1320 bytes} [Mon Oct 3 10:48:04 2022] POST /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19/action => generated 1139 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 03 10:48:05.339519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:05.340184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:05.370498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:05.379817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-375971cd-e78f-47d3-852b-3ee139e6dfa6 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-206857442", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 0}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-375971cd-e78f-47d3-852b-3ee139e6dfa6 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Request method failure captured: Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 167 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3jDaBkEI_P8e7t-3vgn90CE-MQbH24rha-KXARLPD5u-MgO6GBlii9grVnjPPqkT6e8JQW-jCAYzRuSyVIj4hxCeVDuwwvXiHFamxn_1Cqzb3GK5nN9hTpYa7OBs3-C_Nr6PfbC3TNf0Owtt7qh63NtziSMvCTDU78-aVxts_--D0 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}] Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 020de02572b447d6983bbce8ccd3e828 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-206857442", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 0}} Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-206857442', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'min_count': 0}}} Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 0 Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:48:05.383924 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 03 10:48:05.393859 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.400827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:05.400827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:05.400827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:05.400827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:05.400827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:05.402316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-375971cd-e78f-47d3-852b-3ee139e6dfa6 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:05.404270 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-375971cd-e78f-47d3-852b-3ee139e6dfa6 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028496 Oct 03 10:48:05.412254 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2191/4152] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:05 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:48:05.562142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8e0dcdf3-8ec2-4de2-adec-ab35f12628b7 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1861235154", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 2.5}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8e0dcdf3-8ec2-4de2-adec-ab35f12628b7 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Request method failure captured: Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 170 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3jDaBkEI_P8e7t-3vgn90CE-MQbH24rha-KXARLPD5u-MgO6GBlii9grVnjPPqkT6e8JQW-jCAYzRuSyVIj4hxCeVDuwwvXiHFamxn_1Cqzb3GK5nN9hTpYa7OBs3-C_Nr6PfbC3TNf0Owtt7qh63NtziSMvCTDU78-aVxts_--D0 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99d86691ba14d4fbafa98cb5937e2bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99d86691ba14d4fbafa98cb5937e2bf"}]}] Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99d86691ba14d4fbafa98cb5937e2bf Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1636956330 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 020de02572b447d6983bbce8ccd3e828 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1636956330-project Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1861235154", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "min_count": 2.5}} Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1861235154', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'min_count': 2.5}}} Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 2.5 Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:48:05.566454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 10:48:05.572438 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:05.576629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8e0dcdf3-8ec2-4de2-adec-ab35f12628b7 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:05.580920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8e0dcdf3-8ec2-4de2-adec-ab35f12628b7 tempest-MultipleCreateNegativeTestJSON-1636956330 tempest-MultipleCreateNegativeTestJSON-1636956330-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023125 Oct 03 10:48:05.585501 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2192/4153] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:48:05.650296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3cd24f4b-6fe3-4d7b-b781-22833f9e3b6d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f247820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:05.743859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:05.778343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:05.787605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:05.800847 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24f7ad70-974e-4f6e-96c8-aa7cfee5b991 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.466208 Oct 03 10:48:05.804260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1962/4154] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:05 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:05.817871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3cd24f4b-6fe3-4d7b-b781-22833f9e3b6d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.157057 Oct 03 10:48:05.818756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2193/4155] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:05 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:06.297727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:06.298901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:06.323350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:06.326946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:06.331513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:06.336033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:06.340754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:06.341803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:06.833618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:06.835219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:06.858404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:06.861474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:06.862276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:06.863451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:06.867345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:06.869009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:06.910470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:07.184721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:07.215879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:07.219281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:07.222078 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6dabf2d7-7db6-44a9-af06-5c73fd496537 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.935391 Oct 03 10:48:07.229256 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1963/4156] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:06 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:07.240668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a7d07861-6ebb-4dc8-9052-92218de6c0db tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e2f6700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:07.276388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:07.295895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:07.309308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:07.318652 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e86a179d-13c8-4cea-8d4f-af1d1b8d2e35 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.482826 Oct 03 10:48:07.320011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2194/4157] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:06 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:07.394837 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a7d07861-6ebb-4dc8-9052-92218de6c0db tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1450 microversion: 2.1 time: 0.164171 Oct 03 10:48:07.401053 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1964/4158] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:07 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:08.261367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:08.261981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:08.271749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:08.276116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:08.279493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:08.280022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:08.280809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:08.281299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:08.281875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:08.351198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:08.357730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:08.358797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:08.386084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:08.387334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:08.388336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:08.391776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:08.393940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:08.395179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:08.451249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:08.473760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:08.475594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:08.483382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5988c62-8325-4071-aa22-9d3595369a95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.227313 Oct 03 10:48:08.484217 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2195/4159] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:08 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:08.502111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d098331-b9a4-48b8-a5b5-857ad608015f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1c7e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:08.557607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:08.571001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d098331-b9a4-48b8-a5b5-857ad608015f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1459 microversion: 2.1 time: 0.079220 Oct 03 10:48:08.584942 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2196/4160] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:08 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1459 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:08.587829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:08.590509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:08.593295 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f727f2c-6733-4223-b59a-c500f3e1cf13 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.242551 Oct 03 10:48:08.596618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d194784a-c611-403b-8dce-74b89f0557f0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1b5e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:08.603528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1965/4161] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:08 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:08.676968 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d194784a-c611-403b-8dce-74b89f0557f0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 200 len: 1459 microversion: 2.1 time: 0.089072 Oct 03 10:48:08.690594 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2197/4162] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:08 2022] GET /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 1459 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:08.706169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:08.708098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:08.727238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:08.734142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:08.735087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:08.736207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:08.737105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:08.738335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:09.090379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:09.100153 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3a4c5f2-fe45-4325-b1fa-9e988fb2260d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 200 len: 1467 microversion: 2.1 time: 0.406369 Oct 03 10:48:09.113941 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1966/4163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:08 2022] GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 1467 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:09.127061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-770691266"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:09.130697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:09.147296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:09.155449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:09.156285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:09.157577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:09.158230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:09.158973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:09.516457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:09.517751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:09.539611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:09.541023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:09.541974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:09.544190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:09.545027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:09.545740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:09.648169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:09.648955 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb191d1b-7dc3-46eb-9a54-55d02e94af3f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "POST /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d/action" status: 202 len: 0 microversion: 2.1 time: 0.526427 Oct 03 10:48:09.650542 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2198/4164] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:48:09 2022] POST /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 10:48:09.661724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:09.662802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:09.672654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:09.673484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:09.674124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:09.675187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:09.675818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:09.676424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:09.698268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:09.713219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:09.716893 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cfc14f1c-1db7-4524-ae7b-ea7990b380fb tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.205266 Oct 03 10:48:09.729958 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1967/4165] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:09 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:09.739223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e93a915-889a-406a-aba2-162838aa1f45 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e2f6700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:09.803443 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e93a915-889a-406a-aba2-162838aa1f45 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.070611 Oct 03 10:48:09.829693 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1968/4166] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:09 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:09.950988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:09.961458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:09.963745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:09.967081 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-775b8527-84a1-43fd-9493-d1b560772231 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.314838 Oct 03 10:48:09.968247 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2199/4167] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:09 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:10.757770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:10.758804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:10.779642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:10.779968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:10.780402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:10.783437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:10.785561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:10.786354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:10.824680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:10.946525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:10.960381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:10.965487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:10.970312 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d6efdb08-185b-4546-88ab-3c1ad2559d7d tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.225117 Oct 03 10:48:10.972698 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1969/4168] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:10 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:10.982905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c77452e-7168-43a4-a642-72c6d78c5daf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e2f6f70>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:11.107644 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c77452e-7168-43a4-a642-72c6d78c5daf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.131196 Oct 03 10:48:11.114050 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1970/4169] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:10 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:11.119951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:11.127140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:11.134351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:11.134856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:11.147866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:11.149479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:11.150384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:11.152120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:11.269712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:11.291545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:11.299192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:11.301396 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e23add6-039d-40f7-9b15-d66e73d105e9 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.184794 Oct 03 10:48:11.301993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1971/4170] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:11 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:11.379166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1500691699", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": "none"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:11.479728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:48:11.480417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:48:11.483492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:48:11.484592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:48:11.486491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:48:11.505428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:11.505892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:11.509587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:11.511373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:11.512465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:11.512948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:11.568873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Getting quotas for project 297945f6c7fa487eba5c49ce0adcb193. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:48:11.598666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Getting quotas for user 252231359cad4b958c372c93ba702cbc and project 297945f6c7fa487eba5c49ce0adcb193. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:48:11.620062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:48:11.623908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:48:11.689896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-568cd7c2-37dd-40b5-a939-11a9067eea23 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.940370 Oct 03 10:48:11.693721 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2200/4171] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:48:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 03 10:48:11.711469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8750f2b-98d1-4eff-9c1b-26c9c777fb1e tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:11.712527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8750f2b-98d1-4eff-9c1b-26c9c777fb1e tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:11.831784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8750f2b-98d1-4eff-9c1b-26c9c777fb1e tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:11.855926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8750f2b-98d1-4eff-9c1b-26c9c777fb1e tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:11.857754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8750f2b-98d1-4eff-9c1b-26c9c777fb1e tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:11.859589 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8750f2b-98d1-4eff-9c1b-26c9c777fb1e tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1281 microversion: 2.47 time: 0.158274 Oct 03 10:48:11.860545 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2201/4172] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:11 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:12.003660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:12.008828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:12.024389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:12.024924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:12.025374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:12.026112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:12.026585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:12.031093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:12.065537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1252716519", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:12.158347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] validate_networks() for [('e7ae23a2-3981-4e49-a241-72d811fa94dc', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:48:12.164100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:12.183190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:12.187341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:12.189565 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8062ef28-78f8-4f4a-bf2a-650442e479b3 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.193826 Oct 03 10:48:12.190913 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2202/4173] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:11 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:12.209935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-810c99ff-8857-4aba-9976-09a97e4399cc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e562040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:12.304118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-810c99ff-8857-4aba-9976-09a97e4399cc tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.110263 Oct 03 10:48:12.319698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2203/4174] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:12 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:12.339871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:12.341688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:12.362207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:12.362866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:12.363515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:12.365225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:12.365798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:12.367419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:12.477390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:12.490454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:12.492104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:12.494042 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a45e5612-c9a6-4258-876d-b2d8ac849431 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.166229 Oct 03 10:48:12.495593 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2204/4175] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:12 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:12.888326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:12.888965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:12.911874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:12.914591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:12.929533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:12.930322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:12.930800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:12.934900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.252835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:13.256931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:13.283624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:13.287732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:13.289352 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6c18ff0-20b9-4c32-8da9-3d63796bd8da tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1333 microversion: 2.47 time: 0.405616 Oct 03 10:48:13.291326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2205/4176] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:12 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1333 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:13.313264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-190deae0-acd1-4879-8c81-80e9a460d4c1 req-04979665-1cf9-46bf-9c9b-5ef6f00e314d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fe7879-6f32-4d3b-8038-a4f40f154995", "name": "network-vif-unplugged", "status": "completed", "tag": "873702af-4840-46a1-b693-3ceb18ce3a18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:13.331505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-190deae0-acd1-4879-8c81-80e9a460d4c1 req-04979665-1cf9-46bf-9c9b-5ef6f00e314d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:13.333189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-190deae0-acd1-4879-8c81-80e9a460d4c1 req-04979665-1cf9-46bf-9c9b-5ef6f00e314d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:13.334316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-190deae0-acd1-4879-8c81-80e9a460d4c1 req-04979665-1cf9-46bf-9c9b-5ef6f00e314d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.360908 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-190deae0-acd1-4879-8c81-80e9a460d4c1 req-04979665-1cf9-46bf-9c9b-5ef6f00e314d service nova] Creating event network-vif-unplugged:873702af-4840-46a1-b693-3ceb18ce3a18 for instance d4fe7879-6f32-4d3b-8038-a4f40f154995 on n-h2-858383-3 Oct 03 10:48:13.378219 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-190deae0-acd1-4879-8c81-80e9a460d4c1 req-04979665-1cf9-46bf-9c9b-5ef6f00e314d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082416 Oct 03 10:48:13.379069 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2206/4177] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:13.384899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:13.389298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:13.404860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:13.405770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:13.406480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.407493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:13.408204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:13.408907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.516045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:13.519359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:48:13.519887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:48:13.520263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:48:13.522233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:48:13.522670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:48:13.536690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:13.538295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:13.541314 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a289634c-2f3b-49e7-be75-bd66f345bc95 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.159102 Oct 03 10:48:13.541938 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2207/4178] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:13 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:13.545605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:13.546498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:13.548200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.552956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:13.553981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:13.554926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.568376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9761190-a6f1-4287-b933-f9310f83d533 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e546a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:13.618664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Getting quotas for project d590a49addcf4b6b9fbbfc3293c6c5a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:48:13.626100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Getting quotas for user 5ec2b3ac76804e0a895b7751677a4671 and project d590a49addcf4b6b9fbbfc3293c6c5a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:48:13.644593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:48:13.647331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:48:13.696109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9761190-a6f1-4287-b933-f9310f83d533 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.148052 Oct 03 10:48:13.697371 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2208/4179] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:13 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:13.709390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:13.710648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:13.719231 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65645deb-a7b3-466c-849b-a348b92a6e99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.086981 Oct 03 10:48:13.720908 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1972/4180] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:48:13.738988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb444946-3dfc-43de-bca9-270d8cd1ee45 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:13.740313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb444946-3dfc-43de-bca9-270d8cd1ee45 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:13.751237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:13.754696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:13.756798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.758083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:13.759449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:13.761555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:13.860037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb444946-3dfc-43de-bca9-270d8cd1ee45 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:13.872038 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb444946-3dfc-43de-bca9-270d8cd1ee45 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1217 microversion: 2.1 time: 0.138988 Oct 03 10:48:13.876065 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1973/4181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:13 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:13.983389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.003294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.005528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.008234 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8042ba95-b732-4f16-a2a3-d50837762d85 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.301633 Oct 03 10:48:14.008956 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2209/4182] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:13 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:14.320695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:14.321615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:14.337430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:14.338900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:14.341716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:14.343554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:14.345508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:14.346916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:14.539280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.554333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.557353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.559687 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f5e4616c-3a8c-4abc-9c34-5eaa6905cccb tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1339 microversion: 2.47 time: 0.242688 Oct 03 10:48:14.572792 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1974/4183] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:14 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:14.581966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:14.583418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:14.604272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:14.604919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:14.609675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:14.611103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:14.615472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:14.616112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:14.715083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93ecaea0-e4a7-4340-9190-88f10372cad2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f0757565af0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:14.788753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.807795 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93ecaea0-e4a7-4340-9190-88f10372cad2 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.097798 Oct 03 10:48:14.818205 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1975/4184] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:14 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:14.819412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.821611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:14.823166 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40d07c69-bbb4-4303-8d6d-5ae726861903 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.257000 Oct 03 10:48:14.824730 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2210/4185] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:14 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:14.898512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:14.909473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:14.945922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:14.946433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:14.946916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:14.949866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:14.950348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:14.950801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:15.039508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:15.040935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:15.065311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:15.066221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:15.068229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:15.070101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:15.070780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:15.072355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:15.122555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:15.136441 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4427a7ac-005e-4a25-b60b-dfb3fc61ce0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1213 microversion: 2.1 time: 0.242458 Oct 03 10:48:15.151738 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1976/4186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:14 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:15.202623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:15.240443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:15.244912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:15.249615 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-01db4842-98f2-4a0c-9c4a-954b5d0eb831 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.215437 Oct 03 10:48:15.252366 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2211/4187] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:15 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:15.591526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:15.593007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:15.602696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:15.606322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:15.608919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:15.610043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:15.610783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:15.613755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:15.720377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:15.729148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:15.731003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:15.732953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-44f19386-311a-4470-b1a7-697ba752100b tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1339 microversion: 2.47 time: 0.146528 Oct 03 10:48:15.734092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1977/4188] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:15 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1339 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:15.831618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-67c2c98d-c86e-4494-8900-5837496c350c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e56cd30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:15.856112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:15.856737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:15.869234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:15.869736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:15.870182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:15.871682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:15.872333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:15.872813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:15.902197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-67c2c98d-c86e-4494-8900-5837496c350c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.074328 Oct 03 10:48:15.908317 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2212/4189] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:15 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:16.006867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.023956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.030477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.032036 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0972e763-507b-4b3e-b704-56e1eb528384 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.180534 Oct 03 10:48:16.033203 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1978/4190] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:15 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:16.169529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:16.171084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:16.189616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.190796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.191602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:16.196231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.197202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.197934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:16.280515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:16.281721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:16.292089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.294046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.294886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:16.296552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.297314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.298019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:16.366249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.392050 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-646e8d45-53da-4875-959d-6cd6ab005ada tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1287 microversion: 2.1 time: 0.227887 Oct 03 10:48:16.395690 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2213/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:16 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1287 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:16.608108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.618032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.619996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.621681 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e4e18543-88ad-4fd2-9708-8c79bff4669b tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.345746 Oct 03 10:48:16.642237 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1979/4192] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:16 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:16.770387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:16.771014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:16.785019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.786311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.788502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:16.789571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.790841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.794437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:16.901750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.915641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.917419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:16.919136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-250fd3d3-ca75-4fa7-821c-dd70957da607 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f8b7700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:16.920680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-64da4e80-7cf9-47a9-bb11-dab7c0ea1fee tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1360 microversion: 2.47 time: 0.159156 Oct 03 10:48:16.938904 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2214/4193] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:16 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:16.951958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1301922779"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:16.956128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:16.964182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.965716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.966406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:16.967398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:16.968114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:16.969165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.033189 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-250fd3d3-ca75-4fa7-821c-dd70957da607 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.118355 Oct 03 10:48:17.033887 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1980/4194] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:16 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:17.064895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:17.067013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:17.082940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.083607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.084143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.084762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.086402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.087023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.298225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.314496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.316506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.318181 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-183e23ab-d117-4ff2-b648-0a22af12438e tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.258146 Oct 03 10:48:17.327014 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2f8a4db-b3dc-44eb-adb3-11ec352ee99a tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "POST /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210/action" status: 202 len: 52 microversion: 2.47 time: 0.379836 Oct 03 10:48:17.330854 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2215/4195] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:48:16 2022] POST /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210/action => generated 52 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 03 10:48:17.337933 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1981/4196] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:17 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:17.351037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:17.352121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:17.374588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.375092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.375540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.376267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.376724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.380835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.420706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:17.421359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:17.428046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.433573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.434042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.434792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.435256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.438766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:48:17.440258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.588437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.603129 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06b25cb2-7c15-4027-a7bc-3e1fff1425a6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1275 microversion: 2.1 time: 0.185998 Oct 03 10:48:17.609418 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-920daef9-4e07-4219-892a-42c6c3009af3 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 204 len: 0 microversion: 2.47 time: 0.264657 Oct 03 10:48:17.610704 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2216/4197] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:48:17 2022] DELETE /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:48:17.621180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:17.621522 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1982/4198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:17 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:17.629801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:17.656316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:17.657143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.657800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.658218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.658970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.659351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:17.659554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.659850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.675752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.677694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.678988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.680699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:17.681933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:17.683113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:17.757239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.767880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.769371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.772328 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1123517d-29b2-4579-bede-60d981069622 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1366 microversion: 2.47 time: 0.157576 Oct 03 10:48:17.773476 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2217/4199] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:17 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:17.894840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.914646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.917398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:17.918898 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f965f80-5a90-4841-8e40-b64e06d26576 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.274501 Oct 03 10:48:17.936729 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1983/4200] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:17 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:18.049757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e8eb7b3-8fba-44cf-9fa2-36bd0578d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e5460d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:18.093345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d2db5162-8b5a-4e9e-8e79-4d297f8c56e9 req-a2f33305-2611-491c-b0b1-195ce56117ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74014a1-fb90-45e3-ba2d-71fdddefa20d", "name": "network-vif-plugged", "status": "completed", "tag": "ae3e817d-c947-4bc6-bdd3-d9aef8449dbb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:18.118386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d2db5162-8b5a-4e9e-8e79-4d297f8c56e9 req-a2f33305-2611-491c-b0b1-195ce56117ec service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:18.127693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d2db5162-8b5a-4e9e-8e79-4d297f8c56e9 req-a2f33305-2611-491c-b0b1-195ce56117ec service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:18.128413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d2db5162-8b5a-4e9e-8e79-4d297f8c56e9 req-a2f33305-2611-491c-b0b1-195ce56117ec service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:18.159508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d2db5162-8b5a-4e9e-8e79-4d297f8c56e9 req-a2f33305-2611-491c-b0b1-195ce56117ec service nova] Creating event network-vif-plugged:ae3e817d-c947-4bc6-bdd3-d9aef8449dbb for instance a74014a1-fb90-45e3-ba2d-71fdddefa20d on n-h1-858383-3 Oct 03 10:48:18.166552 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d2db5162-8b5a-4e9e-8e79-4d297f8c56e9 req-a2f33305-2611-491c-b0b1-195ce56117ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078312 Oct 03 10:48:18.167751 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1984/4201] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:18.169662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e8eb7b3-8fba-44cf-9fa2-36bd0578d782 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.124117 Oct 03 10:48:18.179092 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2218/4202] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:18 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:18.357982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:18.358749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:18.378580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:18.379687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:18.384147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:18.385109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:18.387887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:18.388691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:18.565350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:18.584319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:18.589849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:18.592787 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00b721e9-ef6c-4fec-99f2-c6278bbf8594 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.244147 Oct 03 10:48:18.597746 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1985/4203] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:18 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:18.645311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:18.646055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:18.666974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:18.667496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:18.667980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:18.668703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:18.669179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:18.672341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:18.809203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:18.811490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:18.835461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:18.837463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:18.838607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:18.841045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:18.843914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:18.845812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:19.084102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:19.096695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:19.101262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:19.103404 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2afa4f88-7e02-42d4-bacf-332c6eb2f36f tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1366 microversion: 2.47 time: 0.307420 Oct 03 10:48:19.109843 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1986/4204] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:18 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:19.124134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:19.125553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:19.161191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:19.164623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:19.165599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:19.171897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:19.176180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:19.177051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:19.202844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:19.211399 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5690550f-f04a-459a-9df9-c13f4428b4dd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.572423 Oct 03 10:48:19.215939 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2219/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:18 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:19.221546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3eb01dc-7512-49b1-9d0d-53c1e11558bb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ec0ee50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:19.301192 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3eb01dc-7512-49b1-9d0d-53c1e11558bb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.083538 Oct 03 10:48:19.314733 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2220/4206] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:19 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:19.628838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:19.629664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:19.650468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:19.676012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:19.679386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:19.683874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:19.685521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:19.691009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:19.695095 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-398dd644-cf6a-4b5b-8a16-d452d401a338 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.581424 Oct 03 10:48:19.697263 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1987/4207] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:19 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:19.705435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:19.709548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:19.716208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.141472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:20.142582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:20.166321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:20.167522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.170187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:20.171588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.173747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:20.177069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:20.177849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.188928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.190695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.191951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f429a2ae-2803-4225-8781-061e003d3643 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.572766 Oct 03 10:48:20.231299 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2221/4208] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:19 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:20.242754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:20.243506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:20.259885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:20.260663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:20.262425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.263392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:20.264183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:20.265265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.416411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.431222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.436829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252231359cad4b958c372c93ba702cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297945f6c7fa487eba5c49ce0adcb193', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.440524 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d89b2c4a-5e48-4e94-9040-acd48aea0719 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 200 len: 1366 microversion: 2.47 time: 0.303519 Oct 03 10:48:20.441888 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1988/4209] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:20 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:20.456366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5156d833-020d-4921-a3c9-8cd025279205 req-c118a425-1134-4c8d-ac62-a55a8a4bf221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291b31e5-972b-4f07-817d-dcafef6fbcc8", "tag": "18aa44af-26c4-4872-80e2-aecc15b9524d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:20.479378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:20.489759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5156d833-020d-4921-a3c9-8cd025279205 req-c118a425-1134-4c8d-ac62-a55a8a4bf221 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:20.490382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5156d833-020d-4921-a3c9-8cd025279205 req-c118a425-1134-4c8d-ac62-a55a8a4bf221 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:20.491080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5156d833-020d-4921-a3c9-8cd025279205 req-c118a425-1134-4c8d-ac62-a55a8a4bf221 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.533132 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5156d833-020d-4921-a3c9-8cd025279205 req-c118a425-1134-4c8d-ac62-a55a8a4bf221 service nova] Creating event network-changed:18aa44af-26c4-4872-80e2-aecc15b9524d for instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 on n-h1-858383-3 Oct 03 10:48:20.543157 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5156d833-020d-4921-a3c9-8cd025279205 req-c118a425-1134-4c8d-ac62-a55a8a4bf221 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097069 Oct 03 10:48:20.545479 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1989/4210] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:20.554152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55ea15fd-e6bc-42e0-a88c-d7ecc7ed460b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea2baf0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:20.663575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55ea15fd-e6bc-42e0-a88c-d7ecc7ed460b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.115836 Oct 03 10:48:20.674355 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1990/4211] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:20 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:20.725437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.729012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:20.731049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:20.736600 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d29958c6-ac34-4ff9-9095-a42c95cc2d42 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.498544 Oct 03 10:48:20.744714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2222/4212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:20 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:20.745109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:20.749774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:20.750408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.751244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:20.751734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:20.752172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:20.930111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.956760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.965567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:20.967586 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7edaa3b2-4b6d-49b7-8006-b3f7ca1b310d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.243759 Oct 03 10:48:20.970795 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1991/4213] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:20 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:21.224114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:21.224732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:21.237295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:21.238753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:21.241914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:21.242881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:21.243996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:21.245073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:21.471888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:21.474580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] [instance: 276556b4-89e8-4f71-8f54-fde289b13210] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:21.474761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:21.484292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:21.484821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:21.485263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:21.490729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:21.492150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:21.493610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2fabf59c-a632-4d1c-b592-6e80ac8adc14 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.274167 Oct 03 10:48:21.497871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:21.498586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:21.499205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:21.525884 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2223/4214] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:21 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:21.535660 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] HTTP exception thrown: Instance 276556b4-89e8-4f71-8f54-fde289b13210 could not be found. Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Request method failure captured: Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 HTTP/1.1 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3qhjx1qHMVLbxF-ZSNqaIcioGCaTL62BKaPiP1GQlPnmLW0KMhACV6kELuFHa7mG1qkfakRqsFKi9flp5UkhTpDK45sdx5oSThIACH2Y3vEFpvNh71SQbj_qKqWXVJ3421PBzTQtCmr1x3hsP4TdF7lMfMXkx4RDJ98RP7ZwuZYCw Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.47 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 297945f6c7fa487eba5c49ce0adcb193 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAaction247Test-370386627 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/297945f6c7fa487eba5c49ce0adcb193"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_297945f6c7fa487eba5c49ce0adcb193"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/297945f6c7fa487eba5c49ce0adcb193"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/297945f6c7fa487eba5c49ce0adcb193"}]}] Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAaction247Test-370386627 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 297945f6c7fa487eba5c49ce0adcb193 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAaction247Test-370386627 Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAaction247Test-370386627-project Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 252231359cad4b958c372c93ba702cbc Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAaction247Test-370386627-project Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 276556b4-89e8-4f71-8f54-fde289b13210 could not be found. Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '276556b4-89e8-4f71-8f54-fde289b13210'} Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276556b4-89e8-4f71-8f54-fde289b13210 could not be found. Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276556b4-89e8-4f71-8f54-fde289b13210 could not be found. Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:21.538271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276556b4-89e8-4f71-8f54-fde289b13210 could not be found. Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] Returning 404 to user: Instance 276556b4-89e8-4f71-8f54-fde289b13210 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:21.543516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b308f171-b20a-4d42-a1f8-f70bf5321bb6 tempest-ServersAaction247Test-370386627 tempest-ServersAaction247Test-370386627-project] 10.222.0.27 "GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210" status: 404 len: 111 microversion: 2.47 time: 0.072035 Oct 03 10:48:21.545417 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1992/4215] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:21 2022] GET /compute/v2.1/servers/276556b4-89e8-4f71-8f54-fde289b13210 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:48:21.679959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe62b19b-96fe-4424-bbeb-6f727eb86a1b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e5134c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:21.692432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:21.758331 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe62b19b-96fe-4424-bbeb-6f727eb86a1b tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.081981 Oct 03 10:48:21.761246 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2224/4216] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:21 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:21.769468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:21.770249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:21.787324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:21.789234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:21.794500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:21.796673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:21.797775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:21.798597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:21.847755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:21.999998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:22.010061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:22.011929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:22.054724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:22.059407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:22.062699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:22.067508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:22.068034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:22.068479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:22.084602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:22.195947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:22.212103 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8da9bda1-956a-454c-b51a-2967ce3d6c28 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.446440 Oct 03 10:48:22.215092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1993/4217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:21 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:22.280002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:22.293137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:22.312911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:22.312911 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59c68aff-342f-4373-b2ac-de7b3557db81 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.316358 Oct 03 10:48:22.335963 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2225/4218] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:21 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:22.548423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:22.570012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:22.636137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:22.647759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:22.648826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:22.650013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:22.650599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:22.651711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:22.777001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ce8571a-f00b-4c02-9329-a0b462abc4d3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f7214c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:22.856757 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ce8571a-f00b-4c02-9329-a0b462abc4d3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.083004 Oct 03 10:48:22.857727 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2226/4219] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:22 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:22.886096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:22.899598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:22.901414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:22.902988 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99e5a1f5-2fb6-418e-b783-2b5adaece6d4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.365013 Oct 03 10:48:22.903761 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1994/4220] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:22 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:23.242978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:23.243746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:23.259926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:23.263679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:23.266809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:23.272692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:23.279985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:23.280820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:23.339420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:23.340597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:23.359786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:23.360286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:23.360750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:23.363714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:23.364206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:23.364651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:23.530515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:23.548981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:23.550487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:23.551958 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29bb69b2-7087-475a-bdd6-8afd7adccd26 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.216911 Oct 03 10:48:23.553165 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1995/4221] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:23 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:23.679373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:23.689250 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56adf244-9835-4828-8695-1ee60376c0fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.450942 Oct 03 10:48:23.691726 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2227/4222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:23 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:23.886675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac5af29d-9614-41f3-9311-7e6efae372e8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e59e550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:23.909421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:23.911843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:23.932558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:23.933743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:23.953151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:23.953649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:23.954092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:23.954813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:23.955268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:23.955701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:23.985451 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac5af29d-9614-41f3-9311-7e6efae372e8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.103743 Oct 03 10:48:23.986245 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1996/4223] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:23 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:24.128356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:24.148983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:24.151166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:24.153188 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e411e3c-18d1-4f74-afd0-f526bd7d0ac4 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1604 microversion: 2.32 time: 0.224881 Oct 03 10:48:24.154022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2228/4224] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:23 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:24.591307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:24.591916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:24.622121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:24.624202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:24.624905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:24.625525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:24.626006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:24.626442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:24.719439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:24.720075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:24.736957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:24.737467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:24.738506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:24.739471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:24.740738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:24.741629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:25.052806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:25.061628 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02e14c4d-b4f7-464d-8578-370a780aef88 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.347054 Oct 03 10:48:25.076859 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2229/4225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:24 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:25.081535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f3d6287-4554-4dba-a2fd-ca64fe2ba866 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e21e310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:25.161842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:25.176955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:25.178865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:25.182860 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-90ebcc11-faae-49bb-aa1d-e0a6b7b17192 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.599108 Oct 03 10:48:25.192562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f3d6287-4554-4dba-a2fd-ca64fe2ba866 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.125847 Oct 03 10:48:25.205034 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2230/4226] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:25 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:25.205812 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1997/4227] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:24 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:25.233747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:25.246751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:25.261627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:25.266006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:25.266710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:25.280682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:25.281811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:25.288705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:25.378370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:25.379123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:25.380487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:25.381868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lazy-loading 'fault' on Instance uuid 1c468f4c-dc50-41ee-883e-47f3cbf052a3 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:48:25.463206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:25.475911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:25.483858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8661b68516064439beaa63b26678a918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2675121b976b452db6d77e8e6e628954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:25.487368 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-69d19e41-93c2-437a-97fd-0ef1071e5332 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 200 len: 1609 microversion: 2.32 time: 0.265460 Oct 03 10:48:25.508810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2231/4228] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:25 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 1609 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:26.101576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:26.101576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:26.118386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:26.119173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:26.119624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:26.120480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:26.121116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:26.121904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:26.212157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b78210c-c49d-4024-ad18-24c201909bdb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e21ec10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:26.282654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b78210c-c49d-4024-ad18-24c201909bdb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.074168 Oct 03 10:48:26.283417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2232/4229] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:26 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:26.297407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:26.298444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:26.318675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:26.319550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:26.320218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:26.321202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:26.321898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:26.322545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:26.623765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:26.633755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41f2e5b9-1b3c-4606-9197-943c010ff341 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.546574 Oct 03 10:48:26.657694 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1998/4230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:26 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:26.673786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:26.674425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:26.688156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:26.688886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:26.689519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:26.701005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:26.701692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:26.702160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:26.725181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:26.733371 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] HTTP exception thrown: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:26.738655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Request method failure captured: Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 HTTP/1.1 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxaHDpBbwmrEtvxRZ-VKxhzgYvHPz8-0iF9i0ukFNFqiF2tmK88Fl9Jbsfil4hLMLTDr8ebvtxLlFlM5JTHUPcTxxhDWLxBAdYnEo9X4vUtn9urJfOU3bwlKdLlsvh6zOe0gtviDrVYm3Qli0IazWmwsgQkYAcT-zK-9jIA6ffjNGs Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.32 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 2675121b976b452db6d77e8e6e628954 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2675121b976b452db6d77e8e6e628954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2675121b976b452db6d77e8e6e628954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2675121b976b452db6d77e8e6e628954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2675121b976b452db6d77e8e6e628954"}]}] Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 2675121b976b452db6d77e8e6e628954 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TaggedBootDevicesTest-72559638-project Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 8661b68516064439beaa63b26678a918 Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TaggedBootDevicesTest-72559638-project Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '1c468f4c-dc50-41ee-883e-47f3cbf052a3'} Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:26.740999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:26.745613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:26.745613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:26.745613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:26.745613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:48:26.745613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:48:26.745613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:26.745613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:26.746134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:26.747152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Returning 404 to user: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:26.747930 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2883283-c1e6-4307-a93a-ebd3f5466362 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.462105 Oct 03 10:48:26.751302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ecb2175-cc59-4d43-88d5-72be456c9635 tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 404 len: 111 microversion: 2.32 time: 0.089159 Oct 03 10:48:26.752335 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 1999/4231] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:26 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:48:26.763424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a88de98-4f23-462e-9b44-1b0a67e82ffe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '.version_select at 0x7f074ea3e820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:26.765012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2233/4232] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:26 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:26.807147 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a88de98-4f23-462e-9b44-1b0a67e82ffe tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088735604" status: 204 len: 0 microversion: 2.32 time: 0.049021 Oct 03 10:48:26.809846 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2000/4233] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:48:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088735604 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:48:27.301797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b50a259e-88bd-43e2-972f-9e7bece1c350 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e21e040>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:27.398900 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b50a259e-88bd-43e2-972f-9e7bece1c350 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.101016 Oct 03 10:48:27.399488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2234/4234] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:27 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:27.671073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:27.673340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:27.696508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:27.697233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:27.699414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:27.704108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:27.707615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:27.708258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:27.779459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:27.780364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:27.795795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:27.798024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:27.798705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:27.812883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:27.815280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:27.816044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:28.025090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:28.045950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:28.053553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:28.054977 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-428bffa3-9cb8-4e7a-a1e0-cb55b26d12a3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.280430 Oct 03 10:48:28.057863 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2235/4235] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:27 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:28.215686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:28.229304 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13393c6a-7cdf-40cc-9d65-8cad449f23e0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.567894 Oct 03 10:48:28.247061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2001/4236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:27 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:28.414452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a9284c9-8fc3-4622-8de6-144f2b473a72 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1c7700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:28.488020 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a9284c9-8fc3-4622-8de6-144f2b473a72 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.077262 Oct 03 10:48:28.488612 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2236/4237] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:28 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:29.085204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:29.085839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:29.109774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:29.110440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:29.110902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:29.111662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:29.112127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:29.112836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:29.259836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:29.262242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:29.287830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:29.293417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:29.294091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:29.297381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:29.302456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:29.303109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:29.303853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:29.306456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:29.314979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:29.317037 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a5e6f14-e943-47d8-9fbf-643730fed457 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.235985 Oct 03 10:48:29.334990 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2002/4238] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:29 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:29.507352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-60f4d1bf-3a6b-4bc6-93b6-bf34e8ba5e1a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f07574929d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:29.615978 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-60f4d1bf-3a6b-4bc6-93b6-bf34e8ba5e1a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.116205 Oct 03 10:48:29.617709 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2003/4239] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:29 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:29.865378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:29.891661 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac1ea1d2-f83d-4a88-8540-0567e8506ec8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.636583 Oct 03 10:48:29.892562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2237/4240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:29 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:30.202727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4197a1ec-bc30-4184-9b77-763f8b257520 req-d25a8745-3f3b-4726-82e1-64611ed14491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291b31e5-972b-4f07-817d-dcafef6fbcc8", "name": "network-vif-plugged", "status": "completed", "tag": "18aa44af-26c4-4872-80e2-aecc15b9524d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:30.237933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4197a1ec-bc30-4184-9b77-763f8b257520 req-d25a8745-3f3b-4726-82e1-64611ed14491 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:30.238432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4197a1ec-bc30-4184-9b77-763f8b257520 req-d25a8745-3f3b-4726-82e1-64611ed14491 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:30.238874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4197a1ec-bc30-4184-9b77-763f8b257520 req-d25a8745-3f3b-4726-82e1-64611ed14491 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:30.281275 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4197a1ec-bc30-4184-9b77-763f8b257520 req-d25a8745-3f3b-4726-82e1-64611ed14491 service nova] Creating event network-vif-plugged:18aa44af-26c4-4872-80e2-aecc15b9524d for instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 on n-h1-858383-3 Oct 03 10:48:30.287571 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4197a1ec-bc30-4184-9b77-763f8b257520 req-d25a8745-3f3b-4726-82e1-64611ed14491 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091118 Oct 03 10:48:30.288733 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2004/4241] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:30.348365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:30.349874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:30.358677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:30.361951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:30.364930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:30.368725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:30.369802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:30.372043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:30.634284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b6137b1-57f9-40cd-af2f-f74c368889ea tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f830ee0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:30.711516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b6137b1-57f9-40cd-af2f-f74c368889ea tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.081582 Oct 03 10:48:30.721218 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2005/4242] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:30 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:30.775462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:30.785071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:30.790642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:30.797847 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-769624e5-470a-425d-9505-3e354c34c4f1 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.453533 Oct 03 10:48:30.802149 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2238/4243] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:30 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:30.916152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:30.917236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:30.929693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:30.932490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:30.936064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:30.937062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:30.937729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:30.938289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:31.728976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-745881c6-2959-491a-a7bd-e412149d8bcb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e56c820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:31.809881 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-745881c6-2959-491a-a7bd-e412149d8bcb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.084831 Oct 03 10:48:31.810643 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2239/4244] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:31 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:31.832486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:31.836101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:31.851331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:31.851941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:31.852498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:31.853388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:31.854107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:31.854762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:31.868394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:31.878437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4a88ad5-219f-47ae-86bc-640a764e3e5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1317 microversion: 2.1 time: 0.966704 Oct 03 10:48:31.883857 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2006/4245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:30 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1317 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:32.023639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:32.040529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:32.042134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:32.043480 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c323ddbd-6267-40d3-b452-c215bdd11b18 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.215990 Oct 03 10:48:32.044857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2240/4246] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:31 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:32.830173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb94176c-bf1d-4d50-b04a-d41df2ed0f83 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074faa15e0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:32.921003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:32.923411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:32.929454 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb94176c-bf1d-4d50-b04a-d41df2ed0f83 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.106850 Oct 03 10:48:32.946387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:32.947769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:32.949683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:32.953781 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2007/4247] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:32 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:32.955405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:32.956530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:32.957186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:33.073972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:33.074864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:33.091526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:33.097231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:33.102069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:33.103079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:33.107172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:33.111131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:33.305217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:33.322202 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea29a08f-f958-4e87-a38c-d2cd6249a381 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.411566 Oct 03 10:48:33.324533 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2241/4248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:32 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:33.428350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:33.442846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:33.447359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:33.452491 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4e48329-7257-434d-a2b1-d51ceda1adf3 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.382735 Oct 03 10:48:33.455972 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2008/4249] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:33 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:33.538374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1485072946", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:33.649836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] validate_networks() for [('e7ae23a2-3981-4e49-a241-72d811fa94dc', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:48:33.947454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d0f3b20-0847-4a97-90c2-c29a4687e414 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f802940>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:34.037513 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d0f3b20-0847-4a97-90c2-c29a4687e414 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.096523 Oct 03 10:48:34.046175 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2009/4250] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:33 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:34.495595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:34.497023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:34.511675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:34.515312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:34.517549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:34.518785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:34.521980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:34.546027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:34.736545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:34.753724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:34.770321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:34.786112 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da196a58-141d-491d-ba0a-54396ecf529d tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.294284 Oct 03 10:48:34.801157 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2010/4251] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:34 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:35.054850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3ef1891c-3eff-4e53-abc4-254f777acfd8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f74e3a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:35.157859 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3ef1891c-3eff-4e53-abc4-254f777acfd8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.107590 Oct 03 10:48:35.160830 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2011/4252] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:35 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:35.827074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:35.830258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:35.833886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:48:35.835434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:48:35.836475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:48:35.837466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:48:35.838402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:48:35.846636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:35.848534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:35.849156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:35.851315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:35.852089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:35.854935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:35.868819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:35.869859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:35.871279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:35.872661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:35.873878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:35.877498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:35.908972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Getting quotas for project d590a49addcf4b6b9fbbfc3293c6c5a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:48:35.916754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Getting quotas for user 5ec2b3ac76804e0a895b7751677a4671 and project d590a49addcf4b6b9fbbfc3293c6c5a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:48:35.965855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:35.978597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:48:35.981251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:48:36.053480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:36.098279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:36.101385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:36.103335 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-88cc7ab1-3888-4ea9-abff-1f5651b76ae0 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.282707 Oct 03 10:48:36.104349 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2012/4253] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:35 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:48:36.185220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0fec52d-dc8f-4b6b-b145-51b334551561 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea3e9d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:36.210498 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d37855b-a141-4c53-a947-c04c987a50e4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.676888 Oct 03 10:48:36.212517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2242/4254] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:48:36.234890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad1dd8dc-e01a-4629-853c-7097dd0bfedf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:36.235694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad1dd8dc-e01a-4629-853c-7097dd0bfedf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:36.348085 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b0fec52d-dc8f-4b6b-b145-51b334551561 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.168347 Oct 03 10:48:36.349312 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2013/4255] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:36 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:36.801528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ad1dd8dc-e01a-4629-853c-7097dd0bfedf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:36.815522 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad1dd8dc-e01a-4629-853c-7097dd0bfedf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1217 microversion: 2.1 time: 0.590624 Oct 03 10:48:36.837185 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2243/4256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:36 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1217 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:37.147718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:37.149107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:37.207562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:37.208312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:37.209080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:37.210075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:37.212290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:37.217279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:37.454515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:37.486997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:37.489276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:37.494012 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b67013c5-3be0-4f71-9a24-202dc2a90659 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1408 microversion: 2.54 time: 0.349696 Oct 03 10:48:37.496583 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2014/4257] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:37 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:37.509457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-066dc1d3-721a-4746-a8e8-39192daf92bf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea3e040>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:37.614565 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-066dc1d3-721a-4746-a8e8-39192daf92bf tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.116759 Oct 03 10:48:37.615168 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2015/4258] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:37 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:37.750526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-29844724", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "fd2dc9cd-001b-4543-93c8-6ff550a1c7a4"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:37.845369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:37.845917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:37.858460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:37.858972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:37.862728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:37.863269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:37.864086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:37.864556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:37.877773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] validate_networks() for [('fd2dc9cd-001b-4543-93c8-6ff550a1c7a4', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:48:38.006940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:38.018239 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8303265d-dfcc-4de4-b4d0-34acdd0dc1a8 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1213 microversion: 2.1 time: 0.177150 Oct 03 10:48:38.019186 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2016/4259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:37 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:38.208016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:38.209442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:38.226177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:38.229117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:38.231170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:38.232198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:38.233088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:38.233778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:38.297113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:48:38.463844 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c76d86ef-40af-4898-bea2-e7934d0cb3d0 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 204 len: 0 microversion: 2.1 time: 0.260794 Oct 03 10:48:38.465309 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2017/4260] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:48:38 2022] DELETE /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:48:38.476836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:38.477578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:38.485694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:38.486224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:38.486634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:38.487353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:38.487816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:38.488257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:38.730824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:38.740190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:38.744031 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3aad7147-44b5-4aa4-8a94-c8af15c11abc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1666 microversion: 2.1 time: 0.271418 Oct 03 10:48:38.746461 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2018/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:38 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1666 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:38.763164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:38.767027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:38.814093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:38.815602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:38.816604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:38.819120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:38.819943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:38.820123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:38.976010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:39.003576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:39.010386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:39.014340 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9295b3e-c7fa-4d17-82af-91d18c9b8210 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1414 microversion: 2.54 time: 0.263357 Oct 03 10:48:39.016413 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2019/4262] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:38 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1414 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:39.042157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-66524314-2850-47e0-80cd-d94f2a605a79 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f0bb3a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:39.139807 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-66524314-2850-47e0-80cd-d94f2a605a79 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.117987 Oct 03 10:48:39.159853 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2020/4263] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:39 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:39.169678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:39.170785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:39.185198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.186667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.188000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:39.190943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.191831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.192663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:39.331848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:39.342189 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-228bbf41-ffcc-42e0-996b-a974ca4aba2d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1269 microversion: 2.1 time: 0.180767 Oct 03 10:48:39.342954 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2021/4264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:39 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:39.403833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:48:39.404362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:48:39.404520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:48:39.405381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:48:39.405819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:48:39.432499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.440917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.441585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:39.442434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.443078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.443697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:39.483405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Getting quotas for project f1cd8a468d714471b5e254fcc5fc048b. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:48:39.496246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Getting quotas for user fa14eab6cf2e49419dfc7e266e3bb63c and project f1cd8a468d714471b5e254fcc5fc048b. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:48:39.536963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:48:39.539414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:48:39.642258 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-347ce9f7-cb26-4bf7-9286-f7df2901e3ac tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.334340 Oct 03 10:48:39.647628 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2244/4265] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:48:39.660568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e8d88e2-794c-4408-8243-4d0f5b993483 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:39.661334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e8d88e2-794c-4408-8243-4d0f5b993483 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:39.727227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:39.728745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:39.749253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.750339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.751366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:39.752709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.754604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.755208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:39.781597 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] HTTP exception thrown: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Request method failure captured: Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 HTTP/1.1 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrxaHDpBbwmrEtvxRZ-VKxhzgYvHPz8-0iF9i0ukFNFqiF2tmK88Fl9Jbsfil4hLMLTDr8ebvtxLlFlM5JTHUPcTxxhDWLxBAdYnEo9X4vUtn9urJfOU3bwlKdLlsvh6zOe0gtviDrVYm3Qli0IazWmwsgQkYAcT-zK-9jIA6ffjNGs Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.32 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 2675121b976b452db6d77e8e6e628954 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2675121b976b452db6d77e8e6e628954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2675121b976b452db6d77e8e6e628954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2675121b976b452db6d77e8e6e628954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2675121b976b452db6d77e8e6e628954"}]}] Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 2675121b976b452db6d77e8e6e628954 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TaggedBootDevicesTest-72559638-project Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8661b68516064439beaa63b26678a918 Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TaggedBootDevicesTest-72559638-project Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1c468f4c-dc50-41ee-883e-47f3cbf052a3'} Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:48:39.785307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:39.789209 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:39.803628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Returning 404 to user: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:39.806602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58e7181b-0469-40e6-a7b0-416eea359b2c tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 404 len: 111 microversion: 2.32 time: 0.090662 Oct 03 10:48:39.807808 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2245/4266] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:48:39 2022] DELETE /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:48:39.824538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:39.833886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:39.842824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.843547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.844165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:39.845126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:39.845731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:39.846302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:40.015905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2e8d88e2-794c-4408-8243-4d0f5b993483 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:40.029845 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e8d88e2-794c-4408-8243-4d0f5b993483 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1223 microversion: 2.1 time: 0.374230 Oct 03 10:48:40.030471 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2022/4267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:39 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1223 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:40.036178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:40.045739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] [instance: 1c468f4c-dc50-41ee-883e-47f3cbf052a3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:40.062319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:40.063136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:40.063888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:40.071296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:40.071834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:40.072286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:40.074840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:40.116629 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c5e48d7-13a5-43f2-a51f-3c8e712d4ee6 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1666 microversion: 2.1 time: 0.306839 Oct 03 10:48:40.122826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2246/4268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:39 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1666 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:40.136050 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] HTTP exception thrown: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Request method failure captured: Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 HTTP/1.1 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrxaHDpBbwmrEtvxRZ-VKxhzgYvHPz8-0iF9i0ukFNFqiF2tmK88Fl9Jbsfil4hLMLTDr8ebvtxLlFlM5JTHUPcTxxhDWLxBAdYnEo9X4vUtn9urJfOU3bwlKdLlsvh6zOe0gtviDrVYm3Qli0IazWmwsgQkYAcT-zK-9jIA6ffjNGs Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.32 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 2675121b976b452db6d77e8e6e628954 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2675121b976b452db6d77e8e6e628954"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2675121b976b452db6d77e8e6e628954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2675121b976b452db6d77e8e6e628954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2675121b976b452db6d77e8e6e628954"}]}] Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 2675121b976b452db6d77e8e6e628954 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TaggedBootDevicesTest-72559638 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TaggedBootDevicesTest-72559638-project Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 8661b68516064439beaa63b26678a918 Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TaggedBootDevicesTest-72559638-project Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '1c468f4c-dc50-41ee-883e-47f3cbf052a3'} Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:40.140605 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:40.144129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:40.144129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:40.144129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:40.144129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:48:40.144129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:48:40.144129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. Oct 03 10:48:40.144129 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:48:40.150941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] Returning 404 to user: Instance 1c468f4c-dc50-41ee-883e-47f3cbf052a3 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:40.156099 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc2df668-3453-4b08-80ee-9b663d2b32db tempest-TaggedBootDevicesTest-72559638 tempest-TaggedBootDevicesTest-72559638-project] 10.222.0.27 "GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3" status: 404 len: 111 microversion: 2.32 time: 0.124467 Oct 03 10:48:40.161581 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2023/4269] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:40 2022] GET /compute/v2.1/servers/1c468f4c-dc50-41ee-883e-47f3cbf052a3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:48:40.168954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:40.174147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:40.199137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:40.199682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:40.200355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:40.201727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:40.201921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c40fb7f1-08c4-4358-834a-f43e23995b00 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e2c9ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:40.202773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:40.203477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:40.344331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c40fb7f1-08c4-4358-834a-f43e23995b00 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.180238 Oct 03 10:48:40.383464 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2024/4270] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:40 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:40.429696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:40.437443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:40.445724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:40.476622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:40.485228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:40.490221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:40.493879 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a839f14-9a65-4339-bbde-6bab6e2e0aec tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1414 microversion: 2.54 time: 0.363896 Oct 03 10:48:40.496352 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2247/4271] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:40 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1414 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:40.514536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:40.518740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:40.522659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:40.523554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:40.527816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:40.884421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:40.904257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cd02a30-91b9-45bf-9baa-62932d8e21a9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1277 microversion: 2.1 time: 0.511438 Oct 03 10:48:40.905344 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2025/4272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:40 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1277 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:41.074044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bdba66d-eb63-479b-b16a-9ee6f8ee5f21 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:41.074962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4bdba66d-eb63-479b-b16a-9ee6f8ee5f21 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:41.159123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:41.160212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:41.168484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:41.183547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:41.185912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:41.186738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:41.187236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:41.187684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:41.245490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4bdba66d-eb63-479b-b16a-9ee6f8ee5f21 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:41.252958 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4bdba66d-eb63-479b-b16a-9ee6f8ee5f21 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1223 microversion: 2.1 time: 0.183988 Oct 03 10:48:41.256582 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2248/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:41 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1223 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:41.398075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d44c2bd9-97cb-4cc2-a7a0-d638e92d537a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e562dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:41.529939 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d44c2bd9-97cb-4cc2-a7a0-d638e92d537a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.135746 Oct 03 10:48:41.531667 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2249/4274] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:41 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:41.561705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:41.562364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:41.599046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:41.599794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:41.600243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:41.601208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:41.601822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:41.613809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:41.795061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:41.818244 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5306024f-1c75-4cce-be34-0c485f586fbc tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1666 microversion: 2.1 time: 0.662991 Oct 03 10:48:41.818878 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2026/4275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:41 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1666 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:41.854630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:41.869476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:41.871048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:41.872280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5415b60b-a138-4384-a67d-46118fd1e7d7 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1414 microversion: 2.54 time: 0.336982 Oct 03 10:48:41.888567 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2250/4276] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:41 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1414 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:41.931475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:41.932245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:41.946707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:41.947518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:41.948133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:41.949191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:41.949894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:41.950543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:42.216106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:42.231338 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db651583-ac24-4b41-9005-4043f7a30b40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1275 microversion: 2.1 time: 0.302777 Oct 03 10:48:42.231967 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2027/4277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:41 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:42.280687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:42.281357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:42.295350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:42.296163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:42.296882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:42.297807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:42.298418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:42.299604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:42.550562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb784f2d-bbba-4757-bf15-47ed8c5e9d55 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e59e160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:42.666139 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb784f2d-bbba-4757-bf15-47ed8c5e9d55 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.120935 Oct 03 10:48:42.686915 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2028/4278] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:42 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:42.859441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:42.860756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:42.891431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:42.891948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:42.892407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:42.893210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:42.905756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:42.906150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:42.936821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:42.953643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9961620-6f2c-4204-b393-0d1d11fb4209 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1275 microversion: 2.1 time: 0.678000 Oct 03 10:48:42.966207 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2251/4279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:42 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1275 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:42.999888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:43.000556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:43.050678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:43.060008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:43.060581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:43.061702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:43.063234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:43.063800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:43.116264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:43.262967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:43.297811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:43.305955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:43.307996 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9cac3873-649b-4136-9219-154235b53132 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1414 microversion: 2.54 time: 0.337673 Oct 03 10:48:43.317105 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2252/4280] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:42 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1414 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:43.350191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:43.366340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:43.397699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:43.412646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:43.419816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:43.421794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:43.426717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:43.427332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:44.070614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:44.083812 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4bcbea85-29af-40e5-ae3d-53c5e92238fb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1317 microversion: 2.1 time: 0.760413 Oct 03 10:48:44.087304 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2253/4281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:43 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:44.093555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d3dac7f4-74cc-4cc4-992d-9078f6396b6d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e20cc10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:44.177640 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d3dac7f4-74cc-4cc4-992d-9078f6396b6d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.088915 Oct 03 10:48:44.182408 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2254/4282] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:44 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:44.188569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:44.193121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:44.210330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:44.211204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:44.211934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:44.213148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:44.216321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:44.217732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:44.441148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:44.455543 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6cf6703a-83b0-4b85-a011-023ba5c86040 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1281 microversion: 2.1 time: 0.271239 Oct 03 10:48:44.456535 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2255/4283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:44 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:44.462975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:44.463777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:44.472163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:44.472690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:44.473284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:44.474339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:44.474973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:44.476213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:44.630968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:44.657632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:44.659601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:44.668381 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-452069d5-e30f-4009-a2b4-1569cb1e6990 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1399 microversion: 2.54 time: 0.202969 Oct 03 10:48:44.670201 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2256/4284] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:44 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1399 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:44.711783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-608e5b46-5f4f-4758-9d66-a1a6c1500c60 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '.version_select at 0x7f074e201a60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:44.757838 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-608e5b46-5f4f-4758-9d66-a1a6c1500c60 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-131668252" status: 204 len: 0 microversion: 2.54 time: 0.063618 Oct 03 10:48:44.759314 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2257/4285] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Oct 3 10:48:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-131668252 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:48:44.781691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:44.804999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:44.805577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:44.805738 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de60d190-e412-4094-a560-51dafc21cbab tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1599 microversion: 2.1 time: 1.950846 Oct 03 10:48:44.806481 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2029/4286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:42 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1599 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:44.846165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:44.849262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:44.849262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:44.850388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:44.851065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:44.853576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:44.919064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:48:45.115688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:45.116473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:45.137379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:45.138877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:45.139462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:45.141039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:45.141516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:45.141950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:45.144335 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1da4b2a0-ff11-4604-8ebd-d53235536f83 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 204 len: 0 microversion: 2.54 time: 0.358582 Oct 03 10:48:45.151039 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2258/4287] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:48:44 2022] DELETE /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:48:45.161938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:45.163599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:45.197992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:45.213280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:45.214471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:45.215991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:45.230527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:45.236134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:45.533796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:45.544623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:45.546117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:45.549734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a4384be4-d4e0-4d1c-88e7-189f40c08784 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1405 microversion: 2.54 time: 0.396445 Oct 03 10:48:45.580799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2259/4288] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:45 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:45.580799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c238e6a2-ef8f-4f5b-852f-04da2e504dd1 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1bec10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:45.756664 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c238e6a2-ef8f-4f5b-852f-04da2e504dd1 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1450 microversion: 2.1 time: 0.194329 Oct 03 10:48:45.757276 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2260/4289] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:45 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1450 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:45.775739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:45.775739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:45.810640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:45.811804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:45.815499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:45.822044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:45.827924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:45.830766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:45.988883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:46.009810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3649a13c-2ef9-4ca3-a88a-85d8fe828e46 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1281 microversion: 2.1 time: 0.247876 Oct 03 10:48:46.026705 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2261/4290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:45 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:46.083802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6e6195fe-ba20-4fe7-bcfd-2058f17a91f2 req-fed404b7-0878-4c47-9126-628214a43c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cdb0950-c097-4dfc-aef3-bfe925801ec0", "tag": "cfe7e37c-fd92-43bb-aad4-71db47da0d9d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:46.114537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6195fe-ba20-4fe7-bcfd-2058f17a91f2 req-fed404b7-0878-4c47-9126-628214a43c21 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:46.115097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6195fe-ba20-4fe7-bcfd-2058f17a91f2 req-fed404b7-0878-4c47-9126-628214a43c21 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:46.115458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6195fe-ba20-4fe7-bcfd-2058f17a91f2 req-fed404b7-0878-4c47-9126-628214a43c21 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:46.130824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6e6195fe-ba20-4fe7-bcfd-2058f17a91f2 req-fed404b7-0878-4c47-9126-628214a43c21 service nova] Creating event network-changed:cfe7e37c-fd92-43bb-aad4-71db47da0d9d for instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 on n-h2-858383-3 Oct 03 10:48:46.139789 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6e6195fe-ba20-4fe7-bcfd-2058f17a91f2 req-fed404b7-0878-4c47-9126-628214a43c21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110730 Oct 03 10:48:46.140719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2262/4291] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:46.161615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b8173cb6-3e6b-4bda-bac4-fe3d2d5f19a9 req-bb94c967-84d9-4f25-8b7a-c998532279e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19491ab9-9855-4602-b203-1c3bfd401b12", "name": "network-vif-deleted", "tag": "2f907708-8c09-4378-a5b4-86d8b19c1353"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:46.182283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b8173cb6-3e6b-4bda-bac4-fe3d2d5f19a9 req-bb94c967-84d9-4f25-8b7a-c998532279e2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:46.185330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b8173cb6-3e6b-4bda-bac4-fe3d2d5f19a9 req-bb94c967-84d9-4f25-8b7a-c998532279e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:46.187247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b8173cb6-3e6b-4bda-bac4-fe3d2d5f19a9 req-bb94c967-84d9-4f25-8b7a-c998532279e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:46.216829 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b8173cb6-3e6b-4bda-bac4-fe3d2d5f19a9 req-bb94c967-84d9-4f25-8b7a-c998532279e2 service nova] Creating event network-vif-deleted:2f907708-8c09-4378-a5b4-86d8b19c1353 for instance 19491ab9-9855-4602-b203-1c3bfd401b12 on n-h2-858383-3 Oct 03 10:48:46.229759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:46.233293 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b8173cb6-3e6b-4bda-bac4-fe3d2d5f19a9 req-bb94c967-84d9-4f25-8b7a-c998532279e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087503 Oct 03 10:48:46.234895 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2263/4292] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:46.246121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-67f0d2b2-5199-4b5c-9399-af60c7ddd9f5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1317 microversion: 2.1 time: 1.128600 Oct 03 10:48:46.248016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:46.249314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:46.257506 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2030/4293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:45 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1317 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:46.270987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:46.271487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:46.271935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:46.272648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:46.273163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:46.273591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:46.368157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:46.368755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:46.369304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:46.369826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lazy-loading 'fault' on Instance uuid 19491ab9-9855-4602-b203-1c3bfd401b12 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:48:46.532479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8dcc199c80470a81c458f1e8860487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387e024349a64433a7f8850c45ed956a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:46.553633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-950257f7-aea6-4c3e-9972-ca0250c9ac3d tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 200 len: 1316 microversion: 2.1 time: 0.315957 Oct 03 10:48:46.554685 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2264/4294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:46 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:46.615196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:46.617755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:46.653839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:46.654808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:46.655530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:46.656989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:46.659980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:46.661026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:46.796081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d8705e1c-0ed0-427d-b572-4f1998a93fbb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e5133a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:46.919731 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d8705e1c-0ed0-427d-b572-4f1998a93fbb tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1459 microversion: 2.1 time: 0.137354 Oct 03 10:48:46.920752 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2265/4295] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:46 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1459 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:46.942492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-482ca691-b707-4ca8-bbf8-7464c5f8ce87 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1be4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:46.955513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:46.982301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:46.992273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:46.998637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04de220a-dce2-409a-a5af-505a3781b790 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1405 microversion: 2.54 time: 0.399303 Oct 03 10:48:46.999739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2031/4296] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:46 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:47.027836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-482ca691-b707-4ca8-bbf8-7464c5f8ce87 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 200 len: 1459 microversion: 2.1 time: 0.096120 Oct 03 10:48:47.028296 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2266/4297] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:46 2022] GET /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 1459 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:47.043211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:47.044205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:47.047696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:47.051471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.051999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:47.052398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.053081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.053989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.054809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.055470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.090788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.091699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.101263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.102861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.103638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.104445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.171954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:47.183190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-acc24df7-7e97-4475-a056-bafb0d3b6036 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1281 microversion: 2.1 time: 0.144233 Oct 03 10:48:47.185321 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2267/4298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:47 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:47.294061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:47.295301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:47.305673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.306178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.306726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.307466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.307947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.308371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.523824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:47.538921 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eb6de487-8951-4abf-9dd1-53214b6f42ee tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1317 microversion: 2.1 time: 0.258586 Oct 03 10:48:47.551529 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2268/4299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:47 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:47.604687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:47.605425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] [instance: 19491ab9-9855-4602-b203-1c3bfd401b12] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:47.616579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:47.621227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.623146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.624668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.638272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:47.638833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:47.639285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:47.644832 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8ea3c5d6-c610-4a07-99c2-9446d4e0d408 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1478 microversion: 2.1 time: 0.604097 Oct 03 10:48:47.663084 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2032/4300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:47 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1478 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:47.673245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] HTTP exception thrown: Instance 19491ab9-9855-4602-b203-1c3bfd401b12 could not be found. Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Request method failure captured: Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 HTTP/1.1 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3B2IL9fuSTvNa22qpI_1gwcYKO5gr7Ny_R8oMTNVU3wQGm_CeXUN9rF6OdGyiDUk95xHO1UZQi2qby2rYT7HPIApff3ZeY1IQoOhKt62B4k_myF5ow4b0ZGI-m14MAnyNwEiQ1mc3WEKpz2QPI_-aNtL8y7GCuXRIJUGBfXjaRMgg Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 387e024349a64433a7f8850c45ed956a Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestFqdnHostnames-1890509401 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387e024349a64433a7f8850c45ed956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_387e024349a64433a7f8850c45ed956a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/387e024349a64433a7f8850c45ed956a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/387e024349a64433a7f8850c45ed956a"}]}] Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestFqdnHostnames-1890509401 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 387e024349a64433a7f8850c45ed956a Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1890509401 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestFqdnHostnames-1890509401-project Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: fb8dcc199c80470a81c458f1e8860487 Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestFqdnHostnames-1890509401-project Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 19491ab9-9855-4602-b203-1c3bfd401b12 could not be found. Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '19491ab9-9855-4602-b203-1c3bfd401b12'} Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19491ab9-9855-4602-b203-1c3bfd401b12 could not be found. Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19491ab9-9855-4602-b203-1c3bfd401b12 could not be found. Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:47.674909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19491ab9-9855-4602-b203-1c3bfd401b12 could not be found. Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Returning 404 to user: Instance 19491ab9-9855-4602-b203-1c3bfd401b12 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:47.678513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4a527f12-0ac7-49b2-9b67-85d3aeaf1445 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12" status: 404 len: 111 microversion: 2.1 time: 0.079275 Oct 03 10:48:47.683375 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2269/4301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:47 2022] GET /compute/v2.1/servers/19491ab9-9855-4602-b203-1c3bfd401b12 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:48:47.686332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-be8e4e66-9698-45b8-829f-4c5f76c3ecb5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] Calling method '.version_select at 0x7f074e3a08b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:47.724712 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-be8e4e66-9698-45b8-829f-4c5f76c3ecb5 tempest-ServersTestFqdnHostnames-1890509401 tempest-ServersTestFqdnHostnames-1890509401-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317987556" status: 202 len: 0 microversion: 2.1 time: 0.043186 Oct 03 10:48:47.725339 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2033/4302] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317987556 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:48:48.037266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:48.045145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:48.076306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:48.082704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:48.084637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:48.088131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:48.089924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:48.091168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:48.230302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:48.231773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:48.266646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:48.271743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:48.273031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:48.279169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:48.281047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:48.286027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:48.364747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:48.390165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:48.391765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:48.393419 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-173ab7d0-0cba-48c3-813e-1140939d4a56 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1405 microversion: 2.54 time: 0.364658 Oct 03 10:48:48.394378 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2270/4303] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:48 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1405 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:48.595320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:48.596984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:48.606463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:48.607648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:48.608280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:48.609400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:48.610056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:48.610726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.239256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:49.258836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1f9a1008-8c2a-456a-9c8b-8b6ee053724d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1317 microversion: 2.1 time: 0.669149 Oct 03 10:48:49.288803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2271/4304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:48 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:49.288803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:49.288803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:49.296008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:49.297314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:49.298258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.299761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:49.300538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:49.301319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.367415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:49.402589 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f93c6b1c-0563-49b5-a34d-37c32b4f215f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 1.178208 Oct 03 10:48:49.413279 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2034/4305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:48 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:49.427619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:49.430294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:49.447040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:49.447637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:49.448299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.449355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:49.449928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:49.450545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.460749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:49.562522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:49.563025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:49.571274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.574346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lazy-loading 'fault' on Instance uuid 8485c8ac-2246-492a-90b9-34b7df4bca19 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:48:49.735046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:49.752652 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba374fae-37ab-4912-98dc-e11a278fd3d7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1465 microversion: 2.1 time: 0.475357 Oct 03 10:48:49.771467 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2272/4306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:49 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1465 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:49.779481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-777345766"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:49.783495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:49.796982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:49.800658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:49.801750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.803289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:49.810639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:49.811694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:49.849951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:49.884851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:49.891005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2906fee8eef489f9745ca57fd949ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2be9145ee08d490e87426199a983b16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:49.898277 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a7b3c127-0e2b-490a-8f96-67259ba80516 tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 200 len: 1410 microversion: 2.54 time: 0.477554 Oct 03 10:48:49.914453 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2035/4307] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:49 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 1410 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:48:50.206816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:50.320673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:50.322267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:50.327272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:50.341764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:50.345213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:50.346161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:50.347498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:50.350952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:50.352111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:50.365568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d62e6692-af03-44ea-a22a-8a811f9543cd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "POST /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995/action" status: 202 len: 0 microversion: 2.1 time: 0.586279 Oct 03 10:48:50.367180 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2273/4308] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:48:49 2022] POST /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 03 10:48:50.384931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43bb740e-036d-4260-abca-42a0efc29521 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e2019d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:50.465594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43bb740e-036d-4260-abca-42a0efc29521 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.084716 Oct 03 10:48:50.465594 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2274/4309] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:50 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:50.467578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:50.469696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:50.484981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:50.486036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:50.486977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:50.487809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:50.488340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:50.489000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:50.761534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:50.774342 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3701b229-0f48-409e-8074-ae7530e72733 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 0.310721 Oct 03 10:48:50.775196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2275/4310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:50 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:50.939466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:50.940692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] [instance: 8485c8ac-2246-492a-90b9-34b7df4bca19] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:50.960886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:50.961735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:50.962927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:50.964556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:50.965439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:50.966281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:50.997177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] HTTP exception thrown: Instance 8485c8ac-2246-492a-90b9-34b7df4bca19 could not be found. Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Request method failure captured: Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 HTTP/1.1 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3czglt3OY3y5qqzI6Ev37_lUTuEz5lwi3-9Q_tUY6Ml9urhaMP6n4q2uWBC7L3iEkImeC5OBtMcDY3jRzybbJK9FV888MgmmEdGa8hVl9gu8AWScVAXMudCamMjMOregEay_p_yOZKcYHcklSDL9FoqHuhMu8AMVTcGTmXXdv58B4 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.54 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 2be9145ee08d490e87426199a983b16b Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerShowV254Test-1136719272 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2be9145ee08d490e87426199a983b16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2be9145ee08d490e87426199a983b16b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2be9145ee08d490e87426199a983b16b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2be9145ee08d490e87426199a983b16b"}]}] Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerShowV254Test-1136719272 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 2be9145ee08d490e87426199a983b16b Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerShowV254Test-1136719272 Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerShowV254Test-1136719272-project Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d2906fee8eef489f9745ca57fd949ede Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerShowV254Test-1136719272-project Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 8485c8ac-2246-492a-90b9-34b7df4bca19 could not be found. Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '8485c8ac-2246-492a-90b9-34b7df4bca19'} Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8485c8ac-2246-492a-90b9-34b7df4bca19 could not be found. Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8485c8ac-2246-492a-90b9-34b7df4bca19 could not be found. Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:48:51.000401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:51.009395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:48:51.009395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:48:51.009395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:48:51.009395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:48:51.009395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:48:51.009395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8485c8ac-2246-492a-90b9-34b7df4bca19 could not be found. Oct 03 10:48:51.009395 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:48:51.021329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] Returning 404 to user: Instance 8485c8ac-2246-492a-90b9-34b7df4bca19 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:48:51.022759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:51.024261 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-92d0fbbb-2f63-4de6-83d1-22f3320a72ac tempest-ServerShowV254Test-1136719272 tempest-ServerShowV254Test-1136719272-project] 10.222.0.27 "GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19" status: 404 len: 111 microversion: 2.54 time: 0.094563 Oct 03 10:48:51.028636 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2276/4311] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:48:50 2022] GET /compute/v2.1/servers/8485c8ac-2246-492a-90b9-34b7df4bca19 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:48:51.040140 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c5fbde67-d63e-4a61-96ac-2e4244f308a3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1317 microversion: 2.1 time: 0.724727 Oct 03 10:48:51.060617 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2036/4312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:50 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:51.477912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9a7d883-a7cd-41aa-8ad0-5895746ebec3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074eb5f4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:51.484401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=16 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:51.611745 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9a7d883-a7cd-41aa-8ad0-5895746ebec3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.137744 Oct 03 10:48:51.620056 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2277/4313] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:51 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:51.662079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-cdcdcf41-27d8-41db-849c-ba903d465732 req-87819d99-cd43-40f9-80ab-a5be4be5d8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdb0950-c097-4dfc-aef3-bfe925801ec0", "name": "network-vif-plugged", "status": "completed", "tag": "cfe7e37c-fd92-43bb-aad4-71db47da0d9d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:51.668568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:51.686930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cdcdcf41-27d8-41db-849c-ba903d465732 req-87819d99-cd43-40f9-80ab-a5be4be5d8c6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:51.687397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cdcdcf41-27d8-41db-849c-ba903d465732 req-87819d99-cd43-40f9-80ab-a5be4be5d8c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:51.688471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cdcdcf41-27d8-41db-849c-ba903d465732 req-87819d99-cd43-40f9-80ab-a5be4be5d8c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:51.727657 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-cdcdcf41-27d8-41db-849c-ba903d465732 req-87819d99-cd43-40f9-80ab-a5be4be5d8c6 service nova] Creating event network-vif-plugged:cfe7e37c-fd92-43bb-aad4-71db47da0d9d for instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 on n-h2-858383-3 Oct 03 10:48:51.742660 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-cdcdcf41-27d8-41db-849c-ba903d465732 req-87819d99-cd43-40f9-80ab-a5be4be5d8c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085441 Oct 03 10:48:51.762414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2037/4314] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:51.833408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:51.858959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:51.887463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:51.891826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:51.892536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:51.898946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:51.903750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:51.905085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:52.070062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:52.070829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:52.086477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:52.087242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:52.087704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:52.088457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:52.089863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:52.090323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:52.795956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:52.813922 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5bbc784b-ab31-445b-9fcf-4fbcd3f92e5f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 1.005309 Oct 03 10:48:52.814640 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2278/4315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:51 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:52.831301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b2fbc9b-c4ed-46c4-98fe-1e441c40de0f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e201310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:52.934448 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b2fbc9b-c4ed-46c4-98fe-1e441c40de0f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.118385 Oct 03 10:48:52.935417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2279/4316] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:52 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:52.959622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4a9f8b60-e0a9-4841-b983-9b3bedb4cdc3 req-1f152044-d28a-4850-88e6-1fa4665b609e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8bbb2a-12e2-4562-87ac-c806d8003e34", "tag": "553993e6-1f6b-4a87-b61d-088a455fa87a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:52.978861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4a9f8b60-e0a9-4841-b983-9b3bedb4cdc3 req-1f152044-d28a-4850-88e6-1fa4665b609e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:52.979362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4a9f8b60-e0a9-4841-b983-9b3bedb4cdc3 req-1f152044-d28a-4850-88e6-1fa4665b609e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:52.980335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4a9f8b60-e0a9-4841-b983-9b3bedb4cdc3 req-1f152044-d28a-4850-88e6-1fa4665b609e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:52.995987 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4a9f8b60-e0a9-4841-b983-9b3bedb4cdc3 req-1f152044-d28a-4850-88e6-1fa4665b609e service nova] Creating event network-changed:553993e6-1f6b-4a87-b61d-088a455fa87a for instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 on n-h2-858383-3 Oct 03 10:48:53.006139 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4a9f8b60-e0a9-4841-b983-9b3bedb4cdc3 req-1f152044-d28a-4850-88e6-1fa4665b609e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054464 Oct 03 10:48:53.008254 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2280/4317] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:53.250240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:53.267349 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c24e0519-2616-451e-8841-96e4ae143aff tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1317 microversion: 2.1 time: 1.203809 Oct 03 10:48:53.277281 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2038/4318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:52 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1317 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:53.817869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-48d43eba-caa8-4b40-97aa-e6900aa762ed req-1bfed497-225d-4305-bb75-e99251af6afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74014a1-fb90-45e3-ba2d-71fdddefa20d", "name": "network-vif-unplugged", "status": "completed", "tag": "ae3e817d-c947-4bc6-bdd3-d9aef8449dbb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:53.829522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-48d43eba-caa8-4b40-97aa-e6900aa762ed req-1bfed497-225d-4305-bb75-e99251af6afc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:53.830061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-48d43eba-caa8-4b40-97aa-e6900aa762ed req-1bfed497-225d-4305-bb75-e99251af6afc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:53.830694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-48d43eba-caa8-4b40-97aa-e6900aa762ed req-1bfed497-225d-4305-bb75-e99251af6afc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:53.844538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:53.846089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:53.886146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:53.893608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:53.895794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:53.904721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:53.906668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:53.907342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:53.921177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-48d43eba-caa8-4b40-97aa-e6900aa762ed req-1bfed497-225d-4305-bb75-e99251af6afc service nova] Creating event network-vif-unplugged:ae3e817d-c947-4bc6-bdd3-d9aef8449dbb for instance a74014a1-fb90-45e3-ba2d-71fdddefa20d on n-h1-858383-3 Oct 03 10:48:53.933478 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-48d43eba-caa8-4b40-97aa-e6900aa762ed req-1bfed497-225d-4305-bb75-e99251af6afc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120213 Oct 03 10:48:53.935268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2281/4319] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:53.962775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71eb1deb-89b1-45d5-8f26-9aea7667b91a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e1a43a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:54.080882 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-71eb1deb-89b1-45d5-8f26-9aea7667b91a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.122720 Oct 03 10:48:54.081975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2282/4320] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:53 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:54.304211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:54.312554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:54.332645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:54.333175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:54.335570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:54.337449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:54.338090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:54.339710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:54.579785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:54.597064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2d61b60-420e-423f-bc7c-1897844165d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1507 microversion: 2.1 time: 0.295337 Oct 03 10:48:54.597064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2283/4321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:54 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:54.621885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:54.622380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:54.644098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:54.649550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:54.651308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:54.653236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:54.666211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:54.666784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:54.763482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:48:54.917925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:54.947123 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-711cb387-c8d8-4910-8045-4e744e3c809a tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 1.111026 Oct 03 10:48:54.964981 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2039/4322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:53 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:55.049626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:55.098746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3c598ca-3a40-4057-832f-64236939bc59 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f07573e3ee0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:55.132204 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb40a7b7-4d22-41fe-8a49-aa554d256af7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 204 len: 0 microversion: 2.1 time: 0.507196 Oct 03 10:48:55.135296 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2284/4323] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:48:54 2022] DELETE /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:48:55.186624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:55.209883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:55.261051 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3c598ca-3a40-4057-832f-64236939bc59 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.166906 Oct 03 10:48:55.270688 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2040/4324] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:55 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:55.297500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:55.298468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:55.299129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:55.302846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:55.303592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:55.304242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:55.794176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:55.808600 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-afaba79f-e63c-4daf-bb3c-b7e0d28d61a1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1513 microversion: 2.1 time: 0.667862 Oct 03 10:48:55.829300 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2285/4325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:55 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1513 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:55.991346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:55.991949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:56.008101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:56.008529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:56.014713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:56.015834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:56.018559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:56.019194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:56.070846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7f6de033-1c21-4a29-961a-92dd6cf71414 req-dd59366c-867a-402f-b547-d38390bf8f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fe7879-6f32-4d3b-8038-a4f40f154995", "name": "network-vif-plugged", "status": "completed", "tag": "873702af-4840-46a1-b693-3ceb18ce3a18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:56.145336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7f6de033-1c21-4a29-961a-92dd6cf71414 req-dd59366c-867a-402f-b547-d38390bf8f20 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:56.149903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7f6de033-1c21-4a29-961a-92dd6cf71414 req-dd59366c-867a-402f-b547-d38390bf8f20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:56.152613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7f6de033-1c21-4a29-961a-92dd6cf71414 req-dd59366c-867a-402f-b547-d38390bf8f20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:56.227414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7f6de033-1c21-4a29-961a-92dd6cf71414 req-dd59366c-867a-402f-b547-d38390bf8f20 service nova] Creating event network-vif-plugged:873702af-4840-46a1-b693-3ceb18ce3a18 for instance d4fe7879-6f32-4d3b-8038-a4f40f154995 on n-h2-858383-3 Oct 03 10:48:56.249705 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7f6de033-1c21-4a29-961a-92dd6cf71414 req-dd59366c-867a-402f-b547-d38390bf8f20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190424 Oct 03 10:48:56.250334 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2286/4326] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:56.282414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aeab4dcc-3a38-4078-a8cf-dffd906d82b7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e07a9d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:56.374660 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aeab4dcc-3a38-4078-a8cf-dffd906d82b7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.098526 Oct 03 10:48:56.375260 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2287/4327] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:56 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:56.842516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:56.843446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:56.851912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:56.852812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:56.854452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:56.856146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:56.856847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:56.857485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:56.972369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:56.981737 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-013509be-914e-4e0e-8790-646391c5b991 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 0.995464 Oct 03 10:48:56.992017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2041/4328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:55 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:57.402220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b657798-6801-4c3b-80bb-67fa6be0bdf3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074fc88b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:57.527666 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b657798-6801-4c3b-80bb-67fa6be0bdf3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.140920 Oct 03 10:48:57.529633 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2042/4329] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:57 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:57.708295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:57.720336 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56f87d19-a3d8-489a-942f-bc7ab8ba9735 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1513 microversion: 2.1 time: 0.887535 Oct 03 10:48:57.721002 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2288/4330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:56 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1513 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:58.022150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:58.022812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:58.035415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:58.039158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:58.040050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:58.044298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:58.044856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:58.045775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:58.101630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:48:58.543947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d25abb6e-f871-4602-abbe-6ad46747c706 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e201c10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:58.636386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d25abb6e-f871-4602-abbe-6ad46747c706 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.096063 Oct 03 10:48:58.637603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2289/4331] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:58 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:58.740147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:58.749890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:58.751517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:58.756565 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca6668d0-3bb1-4e0a-b767-6924d04f1c4e tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 0.742565 Oct 03 10:48:58.760222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2043/4332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:58 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:58.763146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:58.766886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:58.769153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:58.770147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:58.771167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:58.774339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:59.319361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:48:59.344899 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7a10b5f-239b-4acb-8af1-5a1bcfb27738 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 200 len: 1513 microversion: 2.1 time: 0.584947 Oct 03 10:48:59.348516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2290/4333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:58 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 1513 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:48:59.493810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a686b097-1f49-498a-914b-680b245d854d req-cdd394eb-c813-4c82-8a22-c92c41cd85c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdb0950-c097-4dfc-aef3-bfe925801ec0", "name": "network-vif-deleted", "tag": "cfe7e37c-fd92-43bb-aad4-71db47da0d9d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:48:59.534368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a686b097-1f49-498a-914b-680b245d854d req-cdd394eb-c813-4c82-8a22-c92c41cd85c6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:59.534850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a686b097-1f49-498a-914b-680b245d854d req-cdd394eb-c813-4c82-8a22-c92c41cd85c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:59.538549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a686b097-1f49-498a-914b-680b245d854d req-cdd394eb-c813-4c82-8a22-c92c41cd85c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:59.592968 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a686b097-1f49-498a-914b-680b245d854d req-cdd394eb-c813-4c82-8a22-c92c41cd85c6 service nova] Creating event network-vif-deleted:cfe7e37c-fd92-43bb-aad4-71db47da0d9d for instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 on n-h2-858383-3 Oct 03 10:48:59.604026 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a686b097-1f49-498a-914b-680b245d854d req-cdd394eb-c813-4c82-8a22-c92c41cd85c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119625 Oct 03 10:48:59.608253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2044/4334] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:48:59.654211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-477d7b29-75e3-45f5-bc0f-16c76f8aa1fe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e546430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:59.765509 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-477d7b29-75e3-45f5-bc0f-16c76f8aa1fe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.108810 Oct 03 10:48:59.782601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:48:59.783701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:48:59.785988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2291/4335] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:48:59 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:48:59.799135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:59.799929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:59.806456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:48:59.808661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:48:59.809474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:48:59.810147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:00.371226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:00.372582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:00.388794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:00.393508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:00.394206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:00.395213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:00.398783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:00.399533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:00.440620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 HTTP/1.1 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3cdb0950-c097-4dfc-aef3-bfe925801ec0'} Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:00.443597 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:00.446995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:00.446995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:00.446995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:00.446995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:00.446995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:00.446995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:49:00.446995 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:00.449002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:00.450265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-88e4532c-232a-431c-99df-a1255772e2fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 404 len: 111 microversion: 2.1 time: 0.084183 Oct 03 10:49:00.453223 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2292/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:00 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:00.466195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:00.467245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:00.484277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:00.485163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:00.485871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:00.487419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:00.490817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:00.492057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:00.690988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:00.702413 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b3451e2-8cc3-46a0-9d87-535ab00d61a5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 0.923445 Oct 03 10:49:00.704806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2045/4337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:48:59 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:00.783735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e61291b8-e782-4719-95e6-b92dc97f2aef tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f075736bca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:00.872681 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e61291b8-e782-4719-95e6-b92dc97f2aef tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.093502 Oct 03 10:49:00.873590 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2046/4338] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:00 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:01.206844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:01.227641 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb1bb982-5cec-42a6-8139-a7e90332c0d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.769607 Oct 03 10:49:01.248858 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2293/4339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:00 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:01.557729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ffdd946b-c1dd-46ce-a209-1f8aafd201c6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ffdd946b-c1dd-46ce-a209-1f8aafd201c6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 163 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": 12345, "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 12345 Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:49:01.562769 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 03 10:49:01.567080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:01.569357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ffdd946b-c1dd-46ce-a209-1f8aafd201c6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:01.570446 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ffdd946b-c1dd-46ce-a209-1f8aafd201c6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.016845 Oct 03 10:49:01.571263 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2047/4340] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:01 2022] POST /compute/v2.1/servers => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:49:01.581157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:01.582322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:01.596760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:01.597562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:01.598251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:01.602207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:01.602207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:01.602207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:01.732884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:01.733687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:01.752684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:01.760244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:01.763143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:01.773143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:01.776041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:01.777222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:02.486800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:02.495795 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cce2ae35-3c4d-423e-99a6-eb6baae51a57 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 0.767769 Oct 03 10:49:02.502192 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2048/4341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:01 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:02.507210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71e6b554-5f9b-4e07-aea6-2cae6c18d4a7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f5a9ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:02.564616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:02.604754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71e6b554-5f9b-4e07-aea6-2cae6c18d4a7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.101113 Oct 03 10:49:02.605439 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2049/4342] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:02 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:02.608787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-25812f48-e605-433a-a901-642174599ce7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.032631 Oct 03 10:49:02.611736 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2294/4343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:01 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:02.641880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:02.642509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:02.658203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:02.658879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:02.659355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:02.660105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:02.660568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:02.661032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:03.566800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:03.568604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:03.594514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:03.595444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:03.596267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:03.597471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:03.598214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:03.598839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:03.912591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:03.938370 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8aa31bea-6165-486a-ad6d-a2c8efdb6fa4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.298043 Oct 03 10:49:03.941826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2295/4344] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:02 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:03.962453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91f40591-a14a-4f70-9844-855313f4e256 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e56cd30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:04.085613 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91f40591-a14a-4f70-9844-855313f4e256 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.142484 Oct 03 10:49:04.086352 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2296/4345] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:03 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:04.270194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6a78b18c-d435-4f6f-bf8a-740d50bc047f req-8028051a-455b-4f48-b200-4a9147ddebb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8bbb2a-12e2-4562-87ac-c806d8003e34", "name": "network-vif-plugged", "status": "completed", "tag": "553993e6-1f6b-4a87-b61d-088a455fa87a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:04.301893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6a78b18c-d435-4f6f-bf8a-740d50bc047f req-8028051a-455b-4f48-b200-4a9147ddebb3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:04.302682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6a78b18c-d435-4f6f-bf8a-740d50bc047f req-8028051a-455b-4f48-b200-4a9147ddebb3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:04.303319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6a78b18c-d435-4f6f-bf8a-740d50bc047f req-8028051a-455b-4f48-b200-4a9147ddebb3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:04.345614 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6a78b18c-d435-4f6f-bf8a-740d50bc047f req-8028051a-455b-4f48-b200-4a9147ddebb3 service nova] Creating event network-vif-plugged:553993e6-1f6b-4a87-b61d-088a455fa87a for instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 on n-h2-858383-3 Oct 03 10:49:04.358460 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6a78b18c-d435-4f6f-bf8a-740d50bc047f req-8028051a-455b-4f48-b200-4a9147ddebb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094642 Oct 03 10:49:04.362267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2297/4346] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:49:04.544172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:04.563245 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-644740ea-9390-4bd4-98b2-aa6fd39ae789 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 1.038137 Oct 03 10:49:04.578224 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2050/4347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:03 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:05.108388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62b3faf3-4a51-4b31-9220-c057b56e728f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e56cf70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:05.233269 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62b3faf3-4a51-4b31-9220-c057b56e728f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.133225 Oct 03 10:49:05.241115 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2298/4348] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:05 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:05.607270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:05.608812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:05.628442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:05.633330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:05.639437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:05.647455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:05.649261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:05.653464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:06.250092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5356c456-8ce7-4c99-9fd9-caa7c51f555e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074eb5fc10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:06.367132 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5356c456-8ce7-4c99-9fd9-caa7c51f555e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.122984 Oct 03 10:49:06.367728 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2299/4349] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:06 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:06.483271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:06.503393 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-15864fae-3244-4131-9522-04583b74ad48 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1323 microversion: 2.1 time: 0.897483 Oct 03 10:49:06.529687 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2051/4350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:05 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1323 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:07.168904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9334e5b9-4096-48b7-a65e-550cfe3fddba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-163141456", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "95ecca79-fa20-4d57-8f87-3445d8b54cd5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:07.286764 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-9334e5b9-4096-48b7-a65e-550cfe3fddba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Block Device 95ecca79-fa20-4d57-8f87-3445d8b54cd5 is not bootable. Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9334e5b9-4096-48b7-a65e-550cfe3fddba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 357 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-163141456", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "95ecca79-fa20-4d57-8f87-3445d8b54cd5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: exception: Block Device 95ecca79-fa20-4d57-8f87-3445d8b54cd5 is not bootable. Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-163141456', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '95ecca79-fa20-4d57-8f87-3445d8b54cd5'}], 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 95ecca79-fa20-4d57-8f87-3445d8b54cd5 is not bootable. Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:07.303858 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 95ecca79-fa20-4d57-8f87-3445d8b54cd5 is not bootable. Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 95ecca79-fa20-4d57-8f87-3445d8b54cd5 is not bootable. Oct 03 10:49:07.307268 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:07.311353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9334e5b9-4096-48b7-a65e-550cfe3fddba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Block Device 95ecca79-fa20-4d57-8f87-3445d8b54cd5 is not bootable. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:07.312475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9334e5b9-4096-48b7-a65e-550cfe3fddba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.148420 Oct 03 10:49:07.314254 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2300/4351] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:07 2022] POST /compute/v2.1/servers => generated 110 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:07.335793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:07.338273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:07.366747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:07.373837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:07.376618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:07.377890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:07.379033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:07.380437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:07.388710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0edacf7f-4f6a-449d-a215-17b24571dd6d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f210b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:07.466753 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0edacf7f-4f6a-449d-a215-17b24571dd6d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.087329 Oct 03 10:49:07.476936 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2301/4352] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:07 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:07.536028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:07.537804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:07.551135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:07.551621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:07.562579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:07.563813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:07.567117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:07.567575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:07.870249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:07.878308 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-667a925c-13d3-471b-9fa7-0ea49b5ff9a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.560513 Oct 03 10:49:07.879282 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2052/4353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:07 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:07.924035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:07.924700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:07.940184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:07.940677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:07.941140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:07.959921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:07.962951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:07.974661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:08.115366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:08.125946 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-729b6623-de99-4bee-a658-156ecb3b073f tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1521 microversion: 2.1 time: 0.595475 Oct 03 10:49:08.126666 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2302/4354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:07 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:08.156034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:08.156620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:08.169351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:08.171033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:08.171695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:08.173473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:08.174200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:08.175884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:08.233059 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] HTTP exception thrown: Instance is not a member of specified network Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Request method failure captured: Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34/ips/invalid HTTP/1.1 Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr4E3InrrnB9DSj_K0GUp8enr7otxy-iGGPiF48PhSENQZDt4u9BdezPzpToXPxbL5A0KHyy-aih-OxejPnh8xJ2vBsP71zHy4JtawMXkLnYTH4AiQPMyD9WMOIwZGNf4cnrf6t0_xVIG5AlAnwAq_T7EOYGNX8Fw44H0HuJ_i1nodg Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f1cd8a468d714471b5e254fcc5fc048b Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1cd8a468d714471b5e254fcc5fc048b"}]}] Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f1cd8a468d714471b5e254fcc5fc048b Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerAddressesNegativeTestJSON-1915311535-project Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: fa14eab6cf2e49419dfc7e266e3bb63c Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1915311535-project Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance is not a member of specified network Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '1e8bbb2a-12e2-4562-87ac-c806d8003e34', 'id': 'invalid'} Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 03 10:49:08.241022 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.245778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:08.246917 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f472bb0-3f06-44e4-83b2-488ca68981a6 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.095638 Oct 03 10:49:08.249829 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2303/4355] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:49:08 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34/ips/invalid => generated 91 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:49:08.261410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1894ac2a-5e92-4c28-af1f-0083f430397d tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:08.262752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1894ac2a-5e92-4c28-af1f-0083f430397d tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Failed to fetch instance by id 999 {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 10:49:08.263602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1894ac2a-5e92-4c28-af1f-0083f430397d tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] HTTP exception thrown: Instance 999 could not be found. Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1894ac2a-5e92-4c28-af1f-0083f430397d tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Request method failure captured: Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr4E3InrrnB9DSj_K0GUp8enr7otxy-iGGPiF48PhSENQZDt4u9BdezPzpToXPxbL5A0KHyy-aih-OxejPnh8xJ2vBsP71zHy4JtawMXkLnYTH4AiQPMyD9WMOIwZGNf4cnrf6t0_xVIG5AlAnwAq_T7EOYGNX8Fw44H0HuJ_i1nodg Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f1cd8a468d714471b5e254fcc5fc048b Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1cd8a468d714471b5e254fcc5fc048b"}]}] Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f1cd8a468d714471b5e254fcc5fc048b Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerAddressesNegativeTestJSON-1915311535-project Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: fa14eab6cf2e49419dfc7e266e3bb63c Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1915311535-project Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 999 could not be found. Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '999'} Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 03 10:49:08.267280 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:08.270848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1894ac2a-5e92-4c28-af1f-0083f430397d tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:08.270848 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1894ac2a-5e92-4c28-af1f-0083f430397d tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013666 Oct 03 10:49:08.270848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2304/4356] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:49:08 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:49:08.303726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:08.305222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:08.334447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:08.349910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:08.350670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:08.351618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:08.352317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:08.352964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:08.358207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:08.386476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:08.395620 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc49a326-9743-4e63-bc85-4023b8c5e088 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.487100 Oct 03 10:49:08.396209 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2053/4357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:07 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:08.447446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:49:08.483708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc44384b-afda-4035-9983-81551a442335 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074faa1ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:08.594138 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc44384b-afda-4035-9983-81551a442335 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.115006 Oct 03 10:49:08.594739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2054/4358] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:08 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:08.689211 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8f7df220-4722-47b1-8d78-af85897c56e4 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 204 len: 0 microversion: 2.1 time: 0.409864 Oct 03 10:49:08.690350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2305/4359] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:49:08 2022] DELETE /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:49:08.699759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:08.700370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:08.710283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:08.710782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:08.711341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:08.712057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:08.712572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:08.713140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:09.264540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:09.273706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab44fe10-d857-4659-a179-901f5e7889b5 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1527 microversion: 2.1 time: 0.578936 Oct 03 10:49:09.292796 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2055/4360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:08 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1527 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:09.612235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cafe2a0d-ef22-4a60-9281-1f1eb4ec31e4 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e56caf0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:09.772229 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cafe2a0d-ef22-4a60-9281-1f1eb4ec31e4 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.165426 Oct 03 10:49:09.775391 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2306/4361] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:09 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:10.305674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:10.306931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:10.316449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:10.324002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:10.324713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:10.327120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:10.335630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:10.336245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:10.791898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-418487c4-19cc-40e0-9580-63b7b5cefdd1 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e01a3a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:10.888357 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-418487c4-19cc-40e0-9580-63b7b5cefdd1 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.101717 Oct 03 10:49:10.902254 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2307/4362] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:10 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:11.226186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:11.245792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7af158c9-e1b9-445f-a574-d114c3f0e553 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1527 microversion: 2.1 time: 0.943567 Oct 03 10:49:11.246416 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2056/4363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:10 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1527 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:11.817991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:11.819677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:11.828814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:11.829663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:11.830421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:11.831350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:11.831990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:11.832597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:11.865514 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9b0e8f2-5c35-4a61-aa2f-2ebdfac09c58 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/ips" status: 200 len: 152 microversion: 2.20 time: 0.051970 Oct 03 10:49:11.866787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2308/4364] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Oct 3 10:49:11 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:49:11.905293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b8e7e748-0606-4625-9266-b30f866f4da3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f5a98b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:12.009542 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b8e7e748-0606-4625-9266-b30f866f4da3 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.109421 Oct 03 10:49:12.010502 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2057/4365] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:11 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:12.273900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:12.274794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:12.303260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:12.304118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:12.305434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:12.307618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:12.311377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:12.312920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:12.903668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e7ea7ff-fb15-40d4-b089-8e652a3cd1b0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-286525742", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "destination_type": "local"}, {"source_type": "volume", "uuid": "d42cf0a1-a4b7-47a5-a635-40a3d1f97296", "destination_type": "invalid"}], "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e7ea7ff-fb15-40d4-b089-8e652a3cd1b0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 494 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-286525742", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "destination_type": "local"}, {"source_type": "volume", "uuid": "d42cf0a1-a4b7-47a5-a635-40a3d1f97296", "destination_type": "invalid"}], "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-286525742', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd42cf0a1-a4b7-47a5-a635-40a3d1f97296', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:12.908612 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 03 10:49:12.912695 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:12.918440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e7ea7ff-fb15-40d4-b089-8e652a3cd1b0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:12.919500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e7ea7ff-fb15-40d4-b089-8e652a3cd1b0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020201 Oct 03 10:49:12.922600 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2058/4366] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:12 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:12.943891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:12.948815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:12.969514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:12.977481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:12.978159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:12.979790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:12.985679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:12.987331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:13.547717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa14eab6cf2e49419dfc7e266e3bb63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1cd8a468d714471b5e254fcc5fc048b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:13.560845 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1dea3623-8755-4cb6-b845-b044769dfec0 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 200 len: 1527 microversion: 2.1 time: 1.292973 Oct 03 10:49:13.562425 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2309/4367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:12 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 1527 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:13.591467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c3a2e4b-62ca-4835-81f9-bf7b6c77a13f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e01af70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:13.706463 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c3a2e4b-62ca-4835-81f9-bf7b6c77a13f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.133588 Oct 03 10:49:13.707667 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2310/4368] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:13 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:13.726696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:13.739299 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0bc897d-1d83-449b-8c65-f96c99265b02 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.811405 Oct 03 10:49:13.739980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c9d090b1-5138-4855-9bce-c6cdce59404c req-601898b5-70df-4549-a4c6-69215f1ce148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8bbb2a-12e2-4562-87ac-c806d8003e34", "name": "network-vif-deleted", "tag": "553993e6-1f6b-4a87-b61d-088a455fa87a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:13.746528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2059/4369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:12 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:13.785068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:13.785967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:13.786897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c9d090b1-5138-4855-9bce-c6cdce59404c req-601898b5-70df-4549-a4c6-69215f1ce148 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:13.787403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c9d090b1-5138-4855-9bce-c6cdce59404c req-601898b5-70df-4549-a4c6-69215f1ce148 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:13.787846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c9d090b1-5138-4855-9bce-c6cdce59404c req-601898b5-70df-4549-a4c6-69215f1ce148 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:13.799296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:13.808875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:13.811133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:13.811965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:13.812450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:13.812941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:13.841518 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c9d090b1-5138-4855-9bce-c6cdce59404c req-601898b5-70df-4549-a4c6-69215f1ce148 service nova] Creating event network-vif-deleted:553993e6-1f6b-4a87-b61d-088a455fa87a for instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 on n-h2-858383-3 Oct 03 10:49:13.870757 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c9d090b1-5138-4855-9bce-c6cdce59404c req-601898b5-70df-4549-a4c6-69215f1ce148 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146960 Oct 03 10:49:13.873030 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2311/4370] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:14.346334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:14.365981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d24b8dc-8214-4f92-8f4a-fbd733e29d35 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.585161 Oct 03 10:49:14.366606 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2060/4371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:13 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:14.519096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06d0fe9f-f69a-48f6-b2cf-caad6adc9004 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-245832952", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06d0fe9f-f69a-48f6-b2cf-caad6adc9004 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 491 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-245832952", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-245832952', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.534557 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 10:49:14.542579 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.547635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06d0fe9f-f69a-48f6-b2cf-caad6adc9004 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:14.551842 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06d0fe9f-f69a-48f6-b2cf-caad6adc9004 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.041451 Oct 03 10:49:14.559151 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2312/4372] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:14 2022] POST /compute/v2.1/servers => generated 624 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:14.580320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:14.587974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:14.590156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] [instance: 1e8bbb2a-12e2-4562-87ac-c806d8003e34] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:14.600046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:14.621666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:14.623161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:14.623663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:14.624104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:14.624846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:14.625313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:14.625746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:14.638300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:14.638777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:14.639928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:14.640565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:14.641041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:14.671805 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] HTTP exception thrown: Instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 could not be found. Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Request method failure captured: Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 HTTP/1.1 Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr4E3InrrnB9DSj_K0GUp8enr7otxy-iGGPiF48PhSENQZDt4u9BdezPzpToXPxbL5A0KHyy-aih-OxejPnh8xJ2vBsP71zHy4JtawMXkLnYTH4AiQPMyD9WMOIwZGNf4cnrf6t0_xVIG5AlAnwAq_T7EOYGNX8Fw44H0HuJ_i1nodg Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f1cd8a468d714471b5e254fcc5fc048b Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1cd8a468d714471b5e254fcc5fc048b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1cd8a468d714471b5e254fcc5fc048b"}]}] Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f1cd8a468d714471b5e254fcc5fc048b Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1915311535 Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerAddressesNegativeTestJSON-1915311535-project Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: fa14eab6cf2e49419dfc7e266e3bb63c Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1915311535-project Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 could not be found. Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1e8bbb2a-12e2-4562-87ac-c806d8003e34'} Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 could not be found. Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 could not be found. Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.673435 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 could not be found. Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] Returning 404 to user: Instance 1e8bbb2a-12e2-4562-87ac-c806d8003e34 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c1a3872-a166-44a6-a649-d4f8ed7b3af3 tempest-ServerAddressesNegativeTestJSON-1915311535 tempest-ServerAddressesNegativeTestJSON-1915311535-project] 10.222.0.27 "GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34" status: 404 len: 111 microversion: 2.1 time: 0.091210 Oct 03 10:49:14.678491 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2313/4373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:14 2022] GET /compute/v2.1/servers/1e8bbb2a-12e2-4562-87ac-c806d8003e34 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:14.725017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf8f5c7f-bd64-4e56-bfb7-0d67e03d49a4 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e01ac10>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:14.819662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf8f5c7f-bd64-4e56-bfb7-0d67e03d49a4 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.100187 Oct 03 10:49:14.828405 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2314/4374] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:14 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:15.073427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:15.095400 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb7b150b-e7a5-4b8b-989e-5b69b51f0b57 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.532420 Oct 03 10:49:15.113824 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2061/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:14 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:15.132141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:15.133179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:15.155975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:15.165258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:15.166641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:15.168457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:15.169475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:15.170303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:15.292042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:15.292639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:15.312055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:15.314677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:15.315165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:15.315977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:15.317807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:15.318627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:15.397825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lazy-loading 'flavor' on Instance uuid 8eab68b2-c592-4556-b7dd-23edcc398ed4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:49:15.906279 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f3777b4-fd99-4349-ab04-25cf2c76f3d6 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/action" status: 202 len: 0 microversion: 2.20 time: 0.619803 Oct 03 10:49:15.908008 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2062/4376] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:49:15 2022] POST /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:49:15.918721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16d50619-429b-4f5a-a952-0afbf7bee766 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074fad00d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:16.010687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:16.019531 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-69de3470-f31d-45fe-9960-066dcb783a7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.893595 Oct 03 10:49:16.020118 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2315/4377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:15 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:16.051205 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16d50619-429b-4f5a-a952-0afbf7bee766 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.140552 Oct 03 10:49:16.054025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:16.054907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:16.058177 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2063/4378] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:15 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:16.078962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:16.079560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:16.080106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:16.080993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:16.081915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:16.082554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:16.237500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a6614a5-3a72-4661-b67a-aaa93ac211ab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a6614a5-3a72-4661-b67a-aaa93ac211ab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 416 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:16.242694 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:49:16.246117 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:16.254356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a6614a5-3a72-4661-b67a-aaa93ac211ab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:16.267754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a6614a5-3a72-4661-b67a-aaa93ac211ab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.025964 Oct 03 10:49:16.270444 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2064/4379] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:16 2022] POST /compute/v2.1/servers => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:16.289284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:16.292795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:16.319099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:16.324802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:16.329165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:16.334057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:16.335054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:16.336445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:16.799196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:16.811686 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-67c078dc-7afa-46bb-91d7-9b0f813a3981 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.532088 Oct 03 10:49:16.819472 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2065/4380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:16 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:16.853096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:16.853961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:16.884252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:16.884762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:16.885236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:16.894534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:16.895139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:16.895602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:17.287283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:17.296705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:17.298189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:17.315092 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a67adc07-2b4c-400c-9d75-f48483cff3cd tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 1.281072 Oct 03 10:49:17.315943 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2316/4381] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:16 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:17.354054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-352d9981-4634-45da-a0e3-a79e9c702e05 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e1a4af0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:17.474226 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-352d9981-4634-45da-a0e3-a79e9c702e05 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.157037 Oct 03 10:49:17.478645 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2317/4382] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:17 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:17.979871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:18.003428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:18.013307 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48622aa2-1042-4783-a83b-bbe269486631 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.161601 Oct 03 10:49:18.013978 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2066/4383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:16 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:18.345462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:18.346901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:18.372091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:18.381995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:18.382628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:18.383501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:18.384655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:18.385228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:18.385590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bc2a625-ac00-4eca-a58c-826ecb9dc855 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1570557331", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": -1, "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:18.422762 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1bc2a625-ac00-4eca-a58c-826ecb9dc855 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Flavor -1 could not be found. Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bc2a625-ac00-4eca-a58c-826ecb9dc855 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 206 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1570557331", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": -1, "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: exception: Flavor -1 could not be found. Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1570557331', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': -1, 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:18.424468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 03 10:49:18.429235 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:18.452017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bc2a625-ac00-4eca-a58c-826ecb9dc855 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:18.453246 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1bc2a625-ac00-4eca-a58c-826ecb9dc855 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.071506 Oct 03 10:49:18.456091 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2067/4384] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:18 2022] POST /compute/v2.1/servers => generated 73 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:49:18.463554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:18.476187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:18.490250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:18.490758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:18.491211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:18.491942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:18.492402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:18.492854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:19.063707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:19.092576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:19.094263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:19.096329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:19.098917 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a3fc144-750b-4805-84f1-2928d9bb9170 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.757630 Oct 03 10:49:19.103110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d36ef66-f50e-408d-9d4e-b3f95fe83be3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.643282 Oct 03 10:49:19.105586 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2318/4385] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:18 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:19.106643 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2068/4386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:18 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:19.113621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e7a8154-3766-4ac8-9582-f14aa9a23c46 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f6a3550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:19.134023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:19.134852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:19.153894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:19.154673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:19.155361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:19.156263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:19.156908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:19.157492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:19.226993 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e7a8154-3766-4ac8-9582-f14aa9a23c46 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.119913 Oct 03 10:49:19.233561 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2319/4387] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:19 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:20.201309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:20.202681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:20.238775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:20.239509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:20.240192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:20.241102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:20.246080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:20.246722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:20.549269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:20.558159 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47c028fc-9236-4a72-839f-39b5e0fc3584 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.429921 Oct 03 10:49:20.565734 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2069/4388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:19 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:20.578993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d2c69f0-9599-47bc-9d6e-90de6373791f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f74e670>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:20.677883 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d2c69f0-9599-47bc-9d6e-90de6373791f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.110667 Oct 03 10:49:20.678605 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2070/4389] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:20 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:20.737087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4abc8d3-6bee-402a-a84e-69b35f423c0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1702412184", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4abc8d3-6bee-402a-a84e-69b35f423c0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 173 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1702412184", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1702412184', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi -1 Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:49:20.741522 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 03 10:49:20.745822 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:20.746832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4abc8d3-6bee-402a-a84e-69b35f423c0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:20.748021 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d4abc8d3-6bee-402a-a84e-69b35f423c0b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.014959 Oct 03 10:49:20.749997 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2071/4390] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:20 2022] POST /compute/v2.1/servers => generated 145 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:20.758222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:20.767442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:20.779125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:20.789627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:20.790486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:20.791784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:20.792507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:20.793206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:20.846397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:20.858082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:20.864758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:20.867676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e98ce6e-3b2c-45b2-82fa-5df64732aa4c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.670841 Oct 03 10:49:20.884587 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2320/4391] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:20 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:21.697895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a805486-a0c7-4cae-a00e-031bdc0d469a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e07ba60>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:21.772505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a805486-a0c7-4cae-a00e-031bdc0d469a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.081803 Oct 03 10:49:21.773962 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2321/4392] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:21 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:21.903680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:21.904804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:21.921963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:21.922898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:21.924937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:21.928008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:21.928839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:21.931238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:22.108943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:22.121113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e10cddaf-de42-48bc-8187-1b3e96933473 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.366182 Oct 03 10:49:22.134614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2072/4393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:20 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:22.155824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:22.156451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:22.177498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=48 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:22.179300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:22.179822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:22.180256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:22.181140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:22.181605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:22.182034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:22.478708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:22.492748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:22.497481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:22.502696 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7905a13c-2e03-4864-b827-96b2c54e53a7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.602986 Oct 03 10:49:22.507102 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2322/4394] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:21 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:22.793065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44026467-d384-4909-b59b-051d7656ee95 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e07b670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:22.872974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44026467-d384-4909-b59b-051d7656ee95 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.085609 Oct 03 10:49:22.881860 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2323/4395] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:22 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:22.929103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:22.938589 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-186415d1-d829-4d44-8847-26a6f4288720 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.786641 Oct 03 10:49:22.941889 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2073/4396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:22 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:23.032031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44774bdd-df50-441d-be22-8f06c176c5cf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-525691151", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:23.037302 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-44774bdd-df50-441d-be22-8f06c176c5cf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44774bdd-df50-441d-be22-8f06c176c5cf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 215 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-525691151", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-525691151', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:23.038806 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:23.044170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44774bdd-df50-441d-be22-8f06c176c5cf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:23.052388 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44774bdd-df50-441d-be22-8f06c176c5cf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.024491 Oct 03 10:49:23.056483 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2324/4397] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:23 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:23.066147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:23.067056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:23.095496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:23.099151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:23.099903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:23.104757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:23.107538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:23.108021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:23.533084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:23.533965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:23.565147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:23.565658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:23.566280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:23.567487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:23.569254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:23.574233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:23.992088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:24.015199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:24.023136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:24.027963 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-88907d28-d3f3-4b0e-9165-8a85bd388dd0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.499702 Oct 03 10:49:24.038043 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2325/4398] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:23 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:24.058659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1743a1a-89a5-4b37-9f62-17167ab1f97f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074eb5f4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:24.160665 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1743a1a-89a5-4b37-9f62-17167ab1f97f tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.121212 Oct 03 10:49:24.161825 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2326/4399] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:24 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:24.288274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:24.306215 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2be75287-1e23-4598-be64-28d639754c07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.244670 Oct 03 10:49:24.310297 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2074/4400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:23 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:24.342559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:24.344593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:24.359987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:24.364205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:24.364891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:24.368264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:24.369286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:24.370396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:24.938336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:24.953729 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e226c1a-3ded-42fa-9b20-070349139914 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.616876 Oct 03 10:49:24.958472 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2327/4401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:24 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:25.058142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81976cb6-01ca-4d8a-b8eb-086f4ef76f7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-722875787", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-key-1452080457", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:25.070333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:25.070953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:25.088285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:25.088869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:25.089322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:25.100265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:25.100854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:25.114484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:25.190567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-81976cb6-01ca-4d8a-b8eb-086f4ef76f7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] validate_networks() for [('e7ae23a2-3981-4e49-a241-72d811fa94dc', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:49:25.645318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:25.654424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:25.670415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:25.681653 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24941467-49a3-4f28-8307-9d51f586796b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.616525 Oct 03 10:49:25.689809 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2328/4402] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:25 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:49:25.689809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a315a0e-33ea-4d10-9ce3-a6e69e16d9df tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e078430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:25.835813 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a315a0e-33ea-4d10-9ce3-a6e69e16d9df tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.151721 Oct 03 10:49:25.839450 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2329/4403] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:25 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:26.534259 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-81976cb6-01ca-4d8a-b8eb-086f4ef76f7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Invalid key_name provided. Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81976cb6-01ca-4d8a-b8eb-086f4ef76f7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 246 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-722875787", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-key-1452080457", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid key_name provided. Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-722875787', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'key_name': 'tempest-key-1452080457', 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1452080457 not found for user 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:26.537003 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 03 10:49:26.542058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:26.545923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81976cb6-01ca-4d8a-b8eb-086f4ef76f7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid key_name provided. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:26.548004 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81976cb6-01ca-4d8a-b8eb-086f4ef76f7c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.495722 Oct 03 10:49:26.554137 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2075/4404] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:25 2022] POST /compute/v2.1/servers => generated 70 bytes in 1502 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:49:26.569209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:26.569897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:26.581556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:26.589159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:26.591190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:26.594019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:26.595581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:26.598608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:26.599691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:26.713214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:26.713458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:26.727092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:26.727586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:26.728022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:26.728733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:26.729876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:26.730299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:27.119488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:27.129829 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81d39ddf-fd7a-4729-a2cd-294de89de367 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.573896 Oct 03 10:49:27.135796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2330/4405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:26 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:27.143236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a92c965f-adc1-4da8-b926-b70ddf83cd72 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e078e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:27.275545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a92c965f-adc1-4da8-b926-b70ddf83cd72 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.137749 Oct 03 10:49:27.288151 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2331/4406] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:27 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:27.310214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:27.313683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:27.333646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:27.335134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:27.335696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:27.336548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:27.340493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:27.341969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:27.808375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:27.822881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:27.824469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:27.835424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-388b1acd-29b5-43fc-a054-29096c06a10e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 1.129631 Oct 03 10:49:27.836029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2076/4407] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:26 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:28.305404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-683eddd2-361b-4728-98df-80670d87034a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f240940>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:28.422231 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-683eddd2-361b-4728-98df-80670d87034a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.122276 Oct 03 10:49:28.430371 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2077/4408] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:28 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:28.621295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:28.645243 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d3a6a80-ddbb-4f63-ac72-6392789fcaa6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.355497 Oct 03 10:49:28.645866 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2332/4409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:27 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:28.813808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ebdcdf94-62f3-47c7-8b2f-2d9115584054 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2030515742", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:28.871211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:28.873151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:28.884631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:28.888188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:28.888755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:28.890641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:28.891220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:28.893694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:29.247331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.security_group_api [None req-ebdcdf94-62f3-47c7-8b2f-2d9115584054 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Neutron security group does_not_exist not found {{(pid=122270) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 03 10:49:29.247922 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-ebdcdf94-62f3-47c7-8b2f-2d9115584054 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ebdcdf94-62f3-47c7-8b2f-2d9115584054 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 258 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2030515742", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2030515742', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 03 10:49:29.262251 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 03 10:49:29.266698 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:29.271461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ebdcdf94-62f3-47c7-8b2f-2d9115584054 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:29.274096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ebdcdf94-62f3-47c7-8b2f-2d9115584054 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.462934 Oct 03 10:49:29.275217 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2078/4410] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:28 2022] POST /compute/v2.1/servers => generated 106 bytes in 466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:29.284396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:29.285342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:29.297621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:29.302547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:29.303285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:29.304456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:29.305133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:29.306143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:29.755384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:29.770403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:29.772093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:29.773364 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-803e4c0d-cd93-49dd-bfa5-a1fb655f1c7a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1746 microversion: 2.20 time: 0.909660 Oct 03 10:49:29.773940 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2333/4411] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:28 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1746 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:29.797132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0868fde-69ce-4b10-a57b-3c647617838a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e039e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:29.904630 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0868fde-69ce-4b10-a57b-3c647617838a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.129548 Oct 03 10:49:29.905602 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2334/4412] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:29 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:30.138899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:30.158246 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7149f880-5f00-4ff1-a714-c9a45e19e6fe tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.878299 Oct 03 10:49:30.171767 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2079/4413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:29 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:30.199930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:30.200637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:30.204809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-595e98b4-4f30-4ae7-acd1-1a1df3c805c8 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Action: 'create', calling method: .version_select at 0x7f074e562790>, body: {"keypair": {"name": "tempest-keypair-1005553871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHyRNIk5/1CJseGCiV+oJUb2C8EsbWIvucrzESz4/RG8clDcJawlcsj5uDRta+KveoF7Y4NBTDTHTeEcRs89xfA1JbUmNqrsKMLdy5YuJaAUO6YK6ScEuDcVwtchIeM4g=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:30.230113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:30.235520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:30.236883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:30.239760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:30.240510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-595e98b4-4f30-4ae7-acd1-1a1df3c805c8 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Getting quotas for project 18c6e7a9dc66452bb503b0c12ced7fbd. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:49:30.243059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:30.246290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:30.254799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-595e98b4-4f30-4ae7-acd1-1a1df3c805c8 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Getting quotas for user 40a6898c70f54610920b8c9057811ce4 and project 18c6e7a9dc66452bb503b0c12ced7fbd. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:49:30.335730 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-595e98b4-4f30-4ae7-acd1-1a1df3c805c8 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.426061 Oct 03 10:49:30.336705 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2335/4414] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:49:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:30.805167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:30.806000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:30.820429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:30.821007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:30.821458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:30.822186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:30.822646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:30.823644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:31.030815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:31.072113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5afa59b5-c83a-44c3-a90e-12d757f869fa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.873564 Oct 03 10:49:31.075752 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2080/4415] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:30 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:31.092279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-89fd8e34-0951-4687-95c1-b310c8cdf8ef tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f1a2d30>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:31.280407 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-89fd8e34-0951-4687-95c1-b310c8cdf8ef tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1450 microversion: 2.1 time: 0.201083 Oct 03 10:49:31.284441 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2081/4416] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:31 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1450 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:31.309302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c26bebdb-20ae-4f7a-a7fa-e9008419ee09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:31.309903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c26bebdb-20ae-4f7a-a7fa-e9008419ee09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: c5ff0531-464c-4445-9e12-a116d7a61f60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:31.330126 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c26bebdb-20ae-4f7a-a7fa-e9008419ee09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance c5ff0531-464c-4445-9e12-a116d7a61f60 could not be found. Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c26bebdb-20ae-4f7a-a7fa-e9008419ee09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/c5ff0531-464c-4445-9e12-a116d7a61f60 HTTP/1.1 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c5ff0531-464c-4445-9e12-a116d7a61f60 could not be found. Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'c5ff0531-464c-4445-9e12-a116d7a61f60'} Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ff0531-464c-4445-9e12-a116d7a61f60 could not be found. Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ff0531-464c-4445-9e12-a116d7a61f60 could not be found. Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:31.337753 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ff0531-464c-4445-9e12-a116d7a61f60 could not be found. Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:31.341346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c26bebdb-20ae-4f7a-a7fa-e9008419ee09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance c5ff0531-464c-4445-9e12-a116d7a61f60 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:31.342763 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c26bebdb-20ae-4f7a-a7fa-e9008419ee09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5ff0531-464c-4445-9e12-a116d7a61f60" status: 404 len: 111 microversion: 2.1 time: 0.052880 Oct 03 10:49:31.345840 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2082/4417] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:49:31 2022] DELETE /compute/v2.1/servers/c5ff0531-464c-4445-9e12-a116d7a61f60 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:31.371484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:31.373533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:31.397975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:31.400083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:31.402893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:31.405364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:31.407522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:31.409484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:31.592605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:31.596636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:31.607186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:31.614293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:31.616466 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80b038c2-8779-470f-ac60-00ac3ba0255b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1746 microversion: 2.20 time: 0.815766 Oct 03 10:49:31.622131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2336/4418] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:30 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1746 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:32.180432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:32.192666 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cebf0cea-4390-420f-b8fe-0e8d8adcd8bf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.841655 Oct 03 10:49:32.193896 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2083/4419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:31 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:32.220326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:32.221102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:32.259646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:32.260199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:32.260859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:32.261597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:32.262296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:32.262743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:32.305830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b0ad37e-7813-4eb8-ac84-53ef8e3b8ed8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f07573e31f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:32.415577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b0ad37e-7813-4eb8-ac84-53ef8e3b8ed8 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1459 microversion: 2.1 time: 0.122442 Oct 03 10:49:32.416497 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2084/4420] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:32 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1459 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:32.432667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd0e6d59-0ba6-4923-95be-e38225f8aa45 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea0d8b0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:32.591732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd0e6d59-0ba6-4923-95be-e38225f8aa45 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 200 len: 1459 microversion: 2.1 time: 0.164527 Oct 03 10:49:32.595327 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2085/4421] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:32 2022] GET /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:49:32.625917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:32.626903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:32.636941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:32.637716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:32.638950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:32.639952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:32.640631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:32.641312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:32.962580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:32.974195 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32cee477-e9ef-4c62-b57f-05ad23f61c9f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.758385 Oct 03 10:49:32.974805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2337/4422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:32 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:32.996001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:32.996992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:33.021777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:33.022280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:33.022807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:33.023445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:33.023899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:33.024328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:33.497489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:33.512551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:33.518937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:33.523449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f28e1c40-95d8-46e2-af67-0c1c98e58ad8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1746 microversion: 2.20 time: 0.543600 Oct 03 10:49:33.525572 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2338/4423] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:32 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1746 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:33.534498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac2c1ed5-cdd2-453c-a339-42941b987f60 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:33.535345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac2c1ed5-cdd2-453c-a339-42941b987f60 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 10:49:33.536064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ac2c1ed5-cdd2-453c-a339-42941b987f60 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac2c1ed5-cdd2-453c-a339-42941b987f60 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 9223372036854775808 could not be found. Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '9223372036854775808'} Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:33.538045 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:33.541803 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:33.541803 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:33.541803 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:33.541803 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 03 10:49:33.541803 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:33.542172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:33.544215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac2c1ed5-cdd2-453c-a339-42941b987f60 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:33.545321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac2c1ed5-cdd2-453c-a339-42941b987f60 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016987 Oct 03 10:49:33.546291 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2339/4424] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 3 10:49:33 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:49:33.551296 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-418a1efe-5f8c-4651-8678-8dc1e44ede6c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 200 len: 1467 microversion: 2.1 time: 0.944670 Oct 03 10:49:33.554421 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2086/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:32 2022] GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 1467 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:33.562952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:33.565802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:33.585458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a7772c1-d7d7-4e5f-9b37-fc60bc447113 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea0d550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:33.597804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:33.600883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:33.602442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:33.602442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:33.606792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:33.607508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:33.814953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a7772c1-d7d7-4e5f-9b37-fc60bc447113 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-10-03T10%3A46%3A55Z" status: 200 len: 1901 microversion: 2.1 time: 0.234298 Oct 03 10:49:33.818392 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2087/4426] 10.222.0.27 () {58 vars in 1199 bytes} [Mon Oct 3 10:49:33 2022] GET /compute/v2.1/images?changes-since=2022-10-03T10%3A46%3A55Z => generated 1901 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:33.835977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f396fd35-c585-41b1-b78d-70028ac223f0 req-29ee6822-e861-4fb2-8a32-18e6d3dc7660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "name": "network-vif-plugged", "status": "completed", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:33.885928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f396fd35-c585-41b1-b78d-70028ac223f0 req-29ee6822-e861-4fb2-8a32-18e6d3dc7660 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:33.888677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f396fd35-c585-41b1-b78d-70028ac223f0 req-29ee6822-e861-4fb2-8a32-18e6d3dc7660 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:33.890463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f396fd35-c585-41b1-b78d-70028ac223f0 req-29ee6822-e861-4fb2-8a32-18e6d3dc7660 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:33.914069 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f396fd35-c585-41b1-b78d-70028ac223f0 req-29ee6822-e861-4fb2-8a32-18e6d3dc7660 service nova] Creating event network-vif-plugged:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h1-858383-3 Oct 03 10:49:33.947150 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f396fd35-c585-41b1-b78d-70028ac223f0 req-29ee6822-e861-4fb2-8a32-18e6d3dc7660 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122424 Oct 03 10:49:33.949004 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2088/4427] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:33.960142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e2209b85-7838-4e27-8e82-2fcf2997538a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f07573e3790>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:34.083174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e2209b85-7838-4e27-8e82-2fcf2997538a tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1908561817" status: 200 len: 485 microversion: 2.1 time: 0.132639 Oct 03 10:49:34.084395 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2089/4428] 10.222.0.27 () {58 vars in 1231 bytes} [Mon Oct 3 10:49:33 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1908561817 => generated 485 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:34.122391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8b6fb70-f476-4d98-a66e-f94a9382e435 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074ea6ca60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:34.133286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:34.155510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bba8e58f-53fe-468a-b42d-ea8f33a7e635 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.603728 Oct 03 10:49:34.156108 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2340/4429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:33 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:34.186026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:34.186814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:34.203348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:34.203861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:34.204301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:34.209954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:34.210615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:34.211215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:34.364248 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8b6fb70-f476-4d98-a66e-f94a9382e435 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?server=d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 200 len: 956 microversion: 2.1 time: 0.254817 Oct 03 10:49:34.370823 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2090/4430] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 3 10:49:34 2022] GET /compute/v2.1/images?server=d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 956 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:34.385754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-54194d7d-59a5-4e12-9a5b-65b12220999e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f07573e31f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:34.516093 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-54194d7d-59a5-4e12-9a5b-65b12220999e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 484 microversion: 2.1 time: 0.135059 Oct 03 10:49:34.518427 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2091/4431] 10.222.0.27 () {58 vars in 1317 bytes} [Mon Oct 3 10:49:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 484 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:34.532180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e526c7ad-a7bd-4978-9d84-b6dcec9c8bf5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f74e550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:34.684282 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e526c7ad-a7bd-4978-9d84-b6dcec9c8bf5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 484 microversion: 2.1 time: 0.157263 Oct 03 10:49:34.685875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2092/4432] 10.222.0.27 () {58 vars in 1303 bytes} [Mon Oct 3 10:49:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 484 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:49:34.703510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:34.707679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:34.728746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:34.734693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:34.735285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:34.736062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:34.736543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:34.738735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:35.014491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:35.027395 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d208a51-17e4-4db4-815e-fbe2dec17dfd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.844657 Oct 03 10:49:35.030101 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2341/4433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:34 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:35.047134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d723fc7d-205d-4ef4-bcf2-d6c985431cd5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e005430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:35.279294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:35.290268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:35.297798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:35.300471 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0501317a-b050-423a-944a-c075f06382f5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.612020 Oct 03 10:49:35.301141 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2093/4434] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:34 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:35.336991 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d723fc7d-205d-4ef4-bcf2-d6c985431cd5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.302299 Oct 03 10:49:35.337244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b3438e23-6545-4ca0-9cb6-68c87dc96cbf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:35.337854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b3438e23-6545-4ca0-9cb6-68c87dc96cbf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Failed to fetch instance by id -1 {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 10:49:35.338439 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b3438e23-6545-4ca0-9cb6-68c87dc96cbf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance -1 could not be found. Oct 03 10:49:35.341268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2342/4435] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:49:35 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b3438e23-6545-4ca0-9cb6-68c87dc96cbf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance -1 could not be found. Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '-1'} Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:35.343287 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:35.347285 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:35.347285 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:35.347285 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 03 10:49:35.347285 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:35.359654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b3438e23-6545-4ca0-9cb6-68c87dc96cbf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:35.360167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce690092-3a20-4a66-b9a4-1116d6d20c8c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e039670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:35.363321 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b3438e23-6545-4ca0-9cb6-68c87dc96cbf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.059012 Oct 03 10:49:35.364490 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2094/4436] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:49:35 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:49:35.387660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:35.391105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:35.431262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:35.431861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:35.438719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:35.441061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:35.441575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:35.446687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:35.467094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce690092-3a20-4a66-b9a4-1116d6d20c8c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.113926 Oct 03 10:49:35.468538 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2343/4437] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 10:49:35 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:35.483847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f2439f4-0d4e-465e-8252-9964f35853a5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f3c3b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:35.575486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f2439f4-0d4e-465e-8252-9964f35853a5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.095115 Oct 03 10:49:35.577220 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2344/4438] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:49:35 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:35.600752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5541c4ff-c92c-4f32-a924-c68e5c2754d1 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e21e9d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:36.069646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:36.081206 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d57f79de-5710-42fd-8cdb-07f1f1dcf15c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.712496 Oct 03 10:49:36.090280 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2095/4439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:35 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:36.116713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:36.120222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:36.129439 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5541c4ff-c92c-4f32-a924-c68e5c2754d1 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-10-03T10%3A46%3A49Z" status: 200 len: 6320 microversion: 2.1 time: 0.543420 Oct 03 10:49:36.145338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:36.150096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:36.154172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:36.154956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:36.155450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:36.155895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:36.164863 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2345/4440] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Oct 3 10:49:35 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-03T10%3A46%3A49Z => generated 6320 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:36.188649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-45b7cc2b-5114-4c81-b330-7eb72d057928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e02df70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:36.298124 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-45b7cc2b-5114-4c81-b330-7eb72d057928 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1908561817" status: 200 len: 665 microversion: 2.1 time: 0.131967 Oct 03 10:49:36.299965 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2346/4441] 10.222.0.27 () {58 vars in 1252 bytes} [Mon Oct 3 10:49:36 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1908561817 => generated 665 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:36.332584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-49f65ce1-d884-49a5-b925-c23091655e48 req-b2505a16-8478-4bc4-a283-0e2896343613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fe7879-6f32-4d3b-8038-a4f40f154995", "name": "network-vif-unplugged", "status": "completed", "tag": "873702af-4840-46a1-b693-3ceb18ce3a18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:36.374504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-49f65ce1-d884-49a5-b925-c23091655e48 req-b2505a16-8478-4bc4-a283-0e2896343613 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:36.380740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-49f65ce1-d884-49a5-b925-c23091655e48 req-b2505a16-8478-4bc4-a283-0e2896343613 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:36.384321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-49f65ce1-d884-49a5-b925-c23091655e48 req-b2505a16-8478-4bc4-a283-0e2896343613 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:36.420893 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-49f65ce1-d884-49a5-b925-c23091655e48 req-b2505a16-8478-4bc4-a283-0e2896343613 service nova] Creating event network-vif-unplugged:873702af-4840-46a1-b693-3ceb18ce3a18 for instance d4fe7879-6f32-4d3b-8038-a4f40f154995 on n-h2-858383-3 Oct 03 10:49:36.442557 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-49f65ce1-d884-49a5-b925-c23091655e48 req-b2505a16-8478-4bc4-a283-0e2896343613 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126640 Oct 03 10:49:36.446365 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2347/4442] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:36.982849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:37.007604 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7488a07-e9c2-49b1-8d4e-fd91262bc9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.893470 Oct 03 10:49:37.009430 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2096/4443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:36 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:37.022195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a5f0c41-9062-47e4-8aa5-4bf4ff69077e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f0d95e0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:37.043419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1172380613", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "967a4e96-46ad-4f80-a610-59e8b0570b92"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:37.116744 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a5f0c41-9062-47e4-8aa5-4bf4ff69077e tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1462 microversion: 2.1 time: 0.105149 Oct 03 10:49:37.119306 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2097/4444] 10.222.0.27 () {58 vars in 1338 bytes} [Mon Oct 3 10:49:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:37.135000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:37.141822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:37.169693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:37.170669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:37.171537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:37.172522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:37.173255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:37.174064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:37.257710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] validate_networks() for [('967a4e96-46ad-4f80-a610-59e8b0570b92', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:49:37.811738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:37.826385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:37.834740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:37.837093 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e2ad910-30e7-4988-a2cd-b3e32a28fd8f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.715266 Oct 03 10:49:37.854042 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2098/4445] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:37 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:37.890879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43853aa8-b719-4285-9b89-59005c9651e2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:37.895527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43853aa8-b719-4285-9b89-59005c9651e2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: ac744ed1-9ff1-4fbb-9859-ea817215a07e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:37.917792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-43853aa8-b719-4285-9b89-59005c9651e2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance ac744ed1-9ff1-4fbb-9859-ea817215a07e could not be found. Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43853aa8-b719-4285-9b89-59005c9651e2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/ac744ed1-9ff1-4fbb-9859-ea817215a07e/action HTTP/1.1 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 19 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: {"forceDelete": {}} Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ac744ed1-9ff1-4fbb-9859-ea817215a07e could not be found. Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ac744ed1-9ff1-4fbb-9859-ea817215a07e', 'body': {'forceDelete': {}}} Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac744ed1-9ff1-4fbb-9859-ea817215a07e could not be found. Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac744ed1-9ff1-4fbb-9859-ea817215a07e could not be found. Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:37.932500 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:37.936200 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:37.936200 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:37.936200 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac744ed1-9ff1-4fbb-9859-ea817215a07e could not be found. Oct 03 10:49:37.936200 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:37.937477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43853aa8-b719-4285-9b89-59005c9651e2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance ac744ed1-9ff1-4fbb-9859-ea817215a07e could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:37.945950 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43853aa8-b719-4285-9b89-59005c9651e2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/ac744ed1-9ff1-4fbb-9859-ea817215a07e/action" status: 404 len: 111 microversion: 2.1 time: 0.078732 Oct 03 10:49:37.951168 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2099/4446] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:49:37 2022] POST /compute/v2.1/servers/ac744ed1-9ff1-4fbb-9859-ea817215a07e/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:37.958717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8df18623-6027-4bd7-8371-6f2be1a04325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f0757492280>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:38.090701 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8df18623-6027-4bd7-8371-6f2be1a04325 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1462 microversion: 2.1 time: 0.137262 Oct 03 10:49:38.091882 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2100/4447] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Oct 3 10:49:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1462 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:38.107236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-53659597", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dbe6d841-1986-4f9d-a7cb-fec5f10c8f4c"}], "security_groups": [{"name": "tempest-securitygroup--2059449617"}], "key_name": "tempest-keypair-1005553871", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:38.386312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] validate_networks() for [('dbe6d841-1986-4f9d-a7cb-fec5f10c8f4c', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:49:38.431003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:49:38.431540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:49:38.432604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:49:38.433107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:49:38.433715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:49:38.475658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:38.481202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:38.481671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:38.490739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:38.500447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:38.501050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:38.628339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Getting quotas for project 0e46f1d4b99b42ec9afed29330f9eb13. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:49:38.652969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Getting quotas for user 62a9c644f6294185bdf01b3af30ff1ff and project 0e46f1d4b99b42ec9afed29330f9eb13. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:49:38.714920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:49:38.717649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:49:38.891936 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-290a27ce-f14b-404a-beb6-7d080b449660 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.437158 Oct 03 10:49:38.896740 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2348/4448] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:49:38.906163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:38.906829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:38.947723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:38.950527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:38.953293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:38.962315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:38.962774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:38.968943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:39.579311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Getting quotas for project 18c6e7a9dc66452bb503b0c12ced7fbd. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:49:39.585481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:39.591846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Getting quotas for user 40a6898c70f54610920b8c9057811ce4 and project 18c6e7a9dc66452bb503b0c12ced7fbd. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:49:39.604950 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-554084dc-8caa-40f7-966c-ff6d222c5357 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.706899 Oct 03 10:49:39.617400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2349/4449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:38 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:39.617400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d902a898-471f-4799-9efc-873ce579854c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e039790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:39.627868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:49:39.629324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:49:39.629825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:49:39.630917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:49:39.630917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:49:39.656281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:39.656809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:39.663221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:39.675958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:39.678442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:39.679084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:39.761120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Getting quotas for project 18c6e7a9dc66452bb503b0c12ced7fbd. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:49:39.788567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Getting quotas for user 40a6898c70f54610920b8c9057811ce4 and project 18c6e7a9dc66452bb503b0c12ced7fbd. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:49:39.851923 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d902a898-471f-4799-9efc-873ce579854c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7095 microversion: 2.1 time: 0.240376 Oct 03 10:49:39.857003 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2350/4450] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 3 10:49:39 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7095 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:39.866969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:49:39.870047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:49:39.881734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:39.887549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:39.910674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:39.911522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:39.912463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:39.913551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:39.914280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:39.914984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:40.115376 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c854c25e-94ce-4dbf-9917-f65eca49bdb0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.009035 Oct 03 10:49:40.120163 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2101/4451] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:49:40.193839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43a425b1-b92b-433b-b7ce-724c93abbe49 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:40.195888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43a425b1-b92b-433b-b7ce-724c93abbe49 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:40.354428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:40.370883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:40.379258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:40.380045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43a425b1-b92b-433b-b7ce-724c93abbe49 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:40.386412 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7a1efb6-5316-4928-9298-ee991166aaf0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.528149 Oct 03 10:49:40.394661 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43a425b1-b92b-433b-b7ce-724c93abbe49 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1228 microversion: 2.1 time: 0.265336 Oct 03 10:49:40.402582 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2102/4452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:40 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1228 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:40.423148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2351/4453] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:39 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:40.425080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:40.427258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:40.434826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43532196-9f4b-46fd-a5af-ebc4e62c7d07 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e030790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:40.470362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:40.471577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:40.472030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:40.472780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:40.473246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:40.474859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:40.646545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43532196-9f4b-46fd-a5af-ebc4e62c7d07 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4362 microversion: 2.1 time: 0.222176 Oct 03 10:49:40.651847 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2352/4454] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 3 10:49:40 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:40.668099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-349fa807-2f4f-43d5-9396-2ac5cf21c9dd tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:40.673262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-349fa807-2f4f-43d5-9396-2ac5cf21c9dd tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:40.841173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:40.867606 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2c17506-73fa-4cb4-9325-631ef930bc76 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.461701 Oct 03 10:49:40.869693 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2103/4455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:40 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:40.882073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-818143ed-f824-4218-9e7c-dea62aabaf3c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f07a160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:40.992011 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-818143ed-f824-4218-9e7c-dea62aabaf3c tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/f290423a-28bb-43d3-ba8c-d44fc0f72e5f" status: 200 len: 784 microversion: 2.1 time: 0.116343 Oct 03 10:49:40.993101 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2104/4456] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Oct 3 10:49:40 2022] GET /compute/v2.1/images/f290423a-28bb-43d3-ba8c-d44fc0f72e5f => generated 784 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:41.012858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5a94a16-e121-41a7-b97c-b6c71beed723 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:41.020884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5a94a16-e121-41a7-b97c-b6c71beed723 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 045af1d2-1328-4c95-9e16-eab1e41093ae] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:41.053566 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a5a94a16-e121-41a7-b97c-b6c71beed723 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 045af1d2-1328-4c95-9e16-eab1e41093ae could not be found. Oct 03 10:49:41.060495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-349fa807-2f4f-43d5-9396-2ac5cf21c9dd tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5a94a16-e121-41a7-b97c-b6c71beed723 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/045af1d2-1328-4c95-9e16-eab1e41093ae/action HTTP/1.1 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 39 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: {"os-getConsoleOutput": {"length": 10}} Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 045af1d2-1328-4c95-9e16-eab1e41093ae could not be found. Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '045af1d2-1328-4c95-9e16-eab1e41093ae', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045af1d2-1328-4c95-9e16-eab1e41093ae could not be found. Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045af1d2-1328-4c95-9e16-eab1e41093ae could not be found. Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:41.062904 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:41.066440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:41.066440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:41.066440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:41.066440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:41.066440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045af1d2-1328-4c95-9e16-eab1e41093ae could not be found. Oct 03 10:49:41.066440 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:41.068526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5a94a16-e121-41a7-b97c-b6c71beed723 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 045af1d2-1328-4c95-9e16-eab1e41093ae could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:41.071872 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5a94a16-e121-41a7-b97c-b6c71beed723 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/045af1d2-1328-4c95-9e16-eab1e41093ae/action" status: 404 len: 111 microversion: 2.1 time: 0.075393 Oct 03 10:49:41.074139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2105/4457] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:49:40 2022] POST /compute/v2.1/servers/045af1d2-1328-4c95-9e16-eab1e41093ae/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:41.077967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-349fa807-2f4f-43d5-9396-2ac5cf21c9dd tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1268 microversion: 2.1 time: 0.420438 Oct 03 10:49:41.080713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc13c131-8dbb-43be-8680-7f3e6b64dfbd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f74eaf0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:41.099236 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2353/4458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:40 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1268 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:41.105758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:41.106378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:41.133871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:41.135702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:41.150604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:41.152377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:41.153193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:41.153971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:41.213555 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc13c131-8dbb-43be-8680-7f3e6b64dfbd tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1606 microversion: 2.1 time: 0.137969 Oct 03 10:49:41.214471 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2106/4459] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:49:41 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1606 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:41.270081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-60e3bc55-30c4-46eb-830a-283384730252 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f98e550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:41.944031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:41.967943 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0588b314-ea32-4137-a075-fca517537fb9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.857666 Oct 03 10:49:41.972585 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2354/4460] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:41 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:41.998880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:42.000537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:42.021501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.022537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.023999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.026793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.027683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.029366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.425711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:42.442814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:42.444304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:42.449996 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca04c8aa-8893-4ef2-8b4b-c165ce49bd88 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.475991 Oct 03 10:49:42.452176 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2355/4461] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:41 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:42.464126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:42.464807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:42.477529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.478203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.479591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.480509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.481917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.482993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.607032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:42.616676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19014ea1-1242-4d42-8703-eb8f25b13616 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1286 microversion: 2.1 time: 0.159136 Oct 03 10:49:42.617328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2356/4462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:42 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:42.640653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:42.641330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:42.655790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.656305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.656760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.657529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.657993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.658428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.852160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:42.862623 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-93acf8d8-f65d-413d-bd1a-f0cb48ee3c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.231126 Oct 03 10:49:42.881406 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2357/4463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:42 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:42.887510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:42.888360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:42.896236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.897092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.897743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.898621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:42.899981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:42.902093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:42.929102 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-60e3bc55-30c4-46eb-830a-283384730252 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d" status: 204 len: 0 microversion: 2.1 time: 1.693047 Oct 03 10:49:42.930129 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2107/4464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:41 2022] DELETE /compute/v2.1/images/5920eb9f-e5d6-4454-8248-2ea73a42255d => generated 0 bytes in 1699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:49:42.935557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22b5848c-776e-4be5-a8fe-a11de8ea347f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:42.936336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22b5848c-776e-4be5-a8fe-a11de8ea347f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 373016d0-f409-4582-a951-148afb91b047] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:42.951137 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-22b5848c-776e-4be5-a8fe-a11de8ea347f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 373016d0-f409-4582-a951-148afb91b047 could not be found. Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22b5848c-776e-4be5-a8fe-a11de8ea347f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/373016d0-f409-4582-a951-148afb91b047 HTTP/1.1 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 373016d0-f409-4582-a951-148afb91b047 could not be found. Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '373016d0-f409-4582-a951-148afb91b047'} Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373016d0-f409-4582-a951-148afb91b047 could not be found. Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373016d0-f409-4582-a951-148afb91b047 could not be found. Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:42.960389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:42.965928 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:42.965928 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:42.965928 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:42.965928 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373016d0-f409-4582-a951-148afb91b047 could not be found. Oct 03 10:49:42.965928 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:42.969782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22b5848c-776e-4be5-a8fe-a11de8ea347f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 373016d0-f409-4582-a951-148afb91b047 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:42.970948 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22b5848c-776e-4be5-a8fe-a11de8ea347f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/373016d0-f409-4582-a951-148afb91b047" status: 404 len: 111 microversion: 2.1 time: 0.039532 Oct 03 10:49:42.971854 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2108/4465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:42 2022] GET /compute/v2.1/servers/373016d0-f409-4582-a951-148afb91b047 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:42.983840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e05af2e0-9d6c-4764-8ffe-cd05f3439119 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e3910d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:43.035245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:43.050138 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30dc87e4-bfc7-46ca-8b43-224d5f95e4d5 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1320 microversion: 2.1 time: 0.164799 Oct 03 10:49:43.050933 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2358/4466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:42 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:43.061266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:43.063175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:43.087436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:43.088252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:43.090800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:43.091730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:43.095544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:43.096269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.186950 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e05af2e0-9d6c-4764-8ffe-cd05f3439119 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4" status: 204 len: 0 microversion: 2.1 time: 1.205768 Oct 03 10:49:44.188668 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2109/4467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:42 2022] DELETE /compute/v2.1/images/9a91e253-46a0-4273-926d-0613a7c016c4 => generated 0 bytes in 1216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:49:44.197216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:44.200906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:44.217825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.218578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.219185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.220080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.220701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.221411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.337827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:44.346689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79e3aca0-6fff-4023-abae-db4f94e1a165 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.291375 Oct 03 10:49:44.347262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2359/4468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:43 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:44.358553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:44.364097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:44.382300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.383049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.383686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.384566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.385159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.387477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.545847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:44.559516 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14b0f331-8894-4b42-b5c5-6f9b46e10d74 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1286 microversion: 2.1 time: 0.203889 Oct 03 10:49:44.576784 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2360/4469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:44 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:44.602472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:44.623632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:44.655314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.655835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.656353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.657120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.657555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.658495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.751833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:44.754932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:44.769453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:44.772032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:44.777653 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-02f0278a-bf78-4caa-a8ff-62ff5aa7af65 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.584707 Oct 03 10:49:44.796984 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2110/4470] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:44 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:44.820164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0703acd8-425b-49fa-a61e-69a48fa9a84d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f0d9ee0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:44.873908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:44.882867 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6fd3a1d3-e8de-4a2f-97b9-b778963beac2 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1326 microversion: 2.1 time: 0.304608 Oct 03 10:49:44.883458 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2361/4471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:44 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1326 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:44.898208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:44.898835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:44.910438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.913700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.914359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:44.915526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:44.916459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:44.918945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:46.091454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:46.128411 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e0de8e5-6717-43bf-b18b-843755ee6867 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.236475 Oct 03 10:49:46.129801 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2362/4472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:44 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:46.152107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:46.154747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:46.182758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:46.184872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:46.187343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:46.190643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:46.193304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:46.195634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:46.346716 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0703acd8-425b-49fa-a61e-69a48fa9a84d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29" status: 204 len: 0 microversion: 2.1 time: 1.545258 Oct 03 10:49:46.348105 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2111/4473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:44 2022] DELETE /compute/v2.1/images/5ac8b577-d4f1-4c93-b6db-a5bcb8880d29 => generated 0 bytes in 1549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:49:46.354138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:46.355123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:46.369022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:46.376874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:46.383476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:46.384743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:46.385960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:46.389069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:46.896665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:46.911717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:46.913399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:46.917224 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28fb9c6e-c1ae-4035-8344-39c434518e1f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.566895 Oct 03 10:49:46.922273 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2112/4474] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:46 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:46.969631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:46.976044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:46.995372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:46.999576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.000171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:47.002275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:47.002889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.006327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:47.130106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:47.135021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:47.150422 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a493ef70-353b-4479-b02e-fd8af2fea8a7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 1.014150 Oct 03 10:49:47.152123 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2363/4475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:46 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:47.163224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:47.164648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:47.189148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:47.192281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.193560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:47.195955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:47.197884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.199206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:47.269495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:49:47.535258 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-204e66e5-782e-4d33-9432-f9c8d1efdea7 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 204 len: 0 microversion: 2.1 time: 0.380728 Oct 03 10:49:47.541829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:47.544058 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2364/4476] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:49:47 2022] DELETE /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:49:47.550895 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dce5fc50-deed-4a13-bff0-0a6744a5fb18 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 0.613107 Oct 03 10:49:47.551484 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2113/4477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:46 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:47.565477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7688a3e-016e-45c7-ba8f-9860d33f8a09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-766910220", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:47.584872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:47.586218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:47.603097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:47.604931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.605788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:47.608080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:47.609310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.613204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7688a3e-016e-45c7-ba8f-9860d33f8a09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 237 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-766910220", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-766910220', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.613988 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7688a3e-016e-45c7-ba8f-9860d33f8a09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:47.618146 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7688a3e-016e-45c7-ba8f-9860d33f8a09 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.072078 Oct 03 10:49:47.622638 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2365/4478] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:47.636477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:47.638430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:47.659722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:47.663161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.665476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:47.666754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:47.669851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:47.671023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:48.273803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:48.301719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e4032014-728f-4de1-b867-e8c3e38b2290 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1471 microversion: 2.1 time: 0.715471 Oct 03 10:49:48.305468 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2114/4479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:47 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1471 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:48.321420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:48.322709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:48.334611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:48.335277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:48.335866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:48.336738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:48.342528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:48.343202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:48.486755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:48.498973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4fcfce67-c24f-4f53-9be6-b278c6ac4bab tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.873393 Oct 03 10:49:48.508952 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2366/4480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:47 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:48.526067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:48.527309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:48.539660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:48.546688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:48.547447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:48.548364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:48.549684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:48.550290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:48.599033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:48.804537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:48.818613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:48.825860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:48.827805 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-323b8ab6-6c48-4146-a095-7ce398dc6254 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.521173 Oct 03 10:49:48.830459 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2115/4481] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:48 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:48.842945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8ef8a25d-f491-4bee-9f6b-167da99635d6 req-fd4d90cd-224a-4e14-86cb-083469e1de3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15970c19-2fac-4ca5-9699-e10860414710", "tag": "98c14be0-de3a-494b-8a2b-235166b1bee3"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:48.873524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8ef8a25d-f491-4bee-9f6b-167da99635d6 req-fd4d90cd-224a-4e14-86cb-083469e1de3b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:48.886392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8ef8a25d-f491-4bee-9f6b-167da99635d6 req-fd4d90cd-224a-4e14-86cb-083469e1de3b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:48.887097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8ef8a25d-f491-4bee-9f6b-167da99635d6 req-fd4d90cd-224a-4e14-86cb-083469e1de3b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:48.903842 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8ef8a25d-f491-4bee-9f6b-167da99635d6 req-fd4d90cd-224a-4e14-86cb-083469e1de3b service nova] Creating event network-changed:98c14be0-de3a-494b-8a2b-235166b1bee3 for instance 15970c19-2fac-4ca5-9699-e10860414710 on n-h2-858383-3 Oct 03 10:49:48.912098 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8ef8a25d-f491-4bee-9f6b-167da99635d6 req-fd4d90cd-224a-4e14-86cb-083469e1de3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079293 Oct 03 10:49:48.913602 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2116/4482] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:48.927943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:48.928926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:48.945555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:48.946451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:48.948286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:48.949456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:48.951187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:48.951985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:49.501761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:49.514552 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-225721a2-7114-4bbc-baf4-76ffdb71bd97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.599526 Oct 03 10:49:49.524138 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2117/4483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:48 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:49.535693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:49.544447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:49.555685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:49.560050 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2a94c8d-516d-45dd-a374-e50ebdec9a2f tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 1.045215 Oct 03 10:49:49.560826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2367/4484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:48 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:49.584543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:49.588966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:49.589612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:49.590373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:49.591010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:49.593445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:49.595356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:49.597622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:49.632617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:49.635645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:49.637751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:49.643509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:49.644413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:49.647113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:49.724709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:50.391032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:50.480008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:50.494147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:50.503504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3c4a5622-1099-47e7-8442-4efa6be64922 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 0.978055 Oct 03 10:49:50.517783 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c163176c-9cf7-4c3c-965b-c30f5be1dabe tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1471 microversion: 2.1 time: 0.925986 Oct 03 10:49:50.518481 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2368/4485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:49 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1471 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:50.527839 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2118/4486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:49 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:50.540239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c67d1464-c1c9-419a-b463-6f6259ae125c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-180107834", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:50.545399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:50.549556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:50.566283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c67d1464-c1c9-419a-b463-6f6259ae125c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 234 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-180107834", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-180107834', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.568456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c67d1464-c1c9-419a-b463-6f6259ae125c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:50.574873 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c67d1464-c1c9-419a-b463-6f6259ae125c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.050695 Oct 03 10:49:50.578576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:50.579269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:50.580591 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2369/4487] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:49:50 2022] POST /compute/v2.1/servers => generated 133 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:49:50.581809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:50.584848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:50.585614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:50.592759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:50.593286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:50.626772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:50.627309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:50.627690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:50.650259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:50.651591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:50.658443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:51.068182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:51.096431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:51.129454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:51.135955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:51.143496 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-003db312-b709-45f3-aa0e-cc3b796d1b40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.609060 Oct 03 10:49:51.145303 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2119/4488] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:50 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:51.179204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:51.182470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:51.203113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:51.205042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:51.206602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:51.211170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:51.212278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:51.212956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:51.348970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:51.360193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f595011-752c-47a1-a18e-e401b15abda1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.778399 Oct 03 10:49:51.377390 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2370/4489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:50 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:51.385584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-40213a93-fa08-44ce-ac0c-21657b4ae116 req-4f6f9405-5221-483d-a55b-b2764f75d601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb", "tag": "94515f26-5931-4964-9074-4a23d56d9e95"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:51.396313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-40213a93-fa08-44ce-ac0c-21657b4ae116 req-4f6f9405-5221-483d-a55b-b2764f75d601 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:51.397419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-40213a93-fa08-44ce-ac0c-21657b4ae116 req-4f6f9405-5221-483d-a55b-b2764f75d601 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:51.398096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-40213a93-fa08-44ce-ac0c-21657b4ae116 req-4f6f9405-5221-483d-a55b-b2764f75d601 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:51.410869 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-40213a93-fa08-44ce-ac0c-21657b4ae116 req-4f6f9405-5221-483d-a55b-b2764f75d601 service nova] Creating event network-changed:94515f26-5931-4964-9074-4a23d56d9e95 for instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb on n-h2-858383-3 Oct 03 10:49:51.419777 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-40213a93-fa08-44ce-ac0c-21657b4ae116 req-4f6f9405-5221-483d-a55b-b2764f75d601 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040297 Oct 03 10:49:51.421662 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2371/4490] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:51.446170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:51.449102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:51.467610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:51.472511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:51.474022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:51.475043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:51.480053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:51.486236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:52.039927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:52.054678 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-470210d5-e5f8-473d-afb9-926f0e25c037 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.629215 Oct 03 10:49:52.060369 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2372/4491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:51 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:52.065757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:52.069733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:52.085918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:52.086838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:52.087358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:52.088214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:52.088743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:52.089296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:52.924874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:52.946406 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c8312454-5663-464a-8b6d-f8a1fbcaacb8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 1.799535 Oct 03 10:49:52.947916 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2120/4492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:51 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:52.952890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:52.953488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:52.969317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:52.971643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:52.972194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:52.972645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:52.973569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:52.974042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:52.977297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.130350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.132181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:53.136736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.137561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.147180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lazy-loading 'fault' on Instance uuid a74014a1-fb90-45e3-ba2d-71fdddefa20d {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:49:53.167037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c2a35652-ec20-4f3e-9535-8eb2504ca6f0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 1.104307 Oct 03 10:49:53.168327 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2373/4493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:52 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:53.178637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-de4ae81f-182f-4d45-8a5c-70c5689e7d69 req-32f33985-6c92-4901-b857-069416961d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74014a1-fb90-45e3-ba2d-71fdddefa20d", "name": "network-vif-deleted", "tag": "ae3e817d-c947-4bc6-bdd3-d9aef8449dbb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:53.195841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-de4ae81f-182f-4d45-8a5c-70c5689e7d69 req-32f33985-6c92-4901-b857-069416961d43 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.196867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-de4ae81f-182f-4d45-8a5c-70c5689e7d69 req-32f33985-6c92-4901-b857-069416961d43 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.197895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-de4ae81f-182f-4d45-8a5c-70c5689e7d69 req-32f33985-6c92-4901-b857-069416961d43 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.226239 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-de4ae81f-182f-4d45-8a5c-70c5689e7d69 req-32f33985-6c92-4901-b857-069416961d43 service nova] Creating event network-vif-deleted:ae3e817d-c947-4bc6-bdd3-d9aef8449dbb for instance a74014a1-fb90-45e3-ba2d-71fdddefa20d on n-h1-858383-3 Oct 03 10:49:53.237329 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-de4ae81f-182f-4d45-8a5c-70c5689e7d69 req-32f33985-6c92-4901-b857-069416961d43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065609 Oct 03 10:49:53.238156 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2374/4494] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:49:53.245596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b72b90c6-5b94-445c-9802-a714547e714d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:53.246519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b72b90c6-5b94-445c-9802-a714547e714d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: ad8d5d05-e261-40dd-9112-209b019824b8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:53.254889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b72b90c6-5b94-445c-9802-a714547e714d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance ad8d5d05-e261-40dd-9112-209b019824b8 could not be found. Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b72b90c6-5b94-445c-9802-a714547e714d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/ad8d5d05-e261-40dd-9112-209b019824b8/action HTTP/1.1 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 13 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: {"pause": {}} Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance ad8d5d05-e261-40dd-9112-209b019824b8 could not be found. Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'ad8d5d05-e261-40dd-9112-209b019824b8', 'body': {'pause': {}}} Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad8d5d05-e261-40dd-9112-209b019824b8 could not be found. Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad8d5d05-e261-40dd-9112-209b019824b8 could not be found. Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:53.278783 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:53.282541 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:53.282541 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:53.282541 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad8d5d05-e261-40dd-9112-209b019824b8 could not be found. Oct 03 10:49:53.282541 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:53.282541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b72b90c6-5b94-445c-9802-a714547e714d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance ad8d5d05-e261-40dd-9112-209b019824b8 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:53.306000 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b72b90c6-5b94-445c-9802-a714547e714d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/ad8d5d05-e261-40dd-9112-209b019824b8/action" status: 404 len: 111 microversion: 2.1 time: 0.061306 Oct 03 10:49:53.319668 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2375/4495] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:49:53 2022] POST /compute/v2.1/servers/ad8d5d05-e261-40dd-9112-209b019824b8/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:53.360451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:53.373540 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f9bc0a69-7969-4915-8b48-a7dd62603630 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 200 len: 1307 microversion: 2.1 time: 0.424468 Oct 03 10:49:53.377068 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2121/4496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:52 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:53.393835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:53.394783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:53.412576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.412751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:53.413327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:53.413879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.416928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.418154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.419125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.421572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.432319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:53.434859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.439223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.439853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.441136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.444562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.445282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.787618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:53.803568 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a626a23a-5508-40e5-b75f-1f10b15a4200 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.423175 Oct 03 10:49:53.804858 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2122/4497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:53 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:53.836425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:53.837298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:53.846680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.847558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.849714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:53.851007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:53.851665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:53.852372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.062018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:54.100171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:54.103748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:54.106177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe1f1cbd-a497-45d2-b971-b2b7b022149a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.779324 Oct 03 10:49:54.125737 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2376/4498] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:53 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:54.144735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:54.149557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:54.152557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:54.167823 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3df5b7c-665a-4a3a-a5f8-e6b3ea5e21e1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.336031 Oct 03 10:49:54.169253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2123/4499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:53 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:54.170731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.171349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.171752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.172508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.188706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.189510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.202838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:54.203814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:54.212752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.213784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.214422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.218431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.219389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.220058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.374033 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f966c79-ece1-4287-9d67-8ec076d23d5c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 202 len: 0 microversion: 2.1 time: 0.185513 Oct 03 10:49:54.375315 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2124/4500] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:49:54 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:49:54.387580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:54.388566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:54.412323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.414273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.418296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.419246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.419863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.420448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.788218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:54.809335 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37a9eb42-7e5d-4248-be09-3f3fb09564aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 0.681323 Oct 03 10:49:54.811223 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2377/4501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:54 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:54.832574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:54.834250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:54.841779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.842601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.843230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:54.844089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:54.844715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:54.845319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.177441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:55.191343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cab41b29-0a6b-4afc-b79d-50a8406e7c89 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1491 microversion: 2.1 time: 0.360282 Oct 03 10:49:55.196747 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2378/4502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:54 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1491 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:55.209006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:55.210113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: a74014a1-fb90-45e3-ba2d-71fdddefa20d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:55.227395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.228283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.229962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.230859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.245828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.248578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.293971 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] HTTP exception thrown: Instance a74014a1-fb90-45e3-ba2d-71fdddefa20d could not be found. Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Request method failure captured: Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d HTTP/1.1 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr2YYCPdxJ3A3hG58TVJIogJi16IzcPUVYIAcp414SyyRqsMvthlXXCJ-y-fgrNLVU_pk3izap8p9T2Ji4VnqVZ-vq849qvryQojLqDdrhfZC2p7KQiWxHfceU9licrBsYmz-rW3-VQQ4w_B1XsQ1FM9NjlDP9h176ZANgEUp-yAt3Q Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 4164ebc4b3a84b3186b9222c7dbdaada Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListImageFiltersTestJSON-32526699 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4164ebc4b3a84b3186b9222c7dbdaada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4164ebc4b3a84b3186b9222c7dbdaada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4164ebc4b3a84b3186b9222c7dbdaada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4164ebc4b3a84b3186b9222c7dbdaada"}]}] Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListImageFiltersTestJSON-32526699 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 4164ebc4b3a84b3186b9222c7dbdaada Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-32526699 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListImageFiltersTestJSON-32526699-project Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0b0afdfbd1534404a5a89913268a3117 Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListImageFiltersTestJSON-32526699-project Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance a74014a1-fb90-45e3-ba2d-71fdddefa20d could not be found. Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a74014a1-fb90-45e3-ba2d-71fdddefa20d'} Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74014a1-fb90-45e3-ba2d-71fdddefa20d could not be found. Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74014a1-fb90-45e3-ba2d-71fdddefa20d could not be found. Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:55.297090 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.301340 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:55.301340 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:55.301340 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:55.301340 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:55.301340 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:55.301340 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74014a1-fb90-45e3-ba2d-71fdddefa20d could not be found. Oct 03 10:49:55.301340 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.304401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Returning 404 to user: Instance a74014a1-fb90-45e3-ba2d-71fdddefa20d could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:55.310966 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b866a839-3d7f-4007-be32-40c3b22d6b88 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d" status: 404 len: 111 microversion: 2.1 time: 0.111830 Oct 03 10:49:55.312039 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2379/4503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:55 2022] GET /compute/v2.1/servers/a74014a1-fb90-45e3-ba2d-71fdddefa20d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:49:55.319101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:55.322138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:55.353065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.354226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.354835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.355889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.356664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.357320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.435591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:55.445692 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5963213c-01b3-4914-bdac-c7ad61529698 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 1.068868 Oct 03 10:49:55.459611 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2125/4504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:54 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:55.476094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:55.479820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:55.496055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.497499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.498573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.499571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.500294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.500960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.539034 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Cannot 'pause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state paused Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action HTTP/1.1 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 13 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: {"pause": {}} Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'pause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state paused Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'pause': {}}} Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 in vm_state paused. Cannot pause while the instance is in this state. Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state paused Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:49:55.541765 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:49:55.546360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:49:55.546360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:49:55.546360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:49:55.546360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state paused Oct 03 10:49:55.546360 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:49:55.549045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 409 to user: Cannot 'pause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state paused {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:49:55.550242 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01f21359-d5a0-4165-8ded-968ab4a24e6e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 409 len: 143 microversion: 2.1 time: 0.089063 Oct 03 10:49:55.551782 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2126/4505] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:49:55 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 143 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:49:55.558658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:55.559879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:55.588595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.590392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.591219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.592363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.600134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.600706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.674134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:55.684663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:55.690886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:55.692113 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2e87403e-cd85-46c1-8933-088d5915fb1a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.378443 Oct 03 10:49:55.701786 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2380/4506] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:55 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:55.707000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:49:55.707735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:55.708513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:49:55.723350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.723862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.724750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.725750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.726391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.726972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.764598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:55.874936 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dac9a82a-78eb-4fa7-a6f4-849693e0ed37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 202 len: 0 microversion: 2.1 time: 0.171444 Oct 03 10:49:55.878529 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2381/4507] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:49:55 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:49:55.906115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:55.908414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:55.930918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.942101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.942815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.943813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:55.946184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:55.946882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:55.966638 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-578a2be9-85e8-41ec-8297-28859a10a739 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 204 len: 0 microversion: 2.1 time: 0.413260 Oct 03 10:49:55.970313 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2127/4508] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:49:55 2022] DELETE /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:49:55.988580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:55.989325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:56.032611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.033535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.034216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.035187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.035840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.036450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.336732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:56.341791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:49:56.359206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f448a47-4c96-403d-83bd-5bd8a6d404aa tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 0.473632 Oct 03 10:49:56.380078 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2382/4509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:55 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:56.391293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:56.392091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:56.402382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.402895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.403388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.404412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.404918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.405347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.649332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:56.667890 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b842f5e9-bb9a-49b3-a4c5-caacf247b14d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1498 microversion: 2.1 time: 0.693062 Oct 03 10:49:56.668508 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2128/4510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:55 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1498 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:56.688523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:56.690366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:56.696215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:56.713877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd58b2a5-f846-43d0-9ed1-014ba79f2735 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 200 len: 1473 microversion: 2.1 time: 0.329589 Oct 03 10:49:56.716132 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2383/4511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:56 2022] GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:56.722995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.727508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.728203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.730621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:56.731353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.732809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:56.733590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.734439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.745849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.746342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.746776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.747488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:56.747936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:56.748362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:56.988548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:57.016023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:57.019633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:57.020898 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6ec8816-adfb-4e0c-aedd-b0c5fb820275 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.294229 Oct 03 10:49:57.032805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2384/4512] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:56 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:57.063372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:57.075340 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3007ef1c-fa2f-4e49-8be9-79dbd52b4a25 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 0.398971 Oct 03 10:49:57.076021 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2129/4513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:56 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:57.390315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:57.391237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:57.413418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:57.414318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:57.440867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:57.442344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:57.443055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:57.443565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:57.693426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:57.694915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:57.711329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:57.712097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:57.712793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:57.714520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:57.716123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:57.717886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:57.765879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:57.781374 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c02da95-6380-4a0a-ac7d-935f5033431a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 0.398237 Oct 03 10:49:57.785620 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2385/4514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:57 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:57.805158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:57.806164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:57.844444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:57.844975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:57.845525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:57.858158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:57.862264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:57.862749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:58.271616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:58.281001 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cde5f578-fcec-40a6-a950-ea2d002f9bec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.593261 Oct 03 10:49:58.283918 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2130/4515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:57 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:58.288876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:58.301421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:58.316902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:58.317595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:58.318199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:58.325239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:58.325966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:58.326565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:58.770285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:58.816783 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-de81534d-b7a2-4b7e-8b90-13e108dec3c5 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 200 len: 1473 microversion: 2.1 time: 1.028459 Oct 03 10:49:58.817805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2386/4516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:57 2022] GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 1473 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:58.837572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:58.845583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:58.894351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:58.903656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:58.904456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:58.914489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:58.915138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:58.923923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:58.926243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:58.940982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:58.945852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:58.952723 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52b1c23d-a0f6-47e3-963d-c628ff5b68a1 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.667544 Oct 03 10:49:58.953875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2131/4517] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:49:58 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:49:58.970035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:58.993903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:59.004028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:59.008220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:59.011778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:59.015586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:59.024145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:59.025065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:59.606872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:49:59.619944 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f44e9388-d4e4-4c36-90f8-10c0efa6ec27 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 0.800011 Oct 03 10:49:59.629384 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2387/4518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:58 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:49:59.640363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:49:59.642698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:49:59.658413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:59.659565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:59.661794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:49:59.663167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:49:59.664749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:49:59.665679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.225722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:00.240015 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7c9e7cf-dea9-4df9-bb5f-df274cd97e4a tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 0.605570 Oct 03 10:50:00.260376 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2388/4519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:59 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:00.270968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1d9ffea6-afe8-4ed6-8b2c-dd50374a19ac req-dcf985a1-812b-4d64-a906-128b8e83cd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15970c19-2fac-4ca5-9699-e10860414710", "name": "network-vif-plugged", "status": "completed", "tag": "98c14be0-de3a-494b-8a2b-235166b1bee3"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:00.331868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1d9ffea6-afe8-4ed6-8b2c-dd50374a19ac req-dcf985a1-812b-4d64-a906-128b8e83cd90 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.335083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1d9ffea6-afe8-4ed6-8b2c-dd50374a19ac req-dcf985a1-812b-4d64-a906-128b8e83cd90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.336556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1d9ffea6-afe8-4ed6-8b2c-dd50374a19ac req-dcf985a1-812b-4d64-a906-128b8e83cd90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.377070 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1d9ffea6-afe8-4ed6-8b2c-dd50374a19ac req-dcf985a1-812b-4d64-a906-128b8e83cd90 service nova] Creating event network-vif-plugged:98c14be0-de3a-494b-8a2b-235166b1bee3 for instance 15970c19-2fac-4ca5-9699-e10860414710 on n-h2-858383-3 Oct 03 10:50:00.386764 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1d9ffea6-afe8-4ed6-8b2c-dd50374a19ac req-dcf985a1-812b-4d64-a906-128b8e83cd90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121721 Oct 03 10:50:00.387649 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2389/4520] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:00.398082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:00.399044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:00.415070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:00.431277 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d8c33012-eeb8-44b9-b612-1589e4cc984d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.475567 Oct 03 10:50:00.435678 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2132/4521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:49:58 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:00.436709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.438579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.439587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.440560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.441239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.441833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.455067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:00.456218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:00.481829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.482718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.483420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.486042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.487448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.488092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.631958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0afdfbd1534404a5a89913268a3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164ebc4b3a84b3186b9222c7dbdaada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:00.658357 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d131e5a-4cd2-4ea7-882d-0b62419f021d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 200 len: 1302 microversion: 2.1 time: 0.260172 Oct 03 10:50:00.660538 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2390/4522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:00 2022] GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 1302 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:00.687116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-822e4bac-41d1-4d0c-a260-60df6f9db2fa req-214b5b74-f0b7-4b47-bc1e-a94f58596eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fe7879-6f32-4d3b-8038-a4f40f154995", "name": "network-vif-deleted", "tag": "873702af-4840-46a1-b693-3ceb18ce3a18"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:00.734488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-822e4bac-41d1-4d0c-a260-60df6f9db2fa req-214b5b74-f0b7-4b47-bc1e-a94f58596eb1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.738700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-822e4bac-41d1-4d0c-a260-60df6f9db2fa req-214b5b74-f0b7-4b47-bc1e-a94f58596eb1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.740491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-822e4bac-41d1-4d0c-a260-60df6f9db2fa req-214b5b74-f0b7-4b47-bc1e-a94f58596eb1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.786349 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-822e4bac-41d1-4d0c-a260-60df6f9db2fa req-214b5b74-f0b7-4b47-bc1e-a94f58596eb1 service nova] Creating event network-vif-deleted:873702af-4840-46a1-b693-3ceb18ce3a18 for instance d4fe7879-6f32-4d3b-8038-a4f40f154995 on n-h2-858383-3 Oct 03 10:50:00.798895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-822e4bac-41d1-4d0c-a260-60df6f9db2fa req-214b5b74-f0b7-4b47-bc1e-a94f58596eb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136719 Oct 03 10:50:00.799824 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2391/4523] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:00.815963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:00.825330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:00.840960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.841700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.842532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.844939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.845868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.847076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.872532 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0/action HTTP/1.1 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 28 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: {"reboot": {"type": "SOFT"}} Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3cdb0950-c097-4dfc-aef3-bfe925801ec0', 'body': {'reboot': {'type': 'SOFT'}}} Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:00.875991 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:00.884261 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:00.888072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:00.889215 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c6e0f182-cc73-4aed-9299-1be4d6210388 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0/action" status: 404 len: 111 microversion: 2.1 time: 0.088048 Oct 03 10:50:00.889997 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2392/4524] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:00 2022] POST /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:00.894917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:00.895781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:00.906846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.907349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.907796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:00.908518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:00.909009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:00.909435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:01.108354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:01.126749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:01.146036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:01.148112 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b85ac8ce-d71e-4db3-99b2-5bcd55c3fde5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.709859 Oct 03 10:50:01.159651 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2133/4525] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:00 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:01.186208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:01.186846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:01.219679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:01.221036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:01.222100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:01.224238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:01.225367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:01.226565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:01.644277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:01.660142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-16927c09-3709-42f1-a786-cf9f93f93da3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 0.768873 Oct 03 10:50:01.663553 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2393/4526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:00 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:01.682511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:01.685125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:01.709239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:01.710086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:01.712360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:01.714526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:01.715914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:01.717984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:02.596907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:02.615861 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c2ca1e5-a6e9-477f-ac69-2602da7d7bd7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1328 microversion: 2.1 time: 0.944678 Oct 03 10:50:02.642884 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2394/4527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:01 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1328 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:02.667399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:02.689702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:02.703605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] [instance: d4fe7879-6f32-4d3b-8038-a4f40f154995] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:02.707332 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6d4ed0e0-0cf8-4116-a575-78961892a377 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.546270 Oct 03 10:50:02.717213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2134/4528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:01 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:02.741196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:02.744723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:02.749854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:02.751104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:02.751801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:02.752236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:02.752511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:02.755272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:02.789579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:02.790092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:02.799618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:02.800927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:02.801437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:02.801934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:02.830193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] HTTP exception thrown: Instance d4fe7879-6f32-4d3b-8038-a4f40f154995 could not be found. Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Request method failure captured: Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 HTTP/1.1 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr2YYCPdxJ3A3hG58TVJIogJi16IzcPUVYIAcp414SyyRqsMvthlXXCJ-y-fgrNLVU_pk3izap8p9T2Ji4VnqVZ-vq849qvryQojLqDdrhfZC2p7KQiWxHfceU9licrBsYmz-rW3-VQQ4w_B1XsQ1FM9NjlDP9h176ZANgEUp-yAt3Q Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 4164ebc4b3a84b3186b9222c7dbdaada Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ListImageFiltersTestJSON-32526699 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4164ebc4b3a84b3186b9222c7dbdaada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4164ebc4b3a84b3186b9222c7dbdaada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4164ebc4b3a84b3186b9222c7dbdaada"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4164ebc4b3a84b3186b9222c7dbdaada"}]}] Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ListImageFiltersTestJSON-32526699 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 4164ebc4b3a84b3186b9222c7dbdaada Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-32526699 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ListImageFiltersTestJSON-32526699-project Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0b0afdfbd1534404a5a89913268a3117 Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ListImageFiltersTestJSON-32526699-project Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance d4fe7879-6f32-4d3b-8038-a4f40f154995 could not be found. Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd4fe7879-6f32-4d3b-8038-a4f40f154995'} Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4fe7879-6f32-4d3b-8038-a4f40f154995 could not be found. Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4fe7879-6f32-4d3b-8038-a4f40f154995 could not be found. Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:02.841670 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:02.849288 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:02.849288 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:02.849288 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:02.849288 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:02.849288 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:02.849288 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4fe7879-6f32-4d3b-8038-a4f40f154995 could not be found. Oct 03 10:50:02.849288 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:02.852761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Returning 404 to user: Instance d4fe7879-6f32-4d3b-8038-a4f40f154995 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:02.855442 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f282d4c5-0312-4c1a-a70c-1f68645a89a0 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995" status: 404 len: 111 microversion: 2.1 time: 0.205225 Oct 03 10:50:02.862228 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2395/4529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:02 2022] GET /compute/v2.1/servers/d4fe7879-6f32-4d3b-8038-a4f40f154995 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:02.876255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fcc93630-687f-420f-8108-677314ecb2b7 req-873db503-d44c-4c68-9c01-da9596163e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb", "name": "network-vif-plugged", "status": "completed", "tag": "94515f26-5931-4964-9074-4a23d56d9e95"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:02.922817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fcc93630-687f-420f-8108-677314ecb2b7 req-873db503-d44c-4c68-9c01-da9596163e57 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:02.924291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fcc93630-687f-420f-8108-677314ecb2b7 req-873db503-d44c-4c68-9c01-da9596163e57 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:02.927648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fcc93630-687f-420f-8108-677314ecb2b7 req-873db503-d44c-4c68-9c01-da9596163e57 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:02.991323 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fcc93630-687f-420f-8108-677314ecb2b7 req-873db503-d44c-4c68-9c01-da9596163e57 service nova] Creating event network-vif-plugged:94515f26-5931-4964-9074-4a23d56d9e95 for instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb on n-h2-858383-3 Oct 03 10:50:03.012811 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fcc93630-687f-420f-8108-677314ecb2b7 req-873db503-d44c-4c68-9c01-da9596163e57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148622 Oct 03 10:50:03.014194 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2396/4530] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:03.034850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:03.036747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:03.074195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:03.076600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:03.077821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:03.079203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:03.080395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:03.081464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:03.690334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:03.704664 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d20b0ca-0fce-4260-9b88-1f1a52d38e7c tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 0.687159 Oct 03 10:50:03.705956 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2397/4531] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:03 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:03.711010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:03.711883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:03.719475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:03.720303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:03.720945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:03.726179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:03.727088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:03.728102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:04.115559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:04.125978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:04.133922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:04.149138 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-765bee8c-d2d1-4ff4-8bc1-9c82d02cea96 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 1.413383 Oct 03 10:50:04.150200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2135/4532] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:02 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:04.156551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d76bdb1d-3e62-413c-bc0f-85fa96cc872d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074e401a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:04.182576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:04.202087 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-29c4e984-4142-406e-8dca-76b7a119aee5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.490144 Oct 03 10:50:04.202963 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2398/4533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:03 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:04.212845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:04.214309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:04.224631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:04.228956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:04.229481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:04.230231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:04.233820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:04.234276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:04.718664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:04.743078 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3224af5-30ee-48fd-a162-3f6203d055c7 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1527 microversion: 2.1 time: 0.539041 Oct 03 10:50:04.745819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2399/4534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:04 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1527 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:04.769978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9bd98838-5c43-4c6a-b057-9a71846dbdcf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:04.776173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9bd98838-5c43-4c6a-b057-9a71846dbdcf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 27e5762a-7b92-4547-993e-b010f5c38263] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:04.785351 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-9bd98838-5c43-4c6a-b057-9a71846dbdcf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 27e5762a-7b92-4547-993e-b010f5c38263 could not be found. Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9bd98838-5c43-4c6a-b057-9a71846dbdcf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/27e5762a-7b92-4547-993e-b010f5c38263/action HTTP/1.1 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 28 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: {"reboot": {"type": "SOFT"}} Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 27e5762a-7b92-4547-993e-b010f5c38263 could not be found. Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '27e5762a-7b92-4547-993e-b010f5c38263', 'body': {'reboot': {'type': 'SOFT'}}} Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e5762a-7b92-4547-993e-b010f5c38263 could not be found. Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e5762a-7b92-4547-993e-b010f5c38263 could not be found. Oct 03 10:50:04.789149 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e5762a-7b92-4547-993e-b010f5c38263 could not be found. Oct 03 10:50:04.793899 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:04.798499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9bd98838-5c43-4c6a-b057-9a71846dbdcf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 27e5762a-7b92-4547-993e-b010f5c38263 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:04.799624 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9bd98838-5c43-4c6a-b057-9a71846dbdcf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/27e5762a-7b92-4547-993e-b010f5c38263/action" status: 404 len: 111 microversion: 2.1 time: 0.052243 Oct 03 10:50:04.800674 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2400/4535] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:04 2022] POST /compute/v2.1/servers/27e5762a-7b92-4547-993e-b010f5c38263/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:04.805717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:04.806508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:04.818609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:04.819393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:04.820015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:04.820931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:04.821574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:04.822181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:05.118968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:05.134839 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-97f8d9ea-de91-4632-b4e4-4d6a1040e8f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1394 microversion: 2.1 time: 0.330338 Oct 03 10:50:05.136694 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2401/4536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:04 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1394 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:05.151687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:05.156522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:05.174277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:05.175904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:05.176384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:05.177182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:05.177605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:05.178029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:05.424755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:05.437883 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e56ac61a-9e5b-4c8b-b008-e761ba34a671 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1527 microversion: 2.1 time: 0.298352 Oct 03 10:50:05.442466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2402/4537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:05 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1527 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:05.452320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:05.454370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:05.471338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:05.472162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:05.477764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:05.480318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:05.481230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:05.482551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:05.491714 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d76bdb1d-3e62-413c-bc0f-85fa96cc872d tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/images/1938b249-7368-40a1-bd5e-4bb9d273b2a4" status: 204 len: 0 microversion: 2.1 time: 1.338613 Oct 03 10:50:05.493136 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2136/4538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:04 2022] DELETE /compute/v2.1/images/1938b249-7368-40a1-bd5e-4bb9d273b2a4 => generated 0 bytes in 1341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:05.502630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:05.503789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:05.535091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:05.535933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:05.536682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:05.538151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:05.539111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:05.539880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:05.708724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:05.718290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:05.725124 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1ee6085-3aa8-43d4-abbb-4b21cf247bc6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.280229 Oct 03 10:50:05.725992 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2403/4539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:05 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:05.901507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:05.913872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:05.920813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:05.925953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1904f5f9-01f0-4efe-a78e-c93b4fcf0804 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1741 microversion: 2.20 time: 0.430921 Oct 03 10:50:05.926622 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2137/4540] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:05 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1741 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:06.288714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-756710702", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "ce99a940-341d-4d12-9919-cc0a62400249"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:06.432592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] validate_networks() for [('ce99a940-341d-4d12-9919-cc0a62400249', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:50:06.698435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:06.699875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:06.712259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:06.715132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:06.716051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:06.717568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:06.718731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:06.721229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:06.758473 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] HTTP exception thrown: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Request method failure captured: Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 HTTP/1.1 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr4_Xca8KDocJUjVCQ8oWbbhsi0k4ggZ6kuHrzs2QoSb-6Suc9EAZK1SGp4J7LhsWnvKjXIS9GoKniCwY0CxYss2K2NQeW13Jbndr-j_ygIVpem-qXaOBPtMxGSMFiuW8HCMhroMXtneNZpPhA7Z_i86OPNPS3JxDkdtV0Kazz83jHc Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d69ae1528fb7470a8f3a19acd1b0ec8c Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1257384780 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d69ae1528fb7470a8f3a19acd1b0ec8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d69ae1528fb7470a8f3a19acd1b0ec8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d69ae1528fb7470a8f3a19acd1b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d69ae1528fb7470a8f3a19acd1b0ec8c"}]}] Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1257384780 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d69ae1528fb7470a8f3a19acd1b0ec8c Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1257384780 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1257384780-project Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a20f81d0a8724ef094ac6c6e03412035 Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1257384780-project Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '15970c19-2fac-4ca5-9699-e10860414710'} Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:06.761468 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:06.765198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:06.771940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Returning 404 to user: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:06.773265 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9836d4de-ae40-4a6d-ab12-59a7135e7418 tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] 10.222.0.27 "DELETE /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 404 len: 111 microversion: 2.1 time: 0.843708 Oct 03 10:50:06.774500 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2138/4541] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:50:05 2022] DELETE /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 111 bytes in 845 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:06.780845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-618f3587-96de-4920-9710-46b11808be98 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074f74ea60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:07.569341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:50:07.569845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:50:07.570454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:50:07.570976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:50:07.571511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:50:07.593918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:07.594667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:07.596959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:07.599543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:07.600137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:07.601850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:07.636542 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-618f3587-96de-4920-9710-46b11808be98 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/images/a1a96d48-c7b6-47b8-840a-bf765b2ec9a0" status: 204 len: 0 microversion: 2.1 time: 0.860158 Oct 03 10:50:07.637215 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2139/4542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:06 2022] DELETE /compute/v2.1/images/a1a96d48-c7b6-47b8-840a-bf765b2ec9a0 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:07.644433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:07.646107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:07.654875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:07.655382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:07.655832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:07.656559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:07.657161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:07.657701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:07.658899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Getting quotas for project c17e2c7d56164c55b054403c99f232b4. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:50:07.670967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Getting quotas for user 4c81f64f90d64c5ea348e13a87061d6d and project c17e2c7d56164c55b054403c99f232b4. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:50:07.701147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:50:07.703807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:50:07.771971 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0a0e6b2-2852-4606-88a6-0b611c902ecf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.044702 Oct 03 10:50:07.779985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2404/4543] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:50:07.779985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:07.780289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:07.789471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:07.790465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:07.792508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:07.793813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:07.794369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:07.794887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:08.229812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:08.254422 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b35b11a8-0e92-4c6f-a7dc-49318e00a47f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1574 microversion: 2.1 time: 0.477065 Oct 03 10:50:08.255057 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2405/4544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:07 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1574 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:08.270084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:08.271487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:08.308576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:08.310194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:08.311171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:08.313648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:08.315096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:08.316364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:08.393105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:08.420715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eaa9b2e0-d14b-47f3-b02a-c1c7855a27ed tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.782186 Oct 03 10:50:08.426830 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2140/4545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:07 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:08.436796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:08.437485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:08.457398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:08.457908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:08.458667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:08.459411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:08.459883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:08.460330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:08.575820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:08.589828 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c301268c-318e-49c4-90b1-463a8c254cb5 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1527 microversion: 2.1 time: 0.331860 Oct 03 10:50:08.592921 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2406/4546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:08 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1527 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:08.598103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95dbd0a0-85b2-42f7-b67c-4b3b7b1ac542 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] Calling method '.version_select at 0x7f074dfa60d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:08.900734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:08.924005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:08.930159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:08.936114 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fdde9f6-8a61-4ce1-b45b-7132f19c362c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1723 microversion: 2.20 time: 0.506329 Oct 03 10:50:08.938214 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2141/4547] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:08 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:08.956942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:08.958275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:08.975176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:08.976393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:08.977392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:08.978828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:08.979590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:08.980225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.143370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:09.169975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43c74e91-ca19-42f0-b478-9e5e37a9c125 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1211 microversion: 2.1 time: 0.229425 Oct 03 10:50:09.170600 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2142/4548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:08 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1211 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:09.190542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:09.192485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:09.206277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.207554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.208662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.211052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.214211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.215618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.405425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-575a4c92-49b3-4016-a566-f0932ef7a73f tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233644 Oct 03 10:50:09.415642 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2143/4549] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:50:09 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:09.424494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:09.429197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:09.439523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.440384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.441200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.442236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.442925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.443813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.463245 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0/action HTTP/1.1 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 65 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3cdb0950-c097-4dfc-aef3-bfe925801ec0', 'body': {'rebuild': {'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f'}}} Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 03 10:50:09.465677 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:50:09.470065 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.473114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:09.476468 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c631a256-d848-4ce4-bc0c-e6bdac999e33 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0/action" status: 404 len: 111 microversion: 2.1 time: 0.057744 Oct 03 10:50:09.478195 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2144/4550] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:09 2022] POST /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:09.487605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Action: 'update', calling method: >, body: {"server": {"name": "15970c19-2fac-4ca5-9699-e10860414710_new"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:09.493756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:09.499655 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95dbd0a0-85b2-42f7-b67c-4b3b7b1ac542 tempest-ListImageFiltersTestJSON-32526699 tempest-ListImageFiltersTestJSON-32526699-project] 10.222.0.27 "DELETE /compute/v2.1/images/f5618c9d-710d-489c-b72c-794bbc413f61" status: 204 len: 0 microversion: 2.1 time: 0.904641 Oct 03 10:50:09.510299 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2407/4551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:08 2022] DELETE /compute/v2.1/images/f5618c9d-710d-489c-b72c-794bbc413f61 => generated 0 bytes in 908 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:09.517321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.517898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.518355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.519425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.519890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.520321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.525665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:09.526780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:09.555654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.556515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.558222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.559670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.560482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.574528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.581536 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] HTTP exception thrown: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Request method failure captured: Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: request: PUT /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 HTTP/1.1 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 64 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr4_Xca8KDocJUjVCQ8oWbbhsi0k4ggZ6kuHrzs2QoSb-6Suc9EAZK1SGp4J7LhsWnvKjXIS9GoKniCwY0CxYss2K2NQeW13Jbndr-j_ygIVpem-qXaOBPtMxGSMFiuW8HCMhroMXtneNZpPhA7Z_i86OPNPS3JxDkdtV0Kazz83jHc Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d69ae1528fb7470a8f3a19acd1b0ec8c Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1257384780 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d69ae1528fb7470a8f3a19acd1b0ec8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d69ae1528fb7470a8f3a19acd1b0ec8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d69ae1528fb7470a8f3a19acd1b0ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d69ae1528fb7470a8f3a19acd1b0ec8c"}]}] Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1257384780 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d69ae1528fb7470a8f3a19acd1b0ec8c Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1257384780 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1257384780-project Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a20f81d0a8724ef094ac6c6e03412035 Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1257384780-project Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "15970c19-2fac-4ca5-9699-e10860414710_new"}} Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '15970c19-2fac-4ca5-9699-e10860414710', 'body': {'server': {'name': '15970c19-2fac-4ca5-9699-e10860414710_new'}}} Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:09.585270 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:09.591863 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:09.598463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] Returning 404 to user: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:09.601298 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e1e50d56-5550-456f-aacd-f3dec33b8e2f tempest-ServersNegativeTestMultiTenantJSON-1257384780 tempest-ServersNegativeTestMultiTenantJSON-1257384780-project] 10.222.0.27 "PUT /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 404 len: 111 microversion: 2.1 time: 0.120328 Oct 03 10:50:09.602675 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2145/4552] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:50:09 2022] PUT /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:09.616693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:09.618483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:09.630364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.631666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.632825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.634547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.635710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.649062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.723227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:50:09.785359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:09.933637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-429466b9-c7e2-4149-97e9-d1c5078f901d tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "DELETE /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 204 len: 0 microversion: 2.1 time: 0.323928 Oct 03 10:50:09.937348 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2146/4553] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:50:09 2022] DELETE /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:09.944889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:09.945733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:09.966636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.966951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.967402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:09.969554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:09.972661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:09.973327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:10.186242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:10.233695 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb51305f-c54c-4ef4-91a8-9bbf2a6020ec tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.721394 Oct 03 10:50:10.234498 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2408/4554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:09 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:10.294429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:10.295457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:10.327381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:10.328211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:10.331355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:10.351905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:10.355762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:10.365098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:10.522939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:10.531483 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc8276e8-2164-46db-af47-3558fddb491c tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1533 microversion: 2.1 time: 0.592566 Oct 03 10:50:10.545651 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2147/4555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:09 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1533 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:10.549835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:10.550839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:10.570200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:10.570879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:10.571463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:10.572993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:10.579879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:10.580486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:10.809098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:10.825800 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc99d28c-54aa-4ac6-b46d-5e76fcf54bc1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1273 microversion: 2.1 time: 0.284200 Oct 03 10:50:10.826678 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2148/4556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:10 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:10.831559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:10.842688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:10.849479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:10.852213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:10.853011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:10.866929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:10.867815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:10.868520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:10.962648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:10.979626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:10.981467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:10.982911 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7ec6f4e4-a16f-47a5-a27f-5b07585d6c3e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1726 microversion: 2.20 time: 0.710249 Oct 03 10:50:10.983604 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2409/4557] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:10 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1726 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:10.996183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c5fb3c53-3d70-4f6a-a8d5-be6483d41d95 req-1a38ca7d-3b69-4eaf-b139-a64bbd28de6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "name": "network-vif-unplugged", "status": "completed", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:11.015865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c5fb3c53-3d70-4f6a-a8d5-be6483d41d95 req-1a38ca7d-3b69-4eaf-b139-a64bbd28de6b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:11.017325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c5fb3c53-3d70-4f6a-a8d5-be6483d41d95 req-1a38ca7d-3b69-4eaf-b139-a64bbd28de6b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:11.022208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c5fb3c53-3d70-4f6a-a8d5-be6483d41d95 req-1a38ca7d-3b69-4eaf-b139-a64bbd28de6b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:11.047949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.server_external_events [req-c5fb3c53-3d70-4f6a-a8d5-be6483d41d95 req-1a38ca7d-3b69-4eaf-b139-a64bbd28de6b service nova] Unable to find a host for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4. Dropping event network-vif-unplugged {{(pid=122269) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 10:50:11.050577 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c5fb3c53-3d70-4f6a-a8d5-be6483d41d95 req-1a38ca7d-3b69-4eaf-b139-a64bbd28de6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057209 Oct 03 10:50:11.051409 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2410/4558] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 10:50:11.071541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c417975e-d716-43cb-af30-c9b45c0e564f"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:11.074022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:11.081161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:11.081660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:11.082100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:11.083049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:11.083512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:11.083945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:11.565178 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-33551156-7847-4ec0-9866-3790ff3e9edf tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.506291 Oct 03 10:50:11.576442 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2411/4559] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Oct 3 10:50:11 2022] POST /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-volume_attachments => generated 188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 10:50:11.586645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:11.596816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:11.615848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:11.616867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:11.617480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:11.618520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:11.619730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:11.619730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:11.709489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:11.723197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04e33718-7f5a-451f-a019-c76249e4a1aa tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.895184 Oct 03 10:50:11.725116 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2149/4560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:10 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:11.748836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0036620-6503-47eb-8bb4-38ea5fa79427 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:11.755265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a0036620-6503-47eb-8bb4-38ea5fa79427 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 311e90ac-be8e-4fc6-9569-bf18674247c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:11.762669 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a0036620-6503-47eb-8bb4-38ea5fa79427 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 311e90ac-be8e-4fc6-9569-bf18674247c2 could not be found. Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0036620-6503-47eb-8bb4-38ea5fa79427 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/311e90ac-be8e-4fc6-9569-bf18674247c2/action HTTP/1.1 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 65 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 311e90ac-be8e-4fc6-9569-bf18674247c2 could not be found. Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '311e90ac-be8e-4fc6-9569-bf18674247c2', 'body': {'rebuild': {'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f'}}} Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311e90ac-be8e-4fc6-9569-bf18674247c2 could not be found. Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 10:50:11.764639 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311e90ac-be8e-4fc6-9569-bf18674247c2 could not be found. Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311e90ac-be8e-4fc6-9569-bf18674247c2 could not be found. Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0036620-6503-47eb-8bb4-38ea5fa79427 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 311e90ac-be8e-4fc6-9569-bf18674247c2 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:11.772192 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0036620-6503-47eb-8bb4-38ea5fa79427 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/311e90ac-be8e-4fc6-9569-bf18674247c2/action" status: 404 len: 111 microversion: 2.1 time: 0.022197 Oct 03 10:50:11.775915 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2150/4561] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:11 2022] POST /compute/v2.1/servers/311e90ac-be8e-4fc6-9569-bf18674247c2/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:50:11.789669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:11.790557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:11.806016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:11.807036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:11.811740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:11.812845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:11.813495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:11.814091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.031300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9c644f6294185bdf01b3af30ff1ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e46f1d4b99b42ec9afed29330f9eb13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:12.044363 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a4f8c17-4e27-41b5-8f0d-b18dcee15aba tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 200 len: 1533 microversion: 2.1 time: 0.466475 Oct 03 10:50:12.060337 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2412/4562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:11 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 1533 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:12.060337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:12.060337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:12.063022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.063531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.064003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.065320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.065777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.066352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.456638 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9cd256bd-b5e5-4b92-befb-46ec0936f09f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-volume_attachments/c417975e-d716-43cb-af30-c9b45c0e564f" status: 202 len: 0 microversion: 2.20 time: 0.410420 Oct 03 10:50:12.459219 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2413/4563] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Oct 3 10:50:12 2022] DELETE /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-volume_attachments/c417975e-d716-43cb-af30-c9b45c0e564f => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:12.480566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:12.482595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:12.486563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:12.494878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2dae2d2a-8753-4045-9a82-9fa27b967305 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.710446 Oct 03 10:50:12.500584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.501672 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2151/4564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:11 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:12.516001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.516001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.516001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.516001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.516001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.523428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-70f89674-8f8d-469a-aed1-054587edf939 req-ad397914-807a-4c1d-865c-82c4657dee3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15970c19-2fac-4ca5-9699-e10860414710", "name": "network-vif-deleted", "tag": "98c14be0-de3a-494b-8a2b-235166b1bee3"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:12.553352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-70f89674-8f8d-469a-aed1-054587edf939 req-ad397914-807a-4c1d-865c-82c4657dee3d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.554114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-70f89674-8f8d-469a-aed1-054587edf939 req-ad397914-807a-4c1d-865c-82c4657dee3d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.559496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-70f89674-8f8d-469a-aed1-054587edf939 req-ad397914-807a-4c1d-865c-82c4657dee3d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.585201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-70f89674-8f8d-469a-aed1-054587edf939 req-ad397914-807a-4c1d-865c-82c4657dee3d service nova] Creating event network-vif-deleted:98c14be0-de3a-494b-8a2b-235166b1bee3 for instance 15970c19-2fac-4ca5-9699-e10860414710 on n-h2-858383-3 Oct 03 10:50:12.609347 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-70f89674-8f8d-469a-aed1-054587edf939 req-ad397914-807a-4c1d-865c-82c4657dee3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102020 Oct 03 10:50:12.610654 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2152/4565] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:12.616494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:12.624652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:12.639562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:12.648667 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24951e08-137b-43dc-97c8-f3b7f0f601c8 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1273 microversion: 2.1 time: 0.188015 Oct 03 10:50:12.649357 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2414/4566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:12 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:12.649539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.651298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.652918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.653954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.654630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.655305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.660689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:12.661633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:12.671394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.672007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.672634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.673396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.674190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.674834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.731431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122269) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 10:50:12.815892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ad70dba-d43a-43c4-b74b-135cbebf9f48 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "POST /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/action" status: 202 len: 0 microversion: 2.20 time: 0.165467 Oct 03 10:50:12.819693 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2415/4567] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 10:50:12 2022] POST /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:12.845087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:12.845788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:12.852837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.853569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.854172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:12.855037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:12.855682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:12.856270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:13.141602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:13.150224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:13.154254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:13.156371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:13.157997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-157528f3-686f-4c8a-9ee2-a9a7e081a221 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1674 microversion: 2.20 time: 0.317734 Oct 03 10:50:13.177221 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2416/4568] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:12 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1674 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:13.190620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:13.191930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] [instance: 15970c19-2fac-4ca5-9699-e10860414710] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:13.199330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:13.201485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:13.202393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:13.203287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:13.204554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:13.205267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:13.210816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:13.254929 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] HTTP exception thrown: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Request method failure captured: Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 HTTP/1.1 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr4rbS9j7F82Nk8P0xZJZxccqaZyP8WvyyM1ExU3dQV051e2IDHmK9DjdCChlKilXmPaQH8DzV3GwkqLldz-Q4J1y_DTuih0cupG5swvBTeqPaoMk2ZzakLghQx-QFVvSsiHIep2kFnmubXw5AhxmsrIZoNHvos3Jxsf9jTEPMPcc2I Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 0e46f1d4b99b42ec9afed29330f9eb13 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2120782496 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0e46f1d4b99b42ec9afed29330f9eb13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0e46f1d4b99b42ec9afed29330f9eb13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0e46f1d4b99b42ec9afed29330f9eb13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0e46f1d4b99b42ec9afed29330f9eb13"}]}] Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2120782496 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 0e46f1d4b99b42ec9afed29330f9eb13 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2120782496 Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2120782496-project Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 62a9c644f6294185bdf01b3af30ff1ff Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2120782496-project Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '15970c19-2fac-4ca5-9699-e10860414710'} Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:13.260549 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. Oct 03 10:50:13.264414 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.266861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] Returning 404 to user: Instance 15970c19-2fac-4ca5-9699-e10860414710 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:13.270752 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-247933af-aae0-423d-ae4d-b4c468d3e5c8 tempest-ServersNegativeTestMultiTenantJSON-2120782496 tempest-ServersNegativeTestMultiTenantJSON-2120782496-project] 10.222.0.27 "GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710" status: 404 len: 111 microversion: 2.1 time: 0.091859 Oct 03 10:50:13.274734 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2417/4569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:13 2022] GET /compute/v2.1/servers/15970c19-2fac-4ca5-9699-e10860414710 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:13.555574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:13.566488 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f36d6b1-c4de-4fad-830e-9d9fb1569712 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.954335 Oct 03 10:50:13.584682 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2153/4570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:12 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:13.595366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8e15cb4-fc9a-4054-bebb-88fb56c726bd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:13.596155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8e15cb4-fc9a-4054-bebb-88fb56c726bd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: a2c6e82d-f908-47d9-b02a-5f4d3f6921ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:13.605555 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-f8e15cb4-fc9a-4054-bebb-88fb56c726bd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance a2c6e82d-f908-47d9-b02a-5f4d3f6921ee could not be found. Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8e15cb4-fc9a-4054-bebb-88fb56c726bd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/a2c6e82d-f908-47d9-b02a-5f4d3f6921ee/action HTTP/1.1 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 15 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: {"restore": {}} Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance a2c6e82d-f908-47d9-b02a-5f4d3f6921ee could not be found. Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a2c6e82d-f908-47d9-b02a-5f4d3f6921ee', 'body': {'restore': {}}} Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c6e82d-f908-47d9-b02a-5f4d3f6921ee could not be found. Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c6e82d-f908-47d9-b02a-5f4d3f6921ee could not be found. Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:13.607462 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:13.611961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:13.611961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:13.611961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c6e82d-f908-47d9-b02a-5f4d3f6921ee could not be found. Oct 03 10:50:13.611961 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:13.613454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8e15cb4-fc9a-4054-bebb-88fb56c726bd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance a2c6e82d-f908-47d9-b02a-5f4d3f6921ee could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:13.614618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8e15cb4-fc9a-4054-bebb-88fb56c726bd tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/a2c6e82d-f908-47d9-b02a-5f4d3f6921ee/action" status: 404 len: 111 microversion: 2.1 time: 0.028244 Oct 03 10:50:13.620221 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2418/4571] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:13 2022] POST /compute/v2.1/servers/a2c6e82d-f908-47d9-b02a-5f4d3f6921ee/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:13.625033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:13.626009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:13.633647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:13.634159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:13.634637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:13.635422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:13.635874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:13.636312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:13.674956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:13.676170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:13.690140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:13.692073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:13.695683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:13.699552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:13.700590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:13.702200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:13.918092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:13.940625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-90e5574b-281f-45f1-aec3-c5e828d4d2b1 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.272131 Oct 03 10:50:13.942506 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2419/4572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:13 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:14.192732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:14.193378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:14.200634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:14.201654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:14.202259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:14.203169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:14.204905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:14.206871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:14.684060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:14.695463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:14.697677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:14.699365 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c0c3eef-0cbf-4c69-8a10-6b2eb0834d0b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1674 microversion: 2.20 time: 0.511605 Oct 03 10:50:14.700055 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2420/4573] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:14 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1674 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:14.751638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:14.770383 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bbec201-867a-401a-aa2a-5bd7841f9a17 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.149214 Oct 03 10:50:14.772622 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2154/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:13 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:14.800439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:14.801279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:14.811959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:14.812632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:14.813298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:14.814168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:14.814720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:14.815277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:14.966671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:14.967558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:14.987321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:14.988232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:14.991495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:14.992306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:14.995341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:14.996093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.218015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:15.232541 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d742bfd-116c-4231-9cbc-dcf8a36a6007 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.436327 Oct 03 10:50:15.238918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2421/4575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:14 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:15.251680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:15.252728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:15.265801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.269750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.270452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.271441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.276319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.279609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.548616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:15.564840 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea616ebe-5814-460a-951b-fc5dd6eac5ac tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.603533 Oct 03 10:50:15.566635 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2155/4576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:14 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:15.572503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fcff9827-6428-46d1-bcef-faa7f02da5db req-5073fa62-c30b-4a23-97bf-dd5bf8a17937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb", "tag": "94515f26-5931-4964-9074-4a23d56d9e95"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:15.596334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fcff9827-6428-46d1-bcef-faa7f02da5db req-5073fa62-c30b-4a23-97bf-dd5bf8a17937 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.597813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fcff9827-6428-46d1-bcef-faa7f02da5db req-5073fa62-c30b-4a23-97bf-dd5bf8a17937 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.599363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fcff9827-6428-46d1-bcef-faa7f02da5db req-5073fa62-c30b-4a23-97bf-dd5bf8a17937 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.616853 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fcff9827-6428-46d1-bcef-faa7f02da5db req-5073fa62-c30b-4a23-97bf-dd5bf8a17937 service nova] Creating event network-changed:94515f26-5931-4964-9074-4a23d56d9e95 for instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb on n-h2-858383-3 Oct 03 10:50:15.623920 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fcff9827-6428-46d1-bcef-faa7f02da5db req-5073fa62-c30b-4a23-97bf-dd5bf8a17937 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055940 Oct 03 10:50:15.626033 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2156/4577] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:15.637139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:15.638565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:15.649132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.649870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.651529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.652990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.653647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.654707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.692577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Cannot 'restore' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action HTTP/1.1 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 15 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: {"restore": {}} Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'restore' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'restore': {}}} Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 in vm_state active. Cannot restore while the instance is in this state. Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:15.695013 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:15.700488 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:15.700488 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:15.700488 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:15.700488 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:15.700488 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:15.702448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 409 to user: Cannot 'restore' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:15.703609 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ed7d781-8344-4d88-b304-87873e69c8d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 409 len: 145 microversion: 2.1 time: 0.073894 Oct 03 10:50:15.704557 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2157/4578] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:15 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:50:15.718439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:15.719416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:15.727387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.729494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.730161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.731118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.731782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.733178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.772349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:15.799915 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24f5d094-38fc-4aa4-87ea-c89466a2e2b9 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1574 microversion: 2.1 time: 0.559621 Oct 03 10:50:15.821878 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2422/4579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:15 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1574 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:15.840121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:15.840738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:15.852826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.853463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.857173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:15.860079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:15.862089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:15.862761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:16.269599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:16.281403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:16.283243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:16.285278 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-797c2770-9ec4-4cc8-a7d7-700425a4ea76 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.453110 Oct 03 10:50:16.310731 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2423/4580] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:15 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:16.589973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:16.590605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:16.605848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:16.606354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:16.611059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:16.612585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:16.616271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:16.618102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:16.618623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:16.638831 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e9b56a8-99d3-4986-b2b7-67665d6dc7a4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.925013 Oct 03 10:50:16.639437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2158/4581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:15 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:16.683291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:16.684679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:16.705610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:16.706823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:16.707429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:16.711411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:16.713585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:16.714307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:17.265291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:17.285875 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48198cca-787a-4fc6-8c78-d3ac27807e3f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.701690 Oct 03 10:50:17.287137 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2424/4582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:16 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:17.317266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:17.318271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:17.335066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:17.335884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:17.336479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:17.338555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:17.339601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:17.340421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:17.615292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:17.633225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:17.647126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:17.648671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:17.649942 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e70c778a-71ae-4438-a2c9-171a5125eea3 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.337575 Oct 03 10:50:17.651112 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2425/4583] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:17 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:50:17.745590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:17.769762 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e33a0bb-c555-4a2e-b2cf-9d2355ed8d50 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 1.092123 Oct 03 10:50:17.773871 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2159/4584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:16 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:17.799510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed89d702-2e28-43ac-b02a-d8674098d7d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:17.800042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed89d702-2e28-43ac-b02a-d8674098d7d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 5de98e99-73eb-42e8-9770-bdc9288a4e04] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:17.802039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:17.808671 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ed89d702-2e28-43ac-b02a-d8674098d7d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 5de98e99-73eb-42e8-9770-bdc9288a4e04 could not be found. Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed89d702-2e28-43ac-b02a-d8674098d7d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/5de98e99-73eb-42e8-9770-bdc9288a4e04/action HTTP/1.1 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 14 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: {"resume": {}} Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 5de98e99-73eb-42e8-9770-bdc9288a4e04 could not be found. Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '5de98e99-73eb-42e8-9770-bdc9288a4e04', 'body': {'resume': {}}} Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de98e99-73eb-42e8-9770-bdc9288a4e04 could not be found. Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de98e99-73eb-42e8-9770-bdc9288a4e04 could not be found. Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:17.813031 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:17.818766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:17.818766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:17.818766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de98e99-73eb-42e8-9770-bdc9288a4e04 could not be found. Oct 03 10:50:17.818766 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:17.821800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed89d702-2e28-43ac-b02a-d8674098d7d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 5de98e99-73eb-42e8-9770-bdc9288a4e04 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:17.823457 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed89d702-2e28-43ac-b02a-d8674098d7d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/5de98e99-73eb-42e8-9770-bdc9288a4e04/action" status: 404 len: 111 microversion: 2.1 time: 0.029411 Oct 03 10:50:17.825186 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2426/4585] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:17 2022] POST /compute/v2.1/servers/5de98e99-73eb-42e8-9770-bdc9288a4e04/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:17.833780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:17.834947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:17.842381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:17.842882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:17.843309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:17.844009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:17.844467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:17.844930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:18.316777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:18.317722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:18.329046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:18.331011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:18.331601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:18.332175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:18.333254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:18.334775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:18.335292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:18.348003 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4fe66538-2b02-4aae-8032-a2fe14689d8d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.518205 Oct 03 10:50:18.348627 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2160/4586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:17 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:18.377879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e20de22d-7f8a-403b-8a34-16c806fe86ec req-192fb2a7-dee4-4455-97a4-5cf1fe9e9a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b", "tag": "d585f016-1faa-4dfb-99fb-90983874c447"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:18.411611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e20de22d-7f8a-403b-8a34-16c806fe86ec req-192fb2a7-dee4-4455-97a4-5cf1fe9e9a13 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:18.414286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e20de22d-7f8a-403b-8a34-16c806fe86ec req-192fb2a7-dee4-4455-97a4-5cf1fe9e9a13 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:18.416416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e20de22d-7f8a-403b-8a34-16c806fe86ec req-192fb2a7-dee4-4455-97a4-5cf1fe9e9a13 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:18.442401 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e20de22d-7f8a-403b-8a34-16c806fe86ec req-192fb2a7-dee4-4455-97a4-5cf1fe9e9a13 service nova] Creating event network-changed:d585f016-1faa-4dfb-99fb-90983874c447 for instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b on n-h1-858383-3 Oct 03 10:50:18.451185 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e20de22d-7f8a-403b-8a34-16c806fe86ec req-192fb2a7-dee4-4455-97a4-5cf1fe9e9a13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087310 Oct 03 10:50:18.452038 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2161/4587] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:18.459783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:18.460803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:18.471366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:18.472112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:18.472717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:18.474468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:18.475195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:18.475807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:18.752890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:18.771642 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a014e57-139e-4781-a10c-d95ef259fa48 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.463381 Oct 03 10:50:18.783163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2427/4588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:18 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:18.803855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:18.804738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:18.840923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:18.845821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:18.845821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:18.845821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:18.845821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:18.845821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:19.243453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:19.261748 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c6b2af30-c5e9-4bea-aeae-4c12218bcb40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.807964 Oct 03 10:50:19.266526 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2162/4589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:18 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:19.293660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:19.294583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:19.305831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:19.306388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:19.307679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:19.308117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:19.312814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:19.313840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:19.368425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Cannot 'resume' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action HTTP/1.1 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 14 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: {"resume": {}} Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'resume' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'resume': {}}} Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 in vm_state active. Cannot resume while the instance is in this state. Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:19.370773 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:19.375317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:19.375317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:19.375317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:19.375317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:19.375317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:19.375317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:50:19.375317 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:19.381422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 409 to user: Cannot 'resume' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:19.382564 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d18d1b2-dcb2-49b9-8b9c-ab03df3220e3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 409 len: 144 microversion: 2.1 time: 0.093847 Oct 03 10:50:19.385422 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2163/4590] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:19 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 144 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:50:19.395027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:19.401930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:19.423711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:19.424919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:19.425915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:19.430205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:19.431134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:19.434539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:19.994848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:20.014017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:20.018525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:20.022260 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f4bca12-3708-4490-a434-24379da2bff5 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 1.235992 Oct 03 10:50:20.027001 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2428/4591] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:18 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:20.036760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:20.037920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:20.056201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:20.057304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:20.057759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:20.058566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:20.059038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:20.059472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:20.080298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:20.097819 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d32f1963-420d-418a-84ad-6bc004700cf3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.709058 Oct 03 10:50:20.117658 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2164/4592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:19 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:20.145927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:20.153957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:20.163864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:20.164366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:20.168230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:20.168230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:20.170073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:20.170551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:20.627976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:20.639346 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51117e3d-ef0c-401a-b366-4f31e13c78a0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.610485 Oct 03 10:50:20.640499 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2429/4593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:20 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:21.014688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:21.026634 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ee415d3-bf64-47b8-8d44-cfb13183a740 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.892101 Oct 03 10:50:21.027834 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2165/4594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:20 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:21.067712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:21.076663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:21.088999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.094869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.095460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.096427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.099149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.099843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.308991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcc23194-a6cc-4fd8-a2e5-171c85bea952 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcc23194-a6cc-4fd8-a2e5-171c85bea952 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 160 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: {"server": {"name": "", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e7ae23a2-3981-4e49-a241-72d811fa94dc"}]}} Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f290423a-28bb-43d3-ba8c-d44fc0f72e5f', 'flavorRef': '452', 'networks': [{'uuid': 'e7ae23a2-3981-4e49-a241-72d811fa94dc'}]}}} Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi '' Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:50:21.313174 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:50:21.316885 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:21.319058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcc23194-a6cc-4fd8-a2e5-171c85bea952 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:21.320164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dcc23194-a6cc-4fd8-a2e5-171c85bea952 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016065 Oct 03 10:50:21.321058 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2166/4595] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:50:21 2022] POST /compute/v2.1/servers => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:50:21.331305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:21.331925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:21.334739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:21.342083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.342830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.342955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.343640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.350937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.353055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.359180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:21.747880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:21.766605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:21.768641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:21.777867 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-256c7868-ebb4-4357-9b94-248f4c97bbc8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.724803 Oct 03 10:50:21.779032 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2430/4596] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:21 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:21.793360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-24661fe5-06b0-403d-89f1-c0627b22e1e0 req-2ee7461d-6891-4b2a-bef7-25e18c5df961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:21.817985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-24661fe5-06b0-403d-89f1-c0627b22e1e0 req-2ee7461d-6891-4b2a-bef7-25e18c5df961 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.818722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-24661fe5-06b0-403d-89f1-c0627b22e1e0 req-2ee7461d-6891-4b2a-bef7-25e18c5df961 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.819327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-24661fe5-06b0-403d-89f1-c0627b22e1e0 req-2ee7461d-6891-4b2a-bef7-25e18c5df961 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.846853 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-24661fe5-06b0-403d-89f1-c0627b22e1e0 req-2ee7461d-6891-4b2a-bef7-25e18c5df961 service nova] Creating event network-changed:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h2-858383-3 Oct 03 10:50:21.852627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:21.869327 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7547141-549a-426c-a0f6-4c5cdf716b2f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.536031 Oct 03 10:50:21.871854 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2167/4597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:21 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:21.876306 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-24661fe5-06b0-403d-89f1-c0627b22e1e0 req-2ee7461d-6891-4b2a-bef7-25e18c5df961 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092993 Oct 03 10:50:21.881110 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2431/4598] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:21.886308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:21.886935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:21.907348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:21.909583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:21.918455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.921413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.922211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.923089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.924948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.926051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.928088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.930902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.931553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:21.932868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:21.934935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:21.936795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:22.236233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:22.246773 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91348b79-2e2a-41d3-9fb5-ebb46a6e9d1f tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.372398 Oct 03 10:50:22.247648 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2168/4599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:21 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:22.588475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:22.603009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1154fe0f-da6d-4c0c-be54-1e3b487ff616 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.706033 Oct 03 10:50:22.604407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2432/4600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:21 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:22.631677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f5c92d92-2f5b-4c27-bb11-6153c135e426 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:22.632215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f5c92d92-2f5b-4c27-bb11-6153c135e426 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 8e874dbb-c31d-4b27-8372-d45aa12e8dd9] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:22.649679 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f5c92d92-2f5b-4c27-bb11-6153c135e426 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 8e874dbb-c31d-4b27-8372-d45aa12e8dd9 could not be found. Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f5c92d92-2f5b-4c27-bb11-6153c135e426 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/8e874dbb-c31d-4b27-8372-d45aa12e8dd9/action HTTP/1.1 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 14 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: {"shelve": {}} Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 8e874dbb-c31d-4b27-8372-d45aa12e8dd9 could not be found. Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '8e874dbb-c31d-4b27-8372-d45aa12e8dd9', 'body': {'shelve': {}}} Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e874dbb-c31d-4b27-8372-d45aa12e8dd9 could not be found. Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e874dbb-c31d-4b27-8372-d45aa12e8dd9 could not be found. Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:22.658691 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:22.662862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:22.662862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:22.662862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e874dbb-c31d-4b27-8372-d45aa12e8dd9 could not be found. Oct 03 10:50:22.662862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:22.662862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f5c92d92-2f5b-4c27-bb11-6153c135e426 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 8e874dbb-c31d-4b27-8372-d45aa12e8dd9 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:22.662862 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f5c92d92-2f5b-4c27-bb11-6153c135e426 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/8e874dbb-c31d-4b27-8372-d45aa12e8dd9/action" status: 404 len: 111 microversion: 2.1 time: 0.034380 Oct 03 10:50:22.662862 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2169/4601] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:22 2022] POST /compute/v2.1/servers/8e874dbb-c31d-4b27-8372-d45aa12e8dd9/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:22.670426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:22.671119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:22.679314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:22.679897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:22.681152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:22.681859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:22.682206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:22.682632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:22.809345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:22.810218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:22.825713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:22.826550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:22.827067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:22.827852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:22.828401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:22.829739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:23.255478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:23.264237 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15554d3d-bf11-49e4-84b5-852d44880733 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.598524 Oct 03 10:50:23.276798 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2433/4602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:22 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:23.283428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:23.284291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:23.295515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:23.296354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:23.297024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:23.298115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:23.298766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:23.299395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:23.418258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:23.432157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:23.433865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:23.435300 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0baf8b79-db94-43be-a12a-b485b9c581eb tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.631520 Oct 03 10:50:23.441142 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2170/4603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:22 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:23.446005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:23.446607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:23.468290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:23.468711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:23.469194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:23.469914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:23.470369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:23.470989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:24.141202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:24.159371 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2dc14a8c-5d53-4e38-832b-f01b75781e08 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.714413 Oct 03 10:50:24.162057 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2171/4604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:23 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:24.189588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:24.190197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:24.201969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:24.202424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:24.203015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:24.203597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:24.204032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:24.204464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:24.236934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:24.249796 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d23b74d7-fd9e-4509-a77b-110926fceb59 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.980139 Oct 03 10:50:24.250916 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2434/4605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:23 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:24.282188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lazy-loading 'flavor' on Instance uuid 291b31e5-972b-4f07-817d-dcafef6fbcc8 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:50:24.471206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:24.472322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:24.486639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:24.487493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:24.488122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:24.492367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:24.493227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:24.494000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:24.802615 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9d10bce-dd24-4d71-a199-7b6f7935cdb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 202 len: 0 microversion: 2.1 time: 0.617387 Oct 03 10:50:24.803922 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2172/4606] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:50:24 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:24.813250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:24.819101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:24.838213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:24.839239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:24.839920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:24.843750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:24.844694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:24.845403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:25.305511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:25.324630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:25.332437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:25.335391 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2181cbd-7616-43d6-a79e-944b48858b08 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.868341 Oct 03 10:50:25.364381 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2435/4607] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:24 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:25.370465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:25.371373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:25.379980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:25.381216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:25.382140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:25.389131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:25.389783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:25.390564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:25.835755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:25.851521 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-60a9b8bc-c1b5-4803-8cca-80ce07653f22 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 1.042483 Oct 03 10:50:25.852146 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2173/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:24 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:26.050543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:26.053314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:26.071398 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9d88858-f9cd-4613-adae-2bfe3ac5d896 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.705250 Oct 03 10:50:26.072668 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2436/4609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:25 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:26.372354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:26.372968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:26.388151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:26.388259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:26.389363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:26.390931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:26.391417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:26.391888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:26.876423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:26.876971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:26.905947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:26.906453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:26.906922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:26.907630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:26.908095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:26.908527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:27.661183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:27.671513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:27.677333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:27.679972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58e75997-46b4-4f47-918c-d92bd5ffa1e0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 1.313278 Oct 03 10:50:27.684264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2174/4610] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:26 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:27.700973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:27.703341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:27.729876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:27.730759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:27.731846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:27.736891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:27.740167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:27.740864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:28.133473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:28.148566 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9c667ba-bba8-443f-bc09-9e36129502bf tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.462603 Oct 03 10:50:28.154757 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2175/4611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:27 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:28.182967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-276dc728-9741-436e-ae5a-865c09f26f89 req-1685d8aa-62c8-4fca-980f-c90b05ec72ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b", "name": "network-vif-plugged", "status": "completed", "tag": "d585f016-1faa-4dfb-99fb-90983874c447"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:28.222939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-276dc728-9741-436e-ae5a-865c09f26f89 req-1685d8aa-62c8-4fca-980f-c90b05ec72ab service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:28.224989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-276dc728-9741-436e-ae5a-865c09f26f89 req-1685d8aa-62c8-4fca-980f-c90b05ec72ab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:28.225435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-276dc728-9741-436e-ae5a-865c09f26f89 req-1685d8aa-62c8-4fca-980f-c90b05ec72ab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:28.270006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-276dc728-9741-436e-ae5a-865c09f26f89 req-1685d8aa-62c8-4fca-980f-c90b05ec72ab service nova] Creating event network-vif-plugged:d585f016-1faa-4dfb-99fb-90983874c447 for instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b on n-h1-858383-3 Oct 03 10:50:28.294500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-276dc728-9741-436e-ae5a-865c09f26f89 req-1685d8aa-62c8-4fca-980f-c90b05ec72ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135702 Oct 03 10:50:28.297366 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2176/4612] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:28.720385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:28.720385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:28.743107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:28.744530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:28.745783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:28.747996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:28.749721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:28.752421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:28.876413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:28.908374 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6beee049-a709-4126-a312-dbf18842de40 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 2.031140 Oct 03 10:50:28.910766 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2437/4613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:26 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:29.176030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:29.179587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:29.187067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:29.197353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:29.198246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:29.198529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:29.199187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:29.200292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:29.200965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:29.201560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:29.202672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:29.212084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d57d5e5f-dcc2-4ec0-9017-978c8ec83056 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.502772 Oct 03 10:50:29.214635 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2177/4614] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:28 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:29.764131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:29.773720 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a3508aa0-ecdb-40a1-a80c-d72917157b67 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1315 microversion: 2.1 time: 0.602356 Oct 03 10:50:29.778152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2438/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:29 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:29.934373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:29.936163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:29.957249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:29.965606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:29.965951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:29.966824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:29.976190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:29.979846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:30.244723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:30.246678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:30.279554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:30.281335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:30.281952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:30.282929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:30.289592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:30.290329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:30.752880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:30.772473 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e52e8d8-134c-4159-b885-b9d379641762 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.840455 Oct 03 10:50:30.773151 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2178/4616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:29 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:30.813222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:30.816186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:30.841845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:30.842353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:30.842802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:30.843532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:30.843993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:30.844423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:30.875234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:30.892810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:30.899780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:30.904574 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ddc5d98e-8e9a-450a-8b27-93a870b57a1b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.664431 Oct 03 10:50:30.905226 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2439/4617] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:30 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:50:31.367054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:31.378797 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e69b5fb3-b207-4588-8b89-210bb7308257 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1504 microversion: 2.1 time: 0.579171 Oct 03 10:50:31.379329 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2179/4618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:30 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:31.410189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:31.410679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:31.425803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:31.426344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:31.426812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:31.433696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:31.434999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:31.435630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:31.804868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:31.805734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:31.822479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:31.823931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:31.825839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:31.829836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:31.831173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:31.831628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:31.896566 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0955ce62-fbe9-4edb-82f6-993c7f59d8d7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.490548 Oct 03 10:50:31.897410 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2440/4619] 10.222.0.27 () {58 vars in 1296 bytes} [Mon Oct 3 10:50:31 2022] DELETE /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b/os-server-password => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:31.931985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:31.933937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:31.969017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:31.969889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:31.970366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:31.971247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:31.971584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:31.975631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:32.068908 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b6f158d0-ef05-4673-8991-4e59345817c7 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.161796 Oct 03 10:50:32.069563 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2441/4620] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 3 10:50:31 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b/os-server-password => generated 16 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:50:32.098140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:32.099068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:32.124386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:32.125447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:32.128150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:32.130410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:32.131923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:32.133210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:32.256235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:32.275773 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7439391b-5103-446e-a214-e750770e178d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.474976 Oct 03 10:50:32.277676 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2180/4621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:31 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:32.293007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:32.299083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:32.307376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:32.308819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:32.309534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:32.314535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:32.317441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:32.318442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:32.386725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:50:32.538224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:32.633098 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f6edfeab-aee2-4e8d-a7e9-f8863eb5c2f5 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 204 len: 0 microversion: 2.1 time: 0.353285 Oct 03 10:50:32.637428 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2181/4622] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:50:32 2022] DELETE /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:32.644913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:32.645936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:32.655094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:32.655835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:32.656639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:32.669395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:32.670109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:32.671786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:32.723000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:32.751802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:32.756411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:32.762932 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe46b185-4c34-4477-8cdc-af2c9c81bd40 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.684599 Oct 03 10:50:32.769021 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2442/4623] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:32 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:33.034304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:33.052228 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-997a4448-44f6-47b7-9765-197a4313e104 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1510 microversion: 2.1 time: 0.412909 Oct 03 10:50:33.054244 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2182/4624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:32 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:33.303177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:33.304462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:33.330601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:33.331434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:33.332058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:33.333128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:33.335942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:33.336602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:33.801113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:33.802952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:33.832808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:33.836178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:33.836916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:33.838365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:33.840821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:33.841518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:33.888693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:33.898243 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96768e93-774c-48d2-9d8b-b1be795a5379 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.600763 Oct 03 10:50:33.917964 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2443/4625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:33 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:34.075857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:34.076637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:34.088460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:34.098050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:34.098995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:34.099991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:34.102375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:34.103746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:34.250086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:34.274214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:34.276029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:34.277385 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a15d71e-f851-4c9b-a127-4a8152c99ab4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.481500 Oct 03 10:50:34.278082 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2183/4626] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:33 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:34.757873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:34.772437 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-979b2468-731d-4a50-8d40-4d920612540c tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1510 microversion: 2.1 time: 0.700543 Oct 03 10:50:34.794601 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2444/4627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:34 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1510 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:34.924194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:34.925094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:34.946678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:34.951353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:34.953381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:34.954378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:34.957341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:34.957998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:35.308089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:35.308835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:35.319862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:35.320375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:35.320879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:35.328553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:35.336620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:35.341730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:35.515671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:35.549682 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-38eefd4d-3bc5-48a4-9d3f-2eaeccb18942 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.613656 Oct 03 10:50:35.551117 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2184/4628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:34 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:35.914067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ce923a3-dcc4-46b5-9c1a-29e86e0ec9c4 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e1ff4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1419317009", "description": "tempest-description-1236925679"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:36.093779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:36.114633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:36.116956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:36.118496 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2833d92b-3e79-44ea-8e7f-1e3a4105a354 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.814760 Oct 03 10:50:36.119196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2445/4629] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:35 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:50:36.137496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-46319a97-d3bf-4378-9d5c-2d553c52871f req-566d5786-5609-4c55-8f68-56d0b54476f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b", "name": "network-vif-deleted", "tag": "d585f016-1faa-4dfb-99fb-90983874c447"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:36.156356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-46319a97-d3bf-4378-9d5c-2d553c52871f req-566d5786-5609-4c55-8f68-56d0b54476f1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:36.157866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-46319a97-d3bf-4378-9d5c-2d553c52871f req-566d5786-5609-4c55-8f68-56d0b54476f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:36.158322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-46319a97-d3bf-4378-9d5c-2d553c52871f req-566d5786-5609-4c55-8f68-56d0b54476f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:36.194722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-46319a97-d3bf-4378-9d5c-2d553c52871f req-566d5786-5609-4c55-8f68-56d0b54476f1 service nova] Creating event network-vif-deleted:d585f016-1faa-4dfb-99fb-90983874c447 for instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b on n-h1-858383-3 Oct 03 10:50:36.209010 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-46319a97-d3bf-4378-9d5c-2d553c52871f req-566d5786-5609-4c55-8f68-56d0b54476f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088416 Oct 03 10:50:36.213635 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2446/4630] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:36.232455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:36.233256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:36.248954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:36.249517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:36.249973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:36.250700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:36.251156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:36.251585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:36.360074 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ce923a3-dcc4-46b5-9c1a-29e86e0ec9c4 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.773525 Oct 03 10:50:36.361922 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2185/4631] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:50:35 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:36.362990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:36.363994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:36.364862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:36.366350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lazy-loading 'fault' on Instance uuid cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:50:36.378400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1be2d06a-b2ca-4e8e-a442-4ed8f8453af7 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e48cc10>, body: {"security_group_rule": {"parent_group_id": "0ea61c01-a110-440f-a9a1-795e4ba9d4d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:36.618083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c81f64f90d64c5ea348e13a87061d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e2c7d56164c55b054403c99f232b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:36.632616 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-55919e13-592e-41f1-ad76-d7b59839ad80 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 200 len: 1305 microversion: 2.1 time: 0.415334 Oct 03 10:50:36.635208 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2447/4632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:36 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 1305 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:36.647471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:36.651524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:36.669586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:36.676098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:36.676640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:36.682105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:36.685624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:36.686105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:36.797231 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1be2d06a-b2ca-4e8e-a442-4ed8f8453af7 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.423999 Oct 03 10:50:36.798177 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2186/4633] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:50:36.810096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa4bf538-e600-44c6-878d-040fa05aa4f3 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e173dc0>, body: {"security_group_rule": {"parent_group_id": "0ea61c01-a110-440f-a9a1-795e4ba9d4d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:36.935189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:36.945169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14878c03-43c6-4cec-834d-9cf82b4ec4b3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.308599 Oct 03 10:50:36.952284 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-aa4bf538-e600-44c6-878d-040fa05aa4f3 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: This rule already exists in group 0ea61c01-a110-440f-a9a1-795e4ba9d4d3 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa4bf538-e600-44c6-878d-040fa05aa4f3 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 138 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: {"security_group_rule": {"parent_group_id": "0ea61c01-a110-440f-a9a1-795e4ba9d4d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: exception: This rule already exists in group 0ea61c01-a110-440f-a9a1-795e4ba9d4d3 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ea61c01-a110-440f-a9a1-795e4ba9d4d3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0ea61c01-a110-440f-a9a1-795e4ba9d4d3 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0ea61c01-a110-440f-a9a1-795e4ba9d4d3 Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:36.954728 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:36.959296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:36.959296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:36.959296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0ea61c01-a110-440f-a9a1-795e4ba9d4d3 Oct 03 10:50:36.959296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:36.960588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa4bf538-e600-44c6-878d-040fa05aa4f3 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 400 to user: This rule already exists in group 0ea61c01-a110-440f-a9a1-795e4ba9d4d3 {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:36.961648 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa4bf538-e600-44c6-878d-040fa05aa4f3 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.155941 Oct 03 10:50:36.963660 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2187/4634] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:36 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 10:50:36.965203 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2448/4635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:36 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:36.972826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d04eb75b-9f24-45db-987f-913c698501b7 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Calling method '.version_select at 0x7f074e173820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:37.145612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:37.146448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:37.158616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:37.159147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:37.159605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:37.164958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:37.167086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:37.169726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:37.371467 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d04eb75b-9f24-45db-987f-913c698501b7 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/bdbf0e3a-d4d0-4b3a-8a90-32d85e716ca1" status: 202 len: 0 microversion: 2.1 time: 0.404399 Oct 03 10:50:37.372793 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2188/4636] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 3 10:50:36 2022] DELETE /compute/v2.1/os-security-group-rules/bdbf0e3a-d4d0-4b3a-8a90-32d85e716ca1 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:37.384381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47671c63-d077-492b-8ae1-131ff188d355 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e1ffdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-334853579", "description": "tempest-description-1915427337"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:37.657386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:37.672311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:37.684806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:37.693414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95a3147a-c757-4e04-8dd1-67b1bfc0908b tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.544820 Oct 03 10:50:37.700327 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2449/4637] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:37 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:50:37.738210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:37.741584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] [instance: cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:37.755506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:37.765362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:37.766125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:37.767172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:37.799577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47671c63-d077-492b-8ae1-131ff188d355 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.415251 Oct 03 10:50:37.799577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2189/4638] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:50:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:50:37.799897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:37.799897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:37.823405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93034d38-d6ad-45fb-8dbb-f00f935c871c tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e1ffaf0>, body: {"security_group_rule": {"parent_group_id": "7649031c-71ee-4eb8-b262-c5fb98615e34", "ip_protocol": "tcp", "from_port": 1850731798, "to_port": 22}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:37.871954 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] HTTP exception thrown: Instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b could not be found. Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Request method failure captured: Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b HTTP/1.1 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr5dZJl047yM3iDCdJb65VxKtpaf_hEGa7VSUDBufptzYFUevsxEUaKUcOq6hO4qVVDXc-GeFKrloaWtwuSEWQ8UYXXOsZUx4Rni3Ip-N91i8zZhpPoPLmnrtpV6pS2Ov9u0rEa8OXqFiWlFMjfEWY-IwY6gKYcTVE5KxCL_D1xoZ3w Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: c17e2c7d56164c55b054403c99f232b4 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerPasswordTestJSON-1558545888 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c17e2c7d56164c55b054403c99f232b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c17e2c7d56164c55b054403c99f232b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c17e2c7d56164c55b054403c99f232b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c17e2c7d56164c55b054403c99f232b4"}]}] Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerPasswordTestJSON-1558545888 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: c17e2c7d56164c55b054403c99f232b4 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1558545888 Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerPasswordTestJSON-1558545888-project Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 4c81f64f90d64c5ea348e13a87061d6d Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerPasswordTestJSON-1558545888-project Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b could not be found. Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b'} Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b could not be found. Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b could not be found. Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:37.873895 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b could not be found. Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] Returning 404 to user: Instance cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:37.878730 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-519093a2-6631-4ee6-abb3-e83abd8a0bd0 tempest-ServerPasswordTestJSON-1558545888 tempest-ServerPasswordTestJSON-1558545888-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b" status: 404 len: 111 microversion: 2.1 time: 0.151465 Oct 03 10:50:37.888016 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2450/4639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:37 2022] GET /compute/v2.1/servers/cfc6dd59-5c69-4f68-8d6a-4b8cddcfb59b => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:37.984360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:37.988592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:37.996855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:37.997707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:37.998372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:37.999342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:38.004040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:38.005387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:38.107761 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-93034d38-d6ad-45fb-8dbb-f00f935c871c tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: Invalid port range 1850731798:22. Former value cannot be greater than the later Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93034d38-d6ad-45fb-8dbb-f00f935c871c tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 146 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: {"security_group_rule": {"parent_group_id": "7649031c-71ee-4eb8-b262-c5fb98615e34", "ip_protocol": "tcp", "from_port": 1850731798, "to_port": 22}} Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid port range 1850731798:22. Former value cannot be greater than the later Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7649031c-71ee-4eb8-b262-c5fb98615e34', 'ip_protocol': 'tcp', 'from_port': 1850731798, 'to_port': 22}}} Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1850731798:22. Former value cannot be greater than the later Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1850731798:22. Former value cannot be greater than the later Oct 03 10:50:38.109996 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1850731798:22. Former value cannot be greater than the later Oct 03 10:50:38.115160 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.118295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93034d38-d6ad-45fb-8dbb-f00f935c871c tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 400 to user: Invalid port range 1850731798:22. Former value cannot be greater than the later {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:38.119974 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93034d38-d6ad-45fb-8dbb-f00f935c871c tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.311935 Oct 03 10:50:38.121098 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2190/4640] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:37 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 314 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:50:38.133019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-59cfd61b-76f6-475c-8024-304321f6b3cd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e2ba4c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1072157817", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:38.139701 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-59cfd61b-76f6-475c-8024-304321f6b3cd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: Security group id should be uuid Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-59cfd61b-76f6-475c-8024-304321f6b3cd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 131 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1072157817", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: exception: Security group id should be uuid Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1072157817', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:38.146666 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:38.151011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 03 10:50:38.151011 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:38.153548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-59cfd61b-76f6-475c-8024-304321f6b3cd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 400 to user: Security group id should be uuid {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:38.154922 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-59cfd61b-76f6-475c-8024-304321f6b3cd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028845 Oct 03 10:50:38.156247 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2191/4641] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:38 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:50:38.165884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42beb9f8-11d3-4533-8a50-c97418c31be7 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f0757492d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1515618297", "description": "tempest-description-168713567"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:38.412567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:38.439114 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9e330c6-54e3-4a6a-9160-dc393df53c91 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.467871 Oct 03 10:50:38.454131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2451/4642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:37 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:38.717145 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42beb9f8-11d3-4533-8a50-c97418c31be7 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.555499 Oct 03 10:50:38.718340 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2192/4643] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:50:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:50:38.733988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:38.737233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f00c2efa-3eff-453e-bc79-3b837228bdbd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074ea6c790>, body: {"security_group_rule": {"parent_group_id": "dcdd07bf-5621-4145-9397-6b3ce1a2104d", "ip_protocol": "tempest-999-109412749", "from_port": 22, "to_port": 22}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:38.738214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:38.756235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:38.758159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:38.761046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:38.762818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:38.763555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:38.765518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:39.116220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f00c2efa-3eff-453e-bc79-3b837228bdbd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: Invalid IP protocol tempest-999-109412749. Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f00c2efa-3eff-453e-bc79-3b837228bdbd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 156 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: {"security_group_rule": {"parent_group_id": "dcdd07bf-5621-4145-9397-6b3ce1a2104d", "ip_protocol": "tempest-999-109412749", "from_port": 22, "to_port": 22}} Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: exception: Invalid IP protocol tempest-999-109412749. Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dcdd07bf-5621-4145-9397-6b3ce1a2104d', 'ip_protocol': 'tempest-999-109412749', 'from_port': 22, 'to_port': 22}}} Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-109412749. Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-109412749. Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:39.118088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-109412749. Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f00c2efa-3eff-453e-bc79-3b837228bdbd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 400 to user: Invalid IP protocol tempest-999-109412749. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f00c2efa-3eff-453e-bc79-3b837228bdbd tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.393106 Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2193/4644] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:38 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 394 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 10:50:39.137425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-45c8d68d-029b-48b6-ac4a-44c6fd4b59b6 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e1739d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1918043789", "description": "tempest-description-1333153352"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:39.216568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:39.252886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:39.255542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:39.268002 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-739fadec-ba41-4067-9dbd-e93b4c5504d0 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.537566 Oct 03 10:50:39.299825 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2452/4645] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:38 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:39.463754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:39.464580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:39.478958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:39.479758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:39.482292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:39.483144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:39.483729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:39.488303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:39.515761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:39.849774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:39.861172 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8d64b6b7-45f7-4012-b088-8e0d19d415d0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.401313 Oct 03 10:50:39.861779 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2453/4646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:39 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:40.328250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:40.329155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:40.338633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:40.341093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:40.341538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:40.342292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:40.342756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:40.343187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:40.991586 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-45c8d68d-029b-48b6-ac4a-44c6fd4b59b6 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.862098 Oct 03 10:50:40.992069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:41.001289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2194/4647] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:50:39 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:41.001289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:41.001289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:41.009778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:41.011449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:41.013879 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b631015-93ca-43ac-8204-0c5391a2e25c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.689512 Oct 03 10:50:41.016252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:41.016633 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2454/4648] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:40 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:50:41.018457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:41.019343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:41.021474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:41.024061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:41.026040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:41.027310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a46cf45c-9122-46ac-9981-e8bf727d1c80 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e1a4940>, body: {"security_group_rule": {"parent_group_id": "ae880061-3813-46f4-93ad-90b00c9ab1da", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:41.374184 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-a46cf45c-9122-46ac-9981-e8bf727d1c80 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a46cf45c-9122-46ac-9981-e8bf727d1c80 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 138 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: {"security_group_rule": {"parent_group_id": "ae880061-3813-46f4-93ad-90b00c9ab1da", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ae880061-3813-46f4-93ad-90b00c9ab1da', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 10:50:41.376030 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 10:50:41.380307 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:41.383407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a46cf45c-9122-46ac-9981-e8bf727d1c80 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:41.387280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a46cf45c-9122-46ac-9981-e8bf727d1c80 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.369421 Oct 03 10:50:41.388189 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2455/4649] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:41 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 371 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:50:41.402922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3291ee6e-ef8a-412d-9787-2471c3a1da5b tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074df425e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-616750403", "description": "tempest-description-654550713"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:41.628000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:41.644975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64d0fb38-bed4-4bff-9349-ccf5d599f37e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.650968 Oct 03 10:50:41.652153 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2195/4650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:40 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:41.726458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:41.799282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:41.803415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Searching by: {'deleted': False, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:50:41.818341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:41.820207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:41.821659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:41.823714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:41.826814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:41.828947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:41.975896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:50:42.020950 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3291ee6e-ef8a-412d-9787-2471c3a1da5b tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.625358 Oct 03 10:50:42.024535 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2456/4651] 10.222.0.27 () {60 vars in 1180 bytes} [Mon Oct 3 10:50:41 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:42.046967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-352d6b5b-9a48-4478-a3ba-10c5ca3daa29 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074df423a0>, body: {"security_group_rule": {"parent_group_id": "66b96c09-d877-4eeb-986b-5c0737b281c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1822027684}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:42.079639 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91c9a011-bd1c-483e-9908-5755f32d8352 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 332 microversion: 2.1 time: 0.357614 Oct 03 10:50:42.094096 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2196/4652] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:50:41 2022] GET /compute/v2.1/servers => generated 332 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:42.129333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:42.132808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:42.178999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:42.181538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:42.186864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:42.190187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:42.193454 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-352d6b5b-9a48-4478-a3ba-10c5ca3daa29 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: Invalid port range 22:1822027684. Valid TCP ports should be between 1-65535 Oct 03 10:50:42.193799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-352d6b5b-9a48-4478-a3ba-10c5ca3daa29 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 146 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: {"security_group_rule": {"parent_group_id": "66b96c09-d877-4eeb-986b-5c0737b281c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1822027684}} Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid port range 22:1822027684. Valid TCP ports should be between 1-65535 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'security_group_rule': {'parent_group_id': '66b96c09-d877-4eeb-986b-5c0737b281c5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1822027684}}} Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1822027684. Valid TCP ports should be between 1-65535 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1822027684. Valid TCP ports should be between 1-65535 Oct 03 10:50:42.195480 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1822027684. Valid TCP ports should be between 1-65535 Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-352d6b5b-9a48-4478-a3ba-10c5ca3daa29 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 400 to user: Invalid port range 22:1822027684. Valid TCP ports should be between 1-65535 {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:42.199769 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-352d6b5b-9a48-4478-a3ba-10c5ca3daa29 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.165359 Oct 03 10:50:42.203018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:42.203649 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2457/4653] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:42 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:50:42.225048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:42.255329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:42.257480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Searching by: {'deleted': False, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:50:42.278699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:42.279200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:42.279643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:42.280375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:42.280863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:42.281310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:42.400475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:50:42.496034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:42.505707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:42.506383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:42.507033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:42.703005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:42.720051 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c749e1da-7223-410d-b2d9-8f3012e6e577 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.515236 Oct 03 10:50:42.720848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2458/4654] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:50:42 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:42.726409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-413a12e2-2181-42b1-b5ce-242e43b0bb32 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Action: 'create', calling method: .version_select at 0x7f074e1a4280>, body: {"security_group_rule": {"parent_group_id": "ae09c14c-8cff-4a3d-901f-4b9075908996", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:42.730901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:42.734589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:42.745930 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1232d016-3c29-4713-a420-dcfc9bde07b2 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.650406 Oct 03 10:50:42.747178 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2197/4655] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:42 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:42.758378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:42.760129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:42.764653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-413a12e2-2181-42b1-b5ce-242e43b0bb32 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:50:42.765809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-413a12e2-2181-42b1-b5ce-242e43b0bb32 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Neutron security group ae09c14c-8cff-4a3d-901f-4b9075908996 not found {{(pid=122269) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 10:50:42.766500 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-413a12e2-2181-42b1-b5ce-242e43b0bb32 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist Oct 03 10:50:42.766500 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-f5681517-f877-4a2f-806c-f15b1434cace'] Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-413a12e2-2181-42b1-b5ce-242e43b0bb32 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 138 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: {"security_group_rule": {"parent_group_id": "ae09c14c-8cff-4a3d-901f-4b9075908996", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-f5681517-f877-4a2f-806c-f15b1434cace'] Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ae09c14c-8cff-4a3d-901f-4b9075908996', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:50:42.769503 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5681517-f877-4a2f-806c-f15b1434cace'] Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5681517-f877-4a2f-806c-f15b1434cace'] Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5681517-f877-4a2f-806c-f15b1434cace'] Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5681517-f877-4a2f-806c-f15b1434cace'] Oct 03 10:50:42.776527 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.784220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:42.784220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:42.784467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-413a12e2-2181-42b1-b5ce-242e43b0bb32 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 404 to user: Security group ae09c14c-8cff-4a3d-901f-4b9075908996 does not exist Oct 03 10:50:42.784467 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-f5681517-f877-4a2f-806c-f15b1434cace'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:42.784828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:42.784984 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-413a12e2-2181-42b1-b5ce-242e43b0bb32 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.061240 Oct 03 10:50:42.784984 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2459/4656] 10.222.0.27 () {60 vars in 1195 bytes} [Mon Oct 3 10:50:42 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:42.792340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:42.793512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-663c6c06-63b8-4cae-ac96-9170e76fc472 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:42.797330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:42.797884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:42.806959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-663c6c06-63b8-4cae-ac96-9170e76fc472 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020867 Oct 03 10:50:42.816430 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2460/4657] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:50:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:42.833618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f6dbf1d-c4d0-42c1-a171-52c34537217d tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Calling method '.version_select at 0x7f074df42ee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:42.863770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG neutronclient.v2_0.client [None req-1f6dbf1d-c4d0-42c1-a171-52c34537217d tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist", "detail": ""}} {{(pid=122269) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 10:50:42.864542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.security_group_api [None req-1f6dbf1d-c4d0-42c1-a171-52c34537217d tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Neutron security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb not found {{(pid=122269) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 03 10:50:42.865078 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1f6dbf1d-c4d0-42c1-a171-52c34537217d tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] HTTP exception thrown: Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist Oct 03 10:50:42.865078 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-aaf2bfd0-a52b-4886-a326-66a7df73fcaf'] Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f6dbf1d-c4d0-42c1-a171-52c34537217d tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Request method failure captured: Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-security-group-rules/242419ff-02c6-4f34-a745-a43c6c18b8eb HTTP/1.1 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr57j2md-urGek1BgmKHId7AmtE-K_Nyx8hcMjf5EsaMLVJsWvylG36rVNPKpRQkTKym7-blFkplwD3Q_9F-Flp821h1jynVQ8yTwnl0-PsRvzmf2v1dA-LvC2mU9nlTMBXcUtk5Ktd9ILr-zv9q2OOcmAQu78PJl1pCnJZ-TP79JwQ Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e64043086c5644de9e1971ab894deae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e64043086c5644de9e1971ab894deae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e64043086c5644de9e1971ab894deae3"}]}] Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: e64043086c5644de9e1971ab894deae3 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: ee8dc31bb5bd41308071ab13ad4adf60 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-398266724-project Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: exception: Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-aaf2bfd0-a52b-4886-a326-66a7df73fcaf'] Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '242419ff-02c6-4f34-a745-a43c6c18b8eb'} Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 10:50:42.868197 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaf2bfd0-a52b-4886-a326-66a7df73fcaf'] Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaf2bfd0-a52b-4886-a326-66a7df73fcaf'] Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaf2bfd0-a52b-4886-a326-66a7df73fcaf'] Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaf2bfd0-a52b-4886-a326-66a7df73fcaf'] Oct 03 10:50:42.872242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:42.876619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f6dbf1d-c4d0-42c1-a171-52c34537217d tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Returning 404 to user: Security group rule 242419ff-02c6-4f34-a745-a43c6c18b8eb does not exist Oct 03 10:50:42.876619 n-d-858383-3 devstack@n-api.service[122269]: Neutron server returns request_ids: ['req-aaf2bfd0-a52b-4886-a326-66a7df73fcaf'] {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:42.878104 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1f6dbf1d-c4d0-42c1-a171-52c34537217d tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/242419ff-02c6-4f34-a745-a43c6c18b8eb" status: 404 len: 199 microversion: 2.1 time: 0.060641 Oct 03 10:50:42.878919 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2461/4658] 10.222.0.27 () {58 vars in 1287 bytes} [Mon Oct 3 10:50:42 2022] DELETE /compute/v2.1/os-security-group-rules/242419ff-02c6-4f34-a745-a43c6c18b8eb => generated 199 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:50:42.911184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8cf7856-0574-4095-93f1-dae64b5705c5 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Calling method '.version_select at 0x7f074e20c790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:43.197355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:43.213288 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-421ef163-8764-4dd5-a897-2228967f3fc3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.464218 Oct 03 10:50:43.216843 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2198/4659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:42 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:43.233644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1462ec35-6b4b-4a45-a324-d7141055c2b4 req-2a3aa636-736f-42ec-a07c-f4f5a0d4943b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "name": "network-vif-plugged", "status": "completed", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:43.253095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1462ec35-6b4b-4a45-a324-d7141055c2b4 req-2a3aa636-736f-42ec-a07c-f4f5a0d4943b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:43.253851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1462ec35-6b4b-4a45-a324-d7141055c2b4 req-2a3aa636-736f-42ec-a07c-f4f5a0d4943b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:43.254458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1462ec35-6b4b-4a45-a324-d7141055c2b4 req-2a3aa636-736f-42ec-a07c-f4f5a0d4943b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:43.267957 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1462ec35-6b4b-4a45-a324-d7141055c2b4 req-2a3aa636-736f-42ec-a07c-f4f5a0d4943b service nova] Creating event network-vif-plugged:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h2-858383-3 Oct 03 10:50:43.273978 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1462ec35-6b4b-4a45-a324-d7141055c2b4 req-2a3aa636-736f-42ec-a07c-f4f5a0d4943b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053501 Oct 03 10:50:43.275662 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2199/4660] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:43.281102 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8cf7856-0574-4095-93f1-dae64b5705c5 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/66b96c09-d877-4eeb-986b-5c0737b281c5" status: 202 len: 0 microversion: 2.1 time: 0.375884 Oct 03 10:50:43.281849 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2462/4661] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:50:42 2022] DELETE /compute/v2.1/os-security-groups/66b96c09-d877-4eeb-986b-5c0737b281c5 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:43.286878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:43.287661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:43.294227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e58cc78-478b-4211-ba07-061fc10ba3a6 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Calling method '.version_select at 0x7f074df42d30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:43.296758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:43.297479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:43.298085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:43.299101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:43.299726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:43.300439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:43.334351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:50:43.530914 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43dff3db-1af8-4c05-bb17-4a476cbed5f3 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 204 len: 0 microversion: 2.1 time: 0.252830 Oct 03 10:50:43.531681 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2200/4662] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:50:43 2022] DELETE /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:50:43.543727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:43.544731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:43.553069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:43.553739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:43.554329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:43.555210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:43.555841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:43.556999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:43.825494 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e58cc78-478b-4211-ba07-061fc10ba3a6 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ae880061-3813-46f4-93ad-90b00c9ab1da" status: 202 len: 0 microversion: 2.1 time: 0.538143 Oct 03 10:50:43.826452 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2463/4663] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:50:43 2022] DELETE /compute/v2.1/os-security-groups/ae880061-3813-46f4-93ad-90b00c9ab1da => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:43.831525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:43.832154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:43.834132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=83 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:43.853792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:43.854211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:43.854657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:43.855389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:43.855851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:43.856291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:43.970407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:43.980163 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-501d147e-a12f-4b6c-8785-b29246c53dcf tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1698 microversion: 2.1 time: 0.443270 Oct 03 10:50:43.983839 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2201/4664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:43 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1698 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:43.994154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65ded9a2-98ab-461e-a8d6-44c40b3d9766 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Calling method '.version_select at 0x7f074e252ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:44.317616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:44.330567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:44.332264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:44.334224 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5003bac1-426d-421b-a5df-3ea56d87427f tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.506610 Oct 03 10:50:44.335746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2464/4665] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:43 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:44.342275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:44.343233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:44.379138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:44.381226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:44.382681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:44.383509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:44.385564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:44.386531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:44.589493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65ded9a2-98ab-461e-a8d6-44c40b3d9766 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/dcdd07bf-5621-4145-9397-6b3ce1a2104d" status: 202 len: 0 microversion: 2.1 time: 0.604392 Oct 03 10:50:44.590721 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2202/4666] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:50:43 2022] DELETE /compute/v2.1/os-security-groups/dcdd07bf-5621-4145-9397-6b3ce1a2104d => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:44.598561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:44.601104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e749ca9-9860-4a1a-8ed6-29c24e9a85a8 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Calling method '.version_select at 0x7f074e252e50>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:44.615497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3651270-1f38-40e8-a4ad-ee82253c6a15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.277982 Oct 03 10:50:44.617165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2465/4667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:44 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:45.009453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:45.010502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:45.021443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:45.023279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:45.024341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:45.028401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:45.030406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:45.032063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:45.343474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:45.353910 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7659066d-0585-4a6e-935c-97896a52f2d4 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1698 microversion: 2.1 time: 0.348540 Oct 03 10:50:45.355124 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2466/4668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:45 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1698 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:45.368537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:45.369721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:45.378824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:45.379694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:45.380463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:45.381363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:45.381991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:45.382511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:45.602718 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e749ca9-9860-4a1a-8ed6-29c24e9a85a8 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7649031c-71ee-4eb8-b262-c5fb98615e34" status: 202 len: 0 microversion: 2.1 time: 1.006410 Oct 03 10:50:45.605845 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2203/4669] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:50:44 2022] DELETE /compute/v2.1/os-security-groups/7649031c-71ee-4eb8-b262-c5fb98615e34 => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:45.617671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed8d7eee-6e71-4b6a-881e-58e4b92d0395 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] Calling method '.version_select at 0x7f074f23ac10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:45.744533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:45.755009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:45.759315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:45.760902 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3c15ae06-c104-44cc-9201-a63900cc3569 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.398566 Oct 03 10:50:45.762796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2467/4670] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:45 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:45.770975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:45.771701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:45.779136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:45.779640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:45.780463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:45.781385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:45.782043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:45.782674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:46.106007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:46.119531 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a44e0bae-ef43-4899-bbf2-8738d9a45fb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.354877 Oct 03 10:50:46.121262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2468/4671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:45 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:46.378467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:46.379788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:46.388960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:46.389664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:46.390624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:46.391617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:46.393053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:46.394850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:46.568167 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed8d7eee-6e71-4b6a-881e-58e4b92d0395 tempest-SecurityGroupRulesNegativeTestJSON-398266724 tempest-SecurityGroupRulesNegativeTestJSON-398266724-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0ea61c01-a110-440f-a9a1-795e4ba9d4d3" status: 202 len: 0 microversion: 2.1 time: 0.957861 Oct 03 10:50:46.592599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2204/4672] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 10:50:45 2022] DELETE /compute/v2.1/os-security-groups/0ea61c01-a110-440f-a9a1-795e4ba9d4d3 => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:46.791427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:46.792751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:46.806852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:46.808165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:46.808625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:46.811254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:46.813652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:46.814133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:46.990251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:47.000899 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3611c18f-f206-47b2-8d78-d02d7c619a0e tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1698 microversion: 2.1 time: 0.626195 Oct 03 10:50:47.003799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2469/4673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:46 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1698 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:47.153724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:47.154400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:47.163707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:47.164608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:47.165413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:47.166633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:47.169222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:47.169904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:47.475233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:47.490128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:47.492544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:47.500890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:47.504412 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf6a5293-d673-4f6b-ba6e-482fc10c037d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.357667 Oct 03 10:50:47.504863 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19ba96d0-1b33-4f24-a5d4-6b3a8a023a35 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1732 microversion: 2.20 time: 0.719085 Oct 03 10:50:47.515165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2470/4674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:47 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:47.551848 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2205/4675] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:46 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1732 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:48.031811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:48.032798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:48.047046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:48.047546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:48.047996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:48.048719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:48.049210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:48.049648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:48.052403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-139e7ad9-d6a9-4243-8b65-70bcab18d381 tempest-ComputeTenantNetworksTest-2143654056 tempest-ComputeTenantNetworksTest-2143654056-project] Calling method '.version_select at 0x7f074f2100d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:48.157934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:48.173926 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b2332ff-edb8-4d1a-9441-8360009eb0e0 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1630 microversion: 2.1 time: 0.146293 Oct 03 10:50:48.174544 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2206/4676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:48 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1630 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:48.531329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:48.532234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:48.551374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:48.551374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:48.553553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:48.554898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:48.557817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:48.558277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:48.598464 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-139e7ad9-d6a9-4243-8b65-70bcab18d381 tempest-ComputeTenantNetworksTest-2143654056 tempest-ComputeTenantNetworksTest-2143654056-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.081051 Oct 03 10:50:48.599350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2471/4677] 10.222.0.27 () {58 vars in 1158 bytes} [Mon Oct 3 10:50:47 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:48.617969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:48.621004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:48.640979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:48.642027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:48.647205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:48.651192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:48.654871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:48.656019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:48.877568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:48.888095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:48.890220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:48.892576 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c4b8f99-7526-4192-a492-e68117dc4477 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1719 microversion: 2.20 time: 0.291570 Oct 03 10:50:48.894071 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2472/4678] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:50:48 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1719 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:50:48.902900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-612f6097-1fb2-4928-bf25-39f34efed4a7 tempest-ComputeTenantNetworksTest-2143654056 tempest-ComputeTenantNetworksTest-2143654056-project] Calling method '.version_select at 0x7f074df67940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:49.015671 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-612f6097-1fb2-4928-bf25-39f34efed4a7 tempest-ComputeTenantNetworksTest-2143654056 tempest-ComputeTenantNetworksTest-2143654056-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/38a9ddc1-1cdc-4b86-87aa-ce5a58756cda" status: 200 len: 140 microversion: 2.1 time: 0.120367 Oct 03 10:50:49.016249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2473/4679] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 10:50:48 2022] GET /compute/v2.1/os-tenant-networks/38a9ddc1-1cdc-4b86-87aa-ce5a58756cda => generated 140 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:49.203627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:49.204155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:49.217035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:49.217532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:49.223963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:49.224716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:49.227102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:49.227545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:49.263011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:49.280190 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad2273a2-cf20-4034-97a1-499ba5a891d7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.751989 Oct 03 10:50:49.282538 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2207/4680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:48 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:49.609345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d151dcc0-a3a4-4011-9e7f-f37b8633afe2 req-19eb0f08-160b-422a-9a11-0de1ff55b498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb", "name": "network-vif-deleted", "tag": "94515f26-5931-4964-9074-4a23d56d9e95"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:49.621999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d151dcc0-a3a4-4011-9e7f-f37b8633afe2 req-19eb0f08-160b-422a-9a11-0de1ff55b498 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:49.622849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d151dcc0-a3a4-4011-9e7f-f37b8633afe2 req-19eb0f08-160b-422a-9a11-0de1ff55b498 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:49.623443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d151dcc0-a3a4-4011-9e7f-f37b8633afe2 req-19eb0f08-160b-422a-9a11-0de1ff55b498 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:49.638408 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d151dcc0-a3a4-4011-9e7f-f37b8633afe2 req-19eb0f08-160b-422a-9a11-0de1ff55b498 service nova] Creating event network-vif-deleted:94515f26-5931-4964-9074-4a23d56d9e95 for instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb on n-h2-858383-3 Oct 03 10:50:49.645029 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d151dcc0-a3a4-4011-9e7f-f37b8633afe2 req-19eb0f08-160b-422a-9a11-0de1ff55b498 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358534 Oct 03 10:50:49.646120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2208/4681] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:50:49.700818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a6898c70f54610920b8c9057811ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c6e7a9dc66452bb503b0c12ced7fbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:49.709168 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bae932bf-e017-4e25-9142-09b04fb17672 tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 200 len: 1630 microversion: 2.1 time: 0.510257 Oct 03 10:50:49.713076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2474/4682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:49 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 1630 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:50:50.314677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:50.315309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:50.331008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:50.331511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:50.337057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:50.340384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:50.342431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:50.346197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:50.739086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:50.740548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] [instance: cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:50.758528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:50.760706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:50.763665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:50.766295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:50.767492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:50.769170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:50.803673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] HTTP exception thrown: Instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb could not be found. Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Request method failure captured: Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb HTTP/1.1 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr45NbZub5nNOe7szFCIvWJqaeyGCSl6TxB5VYm-jnSFLyAVSPWyv9h1Huaq8awUpECas7fA0xrWppjhM1DxtibgnrMwwlOxstRHpze-_V-Y6PiI3rqQ7_tpTFcVXzegtf-sJq5RBsOjycVjhNHN7OcnsmrbhP7cjDGR-3Q2o_vItZg Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 18c6e7a9dc66452bb503b0c12ced7fbd Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-521468324 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18c6e7a9dc66452bb503b0c12ced7fbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18c6e7a9dc66452bb503b0c12ced7fbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18c6e7a9dc66452bb503b0c12ced7fbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18c6e7a9dc66452bb503b0c12ced7fbd"}]}] Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-521468324 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 18c6e7a9dc66452bb503b0c12ced7fbd Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-521468324 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-521468324-project Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 40a6898c70f54610920b8c9057811ce4 Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-521468324-project Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb could not be found. Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb'} Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb could not be found. Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb could not be found. Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:50.805583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:50:50.810826 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:50:50.810826 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:50:50.810826 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:50:50.810826 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:50:50.810826 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb could not be found. Oct 03 10:50:50.810826 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:50:50.823098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Returning 404 to user: Instance cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:50:50.825108 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea5c8fab-a8fa-4903-a6ce-c1447cad04ed tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb" status: 404 len: 111 microversion: 2.1 time: 0.091514 Oct 03 10:50:50.826359 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2475/4683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:50 2022] GET /compute/v2.1/servers/cc73ad50-ba2f-4e0e-9e37-9ab3bdf409cb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:50:50.843483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee369d32-8587-4224-b7f2-5d4abd6e10ff tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] Calling method '.version_select at 0x7f074df9cf70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:50.847653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:50.864757 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-889f408c-68bb-4950-a4d4-dcbcc1373051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.552348 Oct 03 10:50:50.865414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2209/4684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:50 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:50.907348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee369d32-8587-4224-b7f2-5d4abd6e10ff tempest-ServersTestJSON-521468324 tempest-ServersTestJSON-521468324-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005553871" status: 202 len: 0 microversion: 2.1 time: 0.076176 Oct 03 10:50:50.908553 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2476/4685] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005553871 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:50:51.893487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:51.894111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:51.907410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:51.910295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:51.913888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:51.918928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:51.919992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:51.922063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:51.924074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:51.927479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:52.410153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:52.419093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:52.430532 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b3ee33e-49d9-4313-81f5-08bb10f716e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1533 microversion: 2.1 time: 0.538033 Oct 03 10:50:52.433603 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2210/4686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:51 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1533 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:53.453521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:53.454292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:50:53.458848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:53.459470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:53.501797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:53.502324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:53.502854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:53.503630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:53.504393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:53.506068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:54.081981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:54.092585 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8bb43b4-c333-4ed9-ab96-f38c64a57a1a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1533 microversion: 2.1 time: 0.640981 Oct 03 10:50:54.097275 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2477/4687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:53 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1533 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:55.121555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:55.124179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:55.133236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:55.134012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:55.134882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:55.136142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:55.136936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:55.137590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:55.233381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3412a363-75be-4b28-bc94-26994a5bacf0 req-88b34b7e-f25d-48f0-9eef-db8666a239e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291b31e5-972b-4f07-817d-dcafef6fbcc8", "name": "network-vif-plugged", "status": "completed", "tag": "18aa44af-26c4-4872-80e2-aecc15b9524d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:50:55.247336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3412a363-75be-4b28-bc94-26994a5bacf0 req-88b34b7e-f25d-48f0-9eef-db8666a239e0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:55.248080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3412a363-75be-4b28-bc94-26994a5bacf0 req-88b34b7e-f25d-48f0-9eef-db8666a239e0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:55.248750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3412a363-75be-4b28-bc94-26994a5bacf0 req-88b34b7e-f25d-48f0-9eef-db8666a239e0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:55.264566 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3412a363-75be-4b28-bc94-26994a5bacf0 req-88b34b7e-f25d-48f0-9eef-db8666a239e0 service nova] Creating event network-vif-plugged:18aa44af-26c4-4872-80e2-aecc15b9524d for instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 on n-h1-858383-3 Oct 03 10:50:55.269141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3412a363-75be-4b28-bc94-26994a5bacf0 req-88b34b7e-f25d-48f0-9eef-db8666a239e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044510 Oct 03 10:50:55.270175 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2478/4688] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:50:55.708287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:55.731827 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-02a66a5f-5f85-4c6b-9f6e-e23fbddee9cb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1533 microversion: 2.1 time: 0.617930 Oct 03 10:50:55.736865 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2211/4689] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:55 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1533 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:56.760382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:56.761789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:56.772182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:56.774004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:56.774922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:56.776078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:56.778575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:56.780057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:57.684054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:50:57.703046 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cda4e61b-a4fe-47be-9d55-7c9715978e37 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 0.948039 Oct 03 10:50:57.714830 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2479/4690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:56 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:50:58.741973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:50:58.742835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:50:58.755166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:58.755754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:58.756202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:50:58.758260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:50:58.759907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:50:58.761019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:00.244729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:00.261089 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c80f9e30-07fe-4fd9-901e-ba001aee2267 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.522195 Oct 03 10:51:00.262714 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2212/4691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:50:58 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:01.294729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:01.295509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:01.310834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:01.312351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:01.314875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:01.317720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:01.318432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:01.321680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:01.877788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:01.890337 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da7b2e77-f370-415e-a9e0-ad083dde1521 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 0.600717 Oct 03 10:51:01.890958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2480/4692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:01 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:02.916632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:02.917732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:02.949524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:02.950794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:02.951269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:02.955476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:02.956047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:02.961432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:05.291546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:05.303410 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-50527252-d700-4230-9146-1db46757a5f3 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 2.392371 Oct 03 10:51:05.314012 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2213/4693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:02 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:06.334049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:06.334681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:06.363816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:06.364657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:06.365391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:06.366305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:06.367599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:06.368259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:07.342963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:07.358210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:07.371532 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48fbc48f-ddc4-4fd6-b66d-19e7551bcbb0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.043783 Oct 03 10:51:07.391480 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2481/4694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:06 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:08.401726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:08.402474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:08.414319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:08.417946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:08.431226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:08.434142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:08.434889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:08.435656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:10.078910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:10.095582 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-74ffa26c-064a-42d4-89ab-d10e0a54e591 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.699065 Oct 03 10:51:10.108184 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2214/4695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:08 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:11.123434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:11.126074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:11.148512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:11.150085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:11.154280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:11.176642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:11.179917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:11.180563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:12.027134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:12.036847 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a495a98a-8c23-4677-b780-a84401514a99 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 0.917472 Oct 03 10:51:12.050483 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2482/4696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:11 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:13.065662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:13.066910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:13.084637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:13.085905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:13.086566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:13.087458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:13.088216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:13.088729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:13.961115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:13.984760 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f542ca1f-d781-4069-ba42-09962e54d062 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 0.923145 Oct 03 10:51:13.986404 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2215/4697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:13 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:14.819537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-efdf5e99-3aaf-414d-9308-14a82144c5ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: .version_select at 0x7f074e21e9d0>, body: {"keypair": {"name": "tempest-keypair-627422161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFniMHZMSm6VTJlMd0f3GbDXruOwIHJD9MRc/2ANOXbVr4QJOVfSY0Qgt5b0d2IDMDWnmfeVqRhd7digCAwdnRLFD6LblrFhIiE2gAIbaf55M+T/GS1YYjkoITHPAx/Fg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:14.836488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:14.866232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-efdf5e99-3aaf-414d-9308-14a82144c5ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:14.887832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-efdf5e99-3aaf-414d-9308-14a82144c5ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:14.965753 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-efdf5e99-3aaf-414d-9308-14a82144c5ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.396616 Oct 03 10:51:14.976938 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2483/4698] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:51:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:15.032012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:15.032684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:15.066615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:15.067181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:15.067564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:15.068290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:15.078859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:15.079487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:16.073329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:16.099621 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3760daa6-58e3-4314-baa6-cb1706da01bb tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.072251 Oct 03 10:51:16.103920 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2216/4699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:15 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:16.436290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2029307760", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:16.604981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] validate_networks() for [('8ed541fc-75e2-4bb1-952a-542af8b48480', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:51:17.127983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:17.129503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:17.142236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:17.147383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:17.148562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:17.150491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:17.151198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:17.152182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:17.379865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:51:17.380630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:51:17.381321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:51:17.381948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:51:17.382542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:51:17.401443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:17.402130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:17.403583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:17.406722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:17.407488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:17.408130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:17.465682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Getting quotas for project f5a033909cf542a1895ddd2630f50e3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:17.492796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Getting quotas for user 16df3161f12c4ef392387bd4555a4d77 and project f5a033909cf542a1895ddd2630f50e3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:17.531123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:51:17.540428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:51:17.664722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d9faae4-e88b-4123-8886-358ed1aef15b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.720955 Oct 03 10:51:17.668091 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2484/4700] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:51:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:51:17.679735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9fb2a2d3-eb0f-4c72-889e-c96cfb43a89d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:17.680696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9fb2a2d3-eb0f-4c72-889e-c96cfb43a89d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:17.915731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9fb2a2d3-eb0f-4c72-889e-c96cfb43a89d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:17.924582 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9fb2a2d3-eb0f-4c72-889e-c96cfb43a89d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1214 microversion: 2.1 time: 0.248880 Oct 03 10:51:17.931130 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2485/4701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:17 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:18.748411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:18.752690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:18.788081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:18.789331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:18.793045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:18.793986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:18.794579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:18.796315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:18.907853 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b08fbbed-519a-4e19-a781-3e792371fa69 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.163745 Oct 03 10:51:18.911775 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2486/4702] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Oct 3 10:51:18 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:18.956824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17d8d26b-05f3-4e61-8be5-3dd12ef2020d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:18.957673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17d8d26b-05f3-4e61-8be5-3dd12ef2020d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:19.105132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17d8d26b-05f3-4e61-8be5-3dd12ef2020d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:19.115144 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17d8d26b-05f3-4e61-8be5-3dd12ef2020d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1214 microversion: 2.1 time: 0.162353 Oct 03 10:51:19.117122 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2487/4703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:18 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:19.133062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:19.134175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:19.150054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:19.152110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:19.153107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:19.156021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:19.158489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:19.159276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:19.301165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:51:19.521423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:19.588175 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-69aa3980-77b4-4f9b-be25-e5682c1c0653 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 2.458099 Oct 03 10:51:19.593206 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2217/4704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:17 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:19.775283 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-679c6ff3-e786-4941-b218-418f0976c31a tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 204 len: 0 microversion: 2.20 time: 0.653623 Oct 03 10:51:19.787978 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2488/4705] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:51:19 2022] DELETE /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:51:19.797084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:19.798460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:19.831589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:19.834116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:19.834897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:19.835940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:19.847229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:19.848465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:20.157453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:20.158572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:20.182527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:20.190078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:20.194283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:20.199038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:20.200928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:20.201495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:20.418639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:20.444080 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-137df79d-f2b7-4477-9d37-7ec1effbf028 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1210 microversion: 2.1 time: 0.298903 Oct 03 10:51:20.460695 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2489/4706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:20 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1210 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:20.551494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:20.572810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:20.579210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:20.587049 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0138beff-3cfe-490a-9423-882f39f48c42 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.792510 Oct 03 10:51:20.589079 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2218/4707] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:51:19 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:51:20.620791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:20.622000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:20.643528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:20.644457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:20.646274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:20.647201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:20.648834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:20.649513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:21.251987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:21.263784 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8e7cc3d3-c0ce-4f27-9e87-0f02219b858e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 0.647472 Oct 03 10:51:21.284268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2490/4708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:20 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:21.469431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:21.470571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:21.491199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:21.491720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:21.492169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:21.503801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:21.504521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:21.507065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:21.623691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:21.624820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:21.637877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:21.638390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:21.651516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:21.652334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:21.652859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:21.653314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:21.985801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:22.006367 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f3fdd8aa-4df2-4915-8ed5-914456097b13 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1266 microversion: 2.1 time: 0.541363 Oct 03 10:51:22.008371 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2219/4709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:21 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1266 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:22.163236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-741492615", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89560c86-a183-4349-ab87-bdf14ea2ef6d"}], "security_groups": [{"name": "tempest-securitygroup--113295909"}], "key_name": "tempest-keypair-627422161", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:22.226515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=20 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:22.314424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:22.339826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:22.361012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:22.363413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe28e49d-9153-4a79-b0f4-43142623ea1e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.743711 Oct 03 10:51:22.376802 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2491/4710] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:51:21 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:51:22.387799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:22.387799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:22.403987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:22.408317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:22.408996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:22.416476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:22.420372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:22.420897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:23.392471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:23.408975 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0974c64-f8c0-4e46-a9a5-30ac1e774b07 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.040412 Oct 03 10:51:23.411165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2492/4711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:22 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:23.440647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:23.442110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:23.468149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:23.468663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:23.469280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:23.470005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:23.470473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:23.470887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:23.650539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] validate_networks() for [('89560c86-a183-4349-ab87-bdf14ea2ef6d', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:51:24.402042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:24.438211 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c1ab58b-e602-4f16-bd6b-67439c923f72 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1314 microversion: 2.1 time: 1.025345 Oct 03 10:51:24.439649 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2493/4712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:23 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1314 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:24.457640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:24.460622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:24.492963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:24.493656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:24.494219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:24.495155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:24.495820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:24.496584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:25.093742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:25.109006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:25.110503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:25.117103 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b35ea2a1-512a-466c-bac0-2b8e449ec19c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1725 microversion: 2.20 time: 0.670283 Oct 03 10:51:25.133445 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2494/4713] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:51:24 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1725 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:51:25.147108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:25.151217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:25.170368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:25.173632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:25.174622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:25.177528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:25.179649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:25.180317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:26.667237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:26.688000 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-707ef482-da37-4b77-aaec-713029dcd61a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.553031 Oct 03 10:51:26.696994 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2495/4714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:25 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:27.020324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0cf96367-f13d-4dc6-9075-9512ee78dc19 req-560ad1b5-41e0-42ed-9889-3438109422c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "name": "network-vif-unplugged", "status": "completed", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:27.062697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0cf96367-f13d-4dc6-9075-9512ee78dc19 req-560ad1b5-41e0-42ed-9889-3438109422c7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:27.069372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0cf96367-f13d-4dc6-9075-9512ee78dc19 req-560ad1b5-41e0-42ed-9889-3438109422c7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:27.069947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0cf96367-f13d-4dc6-9075-9512ee78dc19 req-560ad1b5-41e0-42ed-9889-3438109422c7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:27.100854 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0cf96367-f13d-4dc6-9075-9512ee78dc19 req-560ad1b5-41e0-42ed-9889-3438109422c7 service nova] Creating event network-vif-unplugged:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h2-858383-3 Oct 03 10:51:27.119964 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0cf96367-f13d-4dc6-9075-9512ee78dc19 req-560ad1b5-41e0-42ed-9889-3438109422c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.421412 Oct 03 10:51:27.122735 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2496/4715] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:27.135226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:27.137581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:27.154001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:27.154846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:27.158855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:27.159888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:27.161327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:27.163115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:27.218159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:51:27.218732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:51:27.219046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:51:27.219456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:51:27.219982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:51:27.238956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:27.239453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:27.239893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:27.240620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:27.254120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:27.254619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:27.283630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=56 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:27.371900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:27.401517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:27.439038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:27.467734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:51:27.470156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:51:27.609132 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4eaf0aa2-63c0-4f07-92d1-6f96a3ec4f25 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.451471 Oct 03 10:51:27.612105 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2220/4716] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:51:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 5457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:51:27.626741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:27.627361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:27.665187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:27.666114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:27.667189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:27.668642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:27.669354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:27.670010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:27.745125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:27.757469 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b6d6d9fa-1983-45a8-a600-58e43db32069 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1314 microversion: 2.1 time: 0.633272 Oct 03 10:51:27.762328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2497/4717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:27 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:27.777122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4fcc507d-0951-4a4b-a741-a29dcb1fd8f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:27.778774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4fcc507d-0951-4a4b-a741-a29dcb1fd8f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:28.045081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:28.056448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:28.057961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95e90959ca07488e9a3960f7e49c99f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29993b8d4e9e4a9f8b78c398561fdd10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:28.059159 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4bb53a6e-9355-422d-b954-805b3348d8a8 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 200 len: 1657 microversion: 2.20 time: 0.446050 Oct 03 10:51:28.076264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2221/4718] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:51:27 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 1657 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:51:28.086592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:28.094095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:28.109822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:28.119396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4fcc507d-0951-4a4b-a741-a29dcb1fd8f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:28.119573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:28.120033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:28.120825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:28.121305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:28.128028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:28.131023 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4fcc507d-0951-4a4b-a741-a29dcb1fd8f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1240 microversion: 2.1 time: 0.363579 Oct 03 10:51:28.131721 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2498/4719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:27 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1240 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:28.792439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:28.793455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:28.831625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:28.832247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:28.834482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:28.849300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:28.850149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:28.850664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:29.489018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:29.515079 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c19cba53-9870-4c6e-a7e7-cc63d2d11617 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1314 microversion: 2.1 time: 0.721268 Oct 03 10:51:29.515822 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2499/4720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:28 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:29.549107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-20a1ec7f-b5c6-4248-a05e-7e4b15ee6e15 req-a28a7387-4156-4b49-bc69-61878a1bc2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eab68b2-c592-4556-b7dd-23edcc398ed4", "name": "network-vif-deleted", "tag": "49c2e439-7d0a-4857-b8ea-fea1cf73b6af"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:29.593471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-20a1ec7f-b5c6-4248-a05e-7e4b15ee6e15 req-a28a7387-4156-4b49-bc69-61878a1bc2a8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:29.593969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-20a1ec7f-b5c6-4248-a05e-7e4b15ee6e15 req-a28a7387-4156-4b49-bc69-61878a1bc2a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:29.594418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-20a1ec7f-b5c6-4248-a05e-7e4b15ee6e15 req-a28a7387-4156-4b49-bc69-61878a1bc2a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:29.745379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:29.771843 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-82621dc2-9d6e-48cd-a79d-4f9943d153ac tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.694065 Oct 03 10:51:29.776053 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2222/4721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:28 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:29.812605 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-20a1ec7f-b5c6-4248-a05e-7e4b15ee6e15 req-a28a7387-4156-4b49-bc69-61878a1bc2a8 service nova] Creating event network-vif-deleted:49c2e439-7d0a-4857-b8ea-fea1cf73b6af for instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 on n-h2-858383-3 Oct 03 10:51:29.832492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-20a1ec7f-b5c6-4248-a05e-7e4b15ee6e15 req-a28a7387-4156-4b49-bc69-61878a1bc2a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292883 Oct 03 10:51:29.835252 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2500/4722] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:29.851424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:29.853727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:29.877103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:29.878580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:29.879593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:29.882447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:29.886932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:29.888256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:29.932706 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] HTTP exception thrown: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Request method failure captured: Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 HTTP/1.1 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrx4QorrGoZ7GhxuPcwBF1RH6T4-0_FtHwIkSu8PZZZ2nVa5NJZRco87YzAWYXscrjktvD56PKeW4CSSeGruZXoIb95aaSqQSrbLlBXl1Q8hdi8AFGBF3hkVoFowDBn3fSsauc7VB6sXVkDQ68a28C1J99C6_A4gKyvvOdfvSPbXgjk Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}] Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 95e90959ca07488e9a3960f7e49c99f1 Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '8eab68b2-c592-4556-b7dd-23edcc398ed4'} Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:29.937791 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:29.942751 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:29.945276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Returning 404 to user: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:51:29.947865 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f48ac4d3-64b5-49f5-a5b8-5635e25cab59 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 404 len: 111 microversion: 2.20 time: 0.106970 Oct 03 10:51:29.948603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2501/4723] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:51:29 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:51:29.963484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:29.973212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:29.993550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:29.994065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:29.994508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:29.995238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:29.995701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:29.996171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:30.043700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7ea60acf-3fb1-42fa-9f72-a11e7611026b req-b26b7bba-0a79-4833-b536-01cfdb70b944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5604e4-6216-416a-8b0c-918b0bcab4e2", "tag": "be140bd3-a5ea-4963-a9e7-a2d6a60462df"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:30.074361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7ea60acf-3fb1-42fa-9f72-a11e7611026b req-b26b7bba-0a79-4833-b536-01cfdb70b944 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:30.083032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7ea60acf-3fb1-42fa-9f72-a11e7611026b req-b26b7bba-0a79-4833-b536-01cfdb70b944 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:30.085932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7ea60acf-3fb1-42fa-9f72-a11e7611026b req-b26b7bba-0a79-4833-b536-01cfdb70b944 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:30.126109 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7ea60acf-3fb1-42fa-9f72-a11e7611026b req-b26b7bba-0a79-4833-b536-01cfdb70b944 service nova] Creating event network-changed:be140bd3-a5ea-4963-a9e7-a2d6a60462df for instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 on n-h2-858383-3 Oct 03 10:51:30.145109 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7ea60acf-3fb1-42fa-9f72-a11e7611026b req-b26b7bba-0a79-4833-b536-01cfdb70b944 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.366863 Oct 03 10:51:30.150185 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2223/4724] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:30.163343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-feef3afe-3e72-43cb-9df9-3a12924c97b4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '.version_select at 0x7f074f74e5e0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:30.214916 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-feef3afe-3e72-43cb-9df9-3a12924c97b4 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758916157" status: 204 len: 0 microversion: 2.20 time: 0.063060 Oct 03 10:51:30.217319 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2224/4725] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Oct 3 10:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758916157 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:51:30.436878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:30.446225 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54804614-b494-4ebb-bd79-a5ced5258527 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1292 microversion: 2.1 time: 0.496345 Oct 03 10:51:30.450544 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2502/4726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:29 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1292 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:30.545500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:30.546548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:30.619369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:30.620029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:30.620603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:30.622990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:30.626710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:30.628907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:30.803885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:30.804935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:30.817369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:30.818600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:30.821866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:30.822880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:30.824840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:30.825509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:30.878694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:31.194383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:31.205120 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9d1a687-f2e0-4931-9556-d74432148834 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 0.405413 Oct 03 10:51:31.208972 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2503/4727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:30 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:31.356560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fad986e1-970a-4eb4-bb64-a33abda27610 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'create', calling method: .version_select at 0x7f07574f2a60>, body: {"keypair": {"name": "tempest-keypair-327078302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowrJl62Yt6XAkosKdt06FUOOMBYtydPt/bwIGfzrDJQylSfXr9icfJYySQDLy8+KT/vn70MKsNUwGu7CPoGLH0dMT6IbNPL0g6DYmptDby/CTVjDUC9ssibWAaUc0VCg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:31.406349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fad986e1-970a-4eb4-bb64-a33abda27610 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for project 598e28eacadb4e528222edc532abb878. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:31.414743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fad986e1-970a-4eb4-bb64-a33abda27610 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for user e3857d14b6f6498c87700ea6ee22c4a6 and project 598e28eacadb4e528222edc532abb878. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:31.495959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fad986e1-970a-4eb4-bb64-a33abda27610 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.283745 Oct 03 10:51:31.497306 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2504/4728] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:51:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:31.502480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:31.503535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:31.515876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:31.519561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:31.520302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:31.524888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:31.526137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:31.528030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:31.813647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:31.828920 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a2d84d0-75ff-4b59-bea9-7e0115c12b9f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1314 microversion: 2.1 time: 1.289602 Oct 03 10:51:31.835626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:31.836139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2225/4729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:30 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1314 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:31.865823 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17a550bf-2727-4c37-b4bb-177c5f39c9d6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1298 microversion: 2.1 time: 0.367234 Oct 03 10:51:31.866426 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2505/4730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:31 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1298 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:32.236218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:32.237155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:32.248243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:32.250620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:32.253349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:32.257318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:32.269609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:32.270971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:32.872925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:32.873554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:32.887445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:32.891692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:32.891692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:32.892849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:32.894446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:32.895698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:33.552508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:33.563563 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-baa4caf9-adca-4957-8e1f-8b8046947492 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1528 microversion: 2.1 time: 1.331308 Oct 03 10:51:33.581101 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2226/4731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:32 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1528 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:33.642973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:33.647211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:33.668520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:33.669315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:33.669934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:33.671975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:33.674051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:33.674932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:33.871200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:33.893003 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06fc39fb-35ca-437a-a8b9-472b5c7f4b40 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1298 microversion: 2.1 time: 0.303323 Oct 03 10:51:33.897214 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2227/4732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:33 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1298 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:34.234266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:34.252825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfd913c3-10e5-4ed6-b80b-5b12eab526e2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1314 microversion: 2.1 time: 1.385163 Oct 03 10:51:34.253410 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2506/4733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:32 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1314 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:34.635504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:34.636604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:34.652486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:34.653246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:34.653628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:34.655426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:34.658476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:34.659298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:34.945014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:34.946157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:34.969350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:34.970383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:34.971909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:34.974634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:34.975227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:34.976907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:35.312315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:35.325337 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0d67ee13-8ede-431d-8779-1ebe25fe08d1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1510 microversion: 2.1 time: 0.704163 Oct 03 10:51:35.326827 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2228/4734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:34 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1510 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:35.333993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:35.338918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:35.353393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:35.354067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:35.357036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:35.358051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:35.358683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:35.361874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:35.504053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:35.514619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f81c4b0-0152-4a07-b951-c9b6a6c51853 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1298 microversion: 2.1 time: 0.576031 Oct 03 10:51:35.515218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2507/4735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:34 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1298 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:35.940139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:35.952144 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-be5fe6a3-6e77-4c57-9b63-3164523ed8e4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1314 microversion: 2.1 time: 0.620485 Oct 03 10:51:35.960934 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2229/4736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:35 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:36.350281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:36.351255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:36.364010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:36.364637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:36.372017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:36.373004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:36.373552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:36.374245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:36.544497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:36.545143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:36.575190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:36.576134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:36.578416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:36.584117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:36.587174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:36.588338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:37.047974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:37.065173 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e82c5b4c-696a-4f89-bb2b-e21c32fcdfdc tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1510 microversion: 2.1 time: 0.717383 Oct 03 10:51:37.067095 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2508/4737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:36 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1510 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:37.084395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-dfa69b95-1b02-4025-a00a-a9040bf67346 req-5f28ada4-7b2d-48e9-9efc-f8cd5de413c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5604e4-6216-416a-8b0c-918b0bcab4e2", "name": "network-vif-plugged", "status": "completed", "tag": "be140bd3-a5ea-4963-a9e7-a2d6a60462df"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:37.129793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dfa69b95-1b02-4025-a00a-a9040bf67346 req-5f28ada4-7b2d-48e9-9efc-f8cd5de413c2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:37.130462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dfa69b95-1b02-4025-a00a-a9040bf67346 req-5f28ada4-7b2d-48e9-9efc-f8cd5de413c2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:37.131037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dfa69b95-1b02-4025-a00a-a9040bf67346 req-5f28ada4-7b2d-48e9-9efc-f8cd5de413c2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:37.198669 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-dfa69b95-1b02-4025-a00a-a9040bf67346 req-5f28ada4-7b2d-48e9-9efc-f8cd5de413c2 service nova] Creating event network-vif-plugged:be140bd3-a5ea-4963-a9e7-a2d6a60462df for instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 on n-h2-858383-3 Oct 03 10:51:37.204711 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-dfa69b95-1b02-4025-a00a-a9040bf67346 req-5f28ada4-7b2d-48e9-9efc-f8cd5de413c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135253 Oct 03 10:51:37.205953 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2509/4738] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:37.221197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:37.226283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:37.229695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:37.247143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:37.247932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:37.249393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:37.250295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:37.253376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:37.257321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:37.285677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:37.442991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:37.446758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:37.456450 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b52acc8-0c14-4803-9506-081a0020b9e0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1365 microversion: 2.1 time: 0.917256 Oct 03 10:51:37.458433 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2230/4739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:36 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1365 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:38.095816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:38.096981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:38.110116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:38.111832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:38.112755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:38.113867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:38.128551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:38.130133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:38.274632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:38.283199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a6491b27-e9c5-4e1a-a497-712763aedc91 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1314 microversion: 2.1 time: 1.075891 Oct 03 10:51:38.284070 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2510/4740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:37 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:38.489045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:38.490622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:38.523878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:38.526629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:38.527525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:38.533515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:38.535840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:38.536803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:38.590543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:38.609654 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b572d6b-2891-4f34-a960-a12fe1c682af tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1510 microversion: 2.1 time: 0.514237 Oct 03 10:51:38.612970 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2231/4741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:38 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:38.635620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-6040b826-abe6-4bbf-a2a9-8b13c0c03944 req-f02fed39-de51-4a8e-85b0-315d188c535f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d2546d-4e01-4ab7-89c9-23bd8ede5a59", "tag": "77e540e9-da27-4325-abb1-8aad034bb399"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:38.669265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6040b826-abe6-4bbf-a2a9-8b13c0c03944 req-f02fed39-de51-4a8e-85b0-315d188c535f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:38.673366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6040b826-abe6-4bbf-a2a9-8b13c0c03944 req-f02fed39-de51-4a8e-85b0-315d188c535f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:38.674534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6040b826-abe6-4bbf-a2a9-8b13c0c03944 req-f02fed39-de51-4a8e-85b0-315d188c535f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:38.714400 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-6040b826-abe6-4bbf-a2a9-8b13c0c03944 req-f02fed39-de51-4a8e-85b0-315d188c535f service nova] Creating event network-changed:77e540e9-da27-4325-abb1-8aad034bb399 for instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 on n-h1-858383-3 Oct 03 10:51:38.728120 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-6040b826-abe6-4bbf-a2a9-8b13c0c03944 req-f02fed39-de51-4a8e-85b0-315d188c535f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111216 Oct 03 10:51:38.730544 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2232/4742] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:39.275925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-740c4052-5801-4e89-8cef-726f100c2ae9 req-dc0874c4-7121-4eb6-9c48-cfe1bb2a0f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291b31e5-972b-4f07-817d-dcafef6fbcc8", "name": "network-vif-unplugged", "status": "completed", "tag": "18aa44af-26c4-4872-80e2-aecc15b9524d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:39.312727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-740c4052-5801-4e89-8cef-726f100c2ae9 req-dc0874c4-7121-4eb6-9c48-cfe1bb2a0f0c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.313257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-740c4052-5801-4e89-8cef-726f100c2ae9 req-dc0874c4-7121-4eb6-9c48-cfe1bb2a0f0c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.318320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-740c4052-5801-4e89-8cef-726f100c2ae9 req-dc0874c4-7121-4eb6-9c48-cfe1bb2a0f0c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.355503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.server_external_events [req-740c4052-5801-4e89-8cef-726f100c2ae9 req-dc0874c4-7121-4eb6-9c48-cfe1bb2a0f0c service nova] Unable to find a host for instance 291b31e5-972b-4f07-817d-dcafef6fbcc8. Dropping event network-vif-unplugged {{(pid=122270) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 10:51:39.363235 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-740c4052-5801-4e89-8cef-726f100c2ae9 req-dc0874c4-7121-4eb6-9c48-cfe1bb2a0f0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089311 Oct 03 10:51:39.366242 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2233/4743] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 03 10:51:39.383340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:39.386883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:39.401806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.404015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.407754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.409056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.412113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.414953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.676439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:39.686122 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3442579-c8fb-4e34-9894-f2e4c4d24326 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1365 microversion: 2.1 time: 1.203827 Oct 03 10:51:39.705196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2511/4744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:38 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1365 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:39.719008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:39.719718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:39.736481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.737101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.737552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.738274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.738932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.739371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.767860 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] HTTP exception thrown: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Request method failure captured: Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 HTTP/1.1 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrx4QorrGoZ7GhxuPcwBF1RH6T4-0_FtHwIkSu8PZZZ2nVa5NJZRco87YzAWYXscrjktvD56PKeW4CSSeGruZXoIb95aaSqQSrbLlBXl1Q8hdi8AFGBF3hkVoFowDBn3fSsauc7VB6sXVkDQ68a28C1J99C6_A4gKyvvOdfvSPbXgjk Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}] Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 95e90959ca07488e9a3960f7e49c99f1 Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '8eab68b2-c592-4556-b7dd-23edcc398ed4'} Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:51:39.773749 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Returning 404 to user: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bc686d09-9009-4005-89b2-08c767e97f0c tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 404 len: 111 microversion: 2.20 time: 0.069124 Oct 03 10:51:39.779273 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2512/4745] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:51:39 2022] DELETE /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:51:39.783658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:39.784289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:39.801811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.802645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.803300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.804250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.809058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.809820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.860610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:39.870332 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5b74904-5a9d-4286-8bda-b37732171b47 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1499 microversion: 2.1 time: 0.500022 Oct 03 10:51:39.875903 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2234/4746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:39 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1499 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:39.883171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:39.892233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 8eab68b2-c592-4556-b7dd-23edcc398ed4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:39.922204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.923038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.923679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.926374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:39.927088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:39.931165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:39.958591 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] HTTP exception thrown: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Request method failure captured: Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 HTTP/1.1 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrx4QorrGoZ7GhxuPcwBF1RH6T4-0_FtHwIkSu8PZZZ2nVa5NJZRco87YzAWYXscrjktvD56PKeW4CSSeGruZXoIb95aaSqQSrbLlBXl1Q8hdi8AFGBF3hkVoFowDBn3fSsauc7VB6sXVkDQ68a28C1J99C6_A4gKyvvOdfvSPbXgjk Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}] Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 95e90959ca07488e9a3960f7e49c99f1 Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '8eab68b2-c592-4556-b7dd-23edcc398ed4'} Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.965846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. Oct 03 10:51:39.969672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:39.972087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Returning 404 to user: Instance 8eab68b2-c592-4556-b7dd-23edcc398ed4 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:51:39.980395 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f4ee607e-a7a9-4435-b637-86e2dfff270e tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4" status: 404 len: 111 microversion: 2.20 time: 0.100840 Oct 03 10:51:39.983359 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2235/4747] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:51:39 2022] GET /compute/v2.1/servers/8eab68b2-c592-4556-b7dd-23edcc398ed4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:51:39.998526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:40.002151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:40.036997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.038319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.039557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:40.042176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.046497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.047663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:40.101442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lazy-loading 'flavor' on Instance uuid 0d5604e4-6216-416a-8b0c-918b0bcab4e2 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:51:40.354105 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5fcb0742-5126-475f-bef8-723a29f57a3f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "POST /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2/action" status: 200 len: 32 microversion: 2.1 time: 0.368009 Oct 03 10:51:40.355176 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2236/4748] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:51:39 2022] POST /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:51:40.368875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:40.369873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:40.378876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.379466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.380135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:40.381006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.381577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.382237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:40.452641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:40.463445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2671dc37-dbb7-429c-be09-d8c2297cad5f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1453 microversion: 2.1 time: 0.686515 Oct 03 10:51:40.489177 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2513/4749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:39 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1453 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:40.502342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:40.502971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:40.518038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.522453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.523348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:40.525578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.526345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.527615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:40.727846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:40.740496 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-59c96411-6c2c-4f55-adae-d60a6ee90d43 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.378789 Oct 03 10:51:40.745090 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2237/4750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:40 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:40.765763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:40.768280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:40.787875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.787875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.795449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:40.797037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:40.798228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:40.799158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:41.040031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:41.052477 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83e99f16-7ecb-4213-adc0-efed95f752a6 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1365 microversion: 2.1 time: 0.305997 Oct 03 10:51:41.054241 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2238/4751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:40 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:41.085067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-804748401", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9dbf8c82-dfae-4d56-9442-6e6c67d23560"}], "security_groups": [{"name": "tempest-securitygroup--1476989996"}], "key_name": "tempest-keypair-327078302", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:41.093869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:41.105690 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df1f5a64-14ac-4c5b-81f4-6a64a028ad0d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1453 microversion: 2.1 time: 0.608050 Oct 03 10:51:41.106302 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2514/4752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:40 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1453 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:41.279702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:41.280307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:41.297292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] validate_networks() for [('9dbf8c82-dfae-4d56-9442-6e6c67d23560', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:51:41.313376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:41.318826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:41.323802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:41.326773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:41.327428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:41.328042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:41.411484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lazy-loading 'flavor' on Instance uuid 291b31e5-972b-4f07-817d-dcafef6fbcc8 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:51:41.447977 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Cannot 'shelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state shelved_offloaded Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action HTTP/1.1 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 14 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: {"shelve": {}} Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: exception: Cannot 'shelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state shelved_offloaded Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'shelve': {}}} Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:51:41.455835 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state shelved_offloaded Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state shelved_offloaded Oct 03 10:51:41.460787 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:41.465590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 409 to user: Cannot 'shelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state shelved_offloaded {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:51:41.470048 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-708b90fa-54b5-4c82-8d2a-b2ff77bb34a0 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 409 len: 155 microversion: 2.1 time: 0.197334 Oct 03 10:51:41.473007 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2515/4753] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:51:41 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 155 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:51:41.488938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:41.491415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:41.506413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=20 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:41.511980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:41.514363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:41.515012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:41.517467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:41.518209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:41.519917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:41.606544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122269) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 10:51:41.781554 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-512aa045-3319-4c62-bf46-2e65530ed773 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 202 len: 0 microversion: 2.1 time: 0.303735 Oct 03 10:51:41.782268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2516/4754] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:51:41 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:51:42.017991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:51:42.018441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:51:42.018916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:51:42.019525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:51:42.020249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:51:42.038128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:42.038909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:42.041354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:42.042794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:42.043698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:42.049327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:42.070213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:42.108014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:42.129104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for user e3857d14b6f6498c87700ea6ee22c4a6 and project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:42.167342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:51:42.170635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:51:42.275627 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26916241-cbba-4541-b385-46de6af0cc1b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.204804 Oct 03 10:51:42.283540 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2239/4755] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:51:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:51:42.287668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:42.288335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:42.307055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:42.308091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:42.308590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:42.309398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:42.310187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:42.311437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:42.482866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9345d282-8efd-4c70-9df6-5422cf1a2be7 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Action: 'create', calling method: .version_select at 0x7f074e20caf0>, body: {"keypair": {"name": "tempest-keypair-913387011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9vjT85+I/PWpPI2YMxmDxHQHbSMu/mquwqzpBBsjJ+5fl98n+RVQ4XHZttZESwraQkUxJXxpMYnHTde5rhAVmMmGUw1H5KP0HPV62qFJYmpOMHGZ/EOcR+82GHSf3/mA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:42.547176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9345d282-8efd-4c70-9df6-5422cf1a2be7 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Getting quotas for project 85ab8aee85144f9288366d04918cf93e. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:42.568720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9345d282-8efd-4c70-9df6-5422cf1a2be7 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Getting quotas for user 43c8927d28224659be9c2b73f3102993 and project 85ab8aee85144f9288366d04918cf93e. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:42.659326 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9345d282-8efd-4c70-9df6-5422cf1a2be7 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.875283 Oct 03 10:51:42.666567 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2517/4756] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:51:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:42.679513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:42.680237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:42.706962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:42.708521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:42.709019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:42.718580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:42.719200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:42.719671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:43.308655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:43.324567 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa36e400-e617-4c59-bf66-6ea3106472f2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1461 microversion: 2.1 time: 0.657442 Oct 03 10:51:43.325992 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2518/4757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:42 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1461 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:43.336932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:43.337799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:43.357843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:43.358887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:43.359516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:43.360610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:43.361256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:43.361853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:43.791118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:43.792838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:43.803035 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe5e2c7c-f66b-4cd1-9d68-9e02361f7112 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 1.523157 Oct 03 10:51:43.804820 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2240/4758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:42 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:43.806048 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91330e97-f506-45eb-a613-964aeceb6449 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1365 microversion: 2.1 time: 0.477194 Oct 03 10:51:43.808460 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2519/4759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:43 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:43.813469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:43.814332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:43.823222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:43.824115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:43.824935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:43.825948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:43.826691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:43.828196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:44.117828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:44.137216 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-79cb4617-7a20-4fb6-800c-b13e24cc1ca8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1289 microversion: 2.1 time: 0.328989 Oct 03 10:51:44.142255 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2241/4760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:43 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1289 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:44.352196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:44.353496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:44.367326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:44.370036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:44.372558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:44.373997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:44.376462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:44.377560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:44.829769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:44.830979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:44.847043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:44.847784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:44.848379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:44.849283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:44.856963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:44.857703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:44.992146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:45.003055 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c61cf17-e89a-4120-a39f-40ce1dd5212d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1461 microversion: 2.1 time: 0.655233 Oct 03 10:51:45.003656 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2520/4761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:44 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1461 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:45.011741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:45.016757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:45.047107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:45.047938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:45.049868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:45.051091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:45.051961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:45.053045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:45.338165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:45.353519 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3aae5b9-7718-454c-8d1a-259be9c08dcf tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.528203 Oct 03 10:51:45.356720 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2242/4762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:44 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:45.369033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:45.369706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:45.387890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:45.388387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:45.393986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:45.394817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:45.395307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:45.395748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:45.456163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:45.480133 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8446ca63-9fdc-4aa4-8d3c-5edc74d7a1e8 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1365 microversion: 2.1 time: 0.463549 Oct 03 10:51:45.480133 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2521/4763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:45 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1365 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:45.587843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:45.599922 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f1ee75c7-6c33-4b41-a390-dfc381c50c3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1295 microversion: 2.1 time: 0.241120 Oct 03 10:51:45.601937 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2243/4764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:45 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1295 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:46.026885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:46.028391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:46.037535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.044327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.048585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.049663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.050141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.050582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.076976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:46.684111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Calling method '.version_select at 0x7f074e193700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:46.690662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.698253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.700801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.786016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.787504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.788489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.809313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.821655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.822623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.853815 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef649c36-af5b-430a-94dc-f198b28f058f tempest-PortsAdminExtendedAttrsTestJSON-95738536 tempest-PortsAdminExtendedAttrsTestJSON-95738536-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.479434 Oct 03 10:51:46.854930 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2244/4765] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:51:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:46.863960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:46.865204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:46.878014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:46.888227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.892788 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2909fa76-ee6d-405a-a02e-7fb6a9a46739 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.869662 Oct 03 10:51:46.894035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.895022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.896500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.897528 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2522/4766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:46 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:46.902077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.902898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.906442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:46.907063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:46.926057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.926826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.927412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:46.931500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:46.932132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:46.932708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:47.396997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:47.410624 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf2b6e9f-e829-42f0-bb5b-a2ff5003908f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.554042 Oct 03 10:51:47.419703 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2245/4767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:46 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:47.434386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:47.435117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:47.458925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:47.459339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:47.459783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:47.460509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:47.461010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:47.461445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:47.628761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:47.639146 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c857e26d-7ed7-4fcf-8f86-34866dce85b7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1295 microversion: 2.1 time: 0.218250 Oct 03 10:51:47.642689 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2246/4768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:47 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1295 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:47.658741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:47.659248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:47.682046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:47.682823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:47.683438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:47.684314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:47.685575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:47.686167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:47.724459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] HTTP exception thrown: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Request method failure captured: Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 HTTP/1.1 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOrx4QorrGoZ7GhxuPcwBF1RH6T4-0_FtHwIkSu8PZZZ2nVa5NJZRco87YzAWYXscrjktvD56PKeW4CSSeGruZXoIb95aaSqQSrbLlBXl1Q8hdi8AFGBF3hkVoFowDBn3fSsauc7VB6sXVkDQ68a28C1J99C6_A4gKyvvOdfvSPbXgjk Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}] Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 95e90959ca07488e9a3960f7e49c99f1 Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '46b2f725-65f5-4190-a0db-43ed8788b274'} Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:51:47.730151 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:47.734415 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:51:47.746046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Returning 404 to user: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:51:47.750110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d5ad7e9-aac3-469d-a0d2-f2edf88124c7 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 404 len: 111 microversion: 2.20 time: 0.098408 Oct 03 10:51:47.750910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2247/4769] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:51:47 2022] DELETE /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:51:47.757834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-300120907", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9cdecc76-ed15-4ce4-9c27-63cde71da407"}], "security_groups": [{"name": "tempest-securitygroup--500914298"}], "key_name": "tempest-keypair-913387011", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:48.077198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:48.098929 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6ec957c0-cd47-4eff-b125-f111b06fb4c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1365 microversion: 2.1 time: 1.196516 Oct 03 10:51:48.099632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2523/4770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:46 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1365 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:48.145290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-92bdf5c0-a1d1-472a-9c5d-2da3b534b886 req-b21ff81b-995b-414c-b4ed-37092e04cbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d2546d-4e01-4ab7-89c9-23bd8ede5a59", "name": "network-vif-plugged", "status": "completed", "tag": "77e540e9-da27-4325-abb1-8aad034bb399"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:48.149728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] validate_networks() for [('9cdecc76-ed15-4ce4-9c27-63cde71da407', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:51:48.184692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-92bdf5c0-a1d1-472a-9c5d-2da3b534b886 req-b21ff81b-995b-414c-b4ed-37092e04cbf3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:48.187897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-92bdf5c0-a1d1-472a-9c5d-2da3b534b886 req-b21ff81b-995b-414c-b4ed-37092e04cbf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:48.188326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-92bdf5c0-a1d1-472a-9c5d-2da3b534b886 req-b21ff81b-995b-414c-b4ed-37092e04cbf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:48.202798 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-92bdf5c0-a1d1-472a-9c5d-2da3b534b886 req-b21ff81b-995b-414c-b4ed-37092e04cbf3 service nova] Creating event network-vif-plugged:77e540e9-da27-4325-abb1-8aad034bb399 for instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 on n-h1-858383-3 Oct 03 10:51:48.209578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-92bdf5c0-a1d1-472a-9c5d-2da3b534b886 req-b21ff81b-995b-414c-b4ed-37092e04cbf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102645 Oct 03 10:51:48.211093 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2524/4771] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:48.217628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:48.218567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] [instance: 46b2f725-65f5-4190-a0db-43ed8788b274] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:48.226738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:48.227594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:48.228460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:48.241196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:48.242298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:48.243056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:48.260825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] HTTP exception thrown: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Request method failure captured: Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 HTTP/1.1 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOrx4QorrGoZ7GhxuPcwBF1RH6T4-0_FtHwIkSu8PZZZ2nVa5NJZRco87YzAWYXscrjktvD56PKeW4CSSeGruZXoIb95aaSqQSrbLlBXl1Q8hdi8AFGBF3hkVoFowDBn3fSsauc7VB6sXVkDQ68a28C1J99C6_A4gKyvvOdfvSPbXgjk Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/29993b8d4e9e4a9f8b78c398561fdd10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/29993b8d4e9e4a9f8b78c398561fdd10"}]}] Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 29993b8d4e9e4a9f8b78c398561fdd10 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-150129445 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 95e90959ca07488e9a3960f7e49c99f1 Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeShelveTestJSON-150129445-project Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '46b2f725-65f5-4190-a0db-43ed8788b274'} Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:48.277713 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. Oct 03 10:51:48.282943 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:51:48.285121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] Returning 404 to user: Instance 46b2f725-65f5-4190-a0db-43ed8788b274 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:51:48.286190 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a5ed9c81-c663-41d8-84e8-692336db3003 tempest-AttachVolumeShelveTestJSON-150129445 tempest-AttachVolumeShelveTestJSON-150129445-project] 10.222.0.27 "GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274" status: 404 len: 111 microversion: 2.20 time: 0.073279 Oct 03 10:51:48.286947 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2525/4772] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:51:48 2022] GET /compute/v2.1/servers/46b2f725-65f5-4190-a0db-43ed8788b274 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:51:48.300683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:48.302339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:48.331462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:48.333396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:48.334804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:48.335758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:48.340103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:48.341180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:49.480194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Getting quotas for project 85ab8aee85144f9288366d04918cf93e. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:49.488192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Getting quotas for user 43c8927d28224659be9c2b73f3102993 and project 85ab8aee85144f9288366d04918cf93e. Resources: dict_keys(['metadata_items']) {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:49.494772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:49.520009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:51:49.520696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:51:49.521415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:51:49.522007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:51:49.522583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:51:49.534964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:49.535845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:49.536435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:49.537714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:49.538354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:49.539012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:49.563984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Getting quotas for project 85ab8aee85144f9288366d04918cf93e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:51:49.570346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Getting quotas for user 43c8927d28224659be9c2b73f3102993 and project 85ab8aee85144f9288366d04918cf93e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:51:49.587276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:51:49.590171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:51:49.665720 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3f30827-c1e6-48f7-9e35-348f3ea675db tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.913411 Oct 03 10:51:49.678848 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2248/4773] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:51:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:51:49.695267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:49.697500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:49.710729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:49.711330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:49.711685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:49.713622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:49.714120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:49.714561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:49.746832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:49.792600 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-093525cd-ea90-4990-a41d-55e010f05822 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 1.494572 Oct 03 10:51:49.818457 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2526/4774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:48 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:49.849896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:49.850942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:49.866746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:49.872800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:49.879834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:49.880924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:49.882900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:49.886963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:50.073734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:50.095192 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9538f89-afc5-4a4f-9842-2a5b00d65fb4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.415093 Oct 03 10:51:50.101157 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2249/4775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:49 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:50.114521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:50.115431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:50.134109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:50.135043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:50.137184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:50.139411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:50.141839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:50.143209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:50.392832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:50.401853 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3cbf8866-f72c-43a0-bf81-15b60423a815 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1365 microversion: 2.1 time: 0.297364 Oct 03 10:51:50.402975 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2250/4776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:50 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:50.408509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ecf3809a-049f-4099-9e07-0d004d6eb3e0 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:50.411594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ecf3809a-049f-4099-9e07-0d004d6eb3e0 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:50.507729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ecf3809a-049f-4099-9e07-0d004d6eb3e0 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:50.517769 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ecf3809a-049f-4099-9e07-0d004d6eb3e0 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1276 microversion: 2.1 time: 0.113602 Oct 03 10:51:50.518914 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2251/4777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:50 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:50.824136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:50.825014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:50.835817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:50.836702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:50.837340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:50.839767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:50.840431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:50.841789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:50.861217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:50.880510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e701d86a-c1d7-4b5d-9e08-692effba69d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 1.059750 Oct 03 10:51:50.881158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2527/4778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:49 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:51.121423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:51.124539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:51.125224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:51.130043 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e7897ff-2126-4917-a7f8-79fd9e85f13b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.310240 Oct 03 10:51:51.136021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:51.137375 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2252/4779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:50 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:51.140864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:51.141385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:51.142332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:51.142978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:51.143423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:51.427195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:51.428246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:51.443280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:51.456399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:51.457040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:51.458424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:51.458931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:51.459381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:51.783678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:51.820573 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-639e4d1d-b2ca-4b6e-95c8-3e66a9c4a506 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.697879 Oct 03 10:51:51.824660 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2528/4780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:51 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:51.841196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:51.842001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:51.866206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:51.866841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:51.869182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:51.870146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:51.873909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:51.875558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:51.898452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:51.916653 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42cd0bfe-ddc2-4616-8832-322e1fa3cdda tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1555 microversion: 2.1 time: 0.493369 Oct 03 10:51:51.929400 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2253/4781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:51 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1555 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:51.942312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e17d22f0-69ff-4e6d-b913-c716ca0afb91 req-daa45179-71bc-49cb-80f7-ef55da7606ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:51.954273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e17d22f0-69ff-4e6d-b913-c716ca0afb91 req-daa45179-71bc-49cb-80f7-ef55da7606ee service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:51.955037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e17d22f0-69ff-4e6d-b913-c716ca0afb91 req-daa45179-71bc-49cb-80f7-ef55da7606ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:51.956762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e17d22f0-69ff-4e6d-b913-c716ca0afb91 req-daa45179-71bc-49cb-80f7-ef55da7606ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:51.975668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e17d22f0-69ff-4e6d-b913-c716ca0afb91 req-daa45179-71bc-49cb-80f7-ef55da7606ee service nova] Creating event network-changed:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:51:51.998157 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e17d22f0-69ff-4e6d-b913-c716ca0afb91 req-daa45179-71bc-49cb-80f7-ef55da7606ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066902 Oct 03 10:51:52.000733 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2254/4782] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:52.006334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:52.014918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:52.031721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.032513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.033209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:52.034197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.035308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.038517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:52.246399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:52.267884 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37fe9cc6-46e8-4fd7-9005-8a8717770329 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1280 microversion: 2.1 time: 0.438538 Oct 03 10:51:52.269891 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2529/4783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:51 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1280 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:52.284271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:52.291841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:52.312454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.316109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.330716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:52.335097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.337654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.342761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:52.384693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:52.397607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b30bf4e2-5d8e-4df2-81b9-5ee8d145d9fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 0.392210 Oct 03 10:51:52.400992 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2255/4784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:52 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:52.406837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:52.407695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:52.435897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.438019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.438673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:52.441086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.441797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.445600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:52.592167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:52.820430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:52.852575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f148166f-9fc4-4f9f-852b-1d6334c7e10c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.449549 Oct 03 10:51:52.857963 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2256/4785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:52 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:52.863503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:52.864632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:52.872873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.873796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.874501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:52.875473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:52.876196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:52.876855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:53.272298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:53.293777 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9821b665-9802-425f-a5a0-3b172166aa35 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.432804 Oct 03 10:51:53.296583 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2257/4786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:52 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:53.312192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:53.313780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:53.331858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:53.332373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:53.332840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:53.337280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:53.337819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:53.340631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:53.366792 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57abefd4-c18c-4027-8490-8d04d2aa188a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.094487 Oct 03 10:51:53.368350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2530/4787] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:51:52 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-interface => generated 284 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:53.428737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:53.429691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:53.441504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:53.445481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:53.446834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:53.449755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:53.451351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:53.453277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:53.643640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:53.691709 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed4da929-10e3-4ffb-9b0c-043178d61a45 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1328 microversion: 2.1 time: 0.391969 Oct 03 10:51:53.697662 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2258/4788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:53 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:53.882722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:53.883807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:53.896416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:53.897369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:53.898792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:53.902099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:53.904147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:53.904884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:53.947702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:54.225671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:54.239851 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3775bfbe-901e-42e1-895b-9fd3c369fe5d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.360560 Oct 03 10:51:54.250939 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2259/4789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:53 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:54.323532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:54.324951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:54.332218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:54.333077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:54.333775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:54.334711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:54.335395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:54.336094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:54.489544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:54.503765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eceabac9-2c5b-4604-830d-6cf85575d879 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 1.080152 Oct 03 10:51:54.504863 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2531/4790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:53 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:54.722223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:54.723096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:54.735562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:54.740469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:54.741494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:54.742820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:54.743537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:54.744196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:54.898492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:54.907734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bba009d8-f8f5-4a1b-aba1-1766f1d96a67 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1328 microversion: 2.1 time: 0.189773 Oct 03 10:51:54.920142 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2532/4791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:54 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1328 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:55.267325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:55.268575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:55.288187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:55.292317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:55.293123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:55.294289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:55.296983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:55.301460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:55.366273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:55.394563 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-35392782-9d85-422f-b424-93bb49783a63 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 1.071811 Oct 03 10:51:55.395732 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2260/4792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:54 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:55.541832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:55.542959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:55.560046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:55.566344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:55.566344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:55.579425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:55.579425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:55.579425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:55.744814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:55.757541 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0a8532dd-fe5e-4455-99d3-5fb45184f0f1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.495111 Oct 03 10:51:55.778145 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2533/4793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:55 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:55.952552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:55.953428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:55.966599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:55.969219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:55.969936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:55.972547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:55.973244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:55.974328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:56.100014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:56.115251 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cefacdc-4ec7-4adc-b2dc-64856f961a0c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 0.577255 Oct 03 10:51:56.117027 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2261/4794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:55 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:56.245688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:56.254724 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0c617a72-043b-4a57-bacb-e8f59d6f396b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1328 microversion: 2.1 time: 0.314807 Oct 03 10:51:56.255315 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2534/4795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:55 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:56.425709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:56.427012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:56.438902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:56.439583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:56.441267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:56.442195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:56.445433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:56.446644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:56.792183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:56.793618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:56.811470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:56.822053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:56.822943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:56.823877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:56.824522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:56.825166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:57.807852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:57.844991 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bd282a09-dda3-4396-9877-b4a2657b139d tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 1.417615 Oct 03 10:51:57.845775 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2262/4796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:56 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:57.854896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:57.864646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:57.884678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:57.889046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:57.892079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:57.893180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:57.896507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:57.897289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:58.325952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:58.339126 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c192a674-15e6-4cfb-85fd-bc0eaf680724 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 0.486916 Oct 03 10:51:58.343089 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2263/4797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:57 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:58.348195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:58.352495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:58.374465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:58.377753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:58.378955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:58.380000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:58.380746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:58.383173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:58.734160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:58.750254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7369368a-e47c-4e0b-8687-bd6727ffa042 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 1.966194 Oct 03 10:51:58.756843 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2535/4798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:56 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:51:58.777010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c805c323-206e-4e76-bd29-27d672ebcdfc req-7efe621e-5b56-4caa-90a8-d57ac59a0708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d2546d-4e01-4ab7-89c9-23bd8ede5a59", "tag": "77e540e9-da27-4325-abb1-8aad034bb399"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:51:58.810287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c805c323-206e-4e76-bd29-27d672ebcdfc req-7efe621e-5b56-4caa-90a8-d57ac59a0708 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:58.811253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c805c323-206e-4e76-bd29-27d672ebcdfc req-7efe621e-5b56-4caa-90a8-d57ac59a0708 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:58.811880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c805c323-206e-4e76-bd29-27d672ebcdfc req-7efe621e-5b56-4caa-90a8-d57ac59a0708 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:58.844162 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c805c323-206e-4e76-bd29-27d672ebcdfc req-7efe621e-5b56-4caa-90a8-d57ac59a0708 service nova] Creating event network-changed:77e540e9-da27-4325-abb1-8aad034bb399 for instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 on n-h1-858383-3 Oct 03 10:51:58.858036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c805c323-206e-4e76-bd29-27d672ebcdfc req-7efe621e-5b56-4caa-90a8-d57ac59a0708 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096961 Oct 03 10:51:58.859018 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2536/4799] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:51:58.877251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:58.878537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:58.906053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:58.906807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:58.907447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:58.909363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:58.910039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:58.911626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:58.971945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:58.989157 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29a364a9-f19b-4f53-9374-a3686da59b9d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1334 microversion: 2.1 time: 0.644361 Oct 03 10:51:58.994956 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2264/4800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:58 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1334 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:59.372242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:59.374160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:59.400178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:59.400947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:59.415070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:59.416033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:59.416539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:59.417021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:59.553895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:51:59.858662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:51:59.888812 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e7e3226-1e7b-4efa-866d-86c9d4095c9d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 0.527056 Oct 03 10:51:59.889732 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2265/4801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:59 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:51:59.918872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:51:59.920087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:51:59.939828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:59.943661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:59.944479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:51:59.946393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:51:59.947265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:51:59.948046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:00.014844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:00.032352 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bbeedd6c-8539-4e78-a73c-07a0b1be2fbc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 1.165758 Oct 03 10:52:00.034988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2537/4802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:58 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:00.049740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:00.051020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:00.068448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:00.069858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:00.071537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:00.072627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:00.073872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:00.074605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:00.226247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:00.244265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f0cf8b0-a797-42a4-b546-95884a185521 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1334 microversion: 2.1 time: 0.207758 Oct 03 10:52:00.246227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2538/4803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:00 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1334 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:00.336248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:00.346866 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-529bc3f8-78db-4b37-a371-558c16ea5dd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.438628 Oct 03 10:52:00.347470 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2266/4804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:51:59 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:00.915577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:00.916333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:00.931749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:00.932256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:00.935212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:00.935991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:00.936482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:00.936972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:01.067979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:01.068963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:01.084499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=18 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:01.091065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:01.091936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:01.092548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:01.093678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:01.094386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:01.095074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:01.351724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:01.362615 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4246cc4-2dc8-41a8-a717-35a6212a31cc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.298989 Oct 03 10:52:01.364628 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2267/4805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:01 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:01.378302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:01.378941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:01.395257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:01.396760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:01.397236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:01.400963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:01.401711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:01.404813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:01.478188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:01.491851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0e23ead-9987-413f-bbcb-50cf356ca2dd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 0.582072 Oct 03 10:52:01.493830 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2539/4806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:00 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:01.509249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:01.510302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:01.520564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:01.521744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:01.522392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:01.523403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:01.524663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:01.525390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:01.726922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:01.736970 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-37793150-3dab-4887-8aa9-a08412afce42 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.371169 Oct 03 10:52:01.738607 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2268/4807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:01 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:01.922472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:01.931934 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce68bf1f-9ae6-4885-b74e-f664a38a6919 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.437011 Oct 03 10:52:01.950292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2540/4808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:01 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:02.394753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:02.395427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:02.410531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:02.411033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:02.412414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:02.433235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:02.434416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:02.435023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:02.521222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:02.522582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:02.535419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:02.538639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:02.542068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:02.543154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:02.545871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:02.547369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:02.609051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:03.050261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:03.063733 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5fb4c8b8-695a-46a4-9db7-c31dbe9c67a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 0.545043 Oct 03 10:52:03.065526 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2541/4809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:02 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:03.078313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:03.079347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:03.093979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:03.095003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:03.095681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:03.101719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:03.103413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:03.104089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:03.302520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:03.312546 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fbab9251-0f6a-4140-8c2c-7ec0ec3d036e tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.925610 Oct 03 10:52:03.314910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2269/4810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:02 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:03.325438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:03.326988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:03.338904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:03.340990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:03.341672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:03.342642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:03.343434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:03.345929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:03.521344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:03.538442 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c0d5cc00-7cde-43a1-8a6a-235cd3fe4c29 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.468215 Oct 03 10:52:03.539485 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2542/4811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:03 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:03.545382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-922342ef-bd34-47e9-b7ee-037518529f4a req-b14b4210-3cd2-4d9b-ab5d-1ed64f3c05eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-plugged", "status": "completed", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:03.563840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-922342ef-bd34-47e9-b7ee-037518529f4a req-b14b4210-3cd2-4d9b-ab5d-1ed64f3c05eb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:03.566061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-922342ef-bd34-47e9-b7ee-037518529f4a req-b14b4210-3cd2-4d9b-ab5d-1ed64f3c05eb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:03.567690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-922342ef-bd34-47e9-b7ee-037518529f4a req-b14b4210-3cd2-4d9b-ab5d-1ed64f3c05eb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:03.595887 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-922342ef-bd34-47e9-b7ee-037518529f4a req-b14b4210-3cd2-4d9b-ab5d-1ed64f3c05eb service nova] Creating event network-vif-plugged:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:52:03.609417 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-922342ef-bd34-47e9-b7ee-037518529f4a req-b14b4210-3cd2-4d9b-ab5d-1ed64f3c05eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068448 Oct 03 10:52:03.610077 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2543/4812] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:03.641316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:03.654544 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-84d152b2-a0d9-49e9-aec8-aa33bc4eeca7 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.337615 Oct 03 10:52:03.669632 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2270/4813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:03 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:04.088278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:04.089037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:04.096328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.097158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.097836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.098852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.099507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.100156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.298701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8df0e888-c844-46f4-ac6a-ba1bc879e7b7 req-7812eb1f-bfc8-41ea-8acf-55e4cdb74783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a23e59-d9cd-4eb9-a5b4-dde4451c57ef", "tag": "a2ac6d7a-be08-4ac8-a509-48d651139d97"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:04.314063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8df0e888-c844-46f4-ac6a-ba1bc879e7b7 req-7812eb1f-bfc8-41ea-8acf-55e4cdb74783 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.315157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8df0e888-c844-46f4-ac6a-ba1bc879e7b7 req-7812eb1f-bfc8-41ea-8acf-55e4cdb74783 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.317018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8df0e888-c844-46f4-ac6a-ba1bc879e7b7 req-7812eb1f-bfc8-41ea-8acf-55e4cdb74783 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.331975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8df0e888-c844-46f4-ac6a-ba1bc879e7b7 req-7812eb1f-bfc8-41ea-8acf-55e4cdb74783 service nova] Creating event network-changed:a2ac6d7a-be08-4ac8-a509-48d651139d97 for instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef on n-h1-858383-3 Oct 03 10:52:04.361535 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8df0e888-c844-46f4-ac6a-ba1bc879e7b7 req-7812eb1f-bfc8-41ea-8acf-55e4cdb74783 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068953 Oct 03 10:52:04.362944 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2271/4814] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:04.372168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:04.373199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:04.381508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.382642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.383848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.384878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.385827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.386614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.437292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:04.457009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5752c1f4-3c80-4753-8341-3d329b45b33c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1363 microversion: 2.1 time: 0.371625 Oct 03 10:52:04.459666 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2544/4815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:04 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:04.563713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:04.564360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:04.571493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.572516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.573245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.574524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.575234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.575912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.797120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:04.815878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3c806f5c-2ae0-4fef-acec-5aaba2814274 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.451050 Oct 03 10:52:04.818347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2272/4816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:04 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:04.829052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:04.830065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:04.860604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.861681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.864065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.865402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:04.866999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:04.868261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:04.968837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:04.978300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7f7ebaf-6628-4da1-8310-0a8acf148e77 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.418425 Oct 03 10:52:04.978896 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2545/4817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:04 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:05.150374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:05.160635 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e484e396-c914-4bd1-9531-8fa08d215b3f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.340571 Oct 03 10:52:05.161470 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2273/4818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:04 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:05.486264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:05.487030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:05.498625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:05.499109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:05.499558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:05.500285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:05.500753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:05.501801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:05.650208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92f84618-b6cc-41f3-97fb-3a0f3bf5ce7e tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Action: 'create', calling method: .version_select at 0x7f074f1b5550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-651999213", "metadata": {"Type": "work"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92f84618-b6cc-41f3-97fb-3a0f3bf5ce7e tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Request method failure captured: Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 121 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7V65w5ztWeYutIrpWEpzgBpd_sbw8mL0msT4przGci0oP1TIegDxromt9dbgpf93KnutE7DKwm_cvLlUYLwp2m1KPLbQb4KszMKw_-JVGPRI_aHyqQ4IpTPB07hbXRr6Bjv8RY5TK3tzHKkvvRRW6syTbmaKR0I1dCUvDHfuxFISc Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}] Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9b61d1bcddee4681b268ef146859bb46 Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-651999213", "metadata": {"Type": "work"}}} Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-651999213', 'metadata': {'Type': 'work'}}}} Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '#$%' Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:52:05.656081 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 10:52:05.661301 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.663146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92f84618-b6cc-41f3-97fb-3a0f3bf5ce7e tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:05.664298 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-92f84618-b6cc-41f3-97fb-3a0f3bf5ce7e tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.189517 Oct 03 10:52:05.665119 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2546/4819] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 3 10:52:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:52:05.674663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91afc98c-de2e-4435-bcb6-8453596a29ed tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Action: 'create', calling method: .version_select at 0x7f074f247af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1135699902", "metadata": {"Type": "work"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91afc98c-de2e-4435-bcb6-8453596a29ed tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Request method failure captured: Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 120 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7V65w5ztWeYutIrpWEpzgBpd_sbw8mL0msT4przGci0oP1TIegDxromt9dbgpf93KnutE7DKwm_cvLlUYLwp2m1KPLbQb4KszMKw_-JVGPRI_aHyqQ4IpTPB07hbXRr6Bjv8RY5TK3tzHKkvvRRW6syTbmaKR0I1dCUvDHfuxFISc Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}] Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9b61d1bcddee4681b268ef146859bb46 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1135699902", "metadata": {"Type": "work"}}} Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1135699902', 'metadata': {'Type': 'work'}}}} Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '0' Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:52:05.679264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91afc98c-de2e-4435-bcb6-8453596a29ed tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91afc98c-de2e-4435-bcb6-8453596a29ed tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010216 Oct 03 10:52:05.689248 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2547/4820] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 3 10:52:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:52:05.691731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f48d1a3-4cf5-4b2e-96e5-0da48956b094 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Action: 'create', calling method: .version_select at 0x7f074f21ed30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2020733257", "metadata": {"Type": "work"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f48d1a3-4cf5-4b2e-96e5-0da48956b094 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Request method failure captured: Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 119 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7V65w5ztWeYutIrpWEpzgBpd_sbw8mL0msT4przGci0oP1TIegDxromt9dbgpf93KnutE7DKwm_cvLlUYLwp2m1KPLbQb4KszMKw_-JVGPRI_aHyqQ4IpTPB07hbXRr6Bjv8RY5TK3tzHKkvvRRW6syTbmaKR0I1dCUvDHfuxFISc Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}] Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9b61d1bcddee4681b268ef146859bb46 Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2020733257", "metadata": {"Type": "work"}}} Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2020733257', 'metadata': {'Type': 'work'}}}} Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '' Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:52:05.696547 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f48d1a3-4cf5-4b2e-96e5-0da48956b094 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:05.701449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f48d1a3-4cf5-4b2e-96e5-0da48956b094 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010352 Oct 03 10:52:05.704526 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2548/4821] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 3 10:52:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:52:05.710020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-00159734-93c9-447f-a021-866fccd6b12f tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Calling method '.version_select at 0x7f074e21e0d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:05.742848 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-00159734-93c9-447f-a021-866fccd6b12f tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] HTTP exception thrown: Volume tempest-invalid-1141106671 could not be found. Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-00159734-93c9-447f-a021-866fccd6b12f tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Request method failure captured: Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1141106671 HTTP/1.1 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7V65w5ztWeYutIrpWEpzgBpd_sbw8mL0msT4przGci0oP1TIegDxromt9dbgpf93KnutE7DKwm_cvLlUYLwp2m1KPLbQb4KszMKw_-JVGPRI_aHyqQ4IpTPB07hbXRr6Bjv8RY5TK3tzHKkvvRRW6syTbmaKR0I1dCUvDHfuxFISc Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}] Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9b61d1bcddee4681b268ef146859bb46 Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: exception: Volume tempest-invalid-1141106671 could not be found. Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'tempest-invalid-1141106671'} Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1141106671 could not be found. (HTTP 404) (Request-ID: req-255aad0a-eaef-448c-a46d-259118853669) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:52:05.746901 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1141106671 could not be found. Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1141106671 could not be found. Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1141106671 could not be found. Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.751637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-00159734-93c9-447f-a021-866fccd6b12f tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Returning 404 to user: Volume tempest-invalid-1141106671 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:05.757395 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-00159734-93c9-447f-a021-866fccd6b12f tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1141106671" status: 404 len: 99 microversion: 2.1 time: 0.045661 Oct 03 10:52:05.759440 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2549/4822] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:52:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1141106671 => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:52:05.765920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d8bb0b03-e91d-44bc-8688-b940863a184e tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005484 Oct 03 10:52:05.766451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2550/4823] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 3 10:52:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 10:52:05.779673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-400f9742-e799-4678-b91a-32b8c75b1575 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004325 Oct 03 10:52:05.781423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2551/4824] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:52:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 10:52:05.786351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03632038-670d-4e6a-a85c-e01d65f5cfd7 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Calling method '.version_select at 0x7f0757510280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:05.817398 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-03632038-670d-4e6a-a85c-e01d65f5cfd7 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] HTTP exception thrown: Volume 1e9aeb0b-08b4-450d-ad33-38241a64b886 could not be found. Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03632038-670d-4e6a-a85c-e01d65f5cfd7 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Request method failure captured: Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-volumes/1e9aeb0b-08b4-450d-ad33-38241a64b886 HTTP/1.1 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7V65w5ztWeYutIrpWEpzgBpd_sbw8mL0msT4przGci0oP1TIegDxromt9dbgpf93KnutE7DKwm_cvLlUYLwp2m1KPLbQb4KszMKw_-JVGPRI_aHyqQ4IpTPB07hbXRr6Bjv8RY5TK3tzHKkvvRRW6syTbmaKR0I1dCUvDHfuxFISc Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}] Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9b61d1bcddee4681b268ef146859bb46 Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: exception: Volume 1e9aeb0b-08b4-450d-ad33-38241a64b886 could not be found. Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1e9aeb0b-08b4-450d-ad33-38241a64b886'} Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e9aeb0b-08b4-450d-ad33-38241a64b886 could not be found. (HTTP 404) (Request-ID: req-073a81a5-5dde-411d-9f82-26a6fd98d974) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:52:05.819508 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e9aeb0b-08b4-450d-ad33-38241a64b886 could not be found. Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e9aeb0b-08b4-450d-ad33-38241a64b886 could not be found. Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e9aeb0b-08b4-450d-ad33-38241a64b886 could not be found. Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03632038-670d-4e6a-a85c-e01d65f5cfd7 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Returning 404 to user: Volume 1e9aeb0b-08b4-450d-ad33-38241a64b886 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:05.824928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-03632038-670d-4e6a-a85c-e01d65f5cfd7 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/1e9aeb0b-08b4-450d-ad33-38241a64b886" status: 404 len: 109 microversion: 2.1 time: 0.041038 Oct 03 10:52:05.830526 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2552/4825] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:52:05 2022] DELETE /compute/v2.1/os-volumes/1e9aeb0b-08b4-450d-ad33-38241a64b886 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:05.836371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e81e1ae5-b2fe-4387-9c79-b39f4128a395 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Calling method '.version_select at 0x7f0757510670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:05.867232 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e81e1ae5-b2fe-4387-9c79-b39f4128a395 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] HTTP exception thrown: Volume a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 could not be found. Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e81e1ae5-b2fe-4387-9c79-b39f4128a395 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Request method failure captured: Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-volumes/a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 HTTP/1.1 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7V65w5ztWeYutIrpWEpzgBpd_sbw8mL0msT4przGci0oP1TIegDxromt9dbgpf93KnutE7DKwm_cvLlUYLwp2m1KPLbQb4KszMKw_-JVGPRI_aHyqQ4IpTPB07hbXRr6Bjv8RY5TK3tzHKkvvRRW6syTbmaKR0I1dCUvDHfuxFISc Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e1bfd41ad4469dbc7099edc6c29e50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e1bfd41ad4469dbc7099edc6c29e50"}]}] Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d5e1bfd41ad4469dbc7099edc6c29e50 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesNegativeTest-286909386 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9b61d1bcddee4681b268ef146859bb46 Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesNegativeTest-286909386-project Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: exception: Volume a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 could not be found. Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9'} Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 could not be found. (HTTP 404) (Request-ID: req-047faa5e-afed-4015-a571-1607f9e32ad9) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:52:05.870235 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 could not be found. Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 could not be found. Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 could not be found. Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e81e1ae5-b2fe-4387-9c79-b39f4128a395 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] Returning 404 to user: Volume a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e81e1ae5-b2fe-4387-9c79-b39f4128a395 tempest-VolumesNegativeTest-286909386 tempest-VolumesNegativeTest-286909386-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9" status: 404 len: 109 microversion: 2.1 time: 0.040010 Oct 03 10:52:05.875760 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2553/4826] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:52:05 2022] GET /compute/v2.1/os-volumes/a0f32e0a-d9e0-4f7b-934d-d74ecb2181d9 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:05.882484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:05.882484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:05.890541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:05.891053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:05.891507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:05.892257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:05.892716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:05.893190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:06.073889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:06.085667 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13bee608-79ff-4c1d-aca0-7e4318a557b1 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.207480 Oct 03 10:52:06.102118 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2554/4827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:05 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:06.110196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:06.111248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:06.118686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:06.119438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:06.120051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:06.120990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:06.121619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:06.122550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:06.170611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:06.179578 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0757b1e5-774e-49d0-95a0-77f14132f924 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1549 microversion: 2.1 time: 0.698260 Oct 03 10:52:06.181766 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2274/4828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:05 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1549 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:06.205590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:06.206516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:06.226552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:06.228055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:06.228682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:06.231485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:06.232188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:06.233385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:06.329949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:06.339912 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1c6a0ca-0602-4fdf-9649-9252e9e92ef8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.236608 Oct 03 10:52:06.341080 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2555/4829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:06 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:06.353235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:06.355808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:06.369793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:06.370203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:06.370791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:06.372278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:06.372756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:06.373406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:06.532382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55836d30-8961-4bc5-874e-9817084c8516 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.331192 Oct 03 10:52:06.533176 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2275/4830] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:52:06 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:06.763196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:06.780741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7dba135c-18f1-4d3d-9bb8-e52e9a483051 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.436051 Oct 03 10:52:06.781696 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2556/4831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:06 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:07.114986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:07.115596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:07.123143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:07.125639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:07.126387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:07.127632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:07.128352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:07.129258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:07.366695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:07.368219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:07.370926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:07.378597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:07.379099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:07.379605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:07.380332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:07.381345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:07.381345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:07.663789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:07.673438 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b42492af-18c6-4e0c-ab44-7045dcfa03df tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.310867 Oct 03 10:52:07.689253 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2557/4832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:07 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:07.806596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:07.808550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:07.814757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:07.815553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:07.816928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:07.818265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:07.818910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:07.819348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:07.831331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:07.845282 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8ba2323e-3515-4018-a51f-365a75b9b20b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.733923 Oct 03 10:52:07.847292 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2276/4833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:07 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:08.147155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:08.204585 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0a62152-bad0-4b6c-9dd7-d12ffa9a778c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.402483 Oct 03 10:52:08.206030 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2558/4834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:07 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:08.427362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8019b7b3-e4ec-47d2-b141-5cfaeb508779 req-8260ea45-8b15-431d-9a17-fd6932007b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:08.442885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8019b7b3-e4ec-47d2-b141-5cfaeb508779 req-8260ea45-8b15-431d-9a17-fd6932007b14 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:08.444484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8019b7b3-e4ec-47d2-b141-5cfaeb508779 req-8260ea45-8b15-431d-9a17-fd6932007b14 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:08.445439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8019b7b3-e4ec-47d2-b141-5cfaeb508779 req-8260ea45-8b15-431d-9a17-fd6932007b14 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:08.453252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:08.466324 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8019b7b3-e4ec-47d2-b141-5cfaeb508779 req-8260ea45-8b15-431d-9a17-fd6932007b14 service nova] Creating event network-changed:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:52:08.474790 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8019b7b3-e4ec-47d2-b141-5cfaeb508779 req-8260ea45-8b15-431d-9a17-fd6932007b14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051780 Oct 03 10:52:08.475855 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2277/4835] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:08.699679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:08.700808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:08.713936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:08.714812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:08.716433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:08.719320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:08.721332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:08.724107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:08.874835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:08.875685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:08.896604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:08.897275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:08.897869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:08.899254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:08.905058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:08.909653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:08.960562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:08.978748 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ed3734c-551c-49b2-bc1c-c6b24d4cdc94 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.282038 Oct 03 10:52:08.984976 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2559/4836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:08 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:09.256401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:09.272544 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-912f9bec-17e9-4a92-922e-d0b0b7ff6456 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1505 microversion: 2.1 time: 0.400692 Oct 03 10:52:09.286867 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2278/4837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:08 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:09.301339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:09.301976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:09.309707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:09.310496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:09.311112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:09.312234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:09.313519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:09.314217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:09.721180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2057071660", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "9a63229a-54db-431d-b915-273af07cb3fa"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:09.795863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] validate_networks() for [('9a63229a-54db-431d-b915-273af07cb3fa', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:52:09.804530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:09.831625 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63a80db6-ced4-4bbc-a88a-d9059aa8c7c1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.543525 Oct 03 10:52:09.835038 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2279/4838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:09 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:09.931372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-48767cf2-24ed-40e5-a4fd-01d4b6c19591 req-c66df0ac-dff7-4947-9b86-7bcd6bee007a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291b31e5-972b-4f07-817d-dcafef6fbcc8", "name": "network-vif-plugged", "status": "completed", "tag": "18aa44af-26c4-4872-80e2-aecc15b9524d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:09.948574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48767cf2-24ed-40e5-a4fd-01d4b6c19591 req-c66df0ac-dff7-4947-9b86-7bcd6bee007a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:09.956562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48767cf2-24ed-40e5-a4fd-01d4b6c19591 req-c66df0ac-dff7-4947-9b86-7bcd6bee007a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:09.957261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48767cf2-24ed-40e5-a4fd-01d4b6c19591 req-c66df0ac-dff7-4947-9b86-7bcd6bee007a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:09.973061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-48767cf2-24ed-40e5-a4fd-01d4b6c19591 req-c66df0ac-dff7-4947-9b86-7bcd6bee007a service nova] Creating event network-vif-plugged:18aa44af-26c4-4872-80e2-aecc15b9524d for instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 on n-h1-858383-3 Oct 03 10:52:09.979325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-48767cf2-24ed-40e5-a4fd-01d4b6c19591 req-c66df0ac-dff7-4947-9b86-7bcd6bee007a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053057 Oct 03 10:52:09.980139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2280/4839] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:10.009323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:10.010291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:10.018192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.019378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.020284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:10.021663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.022433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.023500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:10.241772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:10.257186 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-66eeb1a2-d642-4471-8877-b655d60b9605 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.252900 Oct 03 10:52:10.273531 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2281/4840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:10 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:10.300620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:10.301615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:10.312239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.313335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.314995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:10.316266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.317090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.317954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:10.503247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:10.512251 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3ffcf56-8325-4911-806e-0d1f871aa0b5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1485 microversion: 2.1 time: 0.216294 Oct 03 10:52:10.529620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2282/4841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:10 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1485 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:10.748714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:52:10.749813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:52:10.750300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:52:10.750879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:52:10.751466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:52:10.771196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.775250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.775869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:10.780706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.783023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.784191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:10.843954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Getting quotas for project ff878d95cf53440fa913a3d878fe48bc. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:52:10.848193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1969833745", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:10.854918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Getting quotas for user 37476993270646da91e7c4cc326c3245 and project ff878d95cf53440fa913a3d878fe48bc. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:52:10.872384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:52:10.875414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:52:10.908914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] validate_networks() for [('8ed541fc-75e2-4bb1-952a-542af8b48480', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:52:10.943477 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eb76e5d6-cd2c-46a8-a06d-bd81b37dc6fb tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802110 Oct 03 10:52:10.944867 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2560/4842] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:52:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:52:10.965304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:10.967642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:10.976328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.976859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.979300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:10.980335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:10.981269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:10.981917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:11.277641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:11.288187 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0fe51d0-e5e2-4cdd-86ee-4ee60ebeffd1 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.342092 Oct 03 10:52:11.305988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2561/4843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:10 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:11.312892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-87f4da25-9966-4978-9f5e-73e58bc65a41 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:11.313774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-87f4da25-9966-4978-9f5e-73e58bc65a41 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:11.395449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-87f4da25-9966-4978-9f5e-73e58bc65a41 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:11.402852 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-87f4da25-9966-4978-9f5e-73e58bc65a41 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1214 microversion: 2.1 time: 0.095581 Oct 03 10:52:11.403449 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2562/4844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:11 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:11.418475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:11.419606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:11.433427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:11.434295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:11.438765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:11.441422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:11.441936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:11.443296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:11.709195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:52:11.709682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:52:11.710088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:52:11.710501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:52:11.710917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:52:11.719748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:11.728462 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7f37ece-fa02-4ace-b8a5-3114f64ae286 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.323866 Oct 03 10:52:11.728991 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2563/4845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:11 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:11.737596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:11.738159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:11.738666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:11.739457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:11.739972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:11.740458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:11.761604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Getting quotas for project f5a033909cf542a1895ddd2630f50e3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:52:11.768022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Getting quotas for user 16df3161f12c4ef392387bd4555a4d77 and project f5a033909cf542a1895ddd2630f50e3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:52:11.786601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:52:11.790562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:52:11.819576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:11.866963 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b910fdc-ea64-41a4-b8a6-11544aa41d2f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.022850 Oct 03 10:52:11.868012 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2283/4846] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:52:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:52:11.881836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0afc774d-dd05-408f-b5bc-38104086f713 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:11.883211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0afc774d-dd05-408f-b5bc-38104086f713 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:11.982933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0afc774d-dd05-408f-b5bc-38104086f713 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:11.993978 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0afc774d-dd05-408f-b5bc-38104086f713 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1214 microversion: 2.1 time: 0.114753 Oct 03 10:52:11.994995 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2564/4847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:11 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:12.316547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:12.317393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:12.338191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:12.338831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:12.339391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:12.340198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:12.340977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:12.341639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:12.432196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:12.433161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:12.441970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:12.442789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:12.443530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:12.444726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:12.446691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:12.447361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:12.541326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:12.566318 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-848bba21-12e9-43d8-baea-71d10d242e01 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.254632 Oct 03 10:52:12.574697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:12.586293 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2284/4848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:12 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:12.594907 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-793e2c91-593d-472b-9527-b9bb0e6127d3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1266 microversion: 2.1 time: 0.167327 Oct 03 10:52:12.605963 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2565/4849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:12 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:12.751947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:12.753229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:12.765844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:12.768561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:12.769043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:12.769793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:12.770249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:12.773133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.019664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:13.021227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:13.041925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:13.042883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:13.047192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.049285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:13.051680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:13.052691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.166855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:13.180043 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a491c27f-62da-4393-9e8c-a71c366d2931 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1266 microversion: 2.1 time: 0.166491 Oct 03 10:52:13.183072 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2566/4850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:13 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:13.242969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:13.257830 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a4e552df-24a6-4355-a6d2-f3d59f740072 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.509183 Oct 03 10:52:13.261484 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2285/4851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:12 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:13.418126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-bc816d9f-ec3f-4d85-a888-ac58e960c612 req-66ae2514-6936-495b-a366-9a7902c4ea23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a23e59-d9cd-4eb9-a5b4-dde4451c57ef", "name": "network-vif-plugged", "status": "completed", "tag": "a2ac6d7a-be08-4ac8-a509-48d651139d97"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:13.469478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bc816d9f-ec3f-4d85-a888-ac58e960c612 req-66ae2514-6936-495b-a366-9a7902c4ea23 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:13.470014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bc816d9f-ec3f-4d85-a888-ac58e960c612 req-66ae2514-6936-495b-a366-9a7902c4ea23 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:13.482665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bc816d9f-ec3f-4d85-a888-ac58e960c612 req-66ae2514-6936-495b-a366-9a7902c4ea23 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.504187 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-bc816d9f-ec3f-4d85-a888-ac58e960c612 req-66ae2514-6936-495b-a366-9a7902c4ea23 service nova] Creating event network-vif-plugged:a2ac6d7a-be08-4ac8-a509-48d651139d97 for instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef on n-h1-858383-3 Oct 03 10:52:13.540058 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-bc816d9f-ec3f-4d85-a888-ac58e960c612 req-66ae2514-6936-495b-a366-9a7902c4ea23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121129 Oct 03 10:52:13.541629 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2567/4852] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:13.597793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:13.598972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:13.612978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:13.615914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:13.617072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.621073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:13.621984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:13.622599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.631336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:13.649535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:13.674138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:13.677808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:13.682121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.685218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:13.689740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:13.690542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:13.818541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:13.835359 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-63ed78ef-105c-45d1-a176-caa420e9d9a4 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1272 microversion: 2.1 time: 0.214184 Oct 03 10:52:13.855517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2568/4853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:13 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:14.212326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:14.222662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:14.226161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:14.243385 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5964853e-c890-4a48-9cb1-8ffe445ad5ba tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1519 microversion: 2.1 time: 0.649684 Oct 03 10:52:14.245206 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2286/4854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:13 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1519 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:14.247459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:14.247969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:14.248585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:14.249341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:14.249861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:14.250487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:14.302446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:14.303054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:14.336900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:14.339766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:14.340259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:14.349229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:14.349796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:14.350278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:14.456558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:14.472251 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e18993e-e58c-4828-86f1-9b5f37b374f2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1272 microversion: 2.1 time: 0.268845 Oct 03 10:52:14.477424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2569/4855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:14 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:14.712741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:14.729150 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-af96bb58-c807-4bc3-bc95-81961c18657d tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1401 microversion: 2.1 time: 0.431951 Oct 03 10:52:14.731724 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2287/4856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:14 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1401 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:14.862689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:14.863329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:14.874602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:14.878242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:14.878917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:14.879852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:14.880485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:14.882874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:14.894266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:15.155754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:15.167213 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f0530a1-a0c5-4ae9-84ab-31e81b117437 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1314 microversion: 2.1 time: 0.308527 Oct 03 10:52:15.177288 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2570/4857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:14 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:15.271686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:15.273026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:15.282836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.283627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.284319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:15.285655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.286747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.287714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:15.502768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:15.503388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:15.511308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.512221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.512873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:15.514023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.514671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.515865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:15.731276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:15.751558 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e90d9ded-ce8e-4cb2-8900-094f263e890a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.487310 Oct 03 10:52:15.752750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2288/4858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:15 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:15.761747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:15.763273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:15.782023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:15.786937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.789622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.793486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:15.797818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bbd4448e-527a-499f-b10d-0d429a1de979 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.297930 Oct 03 10:52:15.799475 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2571/4859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:15 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:15.802511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.803666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.804869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:15.815751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:15.816419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:15.831025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.831774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.832483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:15.833524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:15.834166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:15.834919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.158628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:16.169241 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65d757d0-238c-4f45-a343-952ef66d0184 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1587 microversion: 2.1 time: 0.414161 Oct 03 10:52:16.170112 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2289/4860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:15 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1587 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:16.175854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9f357c34-e7e6-4f02-b26c-8c675286290f req-28251c25-0fb3-403e-9ff3-4c15e4252a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8453f27-2f55-462f-9d8c-5f714fab884d", "tag": "8cbb0893-8642-4d75-92f1-0842f72860b1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:16.187080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9f357c34-e7e6-4f02-b26c-8c675286290f req-28251c25-0fb3-403e-9ff3-4c15e4252a2b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.187732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9f357c34-e7e6-4f02-b26c-8c675286290f req-28251c25-0fb3-403e-9ff3-4c15e4252a2b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.188245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9f357c34-e7e6-4f02-b26c-8c675286290f req-28251c25-0fb3-403e-9ff3-4c15e4252a2b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.200499 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9f357c34-e7e6-4f02-b26c-8c675286290f req-28251c25-0fb3-403e-9ff3-4c15e4252a2b service nova] Creating event network-changed:8cbb0893-8642-4d75-92f1-0842f72860b1 for instance c8453f27-2f55-462f-9d8c-5f714fab884d on n-h2-858383-3 Oct 03 10:52:16.208682 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9f357c34-e7e6-4f02-b26c-8c675286290f req-28251c25-0fb3-403e-9ff3-4c15e4252a2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037104 Oct 03 10:52:16.209455 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2290/4861] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:16.218766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:16.219845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:16.225540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:16.235269 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3957bb1a-265b-40fd-a9a6-20578a59f7d9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.433893 Oct 03 10:52:16.239096 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2572/4862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:15 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:16.245300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:16.256031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.256031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.256031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.256397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.258183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.258183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.260128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:16.279446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.290340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.291044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.291817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.292289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.292723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.447504 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-88d9cfe3-f38d-4d51-9176-6911566a9b60 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206525 Oct 03 10:52:16.448694 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2573/4863] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:52:16 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:16.454755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:16.455408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:16.473001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.474061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.475025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.476565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.478400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.479527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.672746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:16.682637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ef26bd8-551b-4216-b639-373da27d401d tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1314 microversion: 2.1 time: 0.468169 Oct 03 10:52:16.684271 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2291/4864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:16 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:16.825966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:16.828265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:16.839391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.840208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.840641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:16.841682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:16.843011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:16.843383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.026828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:17.034748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:17.042528 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1ead93c4-7552-4567-91b7-423bf739f801 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.592701 Oct 03 10:52:17.044713 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7256db9e-8218-4bd5-a6ef-f27517f1079f tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.225765 Oct 03 10:52:17.046043 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2292/4865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:16 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:17.049779 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2574/4866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:16 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:17.062346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b2d04922-1f9b-4e67-a01d-d01a0fada1e4 req-063115d0-18bf-40f9-ba5c-2b27dfb34823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653dfa95-6517-4da9-a28c-15f9ad96eccb", "tag": "65b2397d-27e7-4b80-a68a-2c266be85aa0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:17.073994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab0ef7e2-3bd7-40c0-b8b0-f20eef4f6537 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:17.077329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2d04922-1f9b-4e67-a01d-d01a0fada1e4 req-063115d0-18bf-40f9-ba5c-2b27dfb34823 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.078112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2d04922-1f9b-4e67-a01d-d01a0fada1e4 req-063115d0-18bf-40f9-ba5c-2b27dfb34823 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.078903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2d04922-1f9b-4e67-a01d-d01a0fada1e4 req-063115d0-18bf-40f9-ba5c-2b27dfb34823 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.083552 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ab0ef7e2-3bd7-40c0-b8b0-f20eef4f6537 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance e44fe689-cda5-4169-bf5f-2f7c309d74a1 has no mapping to a cell. Oct 03 10:52:17.092665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b2d04922-1f9b-4e67-a01d-d01a0fada1e4 req-063115d0-18bf-40f9-ba5c-2b27dfb34823 service nova] Creating event network-changed:65b2397d-27e7-4b80-a68a-2c266be85aa0 for instance 653dfa95-6517-4da9-a28c-15f9ad96eccb on n-h2-858383-3 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab0ef7e2-3bd7-40c0-b8b0-f20eef4f6537 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/e44fe689-cda5-4169-bf5f-2f7c309d74a1/action HTTP/1.1 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 15 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: {"os-stop": {}} Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance e44fe689-cda5-4169-bf5f-2f7c309d74a1 has no mapping to a cell. Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'e44fe689-cda5-4169-bf5f-2f7c309d74a1', 'body': {'os-stop': {}}} Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e44fe689-cda5-4169-bf5f-2f7c309d74a1 has no mapping to a cell. Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:17.099515 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e44fe689-cda5-4169-bf5f-2f7c309d74a1 has no mapping to a cell. Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e44fe689-cda5-4169-bf5f-2f7c309d74a1 has no mapping to a cell. Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.110786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab0ef7e2-3bd7-40c0-b8b0-f20eef4f6537 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance e44fe689-cda5-4169-bf5f-2f7c309d74a1 has no mapping to a cell. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:17.111901 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b2d04922-1f9b-4e67-a01d-d01a0fada1e4 req-063115d0-18bf-40f9-ba5c-2b27dfb34823 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054970 Oct 03 10:52:17.111901 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2293/4867] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:17.112080 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ab0ef7e2-3bd7-40c0-b8b0-f20eef4f6537 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/e44fe689-cda5-4169-bf5f-2f7c309d74a1/action" status: 404 len: 117 microversion: 2.1 time: 0.036883 Oct 03 10:52:17.112080 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2575/4868] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:17 2022] POST /compute/v2.1/servers/e44fe689-cda5-4169-bf5f-2f7c309d74a1/action => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:52:17.119186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:17.120631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:17.128263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.129400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.130630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.131381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.131852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.132297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.292934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:17.303510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d71c13d-a2d1-4a5d-9286-25e2452e71e5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.193678 Oct 03 10:52:17.316363 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2294/4869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:17 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:17.329334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:17.330956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:17.342835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.343761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.344437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.345442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.346161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.346906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.730319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:17.730932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:17.740340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.741903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.742645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.743882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.745337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.746358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.749022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:17.760724 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a1b9fa2-1b32-4ebe-8c8f-6c127579347b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.435517 Oct 03 10:52:17.765664 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2576/4870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:17 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:17.795055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b7ae287-fcc1-4e38-8209-c7c32267dd64 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:17.795593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b7ae287-fcc1-4e38-8209-c7c32267dd64 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: c6eaa017-28f7-42fd-9fb0-651d2f049698] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:17.806546 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6b7ae287-fcc1-4e38-8209-c7c32267dd64 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance c6eaa017-28f7-42fd-9fb0-651d2f049698 could not be found. Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b7ae287-fcc1-4e38-8209-c7c32267dd64 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/c6eaa017-28f7-42fd-9fb0-651d2f049698/action HTTP/1.1 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 15 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: {"suspend": {}} Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c6eaa017-28f7-42fd-9fb0-651d2f049698 could not be found. Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c6eaa017-28f7-42fd-9fb0-651d2f049698', 'body': {'suspend': {}}} Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6eaa017-28f7-42fd-9fb0-651d2f049698 could not be found. Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6eaa017-28f7-42fd-9fb0-651d2f049698 could not be found. Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:17.809760 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:17.816883 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:17.816883 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:17.816883 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6eaa017-28f7-42fd-9fb0-651d2f049698 could not be found. Oct 03 10:52:17.816883 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:17.820033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b7ae287-fcc1-4e38-8209-c7c32267dd64 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance c6eaa017-28f7-42fd-9fb0-651d2f049698 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:17.821863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b7ae287-fcc1-4e38-8209-c7c32267dd64 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/c6eaa017-28f7-42fd-9fb0-651d2f049698/action" status: 404 len: 111 microversion: 2.1 time: 0.031906 Oct 03 10:52:17.827105 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2577/4871] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:17 2022] POST /compute/v2.1/servers/c6eaa017-28f7-42fd-9fb0-651d2f049698/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:52:17.834309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:17.835673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:17.847558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.848500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.849296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:17.850388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:17.851072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:17.851701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:18.396344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:18.415071 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75d21973-2728-4718-b3c1-57f3e53fb6f7 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1314 microversion: 2.1 time: 0.693483 Oct 03 10:52:18.417095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2295/4872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:17 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:18.424147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:18.425688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:18.438827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:18.440399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:18.440882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:18.442464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:18.443231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:18.443825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:18.528911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:18.540235 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e9b87e17-a464-4dc1-bcc6-72c3c3861b6f tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.711065 Oct 03 10:52:18.544131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2578/4873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:17 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:18.569429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:18.570383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:18.584704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:18.585257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:18.586038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:18.587340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:18.587814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:18.588254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:18.802314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:18.821397 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78b4a3e3-e2cb-432f-a593-130209af40a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.394817 Oct 03 10:52:18.822731 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2296/4874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:18 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:18.995717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:19.004540 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51ca5070-3fdb-4caa-ba72-9d8350a5d461 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.438775 Oct 03 10:52:19.005125 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2579/4875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:18 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:19.036916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:19.038886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:19.050347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.051937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.052598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.053545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.054166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.054782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.057999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:19.088532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lazy-loading 'flavor' on Instance uuid 291b31e5-972b-4f07-817d-dcafef6fbcc8 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:52:19.220095 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dd39da48-c442-4ce4-8b51-bbfc5cda7217 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 202 len: 0 microversion: 2.1 time: 0.190412 Oct 03 10:52:19.229243 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2297/4876] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:19 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:52:19.232587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:19.232820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:19.247907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.248418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.248894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.249628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.250106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.250541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.455948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:19.456634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:19.470775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.471074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.471352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.479138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.480838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.482199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.628789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:19.658511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ccfac98-7161-4340-b5b2-00da04c9abb6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1514 microversion: 2.1 time: 0.428044 Oct 03 10:52:19.670929 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2580/4877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:19 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:19.685630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:19.686535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:19.693093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.693887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.694489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.696184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.696973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.697630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.742456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:19.761040 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e4bf602-f094-44b5-a21d-6c8e5b9af20f tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1314 microversion: 2.1 time: 0.317405 Oct 03 10:52:19.761874 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2298/4878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:19 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:19.768541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f67f0380-7721-4a9a-a1cd-5c5fcb35f080 req-0d45cda1-0306-4991-af52-5f8c9bce6cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a23e59-d9cd-4eb9-a5b4-dde4451c57ef", "tag": "a2ac6d7a-be08-4ac8-a509-48d651139d97"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:19.793231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f67f0380-7721-4a9a-a1cd-5c5fcb35f080 req-0d45cda1-0306-4991-af52-5f8c9bce6cd2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.794863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f67f0380-7721-4a9a-a1cd-5c5fcb35f080 req-0d45cda1-0306-4991-af52-5f8c9bce6cd2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.797029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f67f0380-7721-4a9a-a1cd-5c5fcb35f080 req-0d45cda1-0306-4991-af52-5f8c9bce6cd2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.833521 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f67f0380-7721-4a9a-a1cd-5c5fcb35f080 req-0d45cda1-0306-4991-af52-5f8c9bce6cd2 service nova] Creating event network-changed:a2ac6d7a-be08-4ac8-a509-48d651139d97 for instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef on n-h1-858383-3 Oct 03 10:52:19.845575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f67f0380-7721-4a9a-a1cd-5c5fcb35f080 req-0d45cda1-0306-4991-af52-5f8c9bce6cd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081714 Oct 03 10:52:19.847834 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2299/4879] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:19.854704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:19.856744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:19.865557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.867051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.868068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:19.870349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:19.871253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:19.872008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:20.080147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:20.093391 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7cdd536-08c4-4725-b80d-2d5f2612ce7b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1587 microversion: 2.1 time: 0.411399 Oct 03 10:52:20.096587 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2581/4880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:19 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1587 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:20.247012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:20.260227 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d0e13f7-5a5a-4e4c-912a-e98daaf03115 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.410225 Oct 03 10:52:20.261383 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2300/4881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:19 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:20.692126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:20.693110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:20.710206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:20.710701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:20.720532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:20.724404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:20.725375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:20.725944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:20.793497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:20.797693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:20.814031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:20.814500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:20.819876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:20.823728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:20.824437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:20.825253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:20.838080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:21.100121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:21.122128 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eafb4007-1623-40bc-b03e-f13cbf2213d4 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1497 microversion: 2.1 time: 0.437698 Oct 03 10:52:21.129513 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2582/4882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:20 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1497 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:21.172148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:21.172821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:21.188356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.189378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.190890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.193379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.194285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.197163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.245344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:21.258507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lazy-loading 'flavor' on Instance uuid 291b31e5-972b-4f07-817d-dcafef6fbcc8 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:52:21.261540 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e04a71a8-14bb-47dc-8ba3-f92f3ec74055 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1314 microversion: 2.1 time: 0.476655 Oct 03 10:52:21.262954 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2301/4883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:20 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:21.290100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9894ad69-3269-4af1-ad58-c9f472f58e78 req-2bbfa7cd-5880-4a15-9a87-4f242e82fce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8453f27-2f55-462f-9d8c-5f714fab884d", "name": "network-vif-plugged", "status": "completed", "tag": "8cbb0893-8642-4d75-92f1-0842f72860b1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:21.301977 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Cannot 'suspend' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state suspended Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action HTTP/1.1 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 15 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: {"suspend": {}} Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: exception: Cannot 'suspend' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state suspended Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'suspend': {}}} Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 03 10:52:21.311103 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state suspended Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state suspended Oct 03 10:52:21.323170 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:21.334239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 409 to user: Cannot 'suspend' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state suspended {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:21.335654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9894ad69-3269-4af1-ad58-c9f472f58e78 req-2bbfa7cd-5880-4a15-9a87-4f242e82fce8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.336939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9894ad69-3269-4af1-ad58-c9f472f58e78 req-2bbfa7cd-5880-4a15-9a87-4f242e82fce8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.337457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9894ad69-3269-4af1-ad58-c9f472f58e78 req-2bbfa7cd-5880-4a15-9a87-4f242e82fce8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.342495 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c04b4ad8-60c2-4079-8c2f-f4a3fab44429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 409 len: 148 microversion: 2.1 time: 0.173087 Oct 03 10:52:21.347173 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2583/4884] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:21 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 148 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:52:21.357147 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9894ad69-3269-4af1-ad58-c9f472f58e78 req-2bbfa7cd-5880-4a15-9a87-4f242e82fce8 service nova] Creating event network-vif-plugged:8cbb0893-8642-4d75-92f1-0842f72860b1 for instance c8453f27-2f55-462f-9d8c-5f714fab884d on n-h2-858383-3 Oct 03 10:52:21.364607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9894ad69-3269-4af1-ad58-c9f472f58e78 req-2bbfa7cd-5880-4a15-9a87-4f242e82fce8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098518 Oct 03 10:52:21.365546 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2302/4885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:21.366355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:21.378218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:21.379967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:21.385921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:21.394254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.396756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.399111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.401044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.402236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.403319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.405154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.405640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.406912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.409054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.410494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.411497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.571273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bf48587f-1bc3-4c3d-9513-f07a0feacfb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 202 len: 0 microversion: 2.1 time: 0.202787 Oct 03 10:52:21.578216 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2303/4886] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:21 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:52:21.600545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:21.602695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:21.612522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.613570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.614820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.616116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:21.616938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:21.617794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:21.754229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:21.779854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:21.909012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:21.923362 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3fb3769-8c97-4e46-bcba-53267cca8417 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1503 microversion: 2.1 time: 0.333055 Oct 03 10:52:21.940750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2304/4887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:21 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1503 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:21.991989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:22.062625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:22.074020 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4bb8516f-c763-499d-b6af-f181d6c3778b tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.713603 Oct 03 10:52:22.075440 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2584/4888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:21 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:22.313603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:22.315693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:22.324162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:22.325087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:22.325750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:22.326712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:22.327393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:22.328525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:22.662054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:22.694631 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5242afd7-1fae-45bd-bee5-374168d16d76 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1314 microversion: 2.1 time: 0.388646 Oct 03 10:52:22.697072 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2305/4889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:22 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:22.948467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:22.949582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:22.960228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:22.961951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:22.964240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:22.965271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:22.965944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:22.966579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:23.102265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:23.103812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:23.113521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:23.114026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:23.114472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:23.115186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:23.115699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:23.116202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:23.301658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:23.315344 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9aae1463-9830-4fc5-9a1b-c4eb9c9cee11 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.220011 Oct 03 10:52:23.316314 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2306/4890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:23 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:23.523171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:23.533245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-11bdd8ea-77f5-4423-b86d-0bb2325bd44d tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1503 microversion: 2.1 time: 0.589578 Oct 03 10:52:23.533804 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2585/4891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:22 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:23.730552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:23.731180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:23.740849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:23.742585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:23.742585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:23.742585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:23.743080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:23.746511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:23.958052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:23.968291 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-95c9ac41-162d-4927-ad57-d37d31564052 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1499 microversion: 2.1 time: 0.252659 Oct 03 10:52:23.969078 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2307/4892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:23 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1499 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:24.348407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:24.349228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:24.366401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:24.369426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:24.370135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:24.372165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:24.375344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:24.377059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:24.567374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:24.568455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:24.581215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:24.582131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:24.582580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:24.583417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:24.583879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:24.584304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:24.690517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:24.702681 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77e56617-804c-4b5e-91f7-efd4c0d25ee7 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.362213 Oct 03 10:52:24.718044 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2586/4893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:24 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:24.843069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:24.857800 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ebda4da-dff2-4308-9236-beebc369ac97 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.294972 Oct 03 10:52:24.870713 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2308/4894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:24 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:24.889683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:24.890313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:24.908538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:24.910123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:24.912222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:24.914492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:24.917614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:24.918574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.103611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8c7f4bc7-4d36-495c-851a-2077c24e6dc7 req-862b0ea7-4492-4055-b0ea-43f998556932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653dfa95-6517-4da9-a28c-15f9ad96eccb", "name": "network-vif-plugged", "status": "completed", "tag": "65b2397d-27e7-4b80-a68a-2c266be85aa0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:25.124151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8c7f4bc7-4d36-495c-851a-2077c24e6dc7 req-862b0ea7-4492-4055-b0ea-43f998556932 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:25.125630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8c7f4bc7-4d36-495c-851a-2077c24e6dc7 req-862b0ea7-4492-4055-b0ea-43f998556932 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:25.128499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8c7f4bc7-4d36-495c-851a-2077c24e6dc7 req-862b0ea7-4492-4055-b0ea-43f998556932 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.147711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8c7f4bc7-4d36-495c-851a-2077c24e6dc7 req-862b0ea7-4492-4055-b0ea-43f998556932 service nova] Creating event network-vif-plugged:65b2397d-27e7-4b80-a68a-2c266be85aa0 for instance 653dfa95-6517-4da9-a28c-15f9ad96eccb on n-h2-858383-3 Oct 03 10:52:25.153880 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8c7f4bc7-4d36-495c-851a-2077c24e6dc7 req-862b0ea7-4492-4055-b0ea-43f998556932 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055455 Oct 03 10:52:25.155512 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2309/4895] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:25.391788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:25.402104 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1f6d4d74-ee06-43bc-b223-8df801d0c346 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.520736 Oct 03 10:52:25.402841 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2587/4896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:24 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:25.439839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e1c7ddd-909e-445c-97b4-eeffb7a032e9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:25.443296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e1c7ddd-909e-445c-97b4-eeffb7a032e9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: b08a7c3d-634d-4063-854b-270be5018788] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:25.455602 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-2e1c7ddd-909e-445c-97b4-eeffb7a032e9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance b08a7c3d-634d-4063-854b-270be5018788 could not be found. Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e1c7ddd-909e-445c-97b4-eeffb7a032e9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/b08a7c3d-634d-4063-854b-270be5018788/action HTTP/1.1 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 15 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: {"unpause": {}} Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b08a7c3d-634d-4063-854b-270be5018788 could not be found. Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b08a7c3d-634d-4063-854b-270be5018788', 'body': {'unpause': {}}} Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08a7c3d-634d-4063-854b-270be5018788 could not be found. Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08a7c3d-634d-4063-854b-270be5018788 could not be found. Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:25.457674 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:25.466604 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:25.466604 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:25.466604 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08a7c3d-634d-4063-854b-270be5018788 could not be found. Oct 03 10:52:25.466604 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:25.472184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e1c7ddd-909e-445c-97b4-eeffb7a032e9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance b08a7c3d-634d-4063-854b-270be5018788 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:25.474515 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e1c7ddd-909e-445c-97b4-eeffb7a032e9 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/b08a7c3d-634d-4063-854b-270be5018788/action" status: 404 len: 111 microversion: 2.1 time: 0.046581 Oct 03 10:52:25.476173 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2310/4897] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:25 2022] POST /compute/v2.1/servers/b08a7c3d-634d-4063-854b-270be5018788/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:25.489351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:25.489986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:25.506672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:25.508160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:25.509967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.515852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:25.516445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:25.517187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.725735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:25.732277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:25.732919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:25.740964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:25.741721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:25.742193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4ce6b24-81d3-40aa-8018-d40c021e335a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.257739 Oct 03 10:52:25.742498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.743165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2588/4898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:25 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:25.745419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:25.746438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:25.746886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.767074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:25.767938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:25.780683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:25.781211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:25.781733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.782457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:25.782930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:25.783357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:25.828640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:25.961012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:25.970087 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43be78fc-8cdb-4ad0-8856-0a889c658608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.207548 Oct 03 10:52:25.985699 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2589/4899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:25 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:25.993785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:25.994321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:26.001276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.002002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.002260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.002969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.003431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.003840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.034551 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Cannot 'unpause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action HTTP/1.1 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 15 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: {"unpause": {}} Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: exception: Cannot 'unpause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'unpause': {}}} Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 in vm_state active. Cannot unpause while the instance is in this state. Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:26.036477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:26.041588 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:26.041588 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:26.041588 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:26.041588 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:26.041588 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.042014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:26.043046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 409 to user: Cannot 'unpause' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:26.044427 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-602ade6a-880c-4bd5-aa74-6912a9c16b74 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 409 len: 145 microversion: 2.1 time: 0.054196 Oct 03 10:52:26.048792 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2590/4900] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:25 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 145 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:52:26.054359 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a52185c5-fd99-403c-9537-2652ef95af61 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1314 microversion: 2.1 time: 0.325567 Oct 03 10:52:26.054548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:26.055894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:26.056903 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2311/4901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:25 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:26.063200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.063691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.064127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.064869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.065328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.065747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.252306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:26.270798 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08371504-ac0a-4ad9-b462-e5f4c2399724 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.220464 Oct 03 10:52:26.271556 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2591/4902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:26 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:26.294818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:26.295628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:26.301995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.302708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.303139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.303998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.304610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.305760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.514212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:26.525724 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-73369b98-0b33-481d-8e82-2e9b966cd70b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.234845 Oct 03 10:52:26.553948 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2312/4903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:26 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:26.582264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-214492c3-b33f-4993-889e-d6c068bb9894 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:26.582849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-214492c3-b33f-4993-889e-d6c068bb9894 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: cb792e5d-945a-4087-93c9-30cf3bcd0586] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:26.599681 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-214492c3-b33f-4993-889e-d6c068bb9894 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance cb792e5d-945a-4087-93c9-30cf3bcd0586 could not be found. Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-214492c3-b33f-4993-889e-d6c068bb9894 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/cb792e5d-945a-4087-93c9-30cf3bcd0586/action HTTP/1.1 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 18 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: {"unshelve": null} Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance cb792e5d-945a-4087-93c9-30cf3bcd0586 could not be found. Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'cb792e5d-945a-4087-93c9-30cf3bcd0586', 'body': {'unshelve': None}} Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb792e5d-945a-4087-93c9-30cf3bcd0586 could not be found. Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb792e5d-945a-4087-93c9-30cf3bcd0586 could not be found. Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.601311 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb792e5d-945a-4087-93c9-30cf3bcd0586 could not be found. Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-214492c3-b33f-4993-889e-d6c068bb9894 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance cb792e5d-945a-4087-93c9-30cf3bcd0586 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-214492c3-b33f-4993-889e-d6c068bb9894 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/cb792e5d-945a-4087-93c9-30cf3bcd0586/action" status: 404 len: 111 microversion: 2.1 time: 0.025046 Oct 03 10:52:26.607256 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2592/4904] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:26 2022] POST /compute/v2.1/servers/cb792e5d-945a-4087-93c9-30cf3bcd0586/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:26.612110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:26.612715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:26.627162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.628090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.628926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.629882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.630533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.631127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:26.933384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:26.942795 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5c32acd-8296-4b58-9c41-f96f469613b2 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.334362 Oct 03 10:52:26.943739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2313/4905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:26 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:26.976082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:26.977958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:26.985645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:26.996708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:26.998677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.003114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.009179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.010401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.084637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:27.085546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:27.097046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.097850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.098494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.101359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.102700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.103320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.110779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:27.270550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:27.280132 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-387dc467-3195-4a4b-9074-eab40ae96dd0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1499 microversion: 2.1 time: 0.200855 Oct 03 10:52:27.280692 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2314/4906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:27 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1499 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:27.306761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:27.310127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:27.318234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.318802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.319398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.321244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.321794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.322296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.356723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lazy-loading 'flavor' on Instance uuid 653dfa95-6517-4da9-a28c-15f9ad96eccb {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:52:27.464638 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-451ce632-98c1-4b1e-9d2a-0b8a57903eb2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "POST /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb/action" status: 200 len: 32 microversion: 2.1 time: 0.163571 Oct 03 10:52:27.466073 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2315/4907] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:27 2022] POST /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:52:27.479307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:27.481956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:27.497798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.498916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.501007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.502171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.502681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.503174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.707585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:27.718320 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fba136dd-3c2f-4fcf-8ada-a71bbfbc27df tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.245679 Oct 03 10:52:27.733445 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2316/4908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:27 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:27.822795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:27.835993 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-af61c867-e30d-44cf-abbc-1b362b11740e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.863889 Oct 03 10:52:27.837022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2593/4909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:26 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:27.866708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:27.867845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:27.877671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.878239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.878850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.879639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.880169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.880671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.909101 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Cannot 'unshelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action HTTP/1.1 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 18 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: {"unshelve": null} Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: exception: Cannot 'unshelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'unshelve': None}} Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 in vm_state active. Cannot unshelve while the instance is in this state. Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 10:52:27.910900 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 409 to user: Cannot 'unshelve' instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 while it is in vm_state active {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4bead7b0-44ec-40e4-89b1-12123527c09a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action" status: 409 len: 146 microversion: 2.1 time: 0.059455 Oct 03 10:52:27.918025 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2317/4910] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:27 2022] POST /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8/action => generated 146 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 10:52:27.924743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:27.925479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:27.943691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.944437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.947191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:27.948200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:27.950030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:27.950030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.145680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:28.146688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:28.155853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.156605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.157343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.158605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.159404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.160422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.198485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:52:28.202545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:28.211021 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b73ee77-fcc2-4a24-9033-a48229e09b04 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.290354 Oct 03 10:52:28.211633 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2594/4911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:27 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:28.237286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:28.239784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:28.254089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.254798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.255256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.257242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.257718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.258183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.348181 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7e250d2-e417-4550-8744-428c7c1fab90 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 204 len: 0 microversion: 2.1 time: 0.206332 Oct 03 10:52:28.349872 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2318/4912] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:52:28 2022] DELETE /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:52:28.360674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:28.361649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:28.368208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.368984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.369912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.371386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.372297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.372964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.506815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:28.518719 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38dd75ef-0fab-4464-a5cf-979d0801b79a tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.286125 Oct 03 10:52:28.519554 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2595/4913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:28 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:28.542006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed8e4bac-a98a-4f18-87d0-c6f8a09f413b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1092782943_updated"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:28.544848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed8e4bac-a98a-4f18-87d0-c6f8a09f413b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 72423046-40c8-4ac5-86e6-baa12f988ec3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:28.550586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ed8e4bac-a98a-4f18-87d0-c6f8a09f413b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 72423046-40c8-4ac5-86e6-baa12f988ec3 could not be found. Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed8e4bac-a98a-4f18-87d0-c6f8a09f413b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/servers/72423046-40c8-4ac5-86e6-baa12f988ec3 HTTP/1.1 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 81 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1092782943_updated"}} Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 72423046-40c8-4ac5-86e6-baa12f988ec3 could not be found. Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '72423046-40c8-4ac5-86e6-baa12f988ec3', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1092782943_updated'}}} Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72423046-40c8-4ac5-86e6-baa12f988ec3 could not be found. Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 03 10:52:28.552219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72423046-40c8-4ac5-86e6-baa12f988ec3 could not be found. Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72423046-40c8-4ac5-86e6-baa12f988ec3 could not be found. Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed8e4bac-a98a-4f18-87d0-c6f8a09f413b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 72423046-40c8-4ac5-86e6-baa12f988ec3 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed8e4bac-a98a-4f18-87d0-c6f8a09f413b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "PUT /compute/v2.1/servers/72423046-40c8-4ac5-86e6-baa12f988ec3" status: 404 len: 111 microversion: 2.1 time: 0.016141 Oct 03 10:52:28.558027 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2596/4914] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:52:28 2022] PUT /compute/v2.1/servers/72423046-40c8-4ac5-86e6-baa12f988ec3 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:52:28.562706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:28.563319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:28.571964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.573024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.573786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.574998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.575796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.576605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.632231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:28.640977 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b8ea96a-06cb-44d2-ae75-ba46eee8aaf3 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1505 microversion: 2.1 time: 0.284944 Oct 03 10:52:28.642527 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2319/4915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:28 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:28.733337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:28.743979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:28.744796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:28.745756 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-404cd602-d42a-4110-b383-3bce793e261c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.186679 Oct 03 10:52:28.746950 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2597/4916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:28 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:28.769456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.770256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.770695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.771588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.772209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.772630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.776144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:28.776936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:28.787468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:28.790859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.791380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.793417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.794576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:28.795932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:28.796717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:28.966370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:28.983273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bcbf952b-3aa4-4c69-8c3c-9fbd1f634fdf tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.215140 Oct 03 10:52:28.984098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2598/4917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:28 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:29.010912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1723f7c9-40db-4cda-89a7-a511ccdc3647 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1723f7c9-40db-4cda-89a7-a511ccdc3647 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 HTTP/1.1 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 280 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.017193 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 10:52:29.021101 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.025337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1723f7c9-40db-4cda-89a7-a511ccdc3647 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:29.026317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1723f7c9-40db-4cda-89a7-a511ccdc3647 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "PUT /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 400 len: 619 microversion: 2.1 time: 0.021353 Oct 03 10:52:29.027666 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2599/4918] 10.222.0.27 () {60 vars in 1257 bytes} [Mon Oct 3 10:52:29 2022] PUT /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:52:29.035980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:29.036694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:29.046547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.047267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.047758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.048552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.049107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.049792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.074524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:29.088269 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a6a1e1dd-9461-4873-a512-e9f41a60b392 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.349298 Oct 03 10:52:29.089071 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2320/4919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:28 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:29.249298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:29.258005 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2862c00c-b4ad-4b62-9454-d64ea746458c tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.226144 Oct 03 10:52:29.261672 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2600/4920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:29 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:29.287808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:29.289560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:29.296336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.296836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.297285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.298231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.298879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.299450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.529239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:29.539902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe8ce120-f2d8-4e63-975e-1100d5b4d2b6 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.256439 Oct 03 10:52:29.540707 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2321/4921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:29 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:29.564716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12d2e1b0-a5f3-40cf-b9c0-d3e66dbf8768 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12d2e1b0-a5f3-40cf-b9c0-d3e66dbf8768 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: request: PUT /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 HTTP/1.1 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 24 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: {"server": {"name": ""}} Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8', 'body': {'server': {'name': ''}}} Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '' Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 10:52:29.577159 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 10:52:29.582041 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:29.589234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12d2e1b0-a5f3-40cf-b9c0-d3e66dbf8768 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:29.590278 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12d2e1b0-a5f3-40cf-b9c0-d3e66dbf8768 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "PUT /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 400 len: 108 microversion: 2.1 time: 0.030826 Oct 03 10:52:29.591639 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2601/4922] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:52:29 2022] PUT /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:52:29.601156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:29.602879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:29.610144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.610875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.611610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.612480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.613138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.613727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.667934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:29.669359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:29.682717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.683291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.683839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.684902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:29.685578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:29.686192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:29.859435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:29.869894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1ac1ede5-c666-45d7-a75f-034864acccff tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1505 microversion: 2.1 time: 0.208416 Oct 03 10:52:29.871222 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2602/4923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:29 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:30.111844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:30.112459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:30.119981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:30.120477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:30.120966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:30.123616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:30.124112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:30.124562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:30.221238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:30.237085 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20e22b14-335c-4a70-9b1b-5830cb1becce tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1506 microversion: 2.1 time: 0.641384 Oct 03 10:52:30.248592 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2322/4924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:29 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:30.384410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:30.396813 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9a1f23e-8101-4c9c-9d60-6078580c7048 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.288941 Oct 03 10:52:30.397426 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2603/4925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:30 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:30.647467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3ace82f1-cedc-4bf7-8ac5-73fd5b7a67d2 req-3eaa3b8e-d7de-4ce2-bc90-07f558e968c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8453f27-2f55-462f-9d8c-5f714fab884d", "name": "network-vif-deleted", "tag": "8cbb0893-8642-4d75-92f1-0842f72860b1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:30.666720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3ace82f1-cedc-4bf7-8ac5-73fd5b7a67d2 req-3eaa3b8e-d7de-4ce2-bc90-07f558e968c6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:30.667216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3ace82f1-cedc-4bf7-8ac5-73fd5b7a67d2 req-3eaa3b8e-d7de-4ce2-bc90-07f558e968c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:30.667651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3ace82f1-cedc-4bf7-8ac5-73fd5b7a67d2 req-3eaa3b8e-d7de-4ce2-bc90-07f558e968c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:30.686273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3ace82f1-cedc-4bf7-8ac5-73fd5b7a67d2 req-3eaa3b8e-d7de-4ce2-bc90-07f558e968c6 service nova] Creating event network-vif-deleted:8cbb0893-8642-4d75-92f1-0842f72860b1 for instance c8453f27-2f55-462f-9d8c-5f714fab884d on n-h2-858383-3 Oct 03 10:52:30.696706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3ace82f1-cedc-4bf7-8ac5-73fd5b7a67d2 req-3eaa3b8e-d7de-4ce2-bc90-07f558e968c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052717 Oct 03 10:52:30.701226 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2323/4926] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:30.895292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:30.895906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:30.907327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:30.907837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:30.908276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:30.909493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:30.916335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:30.917005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:30.968974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:30.969696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:30.970303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:30.970923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lazy-loading 'fault' on Instance uuid c8453f27-2f55-462f-9d8c-5f714fab884d {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:52:31.059156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37476993270646da91e7c4cc326c3245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff878d95cf53440fa913a3d878fe48bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:31.067691 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d46781e-e6a6-4102-8af7-4507f9b0ac91 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 200 len: 1304 microversion: 2.1 time: 0.176161 Oct 03 10:52:31.068622 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2604/4927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:30 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:31.425625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:31.426655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:31.439123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:31.440242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:31.442553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:31.445478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:31.446317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:31.447548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:31.734221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:31.762401 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e580cdc-4ee5-43a3-b995-d79026c2e927 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.340588 Oct 03 10:52:31.779181 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2324/4928] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:31 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:32.093064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:32.094206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] [instance: c8453f27-2f55-462f-9d8c-5f714fab884d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:32.105413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:32.106284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:32.107068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:32.110196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:32.111262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:32.112243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:32.137069 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] HTTP exception thrown: Instance c8453f27-2f55-462f-9d8c-5f714fab884d could not be found. Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Request method failure captured: Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d HTTP/1.1 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7VDz2u4wXWRRkVSfSJn8S9DuoZ0mwByB04ONOx8mABlcjBX7guGfUJedibpssIcBFkZySH6ngPLhWVcA1TWclITlSyv1pHMl7cYuTDtQriF4MAF82T7XlbIg3ONRJzJSEs4fU23EHpfbSBYisHw4AHVI3fSA-GYk7mYA30NB6ph3M Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: ff878d95cf53440fa913a3d878fe48bc Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesActionsTest-1273777830 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff878d95cf53440fa913a3d878fe48bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ff878d95cf53440fa913a3d878fe48bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ff878d95cf53440fa913a3d878fe48bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ff878d95cf53440fa913a3d878fe48bc"}]}] Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesActionsTest-1273777830 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: ff878d95cf53440fa913a3d878fe48bc Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesActionsTest-1273777830 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesActionsTest-1273777830-project Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 37476993270646da91e7c4cc326c3245 Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesActionsTest-1273777830-project Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c8453f27-2f55-462f-9d8c-5f714fab884d could not be found. Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c8453f27-2f55-462f-9d8c-5f714fab884d'} Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8453f27-2f55-462f-9d8c-5f714fab884d could not be found. Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8453f27-2f55-462f-9d8c-5f714fab884d could not be found. Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:32.139278 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8453f27-2f55-462f-9d8c-5f714fab884d could not be found. Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:32.147463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] Returning 404 to user: Instance c8453f27-2f55-462f-9d8c-5f714fab884d could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:32.150098 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d086d49-72c5-40f5-b529-d05fa34bbb50 tempest-VolumesActionsTest-1273777830 tempest-VolumesActionsTest-1273777830-project] 10.222.0.27 "GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d" status: 404 len: 111 microversion: 2.1 time: 0.061260 Oct 03 10:52:32.151128 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2605/4929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:32 2022] GET /compute/v2.1/servers/c8453f27-2f55-462f-9d8c-5f714fab884d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:32.786336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:32.787180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:32.795108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:32.795593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:32.796038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:32.796749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:32.797241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:32.797671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:33.103502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:33.118031 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-063fbc4a-df27-4e25-b315-9e10c26792a0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.335695 Oct 03 10:52:33.133408 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2325/4930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:32 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:34.157593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:34.158847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:34.178934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:34.179696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:34.183840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:34.185697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:34.188056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:34.188696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:34.405326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:34.418746 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d010002-e077-4fd4-a3ec-8e940716d159 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.266962 Oct 03 10:52:34.420989 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2606/4931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:34 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:35.444818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:35.446100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:35.459991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:35.461645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:35.462115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:35.462880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:35.465657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:35.468133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:35.799331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:35.814816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0b7a9895-466d-42a6-9cd6-85627937d5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.371892 Oct 03 10:52:35.833017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2326/4932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:35 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:36.846118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:36.847427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:36.859530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:36.864868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:36.865483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:36.866237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:36.868449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:36.869094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.077724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:37.087547 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-191e40b7-55d9-4ab3-a1ae-71465eab9ad0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.245521 Oct 03 10:52:37.088962 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2607/4933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:36 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:37.174768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:37.175858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:37.190846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.194784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.195249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.196044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.196519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.202253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.237717 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 HTTP/1.1 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3cdb0950-c097-4dfc-aef3-bfe925801ec0'} Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:37.239759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:37.244658 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2225dd71-203c-4dfd-87aa-4947d81cf50e tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 404 len: 111 microversion: 2.1 time: 0.074268 Oct 03 10:52:37.250690 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2327/4934] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:52:37 2022] DELETE /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:37.256034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:37.257053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 3cdb0950-c097-4dfc-aef3-bfe925801ec0] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:37.263977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.264859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.265547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.266489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.267192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.267843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.286351 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 HTTP/1.1 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3cdb0950-c097-4dfc-aef3-bfe925801ec0'} Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:37.288544 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.293099 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:37.293099 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:37.293099 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:37.293099 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:37.293099 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:37.293099 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. Oct 03 10:52:37.293099 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:37.295950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 3cdb0950-c097-4dfc-aef3-bfe925801ec0 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:37.297142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb7d0b2c-a994-48df-8dbd-7ff4e2dd5e8b tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0" status: 404 len: 111 microversion: 2.1 time: 0.044950 Oct 03 10:52:37.308439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:37.309426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:37.314619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2608/4935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:37 2022] GET /compute/v2.1/servers/3cdb0950-c097-4dfc-aef3-bfe925801ec0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:37.317003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.317767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.318437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.319396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.320306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.321124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.368243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:52:37.371231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:37.525273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:37.543853 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-21dfd9cb-ea2f-4eef-9412-1e232158bbb5 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "DELETE /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 204 len: 0 microversion: 2.1 time: 0.240437 Oct 03 10:52:37.545465 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2328/4936] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:52:37 2022] DELETE /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:52:37.556110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:37.557551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:37.566997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.587225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.587989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.589244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:37.590018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:37.591258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:37.799185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:37.809420 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8636ac27-0177-4dff-9b8f-4dbcb3c1bd15 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.259605 Oct 03 10:52:37.811319 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2609/4937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:37 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:38.115329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:38.116440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:38.132237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:38.132740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:38.133907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:38.134500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:38.134959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:38.135386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:38.549937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:38.562227 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-246c61ab-e904-4131-987f-ecc05bb1e978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.451470 Oct 03 10:52:38.562658 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2329/4938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:38 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:38.842005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:38.843796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:38.857333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:38.858065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:38.864999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:38.865849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:38.866329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:38.866768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:39.168895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:39.185996 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f6f9b5c7-5829-4edc-b3d3-0157deb11608 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.347905 Oct 03 10:52:39.185996 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2610/4939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:38 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:39.590974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:39.591596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:39.605109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:39.605865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:39.606499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:39.607449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:39.608108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:39.609238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:40.002045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:40.011643 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-921c1564-d2d1-409f-908a-fb34681377e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.424383 Oct 03 10:52:40.012379 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2330/4940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:39 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:40.205754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:40.206377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:40.218953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:40.219452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:40.219889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:40.221492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:40.222018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:40.222437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:40.228958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:52:40.391111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ec2b3ac76804e0a895b7751677a4671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd590a49addcf4b6b9fbbfc3293c6c5a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:40.402126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd26ac5d-51ec-4c0f-b3a9-1d2c50094429 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 200 len: 1512 microversion: 2.1 time: 0.199959 Oct 03 10:52:40.403970 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2611/4941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:40 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:41.045327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:41.047846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:41.077591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b76f66aa-845a-4f33-a063-096786c2416b req-5264ef08-25fc-4dc7-b42a-cbe2cc1f773e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291b31e5-972b-4f07-817d-dcafef6fbcc8", "name": "network-vif-deleted", "tag": "18aa44af-26c4-4872-80e2-aecc15b9524d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:41.089502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:41.091031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:41.093159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:41.094424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:41.095865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:41.097159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:41.144083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b76f66aa-845a-4f33-a063-096786c2416b req-5264ef08-25fc-4dc7-b42a-cbe2cc1f773e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:41.144867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b76f66aa-845a-4f33-a063-096786c2416b req-5264ef08-25fc-4dc7-b42a-cbe2cc1f773e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:41.145472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b76f66aa-845a-4f33-a063-096786c2416b req-5264ef08-25fc-4dc7-b42a-cbe2cc1f773e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:41.160197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b76f66aa-845a-4f33-a063-096786c2416b req-5264ef08-25fc-4dc7-b42a-cbe2cc1f773e service nova] Creating event network-vif-deleted:18aa44af-26c4-4872-80e2-aecc15b9524d for instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 on n-h1-858383-3 Oct 03 10:52:41.167620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b76f66aa-845a-4f33-a063-096786c2416b req-5264ef08-25fc-4dc7-b42a-cbe2cc1f773e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097523 Oct 03 10:52:41.169011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2612/4942] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:41.350863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:41.359579 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c657eb10-b5d6-4625-9efc-31c689460cc2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.326833 Oct 03 10:52:41.363110 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2331/4943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:41 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:41.431662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:41.433078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] [instance: 291b31e5-972b-4f07-817d-dcafef6fbcc8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:41.447818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:41.448583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:41.449211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:41.451401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:41.453196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:41.454881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:41.494508 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] HTTP exception thrown: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 could not be found. Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Request method failure captured: Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 HTTP/1.1 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr3rmrOnNecoQnVgubQrVO0hS9gbDnDzZjHbi4ypg_9d5AdJ4_C-aoTkmHpo9pk-aNOg8IC4BDy9YpATlnPqMGaXMcJ78M4eWi114Lv40aBJ0Noth4giFpdbOpnPUY7mgWfMLldafM8U_GdF-Fyw32xG9lRO-gwseVFORkWGpxLMNgY Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d590a49addcf4b6b9fbbfc3293c6c5a3"}]}] Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d590a49addcf4b6b9fbbfc3293c6c5a3 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145682968 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 5ec2b3ac76804e0a895b7751677a4671 Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-2145682968-project Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 could not be found. Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '291b31e5-972b-4f07-817d-dcafef6fbcc8'} Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 could not be found. Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 could not be found. Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:41.496456 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 could not be found. Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] Returning 404 to user: Instance 291b31e5-972b-4f07-817d-dcafef6fbcc8 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6167b0ec-ae09-41a0-97ad-bf54ca466c77 tempest-ServersNegativeTestJSON-2145682968 tempest-ServersNegativeTestJSON-2145682968-project] 10.222.0.27 "GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8" status: 404 len: 111 microversion: 2.1 time: 0.072955 Oct 03 10:52:41.502255 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2613/4944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:41 2022] GET /compute/v2.1/servers/291b31e5-972b-4f07-817d-dcafef6fbcc8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:42.388264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:42.388822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:42.408602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:42.409149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:42.409594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:42.410516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:42.410979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:42.411598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:42.685938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:42.696412 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a9fa5676-2e91-4e82-8745-f5359b6b2922 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.311522 Oct 03 10:52:42.697643 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2332/4945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:42 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:43.372929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:43.373541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:43.380971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:43.382402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:43.383125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:43.384241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:43.385161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:43.386081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:43.724229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:43.724931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:43.733594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:43.734183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:43.734700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:43.735505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:43.736026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:43.737706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:43.816889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:43.825878 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e01d1c9-812f-4764-92b9-8fc81db1d966 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.456804 Oct 03 10:52:43.840987 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2614/4946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:43 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:43.850441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:43.851471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:43.858949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:43.859830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:43.860564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:43.861530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:43.862211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:43.862852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:43.997617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:44.011599 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12f005da-f03b-4009-98ad-538c08fa5e7c tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.291294 Oct 03 10:52:44.014725 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2333/4947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:43 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:44.286757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:44.300623 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58964984-784b-4423-b221-def235b5c1d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.454835 Oct 03 10:52:44.309530 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2615/4948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:43 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:44.339585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:44.340243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:44.348084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:44.359465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:44.360214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:44.361185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:44.364695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:44.365445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:44.628234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:44.645823 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f473126-0901-402d-b715-71ae39f569ee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.310510 Oct 03 10:52:44.647091 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2334/4949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:44 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:44.673840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1942186142"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:44.676749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:44.685092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:44.685692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:44.686203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:44.687003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:44.687555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:44.688055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:45.033825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c89b0d1-8a9e-4e86-8a4c-b05d7435f6ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.360981 Oct 03 10:52:45.042999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:45.044716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:45.053316 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2616/4950] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:44 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 03 10:52:45.065704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:45.067311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:45.067976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:45.069134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:45.074931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:45.076043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:45.258319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:45.267586 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aea13da0-cee3-49cf-b300-278bd9ae58e3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.231600 Oct 03 10:52:45.268480 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2335/4951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:45 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:46.297624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:46.298349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:46.307528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:46.308120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:46.308635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:46.309503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:46.310177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:46.311219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:46.541861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:46.558820 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3e9650c-2187-4dd2-afc5-85f59748ceae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.264852 Oct 03 10:52:46.561647 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2617/4952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:46 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:47.590424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:47.591489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:47.599126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:47.600049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:47.600720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:47.602091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:47.602788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:47.603492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:47.781902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:47.792291 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc7dcd73-8859-4acf-9e40-253791441af5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.206255 Oct 03 10:52:47.805991 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2336/4953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:47 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:47.911274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ef7507c-a0b1-4028-a54f-827dbc6da2b7 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Action: 'create', calling method: .version_select at 0x7f074f264160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1322448731"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:48.282595 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ef7507c-a0b1-4028-a54f-827dbc6da2b7 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.513526 Oct 03 10:52:48.283817 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2618/4954] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Oct 3 10:52:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 516 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 10:52:48.298113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad88d5fc-6125-4184-a43a-de82907f955f tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074dfc3ee0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:48.352087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad88d5fc-6125-4184-a43a-de82907f955f tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 200 len: 345 microversion: 2.1 time: 0.057707 Oct 03 10:52:48.353167 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2337/4955] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:52:48 2022] GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:48.821202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:48.824083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:48.832255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:48.832756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:48.833267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:48.834123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:48.834582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:48.835119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:49.156959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:49.166455 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1af34c4d-00a8-4d3a-a382-e34f7e8a40b0 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.351638 Oct 03 10:52:49.182653 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2619/4956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:48 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:49.368568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a6756f1f-7a12-45f2-a5cc-8fc0e548be64 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074e00c5e0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:49.444034 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a6756f1f-7a12-45f2-a5cc-8fc0e548be64 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 200 len: 346 microversion: 2.1 time: 0.080915 Oct 03 10:52:49.444809 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2338/4957] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:52:49 2022] GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:49.461349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61664a75-61d5-4635-a2b4-d66e19685c5d tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Action: 'create', calling method: .version_select at 0x7f074f661af0>, body: {"snapshot": {"volume_id": "4328cb86-9980-48ff-8a4e-4be19a8dddf2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1422570412"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:49.733824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61664a75-61d5-4635-a2b4-d66e19685c5d tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.278141 Oct 03 10:52:49.740163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2620/4958] 10.222.0.27 () {60 vars in 1162 bytes} [Mon Oct 3 10:52:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:49.750244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fedff51d-3d12-4f94-a186-422790ad6781 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074dfd6160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:49.811711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fedff51d-3d12-4f94-a186-422790ad6781 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 287 microversion: 2.1 time: 0.068979 Oct 03 10:52:49.819011 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2339/4959] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:49 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:49.824785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1aacd94d-473f-41e2-a1ec-57120d7f33a9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f0757578430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:49.884119 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1aacd94d-473f-41e2-a1ec-57120d7f33a9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064311 Oct 03 10:52:49.885741 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2621/4960] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Oct 3 10:52:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:49.906496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43e8e079-e1b9-4d8c-bbe6-297d67186089 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074f0b0820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:49.963355 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43e8e079-e1b9-4d8c-bbe6-297d67186089 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 287 microversion: 2.1 time: 0.065917 Oct 03 10:52:49.969519 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2340/4961] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:49 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:50.194353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:50.194729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:50.207909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:50.208637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:50.209286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:50.210160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:50.210773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:50.216049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:50.665237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:50.679957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c0f9db33-0a72-413a-a392-2fee310f46c3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.489843 Oct 03 10:52:50.693861 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2622/4962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:50 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:50.979014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de8392e3-686d-4c47-be55-45a1bfa298f7 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074e011c10>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:51.097241 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de8392e3-686d-4c47-be55-45a1bfa298f7 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 287 microversion: 2.1 time: 0.123539 Oct 03 10:52:51.102815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2341/4963] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:50 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:51.192411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5243ee74-2945-4d65-8ab7-89282bcb339d req-1e903fa5-7967-4f2a-b5a5-2834bbc97767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-plugged", "status": "completed", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:51.233502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5243ee74-2945-4d65-8ab7-89282bcb339d req-1e903fa5-7967-4f2a-b5a5-2834bbc97767 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:51.235627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5243ee74-2945-4d65-8ab7-89282bcb339d req-1e903fa5-7967-4f2a-b5a5-2834bbc97767 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:51.239204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5243ee74-2945-4d65-8ab7-89282bcb339d req-1e903fa5-7967-4f2a-b5a5-2834bbc97767 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:51.288825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5243ee74-2945-4d65-8ab7-89282bcb339d req-1e903fa5-7967-4f2a-b5a5-2834bbc97767 service nova] Creating event network-vif-plugged:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:52:51.309359 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5243ee74-2945-4d65-8ab7-89282bcb339d req-1e903fa5-7967-4f2a-b5a5-2834bbc97767 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119809 Oct 03 10:52:51.311163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2623/4964] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:51.707398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:51.708337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:51.729320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:51.729853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:51.730660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:51.731047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:51.731520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:51.731986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:52.102746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:52.110465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28c4a8df-898b-422b-b999-c451f1a8550a tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074ec3e8b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:52.117738 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-85cb7728-3130-4446-8b71-497097804026 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.414191 Oct 03 10:52:52.132389 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2342/4965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:51 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:52:52.178567 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28c4a8df-898b-422b-b999-c451f1a8550a tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 287 microversion: 2.1 time: 0.072205 Oct 03 10:52:52.179230 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2624/4966] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:52 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:53.152988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:53.154117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:53.169188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:53.171567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:53.172108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:53.173154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:53.173708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:53.174776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:53.191764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d37f1018-5737-4a9e-a831-5a2f42c93be9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074f18cdc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:53.253340 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d37f1018-5737-4a9e-a831-5a2f42c93be9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 288 microversion: 2.1 time: 0.065379 Oct 03 10:52:53.253917 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2625/4967] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:53 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 288 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:53.266943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-562cdc3e-7a8b-48c8-a119-95df8aead733 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074f3604c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:53.377627 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-562cdc3e-7a8b-48c8-a119-95df8aead733 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 202 len: 0 microversion: 2.1 time: 0.115735 Oct 03 10:52:53.378805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2626/4968] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 3 10:52:53 2022] DELETE /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:52:53.387739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a0bc539-0421-41c6-a0ea-6f4eded0e539 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074f19e8b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:53.461847 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a0bc539-0421-41c6-a0ea-6f4eded0e539 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 287 microversion: 2.1 time: 0.078228 Oct 03 10:52:53.462526 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2627/4969] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:53 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:52:54.079369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:54.100485 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8dcd9bd1-6f4a-4253-86b9-12b868de2616 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.951227 Oct 03 10:52:54.101219 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2343/4970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:53 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:54.475684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9f98113-63d8-487c-aabc-ef5767b86a85 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f07575780d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:54.517382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9f98113-63d8-487c-aabc-ef5767b86a85 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 287 microversion: 2.1 time: 0.046813 Oct 03 10:52:54.518231 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2628/4971] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:54 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:55.125969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:55.126768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:55.140612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:55.143169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:55.143976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:55.145391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:55.150305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:55.150877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:55.408746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:55.421996 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0ba2a3d9-1c24-4116-8d3c-88d78c62bc56 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.301433 Oct 03 10:52:55.423016 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2344/4972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:55 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:55.587133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d02da9cb-df7b-4658-8561-21b96a3749ff tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f07574ee4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:55.670684 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d02da9cb-df7b-4658-8561-21b96a3749ff tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 200 len: 287 microversion: 2.1 time: 0.136214 Oct 03 10:52:55.676128 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2629/4973] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:55 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:56.448209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:56.448901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:56.459233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:56.463235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:56.464076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:56.465392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:56.469094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:56.469884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:56.769343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-678f9fcc-0485-441e-8404-a82c1d34d81b tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074f185790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:56.769343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-678f9fcc-0485-441e-8404-a82c1d34d81b tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] HTTP exception thrown: Snapshot 4993cf3d-adee-49b6-b418-b65e4f97fcff could not be found. Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-678f9fcc-0485-441e-8404-a82c1d34d81b tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Request method failure captured: Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff HTTP/1.1 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7_4MGh5Vf8LOSTqGuhC-9pSyTehZ6zBwEnnqIkMBH62j6ZVUmL2i1Ayy0W71a6ZF5PNilBuJPWD3JWUZjpHH1E-6o5Vb8BZNwpS62RkkK3CNN6azdk2lzzTyGQJ1_YsmT04DMn0uU05PSZmnwmX3p_i-6AKgTTiLaMpokjAfPH_aE Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}] Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 266674559a1743089995177f182c7b1d Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: exception: Snapshot 4993cf3d-adee-49b6-b418-b65e4f97fcff could not be found. Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '4993cf3d-adee-49b6-b418-b65e4f97fcff'} Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4993cf3d-adee-49b6-b418-b65e4f97fcff could not be found. (HTTP 404) (Request-ID: req-d6e4d9c3-4342-4fb4-8c5f-d2a552b91283) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:52:56.771160 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4993cf3d-adee-49b6-b418-b65e4f97fcff could not be found. Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4993cf3d-adee-49b6-b418-b65e4f97fcff could not be found. Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4993cf3d-adee-49b6-b418-b65e4f97fcff could not be found. Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-678f9fcc-0485-441e-8404-a82c1d34d81b tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Returning 404 to user: Snapshot 4993cf3d-adee-49b6-b418-b65e4f97fcff could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-678f9fcc-0485-441e-8404-a82c1d34d81b tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff" status: 404 len: 111 microversion: 2.1 time: 0.090032 Oct 03 10:52:56.779948 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2630/4974] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 10:52:56 2022] GET /compute/v2.1/os-snapshots/4993cf3d-adee-49b6-b418-b65e4f97fcff => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:52:56.787665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbce3615-cdb6-4109-8e00-457a67414db8 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074f1e71f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:56.850428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:56.862229 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe5d635e-85a6-4a70-80bf-bb6389a25458 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.419522 Oct 03 10:52:56.863045 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2345/4975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:56 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:56.902386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbce3615-cdb6-4109-8e00-457a67414db8 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 202 len: 0 microversion: 2.1 time: 0.120799 Oct 03 10:52:56.907873 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2631/4976] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:52:56 2022] DELETE /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:52:56.913593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f21ac5e5-daf4-4ca6-923c-fa26c034d9ef tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074dfe6af0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:57.033899 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f21ac5e5-daf4-4ca6-923c-fa26c034d9ef tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 200 len: 345 microversion: 2.1 time: 0.124572 Oct 03 10:52:57.042007 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2346/4977] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:52:56 2022] GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:57.891420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:57.892185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:57.916077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:57.916664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:57.917156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:57.917914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:57.918383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:57.918822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:58.052207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-324b7061-06f0-4889-96a4-d4fc3c83c659 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074dfed3a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:58.197936 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-324b7061-06f0-4889-96a4-d4fc3c83c659 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 200 len: 345 microversion: 2.1 time: 0.151041 Oct 03 10:52:58.205812 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2347/4978] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:52:58 2022] GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:58.374081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:58.397864 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15e51b4e-cb56-45bc-b68b-c29360b769e8 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1485 microversion: 2.1 time: 0.511216 Oct 03 10:52:58.408825 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2632/4979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:57 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1485 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:52:58.449443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:52:58.450445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:58.472349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:58.476321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:58.477552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:58.479102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:58.482025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:58.482727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:58.672133 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e81d2cc5-92b5-41c6-8ac6-4a1bf3c34bd3 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "POST /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb/action" status: 202 len: 0 microversion: 2.1 time: 0.228826 Oct 03 10:52:58.673417 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2348/4980] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:52:58 2022] POST /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:52:58.682758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:58.683879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:52:58.698166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:58.708028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:58.708733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:58.709723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:52:58.710557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:52:58.712063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:52:59.216488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a19cc34f-f82e-419e-a4c5-384719dfaca3 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074dfd6a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:52:59.386488 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a19cc34f-f82e-419e-a4c5-384719dfaca3 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 200 len: 345 microversion: 2.1 time: 0.177531 Oct 03 10:52:59.387724 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2349/4981] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:52:59 2022] GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:52:59.618463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:52:59.639351 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d389917-e112-460f-9b31-019dbdd0f2ae tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1493 microversion: 2.1 time: 0.961742 Oct 03 10:52:59.645165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2633/4982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:52:58 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1493 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:00.405570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ad46d25-b708-4326-a4e0-9de1d87193a9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074e03bdc0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:00.466665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9ad46d25-b708-4326-a4e0-9de1d87193a9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] HTTP exception thrown: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ad46d25-b708-4326-a4e0-9de1d87193a9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Request method failure captured: Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 HTTP/1.1 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr7_4MGh5Vf8LOSTqGuhC-9pSyTehZ6zBwEnnqIkMBH62j6ZVUmL2i1Ayy0W71a6ZF5PNilBuJPWD3JWUZjpHH1E-6o5Vb8BZNwpS62RkkK3CNN6azdk2lzzTyGQJ1_YsmT04DMn0uU05PSZmnwmX3p_i-6AKgTTiLaMpokjAfPH_aE Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}] Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 266674559a1743089995177f182c7b1d Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: exception: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '4328cb86-9980-48ff-8a4e-4be19a8dddf2'} Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. (HTTP 404) (Request-ID: req-251bf3b6-1cc8-4c7c-9922-b88b9156401c) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:53:00.470799 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.475862 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.483508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ad46d25-b708-4326-a4e0-9de1d87193a9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Returning 404 to user: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:53:00.483508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ad46d25-b708-4326-a4e0-9de1d87193a9 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 404 len: 109 microversion: 2.1 time: 0.083691 Oct 03 10:53:00.484806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2350/4983] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:53:00 2022] GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:53:00.495409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2727cc83-3dc3-4523-99bc-2b9ab1b8f4f0 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074ec18310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:00.551022 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2727cc83-3dc3-4523-99bc-2b9ab1b8f4f0 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] HTTP exception thrown: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2727cc83-3dc3-4523-99bc-2b9ab1b8f4f0 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Request method failure captured: Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 HTTP/1.1 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr7_4MGh5Vf8LOSTqGuhC-9pSyTehZ6zBwEnnqIkMBH62j6ZVUmL2i1Ayy0W71a6ZF5PNilBuJPWD3JWUZjpHH1E-6o5Vb8BZNwpS62RkkK3CNN6azdk2lzzTyGQJ1_YsmT04DMn0uU05PSZmnwmX3p_i-6AKgTTiLaMpokjAfPH_aE Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}] Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 266674559a1743089995177f182c7b1d Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: method: Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: exception: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '4328cb86-9980-48ff-8a4e-4be19a8dddf2'} Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. (HTTP 404) (Request-ID: req-404d594c-0525-42c7-94d8-15304631054f) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:53:00.553564 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2727cc83-3dc3-4523-99bc-2b9ab1b8f4f0 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Returning 404 to user: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2727cc83-3dc3-4523-99bc-2b9ab1b8f4f0 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 404 len: 109 microversion: 2.1 time: 0.064206 Oct 03 10:53:00.558722 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2634/4984] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:53:00 2022] DELETE /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:53:00.568673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-722e27f6-5271-4e34-82c8-f32a06b21216 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Calling method '.version_select at 0x7f074dfd6430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:00.639417 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-722e27f6-5271-4e34-82c8-f32a06b21216 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] HTTP exception thrown: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-722e27f6-5271-4e34-82c8-f32a06b21216 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Request method failure captured: Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 HTTP/1.1 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr7_4MGh5Vf8LOSTqGuhC-9pSyTehZ6zBwEnnqIkMBH62j6ZVUmL2i1Ayy0W71a6ZF5PNilBuJPWD3JWUZjpHH1E-6o5Vb8BZNwpS62RkkK3CNN6azdk2lzzTyGQJ1_YsmT04DMn0uU05PSZmnwmX3p_i-6AKgTTiLaMpokjAfPH_aE Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b71f84e250484ba6bac9b31ce50959f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b71f84e250484ba6bac9b31ce50959f4"}]}] Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b71f84e250484ba6bac9b31ce50959f4 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1743784209 Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 266674559a1743089995177f182c7b1d Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1743784209-project Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: exception: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '4328cb86-9980-48ff-8a4e-4be19a8dddf2'} Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. (HTTP 404) (Request-ID: req-7fee029f-8d9b-404c-b302-dadc633ac8c2) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 10:53:00.642541 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. Oct 03 10:53:00.646837 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:00.652284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-722e27f6-5271-4e34-82c8-f32a06b21216 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] Returning 404 to user: Volume 4328cb86-9980-48ff-8a4e-4be19a8dddf2 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:53:00.653456 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-722e27f6-5271-4e34-82c8-f32a06b21216 tempest-VolumesSnapshotsTestJSON-1743784209 tempest-VolumesSnapshotsTestJSON-1743784209-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2" status: 404 len: 109 microversion: 2.1 time: 0.089193 Oct 03 10:53:00.653456 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2351/4985] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 10:53:00 2022] GET /compute/v2.1/os-volumes/4328cb86-9980-48ff-8a4e-4be19a8dddf2 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:53:00.675804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:00.677193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:00.686243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=48 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:00.696569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:00.700744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:00.701411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:00.705091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:00.705896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:00.708529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:01.358810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:01.378582 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15254c01-40a6-4545-a154-077062443978 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1493 microversion: 2.1 time: 0.703680 Oct 03 10:53:01.379683 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2635/4986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:00 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1493 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:02.428401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:02.430898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:02.453688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:02.454627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:02.455324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:02.456542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:02.459326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:02.460106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:02.951993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:02.959388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:02.963109 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2fb68bd5-78ab-405d-94e2-8e2f996ff1dc tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1499 microversion: 2.1 time: 0.550817 Oct 03 10:53:02.966789 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2352/4987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:02 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1499 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:03.017545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:03.018559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:03.062350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:03.063273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:03.064026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:03.069357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:03.072345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:03.076155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:03.191680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:53:03.442244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10a59cdc-dc3a-4f22-aea6-82bf4ec17124 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "DELETE /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 204 len: 0 microversion: 2.1 time: 0.430608 Oct 03 10:53:03.446013 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2636/4988] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:53:03 2022] DELETE /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:53:03.468184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:03.469804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:03.486536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:03.491229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:03.491960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:03.493511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:03.494165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:03.494791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:03.720036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:03.736538 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac05f6c9-4356-4cd1-b99b-3961ab67a5a2 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.286309 Oct 03 10:53:03.737535 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2353/4989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:03 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:53:04.775690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:04.778009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:04.792802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:04.793317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:04.794185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:04.797119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:04.798767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:04.799373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:05.199871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:05.241551 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28132fcb-17e6-48a4-8056-1072185bb7c5 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.474623 Oct 03 10:53:05.244329 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2637/4990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:04 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:06.273816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:06.274364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:06.286572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:06.293018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:06.294030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:06.297604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:06.300330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:06.302019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:06.776839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:06.799160 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a02bcb4-5822-4cdc-a83f-2f0461bce2fb tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1505 microversion: 2.1 time: 0.529526 Oct 03 10:53:06.801915 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2354/4991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:06 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:07.831833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:07.832417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:07.846924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:07.847754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:07.848363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:07.849295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:07.849943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:07.850533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:07.895719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-835bc9bb-e58d-4fe2-a13f-88db526b93c1 req-11fab731-c970-4f78-91cf-e4695a17626e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653dfa95-6517-4da9-a28c-15f9ad96eccb", "name": "network-vif-deleted", "tag": "65b2397d-27e7-4b80-a68a-2c266be85aa0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:07.911039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-835bc9bb-e58d-4fe2-a13f-88db526b93c1 req-11fab731-c970-4f78-91cf-e4695a17626e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:07.913720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-835bc9bb-e58d-4fe2-a13f-88db526b93c1 req-11fab731-c970-4f78-91cf-e4695a17626e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:07.916176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-835bc9bb-e58d-4fe2-a13f-88db526b93c1 req-11fab731-c970-4f78-91cf-e4695a17626e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:07.943801 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-835bc9bb-e58d-4fe2-a13f-88db526b93c1 req-11fab731-c970-4f78-91cf-e4695a17626e service nova] Creating event network-vif-deleted:65b2397d-27e7-4b80-a68a-2c266be85aa0 for instance 653dfa95-6517-4da9-a28c-15f9ad96eccb on n-h2-858383-3 Oct 03 10:53:07.957116 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-835bc9bb-e58d-4fe2-a13f-88db526b93c1 req-11fab731-c970-4f78-91cf-e4695a17626e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066144 Oct 03 10:53:07.959936 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2355/4992] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:53:08.080873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:08.090054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:08.095012 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c4d8865-23f0-4816-9fcd-69db00eb2352 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 200 len: 1463 microversion: 2.1 time: 0.267216 Oct 03 10:53:08.096270 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2638/4993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:07 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:53:09.135484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:09.136198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 653dfa95-6517-4da9-a28c-15f9ad96eccb] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:09.138231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:09.152706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:09.171031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:09.171549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:09.172333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:09.172840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:09.173280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:09.216446 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] HTTP exception thrown: Instance 653dfa95-6517-4da9-a28c-15f9ad96eccb could not be found. Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Request method failure captured: Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb HTTP/1.1 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6jaj7c3cX9ruTIWC_vDgHEBPGXuolHQkdj7eAx8OejtiXhK4CKWwTYDBGr1EUG_va0w0OIUx64XqeJku_fHa9jvojLkNQMH-E5rUgGb2MZW4GQOZwJodAKhtIYFLKn5kZlnOHq_VDr-BW8s4w6dFMbnQ5K7xpSTr-ImAv-3WrFvQc Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: f5a033909cf542a1895ddd2630f50e3a Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerRescueTestJSON-584868709 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5a033909cf542a1895ddd2630f50e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5a033909cf542a1895ddd2630f50e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5a033909cf542a1895ddd2630f50e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5a033909cf542a1895ddd2630f50e3a"}]}] Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerRescueTestJSON-584868709 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: f5a033909cf542a1895ddd2630f50e3a Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerRescueTestJSON-584868709 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerRescueTestJSON-584868709-project Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 16df3161f12c4ef392387bd4555a4d77 Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerRescueTestJSON-584868709-project Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 653dfa95-6517-4da9-a28c-15f9ad96eccb could not be found. Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '653dfa95-6517-4da9-a28c-15f9ad96eccb'} Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 653dfa95-6517-4da9-a28c-15f9ad96eccb could not be found. Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 653dfa95-6517-4da9-a28c-15f9ad96eccb could not be found. Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:09.235274 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:09.240090 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:09.240090 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:09.240090 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:09.240090 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:53:09.240090 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:53:09.240090 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 653dfa95-6517-4da9-a28c-15f9ad96eccb could not be found. Oct 03 10:53:09.240090 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:09.249148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Returning 404 to user: Instance 653dfa95-6517-4da9-a28c-15f9ad96eccb could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:53:09.250269 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6338c546-92f2-4336-9a11-3b90f3f69235 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb" status: 404 len: 111 microversion: 2.1 time: 0.120672 Oct 03 10:53:09.256724 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2356/4994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:09 2022] GET /compute/v2.1/servers/653dfa95-6517-4da9-a28c-15f9ad96eccb => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:53:09.273862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:09.275861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:09.298345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:09.299214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:09.304698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:09.309318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:09.313168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:09.314226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:09.372518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:53:09.539680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9597024-651b-41ee-9838-f5e5bd4d0c37 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 204 len: 0 microversion: 2.1 time: 0.277750 Oct 03 10:53:09.540453 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2639/4995] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:53:09 2022] DELETE /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:53:09.552738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:09.552738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:09.566866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:09.567799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:09.569435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:09.570584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:09.571334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:09.572544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:10.053404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:10.064065 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7506c32-88ee-4ce0-877c-b6ba3ca4df80 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1491 microversion: 2.1 time: 0.518412 Oct 03 10:53:10.069209 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2357/4996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:09 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1491 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:11.100918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:11.101672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:11.145185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:11.145716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:11.146162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:11.150980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:11.152267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:11.157540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:11.469646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:11.480397 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62970049-fa89-4f04-bb06-82e757453ed4 tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1491 microversion: 2.1 time: 0.384360 Oct 03 10:53:11.481587 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2640/4997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:11 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1491 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:12.518355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:12.523005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:12.535676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:12.538049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:12.539479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:12.540425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:12.542018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:12.543188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:12.885316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5e4dcc02-d936-44a4-b746-3d3c1c06b1d2 req-4f284b8d-c4bc-453e-905d-9c69f2c3aeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5604e4-6216-416a-8b0c-918b0bcab4e2", "name": "network-vif-deleted", "tag": "be140bd3-a5ea-4963-a9e7-a2d6a60462df"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:12.943336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5e4dcc02-d936-44a4-b746-3d3c1c06b1d2 req-4f284b8d-c4bc-453e-905d-9c69f2c3aeea service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:12.947630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5e4dcc02-d936-44a4-b746-3d3c1c06b1d2 req-4f284b8d-c4bc-453e-905d-9c69f2c3aeea service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:12.948132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5e4dcc02-d936-44a4-b746-3d3c1c06b1d2 req-4f284b8d-c4bc-453e-905d-9c69f2c3aeea service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:13.010449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5e4dcc02-d936-44a4-b746-3d3c1c06b1d2 req-4f284b8d-c4bc-453e-905d-9c69f2c3aeea service nova] Creating event network-vif-deleted:be140bd3-a5ea-4963-a9e7-a2d6a60462df for instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 on n-h2-858383-3 Oct 03 10:53:13.021792 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5e4dcc02-d936-44a4-b746-3d3c1c06b1d2 req-4f284b8d-c4bc-453e-905d-9c69f2c3aeea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139775 Oct 03 10:53:13.025165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2641/4998] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:53:13.206246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:13.207729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:13.227325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:13.229268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:13.229849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:13.230716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:13.231524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:13.232435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:13.332875 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba895c89-b04d-4493-9ad4-2e65fbf5f539 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/ips" status: 200 len: 149 microversion: 2.1 time: 0.129648 Oct 03 10:53:13.332875 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2642/4999] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:53:13 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/ips => generated 149 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:53:13.665030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16df3161f12c4ef392387bd4555a4d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a033909cf542a1895ddd2630f50e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:13.693032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01592ffd-68fd-436a-b4a1-ed836d87f5db tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 200 len: 1491 microversion: 2.1 time: 1.180861 Oct 03 10:53:13.697794 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2358/5000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:12 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 1491 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:14.744293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:14.766620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] [instance: 0d5604e4-6216-416a-8b0c-918b0bcab4e2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:14.800637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:14.802766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:14.803593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:14.808049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:14.833017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:14.837012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:14.930147 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] HTTP exception thrown: Instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 could not be found. Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Request method failure captured: Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 HTTP/1.1 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6jaj7c3cX9ruTIWC_vDgHEBPGXuolHQkdj7eAx8OejtiXhK4CKWwTYDBGr1EUG_va0w0OIUx64XqeJku_fHa9jvojLkNQMH-E5rUgGb2MZW4GQOZwJodAKhtIYFLKn5kZlnOHq_VDr-BW8s4w6dFMbnQ5K7xpSTr-ImAv-3WrFvQc Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: f5a033909cf542a1895ddd2630f50e3a Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerRescueTestJSON-584868709 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5a033909cf542a1895ddd2630f50e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f5a033909cf542a1895ddd2630f50e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f5a033909cf542a1895ddd2630f50e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f5a033909cf542a1895ddd2630f50e3a"}]}] Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerRescueTestJSON-584868709 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: f5a033909cf542a1895ddd2630f50e3a Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerRescueTestJSON-584868709 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerRescueTestJSON-584868709-project Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 16df3161f12c4ef392387bd4555a4d77 Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerRescueTestJSON-584868709-project Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 could not be found. Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '0d5604e4-6216-416a-8b0c-918b0bcab4e2'} Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 could not be found. Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 could not be found. Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:14.932714 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:14.938143 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:14.938143 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:14.938143 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:14.938143 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:53:14.938143 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:53:14.938143 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 could not be found. Oct 03 10:53:14.938143 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:53:14.940170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] Returning 404 to user: Instance 0d5604e4-6216-416a-8b0c-918b0bcab4e2 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:53:14.941444 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5397339c-9680-48fb-b624-ff404994d1ac tempest-ServerRescueTestJSON-584868709 tempest-ServerRescueTestJSON-584868709-project] 10.222.0.27 "GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2" status: 404 len: 111 microversion: 2.1 time: 0.207743 Oct 03 10:53:14.947557 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2643/5001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:14 2022] GET /compute/v2.1/servers/0d5604e4-6216-416a-8b0c-918b0bcab4e2 => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:53:15.950744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:15.952279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:15.962449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:15.963157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:15.963840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:15.964986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:15.965646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:15.966273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:16.282394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4d064d2-f66b-4061-b330-5816f65b0797"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:16.286416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:16.295503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:16.296438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:16.297166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:16.298184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:16.298982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:16.299640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:16.380490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:16.401983 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-82770a7c-1857-4497-95df-ddd7edfbd4d3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.458265 Oct 03 10:53:16.407152 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2359/5002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:15 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:16.826041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c69e79d7-4406-4c75-a7cb-00a8f5586e62 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547698 Oct 03 10:53:16.837857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2644/5003] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:53:16 2022] POST /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:53:17.436866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:17.438028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:17.451207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:17.452556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:17.454098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:17.456142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:17.457052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:17.457934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:17.781825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:17.801201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0860dd46-741c-4f8f-8a22-4863c592bec7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.369740 Oct 03 10:53:17.802402 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2360/5004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:17 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:17.841395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1319538241"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:17.844250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:17.861261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:17.861809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:17.862346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:17.863158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:17.863626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:17.865843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:18.246426 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-47315763-8b4b-4481-ad3a-3fb24d3b501c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.420436 Oct 03 10:53:18.254032 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2645/5005] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:53:17 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 03 10:53:19.296668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-122e00a9-cbd1-4ef7-8b2d-25cdaee250c5 req-28d3895a-71c4-460f-a5dd-b1891edc87f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-unplugged", "status": "completed", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:19.348726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-122e00a9-cbd1-4ef7-8b2d-25cdaee250c5 req-28d3895a-71c4-460f-a5dd-b1891edc87f0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:19.349625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-122e00a9-cbd1-4ef7-8b2d-25cdaee250c5 req-28d3895a-71c4-460f-a5dd-b1891edc87f0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:19.352644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-122e00a9-cbd1-4ef7-8b2d-25cdaee250c5 req-28d3895a-71c4-460f-a5dd-b1891edc87f0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:19.407982 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-122e00a9-cbd1-4ef7-8b2d-25cdaee250c5 req-28d3895a-71c4-460f-a5dd-b1891edc87f0 service nova] Creating event network-vif-unplugged:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:53:19.430549 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-122e00a9-cbd1-4ef7-8b2d-25cdaee250c5 req-28d3895a-71c4-460f-a5dd-b1891edc87f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140549 Oct 03 10:53:19.434750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2361/5006] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:53:22.581417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Calling method '.version_select at 0x7f074df42e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:22.583718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:22.583899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:22.584266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:22.642998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:22.645725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:22.647185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:22.684518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:22.685375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:22.689607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:22.708967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-800ad343-6f71-45a9-a7ee-d795c41bade8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1733300428-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.890265 Oct 03 10:53:22.710570 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2646/5007] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:53:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:53:23.471983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7cf19487-952d-408a-903a-4fbd81725825 req-f14de405-00fc-43df-97aa-621961dbef33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-plugged", "status": "completed", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:23.500506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7cf19487-952d-408a-903a-4fbd81725825 req-f14de405-00fc-43df-97aa-621961dbef33 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:23.501871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7cf19487-952d-408a-903a-4fbd81725825 req-f14de405-00fc-43df-97aa-621961dbef33 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:23.504186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7cf19487-952d-408a-903a-4fbd81725825 req-f14de405-00fc-43df-97aa-621961dbef33 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:23.538582 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7cf19487-952d-408a-903a-4fbd81725825 req-f14de405-00fc-43df-97aa-621961dbef33 service nova] Creating event network-vif-plugged:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:53:23.546885 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7cf19487-952d-408a-903a-4fbd81725825 req-f14de405-00fc-43df-97aa-621961dbef33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079114 Oct 03 10:53:23.548163 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2362/5008] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:53:32.287816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd46e371-ec22-4bcf-9d83-d5788d266c83 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: .version_select at 0x7f075751e280>, body: {"keypair": {"name": "tempest-keypair-451294482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHX1xEEHIcOd3Vfr96jcFiz4tpl3Lju3ldXqo8SgNhslkYH0IZbMhHXHKOphgLyXh1ODaIIC7Rz6LWy/VxIJtKCJrzeonaziKsjlMA05RsCR2XAbMtmLy5qEpIQ2SkNBA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:32.300491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:32.329262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fd46e371-ec22-4bcf-9d83-d5788d266c83 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:53:32.359037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fd46e371-ec22-4bcf-9d83-d5788d266c83 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:53:32.419397 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd46e371-ec22-4bcf-9d83-d5788d266c83 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141262 Oct 03 10:53:32.421070 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2647/5009] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:53:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:53:36.193049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:36.219555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:36.221003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Searching by: {'deleted': False, 'project_id': '85ab8aee85144f9288366d04918cf93e'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:53:36.253001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=13 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:36.255720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=45 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:36.265666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:36.270016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:36.270538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:36.274494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:36.280633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:36.281530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:36.399543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:53:36.495081 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43c67571-dd56-4a2e-80b6-efa0a2379d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.311898 Oct 03 10:53:36.496919 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2363/5010] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 10:53:36 2022] GET /compute/v2.1/servers => generated 339 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:53:36.506588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:36.513777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:36.528380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:36.529214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Searching by: {'deleted': False, 'project_id': '85ab8aee85144f9288366d04918cf93e'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 10:53:36.564671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:36.565316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:36.566255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:36.568508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:36.593861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:36.594366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:36.778697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 10:53:36.945485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:36.972540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:36.974051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:36.977967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:37.606343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-98a44dc1-ae36-47d8-af58-2f24658f7feb tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 1.100467 Oct 03 10:53:37.607070 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2648/5011] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 10:53:36 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:37.640667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f3dea16-4fbd-4bc1-95be-790a6b7a9c61 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:37.674944 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f3dea16-4fbd-4bc1-95be-790a6b7a9c61 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040089 Oct 03 10:53:37.678309 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2364/5012] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:53:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:53:37.996381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:37.997401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:38.022323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:38.022830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:38.023308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:38.024253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:38.024904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:38.033543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:38.109970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:53:38.361009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6cdd2eb0-4db6-46cc-916c-456fd1079de8 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "DELETE /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 204 len: 0 microversion: 2.1 time: 0.368359 Oct 03 10:53:38.365183 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2649/5013] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:53:37 2022] DELETE /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:53:38.378795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:38.380012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:38.402189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:38.403995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:38.404507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:38.405288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:38.405772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:38.406214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:38.911944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:38.925711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac20cc5a-820b-4554-9b6e-b9bfc80445cd tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1712 microversion: 2.1 time: 0.556677 Oct 03 10:53:38.926829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2365/5014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:38 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1712 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:39.811518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-204198186", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89560c86-a183-4349-ab87-bdf14ea2ef6d"}], "security_groups": [{"name": "tempest-securitygroup--729721619"}], "key_name": "tempest-keypair-451294482", "user_data": "}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:39.957800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:39.958727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:40.001647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:40.002158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:40.002604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:40.003323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:40.003956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:40.004531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:40.300888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] validate_networks() for [('89560c86-a183-4349-ab87-bdf14ea2ef6d', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:53:41.356580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:41.376603 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd8f657a-928d-46c4-bd42-3be3eaee5d53 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1712 microversion: 2.1 time: 1.423864 Oct 03 10:53:41.390148 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2366/5015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:39 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1712 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:42.409329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:42.409983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:42.440630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:42.443443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:42.445595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:42.452958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:42.453717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:42.460068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:42.976512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:53:42.977606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:53:42.978358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:53:42.978975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:53:42.979584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:53:43.002897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:43.003315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:43.014917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:43.026412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:43.026922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:43.027368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:43.184617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:53:43.201623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:53:43.256884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:53:43.260148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:53:43.381475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37ec2185-9b78-4ec7-8823-05fe65a358c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.586148 Oct 03 10:53:43.385294 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2650/5016] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:53:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 3590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:53:43.423391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06bea0c0-d7f6-4125-8d58-39b088e278d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:43.427548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-06bea0c0-d7f6-4125-8d58-39b088e278d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:43.737979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-06bea0c0-d7f6-4125-8d58-39b088e278d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:43.777854 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06bea0c0-d7f6-4125-8d58-39b088e278d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1240 microversion: 2.1 time: 0.384490 Oct 03 10:53:43.778583 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2651/5017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:43 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1240 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:44.600574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:44.639061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c509e71-3f9a-46e4-b87f-15d15e737f18 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1712 microversion: 2.1 time: 2.237054 Oct 03 10:53:44.657195 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2367/5018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:42 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1712 bytes in 2256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:44.810567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed397a54-d1b4-4966-93a7-67794c33cc00 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:44.812723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed397a54-d1b4-4966-93a7-67794c33cc00 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:45.436553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ed397a54-d1b4-4966-93a7-67794c33cc00 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:45.450728 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed397a54-d1b4-4966-93a7-67794c33cc00 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1240 microversion: 2.1 time: 0.647284 Oct 03 10:53:45.491479 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2652/5019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:44 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1240 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:45.679701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:45.681286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:45.703804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:45.704312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:45.704762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:45.705530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:45.705998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:45.727483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:46.307161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:53:46.399871 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 10:53:46.400438 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 10:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef (ip 10.222.0.27) !!! Oct 03 10:53:46.476898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:46.498775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:46.504514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:46.507902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d78a0a13-1377-44ce-a369-34139c29054b tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1645 microversion: 2.1 time: 0.835701 Oct 03 10:53:46.533903 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2368/5020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:45 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1645 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:46.566186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:46.567729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:46.573230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:46.575129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:46.578010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:46.582518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:46.720932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a53b68fa-7ae4-48a7-8d9c-6e208b4ae5fb req-6cad7282-95d4-4dc5-bde4-088926f58089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a23e59-d9cd-4eb9-a5b4-dde4451c57ef", "name": "network-vif-deleted", "tag": "a2ac6d7a-be08-4ac8-a509-48d651139d97"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:46.776783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a53b68fa-7ae4-48a7-8d9c-6e208b4ae5fb req-6cad7282-95d4-4dc5-bde4-088926f58089 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:46.779584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a53b68fa-7ae4-48a7-8d9c-6e208b4ae5fb req-6cad7282-95d4-4dc5-bde4-088926f58089 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:46.784397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a53b68fa-7ae4-48a7-8d9c-6e208b4ae5fb req-6cad7282-95d4-4dc5-bde4-088926f58089 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:46.885481 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a53b68fa-7ae4-48a7-8d9c-6e208b4ae5fb req-6cad7282-95d4-4dc5-bde4-088926f58089 service nova] Creating event network-vif-deleted:a2ac6d7a-be08-4ac8-a509-48d651139d97 for instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef on n-h1-858383-3 Oct 03 10:53:46.927824 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a53b68fa-7ae4-48a7-8d9c-6e208b4ae5fb req-6cad7282-95d4-4dc5-bde4-088926f58089 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212511 Oct 03 10:53:46.930625 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2369/5021] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:53:47.333711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:47.392610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ae5ae82a-efcc-4c87-bbc3-a11112c3a0c4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1236 microversion: 2.1 time: 0.917683 Oct 03 10:53:47.399119 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2653/5022] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:46 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1236 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:47.565774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:47.567399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:47.590059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:47.593902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:47.598092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:47.608622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:47.609156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:47.609613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:47.810155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:47.810732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:47.811092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:47.813760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lazy-loading 'fault' on Instance uuid 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:53:48.433336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:48.434197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:48.459056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:48.462657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:48.463302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:48.464228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:48.467033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:48.467486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:48.825696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c8927d28224659be9c2b73f3102993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ab8aee85144f9288366d04918cf93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:48.851450 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7cb6fd25-c3ea-4f07-a251-d42f31f52668 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 200 len: 1366 microversion: 2.1 time: 1.290373 Oct 03 10:53:48.852080 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2370/5023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:47 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 1366 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:48.959347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:48.988186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5655880-1b8a-4f38-b1ec-7b8ea6571b08 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1292 microversion: 2.1 time: 0.554223 Oct 03 10:53:48.998709 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2654/5024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:48 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1292 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:53:49.882958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:49.883614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] [instance: 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:49.909736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:49.910421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:49.910895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:49.911667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:49.912170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:49.912612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:50.016285 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] HTTP exception thrown: Instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef could not be found. Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Request method failure captured: Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef HTTP/1.1 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr69KsBLXzeS4H3Xj2AAFBLT46Uxcb6Qn-qnWIICe-iBu_itYnq6I_D4Zz_nppEhtijRGcrRNULhS7f8siMl7i2hWIJo1TVCINZNwI4PqeqlvdncD5auYyh-TsEk2WxgUOq_t6qXRk6p2Q7Dmh9x3QegFIlcf2y9FZdLS3XIXu39wA0 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 85ab8aee85144f9288366d04918cf93e Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestManualDisk-2093425931 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/85ab8aee85144f9288366d04918cf93e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_85ab8aee85144f9288366d04918cf93e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/85ab8aee85144f9288366d04918cf93e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/85ab8aee85144f9288366d04918cf93e"}]}] Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestManualDisk-2093425931 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 85ab8aee85144f9288366d04918cf93e Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestManualDisk-2093425931 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestManualDisk-2093425931-project Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 43c8927d28224659be9c2b73f3102993 Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestManualDisk-2093425931-project Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef could not be found. Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '90a23e59-d9cd-4eb9-a5b4-dde4451c57ef'} Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef could not be found. Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef could not be found. Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:53:50.025376 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef could not be found. Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Returning 404 to user: Instance 90a23e59-d9cd-4eb9-a5b4-dde4451c57ef could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:53:50.029945 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a6a96ae9-437c-4144-9879-95c087a098e6 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef" status: 404 len: 111 microversion: 2.1 time: 0.148204 Oct 03 10:53:50.034530 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2371/5025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:49 2022] GET /compute/v2.1/servers/90a23e59-d9cd-4eb9-a5b4-dde4451c57ef => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:53:50.047615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:50.056245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:50.074020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:50.084044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:50.086727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:50.087726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:50.088658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:50.093780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:50.442390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1320579630", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "9e707688-91d9-438f-bb7b-973a9180c7f5"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:50.461245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:50.495563 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1f444d21-8f57-42fd-a5b4-2d0b2549ee23 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1298 microversion: 2.1 time: 0.459571 Oct 03 10:53:50.496167 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2372/5026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:50 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1298 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:50.528728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d35e6ab-e258-46e7-a7fb-6ec000af1118 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] Calling method '.version_select at 0x7f074e011160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:50.624392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] validate_networks() for [('9e707688-91d9-438f-bb7b-973a9180c7f5', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:53:50.630161 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d35e6ab-e258-46e7-a7fb-6ec000af1118 tempest-ServersTestManualDisk-2093425931 tempest-ServersTestManualDisk-2093425931-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913387011" status: 202 len: 0 microversion: 2.1 time: 0.128201 Oct 03 10:53:50.651100 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2373/5027] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913387011 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:53:51.530532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:51.531528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:51.585683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:51.585683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:51.585683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:51.585683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:51.592250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:51.593041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:51.943753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:51.968524 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5570e4cd-fd9f-4153-9b8a-806f4c57a438 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1298 microversion: 2.1 time: 0.446078 Oct 03 10:53:51.972052 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2374/5028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:51 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1298 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:52.656006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:53:52.656943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:53:52.657424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:53:52.658097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:53:52.658793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:53:52.688524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:52.694125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:52.698648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:52.701208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:52.702272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:52.703364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:52.759252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Getting quotas for project c769670525b34c13b0419a1800c4f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:53:52.771173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Getting quotas for user a57582a3d45a413bbab1ff542d28c7e3 and project c769670525b34c13b0419a1800c4f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:53:52.806809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:53:52.815758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:53:52.943153 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd0e891b-6a31-46b7-b88d-c0df6bd83451 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.933551 Oct 03 10:53:52.943982 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2655/5029] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 10:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 10:53:52.965776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-953a6ed1-9545-4dbf-9fb5-2b98909fa370 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:52.966822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-953a6ed1-9545-4dbf-9fb5-2b98909fa370 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:52.999029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:53.000280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:53.011621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:53.015274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:53.016152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:53.020071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:53.021033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:53.021726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:53.206890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-953a6ed1-9545-4dbf-9fb5-2b98909fa370 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:53.227351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-953a6ed1-9545-4dbf-9fb5-2b98909fa370 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:53.234517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-953a6ed1-9545-4dbf-9fb5-2b98909fa370 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:53.237395 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-953a6ed1-9545-4dbf-9fb5-2b98909fa370 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1262 microversion: 2.26 time: 0.285276 Oct 03 10:53:53.241760 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2375/5030] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:53:52 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1262 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:53:53.798367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:53.813765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc252cd2-83e3-45a1-9843-80467e1f8bcc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 0.819918 Oct 03 10:53:53.823091 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2656/5031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:52 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:54.274593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1a35dcb-8520-4e6f-ad9b-69e7b4d85500 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:54.275928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1a35dcb-8520-4e6f-ad9b-69e7b4d85500 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:54.850269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:54.852308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:54.887236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:54.888028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:54.888490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:54.893570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1a35dcb-8520-4e6f-ad9b-69e7b4d85500 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:54.921397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:54.931285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:54.933106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:54.936175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1a35dcb-8520-4e6f-ad9b-69e7b4d85500 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:54.949979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1a35dcb-8520-4e6f-ad9b-69e7b4d85500 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:54.956485 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1a35dcb-8520-4e6f-ad9b-69e7b4d85500 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1262 microversion: 2.26 time: 0.686035 Oct 03 10:53:54.980304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2376/5032] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:53:54 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1262 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:53:56.018440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:56.023943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:56.101000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:56.108263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:56.127389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:56.133138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:56.134339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:56.134821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:56.496377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:56.513820 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e636b61-c279-42ee-8de3-7b194d30b7b4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 1.669354 Oct 03 10:53:56.516044 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2657/5033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:54 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:53:57.034587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:57.060839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:57.067129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:57.069475 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ab0ab75-1d61-41bd-ab8b-c71f1c24a526 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1314 microversion: 2.26 time: 1.058055 Oct 03 10:53:57.071579 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2377/5034] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:53:56 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1314 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:53:57.548554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:57.549676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:57.597440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:57.598422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:57.599448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:57.608385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:57.609725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:57.613894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:58.140570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:58.166418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:58.230888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:58.231893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:58.232673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:58.237791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:58.238879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:58.248445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:58.639330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:58.650365 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a03b911b-fbf4-42a7-afc7-a7fbe88254cd tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 1.109406 Oct 03 10:53:58.653615 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2658/5035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:57 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:53:58.668999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-11e2519d-cc12-49a6-b378-6cf09fd79883 req-f8e9cb40-896c-46dc-bf33-11731a4c15b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83af7ea-0bd2-46a1-8c0a-a827b715e111", "tag": "1a303d85-b58e-4026-9236-6298522aa205"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:53:58.705819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-11e2519d-cc12-49a6-b378-6cf09fd79883 req-f8e9cb40-896c-46dc-bf33-11731a4c15b5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:58.708953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-11e2519d-cc12-49a6-b378-6cf09fd79883 req-f8e9cb40-896c-46dc-bf33-11731a4c15b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:58.710989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-11e2519d-cc12-49a6-b378-6cf09fd79883 req-f8e9cb40-896c-46dc-bf33-11731a4c15b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:58.750009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-11e2519d-cc12-49a6-b378-6cf09fd79883 req-f8e9cb40-896c-46dc-bf33-11731a4c15b5 service nova] Creating event network-changed:1a303d85-b58e-4026-9236-6298522aa205 for instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 on n-h2-858383-3 Oct 03 10:53:58.756045 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-11e2519d-cc12-49a6-b378-6cf09fd79883 req-f8e9cb40-896c-46dc-bf33-11731a4c15b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100900 Oct 03 10:53:58.757295 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2659/5036] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:53:58.972833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:58.995605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:58.999353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:53:59.002358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64cb1d57-c552-4fed-9c81-136899edffb8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1320 microversion: 2.26 time: 0.876804 Oct 03 10:53:59.025471 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2378/5037] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:53:58 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1320 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:53:59.683264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:53:59.684583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:53:59.695981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:59.709346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:59.710145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:53:59.711641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:53:59.717511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:53:59.719795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:00.034241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:00.035028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:00.055642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:00.056160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:00.056609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:00.057442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:00.057840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:00.058270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:00.742632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:00.761041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf9664ea-ec66-41e6-bda0-6962c97629ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 1.077979 Oct 03 10:54:00.761873 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2660/5038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:53:59 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:01.653608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:01.663728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:01.680151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:01.685577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f60c6eb-522f-4ba9-a074-209ad78059ce tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 1.655218 Oct 03 10:54:01.691537 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2379/5039] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:00 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:54:01.796178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:01.798068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:01.818446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:01.821824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:01.823143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:01.826874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:01.827724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:01.830149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:02.374015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:02.374948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:02.405724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:02.406221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:02.419790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:02.423556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:02.424080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:02.427770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:02.736159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:02.793428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=22 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:03.485827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:03.526687 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61555c11-1670-4f31-847b-47a9997ef20e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 1.732229 Oct 03 10:54:03.529522 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2661/5040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:01 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:03.565865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:03.569204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:03.604091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:03.608263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:03.609930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:03.610777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:03.612209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:03.613681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:03.615300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:04.157313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:04.169554 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-30a89c5a-08c8-49a7-9a77-79f4a28980b9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 1.802345 Oct 03 10:54:04.170127 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2380/5041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:02 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:04.562677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:04.563318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:04.595171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:04.596675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:04.599672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:04.605193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:04.612458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:04.613297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:04.733381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:04.742832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:04.750047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:04.754255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d7f88f9-bb35-4262-8268-8b22ece2d2f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 1.222202 Oct 03 10:54:04.774505 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2662/5042] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:03 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:04.923693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:05.204992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:05.210080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:05.220642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:05.228370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:05.229858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:05.235088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:05.235774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:05.242071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:06.004280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:06.024553 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f358ce7b-fe54-49a3-a5bc-265813cfb400 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 1.461779 Oct 03 10:54:06.027454 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2381/5043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:04 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:06.050843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:06.053216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:06.063136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:06.085135 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ab1390cc-ce10-4331-9b64-163db61b5a5f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.884762 Oct 03 10:54:06.094326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2663/5044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:05 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:06.096312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:06.097817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:06.104750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:06.106926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:06.110383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3def953c-5821-4575-be32-0f1a189a8692 req-13de6ce1-d66a-4e5d-a2b2-1ed235b1c53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-unplugged", "status": "completed", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:06.113651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:06.114263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:06.154937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3def953c-5821-4575-be32-0f1a189a8692 req-13de6ce1-d66a-4e5d-a2b2-1ed235b1c53e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:06.155152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3def953c-5821-4575-be32-0f1a189a8692 req-13de6ce1-d66a-4e5d-a2b2-1ed235b1c53e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:06.157700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3def953c-5821-4575-be32-0f1a189a8692 req-13de6ce1-d66a-4e5d-a2b2-1ed235b1c53e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:06.179089 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3def953c-5821-4575-be32-0f1a189a8692 req-13de6ce1-d66a-4e5d-a2b2-1ed235b1c53e service nova] Creating event network-vif-unplugged:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:54:06.186585 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3def953c-5821-4575-be32-0f1a189a8692 req-13de6ce1-d66a-4e5d-a2b2-1ed235b1c53e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089784 Oct 03 10:54:06.187922 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2664/5045] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:06.197057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-535686276"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:06.200278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:06.209609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:06.211065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:06.211945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:06.212993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:06.213698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:06.215018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:06.580967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:06.639204 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0282673a-10f4-4d2f-b126-f50411368bc5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.448960 Oct 03 10:54:06.640412 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2665/5046] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:54:06 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 03 10:54:06.650553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:06.655175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:06.676856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:06.677370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:06.677815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:06.678532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:06.679525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:06.679964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:07.170789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:07.187053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:07.207988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=91 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:07.215336 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f808bbc0-7ea3-48c3-8b5b-9ef3d613f927 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.566602 Oct 03 10:54:07.219539 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2666/5047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:06 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:07.221928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:07.235800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:07.237436 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea0460d8-17c6-4dd9-b074-19b66c7f39ea tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 1.207170 Oct 03 10:54:07.238788 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2382/5048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:06 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:07.244893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:07.247725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:07.270700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:07.271121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:07.271690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:07.272267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:07.272817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:07.287884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:07.784756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fccb490a-98fa-475f-a55b-24ebf18dcaac req-c161c11e-8209-4303-9497-fb3f2e458f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052bd5b7-0fcd-4476-b900-df0b86ac8ad4", "tag": "19df9a7a-ece6-425d-8623-c75ff94ae1de"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:07.796813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:07.829837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fccb490a-98fa-475f-a55b-24ebf18dcaac req-c161c11e-8209-4303-9497-fb3f2e458f28 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:07.830356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fccb490a-98fa-475f-a55b-24ebf18dcaac req-c161c11e-8209-4303-9497-fb3f2e458f28 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:07.830809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fccb490a-98fa-475f-a55b-24ebf18dcaac req-c161c11e-8209-4303-9497-fb3f2e458f28 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:07.903793 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fccb490a-98fa-475f-a55b-24ebf18dcaac req-c161c11e-8209-4303-9497-fb3f2e458f28 service nova] Creating event network-changed:19df9a7a-ece6-425d-8623-c75ff94ae1de for instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 on n-h1-858383-3 Oct 03 10:54:07.923222 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fccb490a-98fa-475f-a55b-24ebf18dcaac req-c161c11e-8209-4303-9497-fb3f2e458f28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154256 Oct 03 10:54:07.923877 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2383/5049] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 03 10:54:08.207326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c9b78c11-0584-435c-92b4-e720db134114 req-e333971b-6338-4ea6-a9c9-889df6d0f498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83af7ea-0bd2-46a1-8c0a-a827b715e111", "name": "network-vif-plugged", "status": "completed", "tag": "1a303d85-b58e-4026-9236-6298522aa205"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:08.225906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c9b78c11-0584-435c-92b4-e720db134114 req-e333971b-6338-4ea6-a9c9-889df6d0f498 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:08.231908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c9b78c11-0584-435c-92b4-e720db134114 req-e333971b-6338-4ea6-a9c9-889df6d0f498 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:08.233657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c9b78c11-0584-435c-92b4-e720db134114 req-e333971b-6338-4ea6-a9c9-889df6d0f498 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:08.278880 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c9b78c11-0584-435c-92b4-e720db134114 req-e333971b-6338-4ea6-a9c9-889df6d0f498 service nova] Creating event network-vif-plugged:1a303d85-b58e-4026-9236-6298522aa205 for instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 on n-h2-858383-3 Oct 03 10:54:08.294978 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c9b78c11-0584-435c-92b4-e720db134114 req-e333971b-6338-4ea6-a9c9-889df6d0f498 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091182 Oct 03 10:54:08.295598 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2384/5050] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:08.305396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:08.306140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:08.318071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:08.318699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:08.336152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:08.344186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:08.354212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:08.356542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:08.369661 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-93e764e0-a6b4-4296-8577-6e4f54405629 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 1.146168 Oct 03 10:54:08.370944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2667/5051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:07 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:08.386016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:08.414198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:08.426931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:08.450566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:08.451828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:08.452519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:08.453568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:08.454305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:08.454980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:09.371037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:09.402145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:09.412411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:09.418772 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3cc8689b-2bb7-4f76-9c01-5d182afb86e8 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 1.041948 Oct 03 10:54:09.423861 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2668/5052] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:08 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:09.442489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:09.445251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:09.469009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:09.476524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:09.478804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:09.480882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:09.482154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:09.483235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:10.211466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:10.248087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df8b78e2-f2f0-4c37-8010-d09505acdcfd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1686 microversion: 2.1 time: 1.947914 Oct 03 10:54:10.251476 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2385/5053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:08 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1686 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:10.454859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:10.455955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:10.503028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:10.508740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:10.521562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:10.550105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:10.552096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:10.554991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:10.603669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:10.616058 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-738cb21a-e620-4a06-91c4-34f2cee862d0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1365 microversion: 2.1 time: 1.190518 Oct 03 10:54:10.649461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2669/5054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:09 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1365 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:11.248678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:11.258190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:11.273691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:11.275220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-475f9e49-acd8-439e-9882-ad0d7f62a574 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 0.825219 Oct 03 10:54:11.292797 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2386/5055] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:10 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 10:54:11.297170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:11.298994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:11.316041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:11.319728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:11.322484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:11.325150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:11.327084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:11.328009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:11.643800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:11.644812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:11.667716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:11.669448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:11.672070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:11.674907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:11.679688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:11.681720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:12.037266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:12.056413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b827b428-06c8-4218-af0b-8ae36a4ae2c8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.771758 Oct 03 10:54:12.057717 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2670/5056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:11 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:12.091084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-19178616-2b1c-4f62-b08f-b15018bf12cd req-39c83770-e6d4-46a2-87ad-5c6bdd5acda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-plugged", "status": "completed", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:12.120659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-19178616-2b1c-4f62-b08f-b15018bf12cd req-39c83770-e6d4-46a2-87ad-5c6bdd5acda2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:12.121502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-19178616-2b1c-4f62-b08f-b15018bf12cd req-39c83770-e6d4-46a2-87ad-5c6bdd5acda2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:12.122124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-19178616-2b1c-4f62-b08f-b15018bf12cd req-39c83770-e6d4-46a2-87ad-5c6bdd5acda2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:12.153642 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-19178616-2b1c-4f62-b08f-b15018bf12cd req-39c83770-e6d4-46a2-87ad-5c6bdd5acda2 service nova] Creating event network-vif-plugged:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:54:12.167812 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-19178616-2b1c-4f62-b08f-b15018bf12cd req-39c83770-e6d4-46a2-87ad-5c6bdd5acda2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090503 Oct 03 10:54:12.171377 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2671/5057] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:12.234710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:12.243754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea631418-b92c-4774-89f2-b0f6a74310c1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1555 microversion: 2.1 time: 0.604481 Oct 03 10:54:12.250012 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2387/5058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:11 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1555 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:12.281391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:12.282300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:12.289970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:12.290783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:12.291523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:12.292476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:12.295053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:12.295714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:12.323779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:12.324885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:12.339113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:12.340309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:12.342425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:12.343496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:12.345440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:12.354810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:12.651464 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b24713e6-5cb3-438d-8ea2-946e7f5a79ee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378133 Oct 03 10:54:12.652105 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2672/5059] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:54:12 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111/os-interface => generated 284 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:13.046686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:13.069569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:13.071899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:13.076126 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b2f8728b-657f-4831-9803-270d087cce71 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 0.757243 Oct 03 10:54:13.089021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:13.090489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:13.094667 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2388/5060] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:12 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:13.115530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:13.117351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:13.120728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:13.122013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:13.122665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:13.126858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:14.130849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:14.131504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:14.152224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:14.152784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:14.153746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:14.153952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:14.154422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:14.154938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:14.878053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:14.905582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:14.916103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:14.921107 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5397a394-d6b9-4b2f-ac0c-319f2322b6e4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 0.792257 Oct 03 10:54:14.922155 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2389/5061] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:14 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:14.959172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:14.967951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-76fcf8da-aad7-4337-9976-4cc9073d93a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 1.884298 Oct 03 10:54:14.968549 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2673/5062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:13 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:15.954842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:15.955556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:15.964100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:15.971973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:15.972886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:15.974789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:15.977047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:15.981539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:15.996001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:15.997490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:16.018901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:16.026877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:16.027863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:16.031004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:16.038125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:16.039567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:16.784512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:16.807507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:16.812543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:16.827377 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a90c970-6948-4d68-a8ab-99d70905e185 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 0.877074 Oct 03 10:54:16.837362 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2390/5063] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:15 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:16.909228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:16.927660 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7953f6ba-ab0e-4857-8cac-4344ec6bd1a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.935875 Oct 03 10:54:16.936293 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2674/5064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:15 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:17.002110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c8587ad9-a93d-49e9-b2bd-d690dbcde7d4 req-1c46e160-e6a6-4919-a268-e5083a8e4dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052bd5b7-0fcd-4476-b900-df0b86ac8ad4", "name": "network-vif-plugged", "status": "completed", "tag": "19df9a7a-ece6-425d-8623-c75ff94ae1de"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:17.046477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c8587ad9-a93d-49e9-b2bd-d690dbcde7d4 req-1c46e160-e6a6-4919-a268-e5083a8e4dfd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:17.047222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c8587ad9-a93d-49e9-b2bd-d690dbcde7d4 req-1c46e160-e6a6-4919-a268-e5083a8e4dfd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:17.056188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c8587ad9-a93d-49e9-b2bd-d690dbcde7d4 req-1c46e160-e6a6-4919-a268-e5083a8e4dfd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:17.123413 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c8587ad9-a93d-49e9-b2bd-d690dbcde7d4 req-1c46e160-e6a6-4919-a268-e5083a8e4dfd service nova] Creating event network-vif-plugged:19df9a7a-ece6-425d-8623-c75ff94ae1de for instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 on n-h1-858383-3 Oct 03 10:54:17.135143 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c8587ad9-a93d-49e9-b2bd-d690dbcde7d4 req-1c46e160-e6a6-4919-a268-e5083a8e4dfd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137764 Oct 03 10:54:17.141285 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2391/5065] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:17.866641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:17.867317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:17.906629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:17.908019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:17.909527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:17.914798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:17.915634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:17.918000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:17.955026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:17.956118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:17.984938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:17.986882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:17.988994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:17.997434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:18.001021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:18.004482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:18.368310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:18.416737 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61e233b6-fd94-4f07-8777-b5533bc963e3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.434780 Oct 03 10:54:18.441495 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2392/5066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:17 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:18.483838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-6977686f-0dd1-4d6d-9c3c-73e73a1e63cc req-2ad7e89e-c22b-4ba8-87bb-9da99062caba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83af7ea-0bd2-46a1-8c0a-a827b715e111", "tag": "1a303d85-b58e-4026-9236-6298522aa205"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:18.526819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6977686f-0dd1-4d6d-9c3c-73e73a1e63cc req-2ad7e89e-c22b-4ba8-87bb-9da99062caba service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:18.531822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6977686f-0dd1-4d6d-9c3c-73e73a1e63cc req-2ad7e89e-c22b-4ba8-87bb-9da99062caba service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:18.532343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6977686f-0dd1-4d6d-9c3c-73e73a1e63cc req-2ad7e89e-c22b-4ba8-87bb-9da99062caba service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:18.559134 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-6977686f-0dd1-4d6d-9c3c-73e73a1e63cc req-2ad7e89e-c22b-4ba8-87bb-9da99062caba service nova] Creating event network-changed:1a303d85-b58e-4026-9236-6298522aa205 for instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 on n-h2-858383-3 Oct 03 10:54:18.571660 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-6977686f-0dd1-4d6d-9c3c-73e73a1e63cc req-2ad7e89e-c22b-4ba8-87bb-9da99062caba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094034 Oct 03 10:54:18.573978 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2393/5067] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:19.455380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:19.464982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:19.494917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:19.502126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:19.503219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:19.508129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:19.514335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:19.515178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:19.653393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:19.665118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:19.667367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:19.668708 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-67dae3fe-a4f2-42aa-951f-3c4699bad19d tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1362 microversion: 2.26 time: 1.807885 Oct 03 10:54:19.686202 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2675/5068] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:17 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1362 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:20.119326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:20.135647 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c7f7919-e6a2-47b1-a4b9-862dfac5cf18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.691283 Oct 03 10:54:20.136740 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2394/5069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:19 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:20.698477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:20.699289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:20.716516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:20.717311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:20.719259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:20.721224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:20.723259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:20.726790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.173503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:21.181712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:21.206687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.207458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.210557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.211423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.213623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.214155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.316266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:21.330750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:21.333340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:21.335115 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-04876964-b616-49ad-a5b3-7040d72181c6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1546 microversion: 2.26 time: 0.641635 Oct 03 10:54:21.336021 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2676/5070] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:20 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1546 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:21.377791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074eb1c670>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:21.394689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.402657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.405111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.405732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:21.424918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.425511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.426841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.427484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.428001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.428425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.500024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.500870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.503353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.549304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.550004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.551796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.643781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:21.705028 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-18fd48d1-9066-4b19-be62-9ed38f5ff0cf tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1811917604" status: 201 len: 0 microversion: 2.26 time: 0.331198 Oct 03 10:54:21.707461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2677/5071] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 3 10:54:21 2022] PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1811917604 => generated 0 bytes in 334 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 03 10:54:21.725380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-73a08b20-6bd4-4920-9f68-2f89c11e5904 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074ec18940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:21.750251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a08b20-6bd4-4920-9f68-2f89c11e5904 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.751082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a08b20-6bd4-4920-9f68-2f89c11e5904 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.752543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73a08b20-6bd4-4920-9f68-2f89c11e5904 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.790884 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-73a08b20-6bd4-4920-9f68-2f89c11e5904 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1811917604" status: 204 len: 0 microversion: 2.26 time: 0.076320 Oct 03 10:54:21.792292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2678/5072] 10.222.0.27 () {60 vars in 1361 bytes} [Mon Oct 3 10:54:21 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1811917604 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:54:21.806377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074f18cd30>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:21.824148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.827581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.828277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.833138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:21.877658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.878737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.892794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.902794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.906516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.907574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:21.970732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:21.971635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:21.972417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.016575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:22.076967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-897a6c29-37ef-4a89-8083-a860a8f697f4 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 204 len: 0 microversion: 2.26 time: 0.277025 Oct 03 10:54:22.078627 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2679/5073] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 3 10:54:21 2022] DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 10:54:22.098657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39371f59-7e97-43ab-82a5-066b3aef53da tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074f2195e0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:22.116414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39371f59-7e97-43ab-82a5-066b3aef53da tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.117661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39371f59-7e97-43ab-82a5-066b3aef53da tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.118286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39371f59-7e97-43ab-82a5-066b3aef53da tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.170974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39371f59-7e97-43ab-82a5-066b3aef53da tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 200 len: 12 microversion: 2.26 time: 0.075694 Oct 03 10:54:22.172837 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2680/5074] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:54:22 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 12 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:22.188229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074ec0e4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:22.232514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.232655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.233973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.235215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:22.252526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.253160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.253619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.254536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.255012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.255445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.316328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.317104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.324906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.339126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:22.341466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.342556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.343512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.431613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:22.518572 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f90d867-aa01-4e98-a3fa-6c1bf28e066a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1607808389" status: 201 len: 0 microversion: 2.26 time: 0.334201 Oct 03 10:54:22.528411 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2681/5075] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 3 10:54:22 2022] PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1607808389 => generated 0 bytes in 348 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 03 10:54:22.542356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4fcf490-86cc-4841-a929-37b20c49076a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074eb1c700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:22.563114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4fcf490-86cc-4841-a929-37b20c49076a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.566969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4fcf490-86cc-4841-a929-37b20c49076a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.567784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4fcf490-86cc-4841-a929-37b20c49076a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.610344 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e4fcf490-86cc-4841-a929-37b20c49076a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 200 len: 36 microversion: 2.26 time: 0.074739 Oct 03 10:54:22.618908 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2682/5076] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:54:22 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 36 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:22.626651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074f72e790>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:22.668167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.674743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.676028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.683011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:22.717609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.719076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.719076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.720389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.723053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.726057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.798458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.799434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.800703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.845423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:22.877408 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d11fd71-4428-4d51-8baf-5a81ffa8b4c5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1607808389" status: 204 len: 0 microversion: 2.26 time: 0.254741 Oct 03 10:54:22.878106 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2683/5077] 10.222.0.27 () {60 vars in 1364 bytes} [Mon Oct 3 10:54:22 2022] DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1607808389 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:54:22.896007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d56cd069-2bb6-4ea8-b612-0581e7476a44 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074f72e940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:22.924015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56cd069-2bb6-4ea8-b612-0581e7476a44 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:22.924517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56cd069-2bb6-4ea8-b612-0581e7476a44 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:22.933056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56cd069-2bb6-4ea8-b612-0581e7476a44 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:22.966551 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d56cd069-2bb6-4ea8-b612-0581e7476a44 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 200 len: 12 microversion: 2.26 time: 0.082784 Oct 03 10:54:22.974517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2684/5078] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:54:22 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 12 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:22.987149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f075751e4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:23.006121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.006624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.011756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.012379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:23.025767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.026280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.026721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.027436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.031405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.033258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.104817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.106868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.107331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.125550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:23.157837 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c66fe51-bbf5-4bf8-b8e9-3c0d0e35dd48 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 204 len: 0 microversion: 2.26 time: 0.182109 Oct 03 10:54:23.163007 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2685/5079] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 3 10:54:22 2022] DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:54:23.168761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f07575018b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:23.180966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.182192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.182734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.183259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:23.190776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.191389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.191831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.192542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.193033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.193465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.232014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.232512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.232992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.243834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.244320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.244758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.302057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:23.345776 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-351c0fa4-45a0-406f-987f-fdaf4d48462a tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1998051383" status: 201 len: 0 microversion: 2.26 time: 0.181542 Oct 03 10:54:23.354914 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2686/5080] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 3 10:54:23 2022] PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1998051383 => generated 0 bytes in 191 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 03 10:54:23.377461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074eb90f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:23.392855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.393747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.394243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.394761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:23.411589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.412094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.412545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.414539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.415166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.415727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.416385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:23.427415 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f007400c-a7ce-4e63-9814-3955d067f469 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 2.264852 Oct 03 10:54:23.450983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.451724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.451962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2395/5081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:21 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:23.452633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.474549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.478859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.480906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.584848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:23.626298 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30eebc27-cd08-4311-a306-b1b6bbb4a3b3 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-928898397" status: 201 len: 0 microversion: 2.26 time: 0.269614 Oct 03 10:54:23.627680 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2687/5082] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 3 10:54:23 2022] PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-928898397 => generated 0 bytes in 272 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 03 10:54:23.637798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074dfdca60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:23.654969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.655469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.655924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.656411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:23.697964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.698736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.705674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.706751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.707231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.707662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.772158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.773037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.773676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.823299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:23.910425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e7dd352-ff65-40ea-900d-affad81ce0a0 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 204 len: 0 microversion: 2.26 time: 0.276347 Oct 03 10:54:23.923271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-41dba367-f394-4985-9c76-5dc3527b6540 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074f185dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:23.929003 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2396/5083] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 3 10:54:23 2022] DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:54:23.934916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41dba367-f394-4985-9c76-5dc3527b6540 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:23.935403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41dba367-f394-4985-9c76-5dc3527b6540 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:23.936645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41dba367-f394-4985-9c76-5dc3527b6540 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:23.992379 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-41dba367-f394-4985-9c76-5dc3527b6540 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 200 len: 12 microversion: 2.26 time: 0.074549 Oct 03 10:54:24.005260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074dffcca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:24.008205 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2688/5084] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:54:23 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 12 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:24.019295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.019893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.020353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.020944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:24.040478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.041019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.041529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.042302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.042616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.043037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.111037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.114054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.115140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.155630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:24.196454 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a9f9efef-c91b-492b-a441-b3a8a72bc881 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 204 len: 0 microversion: 2.26 time: 0.196193 Oct 03 10:54:24.197714 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2397/5085] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 3 10:54:23 2022] DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:54:24.212092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074ec0e9d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:24.229666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.230500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.231166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.231973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:24.243032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.243913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.244657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.246595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.247246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.247870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.352460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.364327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.364911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.410880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.411383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.411855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.470697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:24.471991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:24.490922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:24.497778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.498495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.499104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.505418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.506495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.507728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.552087 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-73bc3558-23a9-4c3f-868d-43b110bf9efc tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-340690759" status: 201 len: 0 microversion: 2.26 time: 0.342651 Oct 03 10:54:24.559886 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2689/5086] 10.222.0.27 () {62 vars in 1377 bytes} [Mon Oct 3 10:54:24 2022] PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-340690759 => generated 0 bytes in 351 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 03 10:54:24.569076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074ea8a700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:24.605216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.605973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.606441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.608380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:24.624987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.625490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.628430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.632609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.633185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.633788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.712460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.714473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.714978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.739123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.739625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.740225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.752310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4,nova_cell1:DELETE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:24.831136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:24.877558 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce927c1f-f612-4fcd-b32c-a864111683f5 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1396215609" status: 201 len: 0 microversion: 2.26 time: 0.316035 Oct 03 10:54:24.886479 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2690/5087] 10.222.0.27 () {62 vars in 1380 bytes} [Mon Oct 3 10:54:24 2022] PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags/tempest-tag-1396215609 => generated 0 bytes in 321 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 03 10:54:24.892484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Action: 'update_all', calling method: .version_select at 0x7f074e4c6310>, body: {"tags": ["tempest-tag-844495051", "tempest-tag-1168768844"]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:24.916984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.917480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.917926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.918411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:24.941927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.941927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.943171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:24.943820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:24.944308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:24.946599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.018908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.020401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.021033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.075654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:25.114407 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8af9088f-0cf2-4db0-9fc9-324523a797b6 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 200 len: 61 microversion: 2.26 time: 0.226567 Oct 03 10:54:25.115244 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2691/5088] 10.222.0.27 () {62 vars in 1312 bytes} [Mon Oct 3 10:54:24 2022] PUT /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 61 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:25.136188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1706e00f-33f2-408c-a965-d96039d5bd3e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074eacc280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:25.166179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1706e00f-33f2-408c-a965-d96039d5bd3e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.166179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1706e00f-33f2-408c-a965-d96039d5bd3e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.166631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1706e00f-33f2-408c-a965-d96039d5bd3e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.193484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1706e00f-33f2-408c-a965-d96039d5bd3e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 200 len: 61 microversion: 2.26 time: 0.067292 Oct 03 10:54:25.196451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2692/5089] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Oct 3 10:54:25 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:25.211855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '.version_select at 0x7f074ea8f160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:25.233598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.234848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.238632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.239446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:25.260098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.261338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.261885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.268551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.269292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.269750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.388065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.389199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.389657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.419585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:25.428168 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e52ad9c0-73cc-401a-b72b-691e7ef574fa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.963210 Oct 03 10:54:25.439377 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2398/5090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:24 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:25.454744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lazy-loading 'flavor' on Instance uuid 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:54:25.509722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-040d9e04-8006-4140-b60d-542e39aa624e tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags" status: 204 len: 0 microversion: 2.26 time: 0.308558 Oct 03 10:54:25.510367 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2693/5091] 10.222.0.27 () {60 vars in 1295 bytes} [Mon Oct 3 10:54:25 2022] DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4/tags => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:54:25.520180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:25.521396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:25.541143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.550181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.550645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.551503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:25.552060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:25.552500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:25.724487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:54:26.467909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:26.469312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:26.489008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:26.490397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:26.492282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:26.503560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:26.506853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:26.511123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:26.758879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:26.935442 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5d51607-f7dc-48fa-8b76-03d78b241ced tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 204 len: 0 microversion: 2.26 time: 1.419084 Oct 03 10:54:26.941446 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2399/5092] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 10:54:25 2022] DELETE /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 0 bytes in 1422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 10:54:26.948358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:26.954077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:26.970460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:26.973543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:26.974385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:26.978016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:26.981157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:26.981815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:27.364156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:27.380537 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eb3e0864-3d1b-472f-bbac-30397e3a40f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.922348 Oct 03 10:54:27.408709 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2694/5093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:26 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:27.678201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:27.687790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:27.693108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:27.697580 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eaf9f554-b151-47b4-b0c6-631a7852e2ca tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1552 microversion: 2.26 time: 0.754311 Oct 03 10:54:27.699700 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2400/5094] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:26 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1552 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:28.417046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:28.418394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:28.443128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:28.443725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:28.444179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:28.444990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:28.445455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:28.445896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:28.732270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:28.733531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:28.748544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:28.753949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:28.755504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:28.760208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:28.760903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:28.761676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:29.296996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:29.310327 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5dac5702-1531-4c55-b314-a63732b14cb7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.898478 Oct 03 10:54:29.320828 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2695/5095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:28 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:30.150829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:30.183685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:30.191851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:30.193553 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d6bd24e-f4cb-4add-8450-f4394ae55c32 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1552 microversion: 2.26 time: 1.466525 Oct 03 10:54:30.197139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2401/5096] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:28 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1552 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:30.337084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:30.337713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:30.358370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:30.360361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:30.360860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:30.368253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:30.368875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:30.374026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:30.875391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:30.891577 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8f332e6-2603-4b41-902d-4b868e76e559 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.558376 Oct 03 10:54:30.892541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2696/5097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:30 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:31.226291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:31.226907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:31.237626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:31.243723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:31.245340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:31.259764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:31.260269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:31.260722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:31.921203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:31.923237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:31.944170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:31.946293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:31.948736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:31.949545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:31.953859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:31.954577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:32.509315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:32.524553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:32.530098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:32.534608 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb037eed-db1f-4a8d-a5ab-8331936e3350 tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1552 microversion: 2.26 time: 1.312299 Oct 03 10:54:32.537391 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2402/5098] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:31 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1552 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:33.001554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:33.016121 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1dd29481-a2c0-49d9-a540-46edbe2b5557 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 1.096307 Oct 03 10:54:33.039898 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2697/5099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:31 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:33.565961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:33.566884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:33.581218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:33.589297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:33.589944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:33.590969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:33.592255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:33.599169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:33.761176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c158e1d5-4c5f-494d-a24e-2a74a7293e3c req-1689c5fc-0a65-4de0-a5ed-7ba8d75d3f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052bd5b7-0fcd-4476-b900-df0b86ac8ad4", "name": "network-vif-deleted", "tag": "19df9a7a-ece6-425d-8623-c75ff94ae1de"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:33.794928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:33.801257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c158e1d5-4c5f-494d-a24e-2a74a7293e3c req-1689c5fc-0a65-4de0-a5ed-7ba8d75d3f37 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:33.810603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c158e1d5-4c5f-494d-a24e-2a74a7293e3c req-1689c5fc-0a65-4de0-a5ed-7ba8d75d3f37 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:33.811532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c158e1d5-4c5f-494d-a24e-2a74a7293e3c req-1689c5fc-0a65-4de0-a5ed-7ba8d75d3f37 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:33.897300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c158e1d5-4c5f-494d-a24e-2a74a7293e3c req-1689c5fc-0a65-4de0-a5ed-7ba8d75d3f37 service nova] Creating event network-vif-deleted:19df9a7a-ece6-425d-8623-c75ff94ae1de for instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 on n-h1-858383-3 Oct 03 10:54:33.917509 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c158e1d5-4c5f-494d-a24e-2a74a7293e3c req-1689c5fc-0a65-4de0-a5ed-7ba8d75d3f37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158421 Oct 03 10:54:33.922782 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2698/5100] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:34.051411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:34.052982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:34.074225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:34.077283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:34.077967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:34.083453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:34.084948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:34.087550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:34.232365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:34.246381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:34.254550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a57582a3d45a413bbab1ff542d28c7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c769670525b34c13b0419a1800c4f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:34.258885 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad89b2a0-9443-4552-93e4-4ee38c54132b tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 200 len: 1510 microversion: 2.26 time: 0.696507 Oct 03 10:54:34.276808 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2403/5101] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:33 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 1510 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 10:54:35.242058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:35.261969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e7514f5-b3b3-4f8a-8ce9-a3b64286699b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 1.221709 Oct 03 10:54:35.262543 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2699/5102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:34 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:35.292086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:35.292994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] [instance: 052bd5b7-0fcd-4476-b900-df0b86ac8ad4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:35.306860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:35.309791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:35.310558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:35.313467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:35.314590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:35.315578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:35.352495 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] HTTP exception thrown: Instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 could not be found. Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Request method failure captured: Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 HTTP/1.1 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr89wxtaDissBjQXKmfJiLxSbr-iWQ3O2mQtyqMduyegMymFBLZH4EaDX0k5ItWGz5MBds04RPzUPcjg-CyQlRij2tqYUSAVT9kLzaDBAD900qusyYzhVborqB7tnx7JMeR-v2h7EHkJ3FsQpTDbZJ09f2iNO5TsLpidqkNdoeDX9_s Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Openstack-Nova-Api-Version: 2.26 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: c769670525b34c13b0419a1800c4f85f Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerTagsTestJSON-509058283 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c769670525b34c13b0419a1800c4f85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c769670525b34c13b0419a1800c4f85f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c769670525b34c13b0419a1800c4f85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c769670525b34c13b0419a1800c4f85f"}]}] Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerTagsTestJSON-509058283 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: c769670525b34c13b0419a1800c4f85f Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerTagsTestJSON-509058283 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerTagsTestJSON-509058283-project Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a57582a3d45a413bbab1ff542d28c7e3 Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerTagsTestJSON-509058283-project Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 could not be found. Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '052bd5b7-0fcd-4476-b900-df0b86ac8ad4'} Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 could not be found. Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 could not be found. Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:54:35.358264 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:54:35.362961 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:35.362961 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:54:35.362961 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:54:35.362961 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:54:35.362961 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:54:35.362961 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 could not be found. Oct 03 10:54:35.362961 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:54:35.369865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] Returning 404 to user: Instance 052bd5b7-0fcd-4476-b900-df0b86ac8ad4 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:54:35.371256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1830b233-87c4-4665-b0e8-e4627198b8cd tempest-ServerTagsTestJSON-509058283 tempest-ServerTagsTestJSON-509058283-project] 10.222.0.27 "GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4" status: 404 len: 111 microversion: 2.26 time: 0.085230 Oct 03 10:54:35.375396 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2404/5103] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 10:54:35 2022] GET /compute/v2.1/servers/052bd5b7-0fcd-4476-b900-df0b86ac8ad4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:54:36.290497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:36.291114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:36.307066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:36.307571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:36.310193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:36.310958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:36.311430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:36.311871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:37.066951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:37.087047 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-038e0641-bf43-4f39-9b27-d49561334e70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.800539 Oct 03 10:54:37.088401 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2700/5104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:36 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:38.112912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:38.113705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:38.121035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:38.139014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:38.140551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:38.143846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:38.144917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:38.148743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:38.149669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:39.436971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:39.458618 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06f8f3c0-f547-4601-bf47-08a4504660a8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 1.349423 Oct 03 10:54:39.459284 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2405/5105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:38 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:40.490372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:40.493634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:40.533445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:40.537090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:40.541906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:40.552357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:40.556792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:40.558783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:41.112451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1881161648", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e8c45795-beb8-40e6-ba51-51a8d24fedd0"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:41.361437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] validate_networks() for [('e8c45795-beb8-40e6-ba51-51a8d24fedd0', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:54:42.592355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:42.600532 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b896e11-5aae-4a3f-a59d-390810a70d39 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 2.114496 Oct 03 10:54:42.610607 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2406/5106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:40 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:42.863459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:54:42.864564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:54:42.865323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:54:42.866886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:54:42.867509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:54:42.892450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:42.896793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:42.900968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:42.902022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:42.902532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:42.904858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:42.958872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:54:42.980806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for user 2a0e22aff3574cb286f2c1aa546c6c78 and project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:54:42.996085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:54:42.999344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:54:43.185413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-153c4295-dc33-4383-a229-1f4d0d2c1eeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.833673 Oct 03 10:54:43.200515 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2701/5107] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:54:43.207295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d253c39-541b-4dd6-a38a-c2fc78a8da88 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:43.208404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d253c39-541b-4dd6-a38a-c2fc78a8da88 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:43.479469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d253c39-541b-4dd6-a38a-c2fc78a8da88 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:43.489230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d253c39-541b-4dd6-a38a-c2fc78a8da88 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1215 microversion: 2.1 time: 0.289088 Oct 03 10:54:43.489729 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2407/5108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:43 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1215 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:43.654361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:43.666364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:43.714810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:43.715301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:43.730000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:43.731168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:43.731830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:43.732520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:44.523832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:44.525471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:44.552857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:44.555788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:44.556323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:44.558285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:44.559051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:44.559800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:44.794287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:44.829967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2515a3fe-a6e1-4867-af21-66368021c079 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 1.180316 Oct 03 10:54:44.841178 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2702/5109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:43 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:45.081963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:45.113110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f9ebd211-0077-4cc8-8962-16e13af5fd83 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1211 microversion: 2.1 time: 0.588366 Oct 03 10:54:45.113110 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2408/5110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:44 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1211 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:45.860865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:45.861431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:45.880540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:45.881075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:45.881519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:45.882812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:45.886235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:45.886919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:46.142187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:46.142834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:46.156449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:46.165869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:46.166709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:46.167726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:46.170901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:46.171394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:46.592726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:46.608890 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5f25c36b-2a93-47fd-938f-6be6d4566ed2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1273 microversion: 2.1 time: 0.470580 Oct 03 10:54:46.629719 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2409/5111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:46 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1273 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:46.836863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:46.852497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e4aee651-60d8-4a58-be65-e8c711930cc4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1681 microversion: 2.1 time: 0.991956 Oct 03 10:54:46.879660 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2703/5112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:45 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1681 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:47.638011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:47.638861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:47.689456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:47.689980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:47.690436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:47.691187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:47.691653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:47.692084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:47.899134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:47.900059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:47.914924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:47.915417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:47.915990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:47.916554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:47.917035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:47.917458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:48.109183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:48.122756 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c639468f-b66a-48e9-bf40-ec035d047c7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.488953 Oct 03 10:54:48.125752 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2410/5113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:47 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:48.251465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:48.281435 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c70f384e-17f7-407f-adf3-99779f4998e6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.388404 Oct 03 10:54:48.283032 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2704/5114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:47 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:48.467318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:48.468338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:48.479309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:48.483419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:48.486137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:48.487538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:48.490705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:48.492243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:48.643121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:48.643777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:48.665848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:48.666423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:48.669129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:48.670004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:48.671781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:48.672491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:48.725592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72e6794a-29df-48be-aa55-9a2f65bb745b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111/ips" status: 200 len: 150 microversion: 2.1 time: 0.087274 Oct 03 10:54:48.729466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2705/5115] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:54:48 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:48.749860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4d064d2-f66b-4061-b330-5816f65b0797"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:48.753622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:48.762692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:48.763445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:48.764088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:48.764860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:48.765391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:48.765830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:48.966085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:48.982193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Invalid volume: volume f4d064d2-f66b-4061-b330-5816f65b0797 is already attached to instances: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111/os-volume_attachments HTTP/1.1 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 74 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: {"volumeAttachment": {"volumeId": "f4d064d2-f66b-4061-b330-5816f65b0797"}} Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid volume: volume f4d064d2-f66b-4061-b330-5816f65b0797 is already attached to instances: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': 'f83af7ea-0bd2-46a1-8c0a-a827b715e111', 'body': {'volumeAttachment': {'volumeId': 'f4d064d2-f66b-4061-b330-5816f65b0797'}}} Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4d064d2-f66b-4061-b330-5816f65b0797 is already attached to instances: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:54:48.986683 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4d064d2-f66b-4061-b330-5816f65b0797 is already attached to instances: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4d064d2-f66b-4061-b330-5816f65b0797 is already attached to instances: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 Oct 03 10:54:48.992016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:48.995867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 400 to user: Invalid volume: volume f4d064d2-f66b-4061-b330-5816f65b0797 is already attached to instances: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:54:48.997825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8c63c7f-9a0e-4a0c-af6c-ab6279a03266 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.256250 Oct 03 10:54:48.999018 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2706/5116] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:54:48 2022] POST /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111/os-volume_attachments => generated 174 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:54:49.008209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:49.009486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:49.017206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:49.017838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:49.018357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:49.019154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:49.019690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:49.020190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:49.069189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:54:49.185735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:49.201151 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-325528df-1d6d-42fb-b9a7-15bdaab9b9c3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.738220 Oct 03 10:54:49.202421 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2411/5117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:48 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:49.233900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:49.234614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:49.250928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:49.251731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:49.252636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:49.253578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:49.254433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:49.255066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:49.290303 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8ef02b6-6b6b-4389-9426-0f8e5f467fbc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 204 len: 0 microversion: 2.1 time: 0.286622 Oct 03 10:54:49.294957 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2707/5118] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:54:49 2022] DELETE /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:54:49.318643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:49.323311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:49.330623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:49.331339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:49.336132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:49.342571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:49.343792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:49.344683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:49.944599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:49.972795 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e2c8acd-f975-40de-88c4-a10bf97c14ef tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1680 microversion: 2.1 time: 0.672942 Oct 03 10:54:49.974950 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2708/5119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:49 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1680 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:49.985950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2f2d20bc-1d3d-41b1-903f-2b92bf612230 req-6a459f81-80b4-4055-8f76-ea7b770b7855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-unplugged", "status": "completed", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:50.006130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2f2d20bc-1d3d-41b1-903f-2b92bf612230 req-6a459f81-80b4-4055-8f76-ea7b770b7855 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:50.016942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2f2d20bc-1d3d-41b1-903f-2b92bf612230 req-6a459f81-80b4-4055-8f76-ea7b770b7855 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:50.017583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2f2d20bc-1d3d-41b1-903f-2b92bf612230 req-6a459f81-80b4-4055-8f76-ea7b770b7855 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:50.058325 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-2f2d20bc-1d3d-41b1-903f-2b92bf612230 req-6a459f81-80b4-4055-8f76-ea7b770b7855 service nova] Creating event network-vif-unplugged:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 10:54:50.071598 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2f2d20bc-1d3d-41b1-903f-2b92bf612230 req-6a459f81-80b4-4055-8f76-ea7b770b7855 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094205 Oct 03 10:54:50.077158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2709/5120] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:50.095475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:50.123088 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5d50af2-b65d-48a4-8117-bfb3326bbc19 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.919334 Oct 03 10:54:50.127573 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2412/5121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:49 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:51.024813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:51.033423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:51.057134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:51.057272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:51.057873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:51.059356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:51.060347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:51.062961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:51.064031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:51.065774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:51.073496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:51.074005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:51.074455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:51.075264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:51.075921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:51.076567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:51.729496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:51.739940 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4d396be-a24a-4265-8b74-b59b6a0fd900 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1680 microversion: 2.1 time: 0.736131 Oct 03 10:54:51.740524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2710/5122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:51 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1680 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:51.756890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:51.758277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:51.781423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:51.781932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:51.782541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:51.783416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:51.783882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:51.784317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:52.164925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:52.179811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3153215-1987-4c11-968a-c6e6a69882f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.123194 Oct 03 10:54:52.192724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:52.200866 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2413/5123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:51 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:52.208108 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d534322-7720-4ae9-8652-8937f390c44b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.454836 Oct 03 10:54:52.211115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:52.212025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:52.213221 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2711/5124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:51 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:52.232327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:52.235364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:52.236172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:52.237486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:52.249320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:52.250343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:52.768883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:52.769578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:52.796875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:52.797874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:52.798670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:52.799577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:52.800295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:52.800978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:52.929481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:52.984291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:52.989690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:53.003675 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d311f782-928f-4b65-bc25-b331999dbf90 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 200 len: 1613 microversion: 2.1 time: 0.235292 Oct 03 10:54:53.026994 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2712/5125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:52 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 1613 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:53.032229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-05fea5d5-1c8a-4ed8-bcef-a7e0f343c86a req-3d4bcf91-fc48-426f-ad01-c963c68309e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83af7ea-0bd2-46a1-8c0a-a827b715e111", "name": "network-vif-deleted", "tag": "1a303d85-b58e-4026-9236-6298522aa205"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:53.066335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-05fea5d5-1c8a-4ed8-bcef-a7e0f343c86a req-3d4bcf91-fc48-426f-ad01-c963c68309e4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:53.067109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-05fea5d5-1c8a-4ed8-bcef-a7e0f343c86a req-3d4bcf91-fc48-426f-ad01-c963c68309e4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:53.067883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-05fea5d5-1c8a-4ed8-bcef-a7e0f343c86a req-3d4bcf91-fc48-426f-ad01-c963c68309e4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:53.107419 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-05fea5d5-1c8a-4ed8-bcef-a7e0f343c86a req-3d4bcf91-fc48-426f-ad01-c963c68309e4 service nova] Creating event network-vif-deleted:1a303d85-b58e-4026-9236-6298522aa205 for instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 on n-h2-858383-3 Oct 03 10:54:53.125482 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-05fea5d5-1c8a-4ed8-bcef-a7e0f343c86a req-3d4bcf91-fc48-426f-ad01-c963c68309e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096736 Oct 03 10:54:53.127130 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2713/5126] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:53.237121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:53.238593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:53.250613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:53.254036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:53.258010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:53.258797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:53.261240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:53.264942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:53.265490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:53.265776 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad3af20e-032d-455b-8be6-fd219e131f35 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.062375 Oct 03 10:54:53.281221 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2414/5127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:52 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:53.325355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:53.331541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:53.374305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:53.378420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:53.381024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:53.391079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:53.392333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:53.394586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:53.520132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:53.757217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:53.767068 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-202bd274-e3b4-44d1-9748-e42e775ee134 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.534437 Oct 03 10:54:53.784921 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2714/5128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:53 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:54.040987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:54.044428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:54.078259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.083419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.088528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:54.093083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.097426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.107526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:54.186439 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 HTTP/1.1 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f83af7ea-0bd2-46a1-8c0a-a827b715e111'} Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:54:54.190359 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:54.200059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:54:54.200059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:54:54.200059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:54:54.200059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:54:54.200059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:54:54.200059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:54:54.200059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:54:54.205152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:54:54.205723 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-94093118-7b28-4dbe-96b0-14cbc1684907 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 404 len: 111 microversion: 2.1 time: 0.174152 Oct 03 10:54:54.207484 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2715/5129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:54 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:54:54.226779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-399dbfc4-d567-4ba8-970e-95e2d8b81700 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '.version_select at 0x7f074e2c08b0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:54.310199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-399dbfc4-d567-4ba8-970e-95e2d8b81700 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451294482" status: 202 len: 0 microversion: 2.1 time: 0.092538 Oct 03 10:54:54.314324 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2716/5130] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:54:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451294482 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:54:54.583903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:54.595418 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-03f3c138-ec0b-49ce-bf9d-28b75e1338f6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.304991 Oct 03 10:54:54.605643 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2415/5131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:53 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:54.639797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:54.643901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:54.673389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.674679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.678178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:54.679595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.681518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.682681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:54.799745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:54.800369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:54.815207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.816251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.816976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:54.823326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.827366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.828173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:54.879895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cfa897c5-c65f-4bea-9cf2-c6e10120e759 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.245438 Oct 03 10:54:54.883621 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2717/5132] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:54:54 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:54:54.902505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:54.904177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:54.918415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.919303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.919933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:54.921042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:54.921865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:54.922965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:55.609678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:55.622808 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f00f4397-8722-44b9-818a-ef02bc1b1803 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1670 microversion: 2.1 time: 0.735783 Oct 03 10:54:55.626114 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2718/5133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:54 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1670 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:56.166477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f91f98a8-108d-480a-8b2a-ed13d50fc930 req-f1d42fd3-16c1-42b1-9164-e9e0f4a45723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e2d49c-7ac1-412e-8ac9-30c97b169716", "tag": "ae6f6084-fafd-4741-910f-1537122c301d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:56.189787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f91f98a8-108d-480a-8b2a-ed13d50fc930 req-f1d42fd3-16c1-42b1-9164-e9e0f4a45723 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:56.190260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f91f98a8-108d-480a-8b2a-ed13d50fc930 req-f1d42fd3-16c1-42b1-9164-e9e0f4a45723 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:56.199286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f91f98a8-108d-480a-8b2a-ed13d50fc930 req-f1d42fd3-16c1-42b1-9164-e9e0f4a45723 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:56.216786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f91f98a8-108d-480a-8b2a-ed13d50fc930 req-f1d42fd3-16c1-42b1-9164-e9e0f4a45723 service nova] Creating event network-changed:ae6f6084-fafd-4741-910f-1537122c301d for instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 on n-h1-858383-3 Oct 03 10:54:56.222259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f91f98a8-108d-480a-8b2a-ed13d50fc930 req-f1d42fd3-16c1-42b1-9164-e9e0f4a45723 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061362 Oct 03 10:54:56.223314 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2719/5134] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:54:56.652431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:56.654097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:56.672997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:56.677268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:56.677940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:56.679942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:56.680598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:56.681232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:56.740001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:56.759688 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df7d9940-52fa-406f-a28f-feaeaf762835 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 1.965296 Oct 03 10:54:56.761027 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2416/5135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:54 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:57.164742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:57.184523 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4db7c6b5-b9a2-40e4-a65b-694b245d8a70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1670 microversion: 2.1 time: 0.536299 Oct 03 10:54:57.196295 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2720/5136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:56 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1670 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:57.790870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:57.790870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:57.800801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:57.802074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:57.802893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:57.804088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:57.813702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:57.815463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:57.836869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:54:58.230464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:58.232248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:58.258276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:58.262753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:58.263545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:58.268052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:58.271377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:58.274688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:59.390418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:59.403703 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b2d1a91-38e9-4943-9923-2858ca988403 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.179035 Oct 03 10:54:59.405889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:54:59.407844 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2721/5137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:58 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:54:59.439388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:54:59.441650 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e6148d42-1f94-4100-aaba-1fc2b4efda8b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 1.655860 Oct 03 10:54:59.442557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:59.442892 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2417/5138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:57 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:54:59.462348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:59.463013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:59.463568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:59.464954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:59.465551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:59.466435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:59.604365 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b1fc9f7-46e9-43bb-b941-976781d36075 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 200 len: 322 microversion: 2.1 time: 0.169961 Oct 03 10:54:59.609335 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2722/5139] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:54:59 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:54:59.618950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:59.619941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:59.637570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:59.659360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:59.661811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:59.666500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:59.670390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:59.675947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:59.839842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:54:59.841099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:54:59.862719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:59.867755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:59.868564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:54:59.869582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:54:59.870284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:54:59.871311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:00.067134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lazy-loading 'services' on Instance uuid 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:55:00.427662 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d473ec0-be96-46d4-8671-476d4e408632 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments/f4d064d2-f66b-4061-b330-5816f65b0797" status: 202 len: 0 microversion: 2.1 time: 0.592084 Oct 03 10:55:00.428972 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2723/5140] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:54:59 2022] DELETE /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments/f4d064d2-f66b-4061-b330-5816f65b0797 => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:55:00.450266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:00.459364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:00.485087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:00.485586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:00.496241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:00.503113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:00.503367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:00.503853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:00.627107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:00.790738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e517d24e-3283-46f3-8e2e-68a9cfaaa433 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.354847 Oct 03 10:55:00.792101 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2724/5141] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:00 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:00.816960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:00.822925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:00.853184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:00.855572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:00.856666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:00.860253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:00.862566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:00.864109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:01.304848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:01.350509 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6390235f-c21f-4ff9-98f7-a015bb8f1ede tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.730194 Oct 03 10:55:01.373868 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2418/5142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:54:59 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:01.408934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:01.410190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:01.432499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:01.433126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:01.435102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:01.435891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:01.436381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:01.436848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:01.761917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:01.770027 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f5b268b4-47c7-4d16-95db-50c2e86a1ec7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.972774 Oct 03 10:55:01.785496 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2725/5143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:00 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:01.811181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:01.821155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:01.837894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:01.840559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:01.841392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:01.844871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:01.845618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:01.846443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:01.916817 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-284fc2f0-e654-4dcf-8d39-3cc1578d9a01 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113273 Oct 03 10:55:01.918244 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2726/5144] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:01 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:01.995056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:02.004590 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96080fec-cb92-45ed-9cc8-cefd7436575b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.615169 Oct 03 10:55:02.022759 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2419/5145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:01 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:02.036412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:02.037064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:02.061433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:02.062139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:02.062951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:02.079855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:02.085982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:02.086841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:02.348612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:02.370119 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2f132a9-dee4-471b-b633-8ce5d9024a8a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.338982 Oct 03 10:55:02.370709 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2727/5146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:02 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:02.394760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:02.395554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:02.411101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:02.415259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:02.416043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:02.417194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:02.420205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:02.424960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:02.799188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:02.800591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:02.812672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:02.821886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:02.822345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:02.823136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:02.823593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:02.824021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:03.294314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:03.305206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-93f3488e-6048-43c7-bb39-04f7373694da tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.514595 Oct 03 10:55:03.305810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2728/5147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:02 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:03.324572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:03.327018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:03.351375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:03.352055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:03.352671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:03.353625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:03.358228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:03.359572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:03.426729 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30a33d16-f45a-402e-a7d9-a648a90b6bf5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119807 Oct 03 10:55:03.432346 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2729/5148] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:03 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:03.698277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:03.710870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8ad89ea1-593c-46b6-8c41-1e4934e7e190 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.319478 Oct 03 10:55:03.711806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2420/5149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:02 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:03.978632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1661523653", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "9dbf8c82-dfae-4d56-9442-6e6c67d23560"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:04.021082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:04.108420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] validate_networks() for [('9dbf8c82-dfae-4d56-9442-6e6c67d23560', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:55:04.334736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:04.335660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:04.365124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:04.365677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:04.366692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:04.367448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:04.373879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:04.374362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:05.060990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:05.070461 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e2bb7bc7-702f-4c31-bb7b-6f501877ca2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.741946 Oct 03 10:55:05.102953 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2421/5150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:04 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:05.120210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:05.123651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:05.131321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:05.132215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:05.132921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:05.134984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:05.136668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:05.137400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:05.204218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e88953f-3acc-428c-aca3-8b27a6f99654 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096247 Oct 03 10:55:05.205272 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2422/5151] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:05 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:06.057561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8d6b8da1-bbe0-4429-933b-e94e29266710 req-19d58986-e1a2-4545-8a71-69b1d2b3e7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e2d49c-7ac1-412e-8ac9-30c97b169716", "name": "network-vif-plugged", "status": "completed", "tag": "ae6f6084-fafd-4741-910f-1537122c301d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:06.082825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8d6b8da1-bbe0-4429-933b-e94e29266710 req-19d58986-e1a2-4545-8a71-69b1d2b3e7e2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:06.084182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8d6b8da1-bbe0-4429-933b-e94e29266710 req-19d58986-e1a2-4545-8a71-69b1d2b3e7e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:06.084900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8d6b8da1-bbe0-4429-933b-e94e29266710 req-19d58986-e1a2-4545-8a71-69b1d2b3e7e2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:06.117209 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8d6b8da1-bbe0-4429-933b-e94e29266710 req-19d58986-e1a2-4545-8a71-69b1d2b3e7e2 service nova] Creating event network-vif-plugged:ae6f6084-fafd-4741-910f-1537122c301d for instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 on n-h1-858383-3 Oct 03 10:55:06.127929 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8d6b8da1-bbe0-4429-933b-e94e29266710 req-19d58986-e1a2-4545-8a71-69b1d2b3e7e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079896 Oct 03 10:55:06.131612 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2423/5152] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:06.145527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:06.146276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:06.166130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:06.166649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:06.168283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:06.169654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:06.170142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:06.170587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:06.761585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:55:06.762086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:55:06.762532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:55:06.762943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:55:06.763514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:55:06.780321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:06.784046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:06.784648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:06.787791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:06.790018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:06.792476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:06.804107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:06.814256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dbf24d5e-83cd-44b5-b2c1-12b1c545e161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 0.680977 Oct 03 10:55:06.814870 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2424/5153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:06 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:06.828254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:06.835626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:06.858272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:06.859139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:06.859849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:06.860840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:06.861535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:06.862209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:06.894528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:55:06.925921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for user e3857d14b6f6498c87700ea6ee22c4a6 and project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:55:06.945192 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa3ad54b-f944-4c5b-ba2b-fd1379717c7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125588 Oct 03 10:55:06.946950 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2425/5154] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:06 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:06.969334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:55:06.987344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:55:07.105568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ae5364a-4420-40c9-b8da-8093e7b53077 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.134554 Oct 03 10:55:07.106904 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2730/5155] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:55:07.120486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c553054-a7c0-4b87-8a2f-cd9d7473622e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:07.121389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c553054-a7c0-4b87-8a2f-cd9d7473622e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:07.740347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c553054-a7c0-4b87-8a2f-cd9d7473622e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:07.754861 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c553054-a7c0-4b87-8a2f-cd9d7473622e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1215 microversion: 2.1 time: 0.640409 Oct 03 10:55:07.768986 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2426/5156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:07 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1215 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:07.843773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:07.845130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:07.865492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:07.867034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:07.867773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:07.869757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:07.870502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:07.871166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:07.962184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:07.968827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:08.006582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:08.029109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:08.029922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:08.031228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:08.037363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:08.039118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:08.169126 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad915544-2f32-4870-bf42-553bbbfce690 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214480 Oct 03 10:55:08.178187 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2427/5157] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:07 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:08.781890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:08.782671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:08.784740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=50 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:08.796454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:08.796983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:08.797689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:08.798419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:08.798881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:08.799315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:09.001681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:09.011388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f32e0817-b3a3-4b86-807b-4605b0596e68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1267 microversion: 2.1 time: 0.233478 Oct 03 10:55:09.023304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2428/5158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:08 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:09.184126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:09.188040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:09.204088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:09.205007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:09.205832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:09.206785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:09.212581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:09.213356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:09.292067 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dfb45d08-08c7-4a79-869e-9c30c934f935 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113163 Oct 03 10:55:09.298044 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2429/5159] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:09 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:09.314046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:09.338528 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b6e1f6e-3832-49ca-acf4-7d7e5e679d02 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1315 microversion: 2.1 time: 1.501447 Oct 03 10:55:09.339156 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2731/5160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:07 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1315 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:10.052248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:10.054168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:10.070817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:10.071572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:10.072927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:10.092400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:10.094532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:10.097110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:10.306882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:10.309487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:10.339866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:10.341293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:10.342164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:10.349815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:10.350958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:10.351741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:10.399527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:10.423860 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-337d425a-2dd3-4dbe-8e18-66c7117c9393 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1273 microversion: 2.1 time: 0.378526 Oct 03 10:55:10.426406 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2430/5161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:10 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1273 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:10.432450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:10.447136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:10.461970 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99a7db5e-99f3-494e-a391-912e0c8f03fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160234 Oct 03 10:55:10.464514 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2732/5162] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:10 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:10.477897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:10.478699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:10.479312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:10.480213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:10.480912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:10.481514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:11.452161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:11.453186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:11.469135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:11.470954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:11.472863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:11.475528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:11.478102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:11.479841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:11.656884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:11.671363 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-748f7ba0-ab8c-4089-8d94-897424fb1636 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1273 microversion: 2.1 time: 0.224490 Oct 03 10:55:11.671960 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2733/5163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:11 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:11.684315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:11.687163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:11.703710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:11.706815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:11.707495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:11.711187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:11.711897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:11.712563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:11.805593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b42bc29-3659-4945-80d1-18e9d0e8a5be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121667 Oct 03 10:55:11.806287 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2734/5164] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:11 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:11.974631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:12.001452 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4e61be9-297d-4459-8cc1-50971b67b795 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1502 microversion: 2.1 time: 1.573348 Oct 03 10:55:12.008872 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2431/5165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:10 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1502 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:12.032503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:12.033476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:12.041293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:12.042215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:12.042907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:12.043871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:12.044643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:12.045537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:12.122498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:55:12.446668 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6906d69-5d2f-4c7d-a7e9-e8a2cdf5b9d3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 204 len: 0 microversion: 2.1 time: 0.418125 Oct 03 10:55:12.447710 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2735/5166] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:55:12 2022] DELETE /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:55:12.459772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:12.461548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:12.497778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:12.498393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:12.498860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:12.499641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:12.500111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:12.500552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:12.697523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:12.698247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:12.731964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:12.735363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:12.736025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:12.737173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:12.737814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:12.738437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:13.272495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:13.284508 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aea73664-0ea8-4003-8cab-c9cc02dd2892 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1273 microversion: 2.1 time: 0.592314 Oct 03 10:55:13.297451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2736/5167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:12 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1273 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:13.307232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:13.310879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:13.318638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:13.320986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:13.321653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:13.322810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:13.323457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:13.324048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:13.372809 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c816323-904d-45b8-b23a-d3302ef14bf3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070263 Oct 03 10:55:13.374276 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2737/5168] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:55:13 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:55:13.389194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:13.403593 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0a820a7-fbaf-4a25-b2a0-c4d4bc2ac07a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1508 microversion: 2.1 time: 0.950847 Oct 03 10:55:13.420451 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2432/5169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:12 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1508 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:13.474349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:13.476221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:13.490744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:13.503805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:13.510841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:13.519550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:13.521783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:13.524250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:13.595153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:55:13.675128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:13.776809 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-004efce5-4409-409d-8a9a-29f257fe98a1 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 204 len: 0 microversion: 2.1 time: 0.307485 Oct 03 10:55:13.779673 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2738/5170] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:55:13 2022] DELETE /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:55:13.787097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:13.787835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:13.803253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:13.804097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:13.806952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:13.807932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:13.817665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:13.818488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:14.314552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:14.316867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:14.338147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:14.340931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:14.343130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:14.344250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:14.348534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:14.349282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:14.418873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:14.443014 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b25378a1-40e5-4530-95c2-6939b5762945 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1679 microversion: 2.1 time: 0.651844 Oct 03 10:55:14.450525 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2433/5171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:13 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1679 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:14.460987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:14.465860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:14.499844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:14.500624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:14.505601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:14.509393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:14.510377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:14.512011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:14.952203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:14.966142 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-46abec7a-8f46-4860-a7da-0d8fa9e2ed74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1508 microversion: 2.1 time: 0.513810 Oct 03 10:55:14.967908 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2434/5172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:14 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1508 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:15.077824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:15.086501 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fcb284cb-d111-4c5c-8297-53b5777c3b96 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1315 microversion: 2.1 time: 0.782709 Oct 03 10:55:15.091960 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2739/5173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:14 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:15.493043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:15.494612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:15.545795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:15.546647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:15.547271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:15.549597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:15.556573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:15.559728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:15.631895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:16.087295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:16.094778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:16.130173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:16.142266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:16.156694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:16.160471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:16.162170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:16.169956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:16.821538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:16.834490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:16.850644 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab540ce5-5a03-4bba-b89f-7a6451157755 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1679 microversion: 2.1 time: 1.377584 Oct 03 10:55:16.852102 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2435/5174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:15 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1679 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:16.885853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:16.888884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:16.907357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:16.908383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:16.909099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:16.910017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:16.910933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:16.911557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:16.953045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:17.496533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:17.512253 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e19ae6ff-db4e-4a1c-bd55-a3c301c3d7de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1508 microversion: 2.1 time: 1.512658 Oct 03 10:55:17.512893 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2740/5175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:15 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1508 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:17.533639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6fdd8a43-7724-47a7-bed6-2ff61465b2e6 req-f9d3ebcf-d6f3-4bf5-8485-a8d19d3ee4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d2546d-4e01-4ab7-89c9-23bd8ede5a59", "name": "network-vif-unplugged", "status": "completed", "tag": "77e540e9-da27-4325-abb1-8aad034bb399"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:17.581621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6fdd8a43-7724-47a7-bed6-2ff61465b2e6 req-f9d3ebcf-d6f3-4bf5-8485-a8d19d3ee4fc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:17.584018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6fdd8a43-7724-47a7-bed6-2ff61465b2e6 req-f9d3ebcf-d6f3-4bf5-8485-a8d19d3ee4fc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:17.584514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6fdd8a43-7724-47a7-bed6-2ff61465b2e6 req-f9d3ebcf-d6f3-4bf5-8485-a8d19d3ee4fc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:17.660554 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6fdd8a43-7724-47a7-bed6-2ff61465b2e6 req-f9d3ebcf-d6f3-4bf5-8485-a8d19d3ee4fc service nova] Creating event network-vif-unplugged:77e540e9-da27-4325-abb1-8aad034bb399 for instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 on n-h1-858383-3 Oct 03 10:55:17.702799 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6fdd8a43-7724-47a7-bed6-2ff61465b2e6 req-f9d3ebcf-d6f3-4bf5-8485-a8d19d3ee4fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180995 Oct 03 10:55:17.703753 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2741/5176] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:17.752528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:17.879542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:17.880589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:17.892438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:17.893196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:17.896048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:17.911255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:17.913775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:17.914494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:18.166683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:18.183142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e3f7995-d3bf-44e6-a763-e4d908270c52 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1612 microversion: 2.1 time: 0.308272 Oct 03 10:55:18.198942 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2742/5177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:17 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1612 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:18.506891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:18.527204 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-263da946-713c-44ea-86b8-a5d46c52f833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1315 microversion: 2.1 time: 1.670789 Oct 03 10:55:18.536240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:18.537700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:18.546368 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2436/5178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:16 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1315 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:18.551843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:18.552287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:18.552737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:18.553542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:18.554516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:18.554948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:19.210709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:19.212490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:19.228291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:19.228291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:19.229215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:19.229453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:19.242883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:19.243639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:19.596750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:19.605872 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13680f17-a5a4-4a08-938f-79a355165d8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1612 microversion: 2.1 time: 0.399037 Oct 03 10:55:19.616806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2437/5179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:19 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1612 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:19.632964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:19.633953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:19.647204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:19.650119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:19.654227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:19.655456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:19.656685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:19.657411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:20.126035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:20.165546 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-717d29f4-e924-4654-bcc6-b65a1f60dd58 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 200 len: 1508 microversion: 2.1 time: 1.633048 Oct 03 10:55:20.181397 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2743/5180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:18 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 1508 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:20.191444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c1d074f1-3495-4869-ad63-3facf060f982 req-218e08cb-0251-40a1-ad56-02e31d55fe72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e2d49c-7ac1-412e-8ac9-30c97b169716", "name": "network-vif-deleted", "tag": "ae6f6084-fafd-4741-910f-1537122c301d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:20.206136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1d074f1-3495-4869-ad63-3facf060f982 req-218e08cb-0251-40a1-ad56-02e31d55fe72 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:20.206871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1d074f1-3495-4869-ad63-3facf060f982 req-218e08cb-0251-40a1-ad56-02e31d55fe72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:20.207540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1d074f1-3495-4869-ad63-3facf060f982 req-218e08cb-0251-40a1-ad56-02e31d55fe72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:20.236651 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c1d074f1-3495-4869-ad63-3facf060f982 req-218e08cb-0251-40a1-ad56-02e31d55fe72 service nova] Creating event network-vif-deleted:ae6f6084-fafd-4741-910f-1537122c301d for instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 on n-h1-858383-3 Oct 03 10:55:20.244009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c1d074f1-3495-4869-ad63-3facf060f982 req-218e08cb-0251-40a1-ad56-02e31d55fe72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060875 Oct 03 10:55:20.245212 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2744/5181] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:20.635379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:20.636182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:20.653602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:20.654735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:20.655353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:20.656354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:20.657065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:20.665610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:21.083176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:21.098517 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-de291927-bb39-42eb-b209-e944e37cd7b9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 200 len: 1612 microversion: 2.1 time: 0.467399 Oct 03 10:55:21.101787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2745/5182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:20 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 1612 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:21.196858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:21.197500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:21.247414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:21.250608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:21.251398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:21.252414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:21.257767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:21.261249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:21.297364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:21.307634 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b98425d-e27c-429f-927a-c01a541c1f9b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1315 microversion: 2.1 time: 1.696223 Oct 03 10:55:21.331278 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2438/5183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:19 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1315 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:21.339761 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 HTTP/1.1 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '33e2d49c-7ac1-412e-8ac9-30c97b169716'} Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:55:21.342401 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:21.349242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:21.349242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:55:21.349242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:55:21.349242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:55:21.349242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:55:21.349242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 10:55:21.349242 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:21.358136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:55:21.359494 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2105cceb-b6a5-4186-980a-07c5afaf389b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 404 len: 111 microversion: 2.1 time: 0.168303 Oct 03 10:55:21.360610 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2746/5184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:21 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:55:21.534884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-481914011", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e8c45795-beb8-40e6-ba51-51a8d24fedd0"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:21.655355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] validate_networks() for [('e8c45795-beb8-40e6-ba51-51a8d24fedd0', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:55:21.807083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e2b2d4ff-a8c0-4ef9-af67-a2143bd3e307 req-90c5e5ba-2ccf-4b55-bdc3-8cf884ee65a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6462b873-02b8-4e3e-8371-df0fde41951e", "tag": "8cb9dccd-e037-40bd-9b93-0840f9991a8a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:21.832052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e2b2d4ff-a8c0-4ef9-af67-a2143bd3e307 req-90c5e5ba-2ccf-4b55-bdc3-8cf884ee65a8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:21.832577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e2b2d4ff-a8c0-4ef9-af67-a2143bd3e307 req-90c5e5ba-2ccf-4b55-bdc3-8cf884ee65a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:21.833036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e2b2d4ff-a8c0-4ef9-af67-a2143bd3e307 req-90c5e5ba-2ccf-4b55-bdc3-8cf884ee65a8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:21.853684 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e2b2d4ff-a8c0-4ef9-af67-a2143bd3e307 req-90c5e5ba-2ccf-4b55-bdc3-8cf884ee65a8 service nova] Creating event network-changed:8cb9dccd-e037-40bd-9b93-0840f9991a8a for instance 6462b873-02b8-4e3e-8371-df0fde41951e on n-h2-858383-3 Oct 03 10:55:21.866633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e2b2d4ff-a8c0-4ef9-af67-a2143bd3e307 req-90c5e5ba-2ccf-4b55-bdc3-8cf884ee65a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065159 Oct 03 10:55:21.867503 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2747/5185] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:22.128504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:22.129335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:22.145035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:22.145534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:22.146188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:22.146903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:22.147437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:22.147924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:22.182460 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 HTTP/1.1 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '04d2546d-4e01-4ab7-89c9-23bd8ede5a59'} Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:55:22.184439 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:22.188600 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:22.188600 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:55:22.188600 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:55:22.188600 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:55:22.188600 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:55:22.188600 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:55:22.188600 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:55:22.190940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:55:22.203201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c589d021-7cc9-4b30-8b92-6a24118b3363 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 404 len: 111 microversion: 2.1 time: 0.077948 Oct 03 10:55:22.204929 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2748/5186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:22 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:55:22.213328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0060dd76-085f-4360-9292-22fadcb0629a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '.version_select at 0x7f074eaf2b80>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:22.258483 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0060dd76-085f-4360-9292-22fadcb0629a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627422161" status: 202 len: 0 microversion: 2.1 time: 0.049018 Oct 03 10:55:22.259731 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2749/5187] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627422161 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:55:22.305610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-101f3235-3319-4476-8109-bffc1091b9cc req-56575853-f213-4cec-ae87-756e31ef627c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d2546d-4e01-4ab7-89c9-23bd8ede5a59", "name": "network-vif-deleted", "tag": "77e540e9-da27-4325-abb1-8aad034bb399"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:22.334344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-101f3235-3319-4476-8109-bffc1091b9cc req-56575853-f213-4cec-ae87-756e31ef627c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:22.338328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-101f3235-3319-4476-8109-bffc1091b9cc req-56575853-f213-4cec-ae87-756e31ef627c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:22.338989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-101f3235-3319-4476-8109-bffc1091b9cc req-56575853-f213-4cec-ae87-756e31ef627c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:22.369937 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-101f3235-3319-4476-8109-bffc1091b9cc req-56575853-f213-4cec-ae87-756e31ef627c service nova] Creating event network-vif-deleted:77e540e9-da27-4325-abb1-8aad034bb399 for instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 on n-h1-858383-3 Oct 03 10:55:22.380482 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-101f3235-3319-4476-8109-bffc1091b9cc req-56575853-f213-4cec-ae87-756e31ef627c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079747 Oct 03 10:55:22.385610 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2750/5188] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:22.394863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:22.395927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:22.427380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:22.428230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:22.429545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:22.430834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:22.431616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:22.432328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:23.011079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:23.025761 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-97847879-42da-407e-88d7-7869746fe58a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1315 microversion: 2.1 time: 0.637370 Oct 03 10:55:23.027610 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2751/5189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:22 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:23.296493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:55:23.298376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:55:23.299303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:55:23.301274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:55:23.301826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:55:23.321791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:23.323420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:23.324122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:23.325457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:23.326567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:23.327176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:23.348518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:55:23.355876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for user 2a0e22aff3574cb286f2c1aa546c6c78 and project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:55:23.377546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:55:23.380011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:55:23.434477 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [a887fdda-e6f0-48e0-b74c-5b9b03201d9f] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 10:55:24.055356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:24.057686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:24.080310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:24.091417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:24.093850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:24.095319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:24.098260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:24.098859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:24.453436 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [a887fdda-e6f0-48e0-b74c-5b9b03201d9f] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41902. Oct 03 10:55:24.464559 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2fc2604f-a371-45c3-8141-db178a94ae43 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.937677 Oct 03 10:55:24.466437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2439/5190] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:55:24.484946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c60e7a70-6112-45f6-b950-d23a973ee367 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:24.487467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c60e7a70-6112-45f6-b950-d23a973ee367 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:24.630873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c60e7a70-6112-45f6-b950-d23a973ee367 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:24.639053 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c60e7a70-6112-45f6-b950-d23a973ee367 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1214 microversion: 2.1 time: 0.165451 Oct 03 10:55:24.639655 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2440/5191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:24 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:25.268897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:25.287598 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-895e3b84-f981-4f44-974c-cf681ea9248a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1315 microversion: 2.1 time: 1.238413 Oct 03 10:55:25.293971 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2752/5192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:24 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1315 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:25.664678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:25.665932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:25.696553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:25.697388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:25.698005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:25.698938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:25.699578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:25.705581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:25.852053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:25.862188 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0ea535a7-3a90-44e4-a65a-6bf06954c8a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1210 microversion: 2.1 time: 0.202726 Oct 03 10:55:25.862808 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2441/5193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:25 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1210 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:26.317804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:26.318174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:26.327661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:26.328531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:26.329309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:26.330369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:26.331084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:26.331741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:26.886158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:26.886809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:26.894591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:26.895044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:26.895483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:26.896194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:26.896843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:26.905672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:27.046535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:27.062017 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-09c95a6f-8583-4731-acbd-6040778ac303 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1272 microversion: 2.1 time: 0.178288 Oct 03 10:55:27.063711 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2442/5194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:26 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:27.126919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:27.145241 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce9af35e-8bf1-4d54-8ca1-8570ec6dbd3a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1315 microversion: 2.1 time: 0.832604 Oct 03 10:55:27.147010 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2753/5195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:26 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:27.208147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cd7df4b5-90e7-413d-975f-41ce748d9bce tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: .version_select at 0x7f074e0111f0>, body: {"keypair": {"name": "tempest-keypair-1385260952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDycMXOPCWnivMHDv3ul2x0Vw7qPKMFQiUaGHlyPmpwGbyFfdboda2B0wpHbHPb0DVqsTvAZahr8FcqjvBl2Y6JWqanyL6uZbbFkfgru64MgoCdqeAeobEfXCuFviOik0A=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:27.262133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cd7df4b5-90e7-413d-975f-41ce748d9bce tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:55:27.273562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cd7df4b5-90e7-413d-975f-41ce748d9bce tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:55:27.342347 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cd7df4b5-90e7-413d-975f-41ce748d9bce tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142786 Oct 03 10:55:27.343859 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2443/5196] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:55:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:28.089636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:28.090255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:28.106804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:28.107604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:28.108213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:28.109118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:28.109888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:28.110476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:28.177313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:28.178602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:28.219555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:28.224111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:28.224582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:28.225934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:28.226416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:28.226861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:28.624607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:28.636001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02ed31ae-2ca8-40bd-b43e-aa6fac74f8d6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1272 microversion: 2.1 time: 0.550115 Oct 03 10:55:28.637119 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2754/5197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:28 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1272 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:28.643820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b5cd4960-b124-4c9f-8f8b-4e092fdd8686 req-8f91f243-86bf-42a9-a3c9-fb49c5ff2d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6462b873-02b8-4e3e-8371-df0fde41951e", "name": "network-vif-plugged", "status": "completed", "tag": "8cb9dccd-e037-40bd-9b93-0840f9991a8a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:28.659549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b5cd4960-b124-4c9f-8f8b-4e092fdd8686 req-8f91f243-86bf-42a9-a3c9-fb49c5ff2d8f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:28.660035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b5cd4960-b124-4c9f-8f8b-4e092fdd8686 req-8f91f243-86bf-42a9-a3c9-fb49c5ff2d8f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:28.661233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b5cd4960-b124-4c9f-8f8b-4e092fdd8686 req-8f91f243-86bf-42a9-a3c9-fb49c5ff2d8f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:28.690623 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b5cd4960-b124-4c9f-8f8b-4e092fdd8686 req-8f91f243-86bf-42a9-a3c9-fb49c5ff2d8f service nova] Creating event network-vif-plugged:8cb9dccd-e037-40bd-9b93-0840f9991a8a for instance 6462b873-02b8-4e3e-8371-df0fde41951e on n-h2-858383-3 Oct 03 10:55:28.698245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b5cd4960-b124-4c9f-8f8b-4e092fdd8686 req-8f91f243-86bf-42a9-a3c9-fb49c5ff2d8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059656 Oct 03 10:55:28.699364 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2755/5198] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:29.135259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1878890009", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "77b7129c-f93b-4c9f-acd6-8c3bb9d62151"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:29.275653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:55:29.446918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:29.460059 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fbc2d3d5-c36e-462a-8fbf-aa90f32de2ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1315 microversion: 2.1 time: 1.285897 Oct 03 10:55:29.462025 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2444/5199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:28 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1315 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:29.665636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:29.666095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:29.677464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:29.677986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:29.679226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:29.679774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:29.683643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:29.684533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:30.135221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:55:30.135895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:55:30.137038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:55:30.137628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:55:30.138202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:55:30.156110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:30.156604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:30.157063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:30.157789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:30.158244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:30.158667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:30.208944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:55:30.222896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:55:30.267389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:55:30.270806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:55:30.378985 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3376119c-3cca-4bd6-8da2-f69be0f3e735 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.359562 Oct 03 10:55:30.382461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2756/5200] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:55:30.393619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a03b28c8-91e5-4886-bccf-c221b7c65da4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:30.395617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a03b28c8-91e5-4886-bccf-c221b7c65da4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:30.623999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:30.652746 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3549717-d219-47a6-9827-0d0f99d2085c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.988816 Oct 03 10:55:30.655840 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2445/5201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:29 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:30.676185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:30.679996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a03b28c8-91e5-4886-bccf-c221b7c65da4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:30.683054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:30.687583 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a03b28c8-91e5-4886-bccf-c221b7c65da4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1193 microversion: 2.1 time: 0.297990 Oct 03 10:55:30.696503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:30.697094 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2757/5202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:30 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1193 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:30.698570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:30.699207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:30.700204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:30.706585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:30.707097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:31.683469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:31.684206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:31.701058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:31.703613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:31.704293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:31.704730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:31.705638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:31.706111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:31.706562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:31.924820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:31.935569 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86a06dbf-7309-401e-a058-4d40d5139f88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1501 microversion: 2.1 time: 1.273260 Oct 03 10:55:31.936450 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2446/5203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:30 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1501 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:31.949379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:31.950284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:31.972156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:31.972671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:31.973164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:31.973908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:31.974385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:31.974822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:32.141235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:32.143964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:32.153652 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f1570ab-8359-4764-bc64-ecca9d3b3b68 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1189 microversion: 2.1 time: 0.212653 Oct 03 10:55:32.155785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2447/5204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:31 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1189 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:32.157329 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c00d001-ef2a-4c7b-8d47-7e40f25f43a8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.478339 Oct 03 10:55:32.161756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2758/5205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:31 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:32.184159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1fb5fd7c-00f8-4a84-843e-8090a5ff8f70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:32.210277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1fb5fd7c-00f8-4a84-843e-8090a5ff8f70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:32.215300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1fb5fd7c-00f8-4a84-843e-8090a5ff8f70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:32.217199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1fb5fd7c-00f8-4a84-843e-8090a5ff8f70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:32.315187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1fb5fd7c-00f8-4a84-843e-8090a5ff8f70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 10:55:32.421209 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1fb5fd7c-00f8-4a84-843e-8090a5ff8f70 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e/action" status: 202 len: 0 microversion: 2.1 time: 0.262885 Oct 03 10:55:32.428726 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2448/5206] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:55:32 2022] POST /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:55:32.432047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:32.432665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:32.442714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:32.443295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:32.448513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:32.449382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:32.457710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:32.458031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:33.193506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:33.196528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:33.221371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:33.224441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:33.227187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:33.229932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:33.238734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:33.240023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:33.340998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:34.046698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:34.061540 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-85a0c907-d5e5-48a3-b110-ad56f99bad5d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 1.631737 Oct 03 10:55:34.063749 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2759/5207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:32 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:34.078579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:34.090234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:34.093440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:34.096126 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd5aaa01-c1d3-4f1c-a5cb-35416bee3098 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.906262 Oct 03 10:55:34.109443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:34.112597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:34.113354 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2449/5208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:33 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:34.114244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:34.119195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:34.121773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:34.122474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:34.168729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9d9174c3-3b90-41f1-9a4d-4aea711d532e req-efb4966e-f68f-4823-8120-6ed4b600c873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b834cbe8-6ae7-42b7-a3df-ab8802aae6c3", "tag": "5911a896-e28e-423b-9b2c-99a636e0af21"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:34.193121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9d9174c3-3b90-41f1-9a4d-4aea711d532e req-efb4966e-f68f-4823-8120-6ed4b600c873 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:34.195645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9d9174c3-3b90-41f1-9a4d-4aea711d532e req-efb4966e-f68f-4823-8120-6ed4b600c873 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:34.199819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9d9174c3-3b90-41f1-9a4d-4aea711d532e req-efb4966e-f68f-4823-8120-6ed4b600c873 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:34.233114 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9d9174c3-3b90-41f1-9a4d-4aea711d532e req-efb4966e-f68f-4823-8120-6ed4b600c873 service nova] Creating event network-changed:5911a896-e28e-423b-9b2c-99a636e0af21 for instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 on n-h1-858383-3 Oct 03 10:55:34.240152 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9d9174c3-3b90-41f1-9a4d-4aea711d532e req-efb4966e-f68f-4823-8120-6ed4b600c873 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075414 Oct 03 10:55:34.243667 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2450/5209] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:34.312518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:34.328105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-070855a8-0939-4e39-9c80-9789dcb5a49b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1251 microversion: 2.1 time: 0.262462 Oct 03 10:55:34.343605 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2760/5210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:34 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1251 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:35.101938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:35.103071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:35.125102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:35.125765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:35.128339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:35.130744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:35.131439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:35.135213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:35.136727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:35.138218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:35.139156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:35.139793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:35.141284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:35.143354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:35.145197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:35.146663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:35.794950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:35.806398 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-051985e2-c2ec-41fb-9330-ac159d012232 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.717366 Oct 03 10:55:35.809198 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2451/5211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:35 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:35.833250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:35.834182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:35.840644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:35.841518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:35.842153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:35.843254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:35.843884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:35.844510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:36.591931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:36.609450 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d4c77a6b-2115-4915-980c-69f9960e67c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1251 microversion: 2.1 time: 0.797209 Oct 03 10:55:36.626875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2452/5212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:35 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1251 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:36.727852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:36.746762 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a9703caa-d085-40c6-a9bc-d422cd05c161 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 1.624682 Oct 03 10:55:36.756521 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2761/5213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:35 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:36.837744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:36.839753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:36.862315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:36.862708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:36.872363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:36.873191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:36.873676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:36.874111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:37.294747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:37.386207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:37.400192 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa52fd1b-524d-4ae4-8e00-3b46fc56a78e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.568147 Oct 03 10:55:37.401229 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2453/5214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:36 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:37.430526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-682475494", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89560c86-a183-4349-ab87-bdf14ea2ef6d"}], "security_groups": [{"name": "tempest-securitygroup--725870270"}], "key_name": "tempest-keypair-1385260952", "user_data": "}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:37.634234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:37.634771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:37.644020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:37.644525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:37.644985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:37.654376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:37.655127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:37.655741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:37.685542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:37.788669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] validate_networks() for [('89560c86-a183-4349-ab87-bdf14ea2ef6d', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:55:37.931130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:37.945977 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33f03750-5603-459b-8d89-84f58c4147fb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.316007 Oct 03 10:55:37.947481 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2454/5215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:37 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:37.954332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:37.955449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:37.962919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:37.963486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:37.963938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:37.964832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:37.966381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:37.969274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:38.254571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:38.269817 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a13ad052-5a7d-4cb0-918f-2ae1d2ac448f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.318415 Oct 03 10:55:38.281875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2455/5216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:37 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:38.424693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:38.425529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:38.437306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:38.437810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:38.438249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:38.438963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:38.439430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:38.439845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:38.755818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:38.767006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7051343c-31ad-452d-9dce-47d304f41605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.347196 Oct 03 10:55:38.772076 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2456/5217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:38 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:38.936367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:55:38.937437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:55:38.938107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:55:38.938689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:55:38.939278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:55:38.959854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:38.960359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:38.960819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:38.961572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:38.962028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:38.962447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:38.975897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:38.977232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:38.983374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:38.988127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:38.992482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:38.994213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:38.996195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:38.998093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:38.998844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:39.000225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:39.020378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:55:39.040205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:55:39.083891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:55:39.091024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:55:39.160793 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1f712ae-5778-454f-9580-b57e98106803 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.737116 Oct 03 10:55:39.162184 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2762/5218] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:55:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:55:39.175474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d4cdb2f-ab45-4690-8380-2a2537980ad9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:39.177272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d4cdb2f-ab45-4690-8380-2a2537980ad9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:39.525650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2d4cdb2f-ab45-4690-8380-2a2537980ad9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:39.548750 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d4cdb2f-ab45-4690-8380-2a2537980ad9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1241 microversion: 2.1 time: 0.378479 Oct 03 10:55:39.550030 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2763/5219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:39 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1241 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:39.555705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:39.561935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:39.581964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:39.582981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:39.583657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:39.585331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:39.586479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:39.588651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:39.628745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:39.643956 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e25eba89-1e50-4047-a385-1dcd3f6f73cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.673359 Oct 03 10:55:39.644882 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2457/5220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:38 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:39.795055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:39.795676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:39.813884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:39.814396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:39.814847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:39.815574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:39.816038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:39.816470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:40.177053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:40.192607 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6147eb91-6c3c-4390-8f32-1516a2b0ccc7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.639310 Oct 03 10:55:40.194218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2764/5221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:39 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:40.397057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:40.414897 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13aeb88e-239d-4181-ba4b-b873dabf8e4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.623612 Oct 03 10:55:40.430545 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2458/5222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:39 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:40.577976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:40.578809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:40.596647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:40.597183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:40.597631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:40.598514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:40.598983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:40.599416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:40.675194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:40.677022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:40.710235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:40.711629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:40.713783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:40.716135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:40.718884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:40.719988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:40.865057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:40.881752 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a2d91f1-b7df-42cb-87c6-0cc6822c4c88 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1293 microversion: 2.1 time: 0.309590 Oct 03 10:55:40.887061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2765/5223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:40 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:41.216183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:41.217074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:41.223454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:41.227870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:41.238482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:41.239985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:41.241118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:41.242161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:41.618729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:41.627817 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee299c5b-ef4e-4bc9-a0a0-4f7ce16c2952 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.415541 Oct 03 10:55:41.630962 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2766/5224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:41 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:41.638348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:41.646595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:41.675050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:41.676754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:41.677599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:41.679325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:41.679980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:41.682690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:41.833493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:41.846260 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61d75df2-bd33-47ca-bb4e-10cc8cfbe38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 1.177313 Oct 03 10:55:41.847124 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2459/5225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:40 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:41.905914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:41.906545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:41.918150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:41.918657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:41.919103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:41.919841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:41.925291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:41.925863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:42.061341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:42.068914 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59e964ec-739a-44a0-b033-9c67c5eda573 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.434200 Oct 03 10:55:42.069571 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2767/5226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:41 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:42.111873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:42.130671 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-140212d7-9d8c-4002-b636-b7a01befdeb0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1299 microversion: 2.1 time: 0.229435 Oct 03 10:55:42.134666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2460/5227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:41 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:42.658892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:42.659513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:42.674952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:42.688202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:42.691149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:42.692122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:42.695646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:42.696706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:42.830347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f320bc1a-ce24-4cee-9eb6-a924960bdf85 req-cc55ff3e-c9ac-4093-99f1-f10c498ba9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffad74d-2ed1-407e-9e59-5099546e5903", "tag": "20e8d843-7a43-4012-a632-08c63fb4810b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:42.848301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f320bc1a-ce24-4cee-9eb6-a924960bdf85 req-cc55ff3e-c9ac-4093-99f1-f10c498ba9d9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:42.849619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f320bc1a-ce24-4cee-9eb6-a924960bdf85 req-cc55ff3e-c9ac-4093-99f1-f10c498ba9d9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:42.850303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f320bc1a-ce24-4cee-9eb6-a924960bdf85 req-cc55ff3e-c9ac-4093-99f1-f10c498ba9d9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:42.865572 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f320bc1a-ce24-4cee-9eb6-a924960bdf85 req-cc55ff3e-c9ac-4093-99f1-f10c498ba9d9 service nova] Creating event network-changed:20e8d843-7a43-4012-a632-08c63fb4810b for instance 6ffad74d-2ed1-407e-9e59-5099546e5903 on n-h1-858383-3 Oct 03 10:55:42.873779 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f320bc1a-ce24-4cee-9eb6-a924960bdf85 req-cc55ff3e-c9ac-4093-99f1-f10c498ba9d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047711 Oct 03 10:55:42.874856 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2461/5228] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:42.885213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:42.885942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:42.906477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:42.907623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:42.908575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:42.909698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:42.910670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:42.912018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:43.261659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:43.282961 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3943dbc-5c71-4747-a426-1a59abd24005 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.627023 Oct 03 10:55:43.288450 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2768/5229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:42 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:43.305259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:43.306060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:43.334509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:43.337814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:43.338300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:43.339105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:43.339578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:43.340095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:43.860245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:43.885230 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6853924f-389a-4acd-ab50-b3ae5fc9618d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.593592 Oct 03 10:55:43.886917 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2769/5230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:43 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:43.939962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:43.944255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:43.964482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:43.965530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:43.966429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:43.967456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:43.968052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:43.968889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:44.062375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:44.081834 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6feab5e5-2ac3-4c3a-8c76-6da2548a6fd0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 1.205042 Oct 03 10:55:44.083796 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2462/5231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:42 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:44.094285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7bd46b01-e7a8-4db0-a5c3-73152c34d316 req-aa73bf68-fd0c-4905-b6a5-dd2eb924f7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834cbe8-6ae7-42b7-a3df-ab8802aae6c3", "name": "network-vif-plugged", "status": "completed", "tag": "5911a896-e28e-423b-9b2c-99a636e0af21"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:44.111562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7bd46b01-e7a8-4db0-a5c3-73152c34d316 req-aa73bf68-fd0c-4905-b6a5-dd2eb924f7ee service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:44.118815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7bd46b01-e7a8-4db0-a5c3-73152c34d316 req-aa73bf68-fd0c-4905-b6a5-dd2eb924f7ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:44.125832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7bd46b01-e7a8-4db0-a5c3-73152c34d316 req-aa73bf68-fd0c-4905-b6a5-dd2eb924f7ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:44.143048 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7bd46b01-e7a8-4db0-a5c3-73152c34d316 req-aa73bf68-fd0c-4905-b6a5-dd2eb924f7ee service nova] Creating event network-vif-plugged:5911a896-e28e-423b-9b2c-99a636e0af21 for instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 on n-h1-858383-3 Oct 03 10:55:44.151136 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7bd46b01-e7a8-4db0-a5c3-73152c34d316 req-aa73bf68-fd0c-4905-b6a5-dd2eb924f7ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064667 Oct 03 10:55:44.156107 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2463/5232] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:55:44.310951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:44.312201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:44.321084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:44.322294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:44.329564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:44.332103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:44.333651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:44.335104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:44.757355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:44.767011 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44333974-5b93-4085-b065-8dcd031c8f7e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.878574 Oct 03 10:55:44.768683 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2770/5233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:43 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:44.931359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:44.932989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:44.947497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:44.953030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:44.953753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:44.954714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:44.955336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:44.955935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:45.215449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:45.230838 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56c3375a-67ce-4bf5-a44f-03d0ed9ec5fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.304965 Oct 03 10:55:45.247086 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2771/5234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:44 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:45.257304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:45.258750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:45.269276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:45.272520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:45.274952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:45.294434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:45.297313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:45.302893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:45.434007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:45.451618 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef0d7ae9-6a18-489c-95dc-8e6e0394072f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 1.146763 Oct 03 10:55:45.465597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2464/5235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:44 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:45.658540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a8ff7a14-70e2-46ad-9eb9-97cc65f4aca0 req-1ceda64e-22b4-492c-a308-448d302bf488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31896970-1773-46f8-a675-13c516baaddf", "tag": "a35c13fa-232e-41df-a025-86e8d0f45e73"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:45.681964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a8ff7a14-70e2-46ad-9eb9-97cc65f4aca0 req-1ceda64e-22b4-492c-a308-448d302bf488 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:45.682267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a8ff7a14-70e2-46ad-9eb9-97cc65f4aca0 req-1ceda64e-22b4-492c-a308-448d302bf488 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:45.682707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a8ff7a14-70e2-46ad-9eb9-97cc65f4aca0 req-1ceda64e-22b4-492c-a308-448d302bf488 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:45.721178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a8ff7a14-70e2-46ad-9eb9-97cc65f4aca0 req-1ceda64e-22b4-492c-a308-448d302bf488 service nova] Creating event network-changed:a35c13fa-232e-41df-a025-86e8d0f45e73 for instance 31896970-1773-46f8-a675-13c516baaddf on n-h2-858383-3 Oct 03 10:55:45.735244 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a8ff7a14-70e2-46ad-9eb9-97cc65f4aca0 req-1ceda64e-22b4-492c-a308-448d302bf488 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080284 Oct 03 10:55:45.737001 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2465/5236] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:45.792800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:45.794487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:45.804566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:45.805505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:45.806253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:45.807488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:45.808907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:45.809586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:46.080372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:46.090742 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4799fae-5d38-499a-be44-720c252b0be6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.843591 Oct 03 10:55:46.091352 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2772/5237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:45 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:46.255814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:46.257964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:46.267143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:46.268393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:46.269761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:46.271087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:46.271737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:46.272608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:46.301332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:46.319137 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1c969f2b-b625-4252-b607-560bdeef7210 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.528117 Oct 03 10:55:46.322166 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2466/5238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:45 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:46.486155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:46.486772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:46.533742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:46.534439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:46.534914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:46.535692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:46.536518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:46.541946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:46.685148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:46.699798 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa560754-5eca-4adf-b885-289b3860dcb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.448783 Oct 03 10:55:46.706178 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2773/5239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:46 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:46.998992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:47.017953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-690d8092-fa67-4ea5-8460-b39d71231bcb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.543537 Oct 03 10:55:47.019052 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2467/5240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:46 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:47.120491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:47.122036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:47.128908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:47.129711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:47.130229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:47.132251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:47.132996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:47.133668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:47.348805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:47.349423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:47.355682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:47.356439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:47.357071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:47.357973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:47.358425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:47.359253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:47.369973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:47.379915 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-de566518-57de-4e69-9678-595fcaa652a4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.264872 Oct 03 10:55:47.400461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2774/5241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:47 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:47.732807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:47.735321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:47.736050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:47.745268 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-807f7f65-e1b5-49f7-a59c-291abb9e4e17 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.400316 Oct 03 10:55:47.746353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:47.746875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2468/5242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:47 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:47.749641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:47.750303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:47.751748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:47.752286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:47.752995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:48.003165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:48.015617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c56de68-cf53-47b0-8827-b85eac888c62 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.284127 Oct 03 10:55:48.017249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2775/5243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:47 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:48.044229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:48.045398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:48.054528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:48.055501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:48.056215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:48.057396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:48.058539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:48.059238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:48.407201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:48.407794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:48.421724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:48.422251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:48.432272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:48.442073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:48.442908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:48.449023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:48.585294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:48.600362 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52f6c0c9-ff62-4d13-ad24-e261969c3981 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1314 microversion: 2.1 time: 0.559213 Oct 03 10:55:48.603008 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2469/5244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:48 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:48.778078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:48.780084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:48.787701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:48.789226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:48.789900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:48.790811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:48.791583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:48.792346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:48.905540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:48.918464 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7e424f6c-d95e-44c6-ad9a-0a264028f837 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.515395 Oct 03 10:55:48.932802 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2776/5245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:48 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:49.044743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:49.045700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:49.052025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:49.054569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:49.055277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:49.055977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:49.056943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:49.057584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:49.058188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:49.350842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:49.362363 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-15245a09-7fa5-4fc8-8995-763f68825e61 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.595330 Oct 03 10:55:49.362969 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2470/5246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:48 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:49.534962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=16 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:49.629922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:49.630868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:49.639546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:49.646766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:49.648149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:49.649148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:49.651194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:49.652914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:49.827338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:49.837815 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48f43baa-3c5c-46c0-9267-010de4058bf7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.796855 Oct 03 10:55:49.838857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2777/5247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:49 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:49.965285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:49.965285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:49.975565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:49.976481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:49.977623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:49.978910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:49.979537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:49.980128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:50.165131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:50.183376 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ade48bd-3cb7-489a-8438-43de249f66fb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1502 microversion: 2.1 time: 0.556472 Oct 03 10:55:50.185163 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2471/5248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:49 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1502 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:50.393719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:50.396678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:50.409701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:50.411686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:50.413743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:50.415490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:50.416255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:50.417902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:50.471557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:50.486739 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-73b2f036-0cd7-4d3a-834d-5968c7467628 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.531808 Oct 03 10:55:50.493089 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2778/5249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:49 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:50.862678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:50.863568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:50.884248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:50.885113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:50.885798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:50.889228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:50.891110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:50.891816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:50.951425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:50.960067 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-596025c2-1b06-4e5b-a04c-47f21d6db20f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.572458 Oct 03 10:55:50.963669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2472/5250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:50 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:51.512342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:51.516850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:51.537949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:51.538442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:51.538893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:51.539625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:51.540083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:51.540507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:51.543947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:51.651763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:51.675042 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e687b8e7-6db4-4546-8890-2b26e3da70f7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.816579 Oct 03 10:55:51.675686 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2779/5251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:50 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:51.987821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:51.988420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:52.001388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:52.003379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:52.003838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:52.004749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:52.008283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:52.011744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:52.057209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:55:52.142468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:52.159275 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb5f20d0-dfd7-43b4-aa4e-aec582e3e06e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.650867 Oct 03 10:55:52.161758 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2473/5252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:51 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:52.503228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:52.514954 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53095f2a-937e-42af-9cca-d0bba249b713 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.531071 Oct 03 10:55:52.515988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2780/5253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:51 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:52.703264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:52.705457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:52.714895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:52.715822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:52.716605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:52.718553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:52.719504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:52.720280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:53.116321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:53.125219 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8bb48722-5016-4418-8515-24a6f0019965 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.426091 Oct 03 10:55:53.125815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2474/5254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:52 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:53.189777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:53.190579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:53.205310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:53.205927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:53.207589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:53.210236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:53.211505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:53.213676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:53.329084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c09b66ff-6279-4d2c-aade-762987b6aef3"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:53.331503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:53.345068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:53.346074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:53.346732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:53.347717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:53.348433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:53.349141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:53.617908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:53.632101 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fbd25b7e-facd-4d37-b00d-e7c79f94ba84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.448222 Oct 03 10:55:53.634612 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2781/5255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:53 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:53.639755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:53.640650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:53.650979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:53.651768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:53.652402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:53.653510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:53.654129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:53.654909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:53.957785 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4dc872c-4aaa-48a8-9302-6dfc88718aa1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632978 Oct 03 10:55:53.960028 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2475/5256] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:55:53 2022] POST /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:54.085327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f99b5fba-56f3-4720-a803-e49d6ae64d95 req-2b29e739-1bfe-4c90-983d-e2cedb4e8016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffad74d-2ed1-407e-9e59-5099546e5903", "name": "network-vif-plugged", "status": "completed", "tag": "20e8d843-7a43-4012-a632-08c63fb4810b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:54.125044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f99b5fba-56f3-4720-a803-e49d6ae64d95 req-2b29e739-1bfe-4c90-983d-e2cedb4e8016 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:54.125547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f99b5fba-56f3-4720-a803-e49d6ae64d95 req-2b29e739-1bfe-4c90-983d-e2cedb4e8016 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:54.128669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f99b5fba-56f3-4720-a803-e49d6ae64d95 req-2b29e739-1bfe-4c90-983d-e2cedb4e8016 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:54.141324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:54.161425 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0a79563-1368-451e-871f-d11f2b39d966 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.521767 Oct 03 10:55:54.162534 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2782/5257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:53 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:54.171708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:54.173398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:54.180909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:54.181788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:54.182809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:54.189806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:54.198480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:54.199401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:54.200217 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f99b5fba-56f3-4720-a803-e49d6ae64d95 req-2b29e739-1bfe-4c90-983d-e2cedb4e8016 service nova] Creating event network-vif-plugged:20e8d843-7a43-4012-a632-08c63fb4810b for instance 6ffad74d-2ed1-407e-9e59-5099546e5903 on n-h1-858383-3 Oct 03 10:55:54.213984 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f99b5fba-56f3-4720-a803-e49d6ae64d95 req-2b29e739-1bfe-4c90-983d-e2cedb4e8016 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138461 Oct 03 10:55:54.218493 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2476/5258] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:54.659432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:54.660646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:54.682965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:54.683801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:54.684280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:54.685689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:54.686429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:54.686865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:54.753983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:54.762823 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9efb6bd-81dd-44d9-9ae4-dc0b769e0563 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.595584 Oct 03 10:55:54.777619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2783/5259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:54 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:55.072028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:55.082946 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1bd438a0-260f-4dc8-8e55-3ce89f9aecd3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1293 microversion: 2.1 time: 0.429480 Oct 03 10:55:55.098815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2477/5260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:54 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1293 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:55.192761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:55.194212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:55.204160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:55.205576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:55.206443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:55.207381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:55.208279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:55.208933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:55.750185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:55.765418 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77a84b94-d85f-42fe-bb62-d98c2f43f980 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.577053 Oct 03 10:55:55.769707 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2784/5261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:55 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:55.810404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:55.812022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:55.829571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:55.833091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:55.835981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:55.838081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:55.842208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:55.844715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:56.110085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:56.111229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:56.128677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:56.134370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:56.135428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:56.139147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:56.140063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:56.141790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:56.421570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:56.443466 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bce3ca47-f9bd-492a-b2a9-f6152b11a018 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.646651 Oct 03 10:55:56.459716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2478/5262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:55 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:56.482615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-016ffe64-b7c6-4a39-9fee-dc8fa9d8fe5a req-4b181b44-04f8-4cb2-b26f-cd833da67770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31896970-1773-46f8-a675-13c516baaddf", "name": "network-vif-plugged", "status": "completed", "tag": "a35c13fa-232e-41df-a025-86e8d0f45e73"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:56.531426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-016ffe64-b7c6-4a39-9fee-dc8fa9d8fe5a req-4b181b44-04f8-4cb2-b26f-cd833da67770 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:56.532141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-016ffe64-b7c6-4a39-9fee-dc8fa9d8fe5a req-4b181b44-04f8-4cb2-b26f-cd833da67770 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:56.533749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-016ffe64-b7c6-4a39-9fee-dc8fa9d8fe5a req-4b181b44-04f8-4cb2-b26f-cd833da67770 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:56.549597 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-016ffe64-b7c6-4a39-9fee-dc8fa9d8fe5a req-4b181b44-04f8-4cb2-b26f-cd833da67770 service nova] Creating event network-vif-plugged:a35c13fa-232e-41df-a025-86e8d0f45e73 for instance 31896970-1773-46f8-a675-13c516baaddf on n-h2-858383-3 Oct 03 10:55:56.557110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-016ffe64-b7c6-4a39-9fee-dc8fa9d8fe5a req-4b181b44-04f8-4cb2-b26f-cd833da67770 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082963 Oct 03 10:55:56.557976 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2479/5263] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:55:56.810757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:56.811741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:56.830820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:56.833186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:56.833701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:56.838165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:56.838675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:56.839128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:57.282713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:57.300189 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a0fc1f3-d900-40ab-b7a8-bcea71c50f84 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.502061 Oct 03 10:55:57.302105 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2480/5264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:56 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:57.469191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:57.470181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:57.490608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:57.492217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:57.492868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:57.495141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:57.497116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:57.497682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:57.667837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:57.678398 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f14afad-5563-4602-a21a-702cda79f31a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1511 microversion: 2.1 time: 0.214425 Oct 03 10:55:57.679586 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2481/5265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:57 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:57.793632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:57.831893 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30305892-65ad-41de-8538-637c1001bf59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1475 microversion: 2.1 time: 1.726201 Oct 03 10:55:57.838792 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2785/5266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:56 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1475 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:55:58.017179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-527600171", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:55:58.122312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:55:58.331150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:58.331784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:58.354513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:58.355020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:58.355459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:58.356277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:58.356859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:58.357497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:58.905870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:55:58.907128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:55:58.908127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:55:58.908923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:55:58.909574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:55:58.933743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:58.934388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:58.934842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:58.935599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:58.936066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:58.936561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:58.941254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:55:58.951461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-92f68de1-93ce-4ab7-a468-1ee2b4f5ac14 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1366 microversion: 2.1 time: 0.625635 Oct 03 10:55:58.952211 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2786/5267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:58 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:55:58.971714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:55:58.981157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:58.981400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:55:58.983334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:59.002179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:59.003324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:59.004612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:59.007610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:55:59.008165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:55:59.010972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:55:59.021580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:55:59.025122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 21f76788-edcd-46ca-91c9-1b167c52d40c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:55:59.093081 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c01b46e2-c58d-462e-b72e-4b1c709da2ac tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082550 Oct 03 10:55:59.099773 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2482/5268] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:55:59.112474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9f74a66-9577-4204-b5b5-a9d304e9ca31 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:59.113343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9f74a66-9577-4204-b5b5-a9d304e9ca31 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 21f76788-edcd-46ca-91c9-1b167c52d40c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:59.153247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9f74a66-9577-4204-b5b5-a9d304e9ca31 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 21f76788-edcd-46ca-91c9-1b167c52d40c] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:55:59.763571 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9f74a66-9577-4204-b5b5-a9d304e9ca31 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c" status: 204 len: 0 microversion: 2.1 time: 0.661223 Oct 03 10:55:59.766999 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2483/5269] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:55:59 2022] DELETE /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:55:59.788918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dec26342-58e3-4cf0-bde1-a6c5390bdbec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:55:59.793264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dec26342-58e3-4cf0-bde1-a6c5390bdbec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 21f76788-edcd-46ca-91c9-1b167c52d40c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:55:59.847105 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-dec26342-58e3-4cf0-bde1-a6c5390bdbec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dec26342-58e3-4cf0-bde1-a6c5390bdbec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c HTTP/1.1 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '21f76788-edcd-46ca-91c9-1b167c52d40c'} Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 21f76788-edcd-46ca-91c9-1b167c52d40c Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:55:59.856846 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dec26342-58e3-4cf0-bde1-a6c5390bdbec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dec26342-58e3-4cf0-bde1-a6c5390bdbec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c" status: 404 len: 111 microversion: 2.1 time: 0.084920 Oct 03 10:55:59.873058 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2484/5270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:59 2022] GET /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:55:59.937233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1975592294", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "77b7129c-f93b-4c9f-acd6-8c3bb9d62151"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:00.058584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:56:00.140978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:00.160014 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1bd963e8-0589-44fa-9c0f-0c326d58e7f5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1488 microversion: 2.1 time: 1.193396 Oct 03 10:56:00.160939 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2787/5271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:55:58 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1488 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:00.183661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:00.184510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:00.191122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:00.191840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:00.192440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:00.194386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:00.195126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:00.195752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:00.725716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:00.752759 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-01f6cac5-f634-4f5d-86ee-6ce1460fc11e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1556 microversion: 2.1 time: 0.572223 Oct 03 10:56:00.754714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2788/5272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:00 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1556 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:00.765503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:00.770564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:00.781382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:00.782395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:00.784852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:00.785850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:00.786861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:00.787690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:00.896793 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac5ef9ca-e796-417f-a598-1afa8a5884e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 200 len: 134 microversion: 2.1 time: 0.140029 Oct 03 10:56:00.903185 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2789/5273] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:00 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 134 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:00.910705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:00.915553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:00.937977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:00.938762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:00.939384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:00.940309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:00.946111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:00.946878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:01.256176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:56:01.257688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:56:01.258395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:56:01.259060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:56:01.259724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:56:01.274177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:01.278133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:01.278887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:01.280078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:01.280859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:01.282654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:01.327231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:01.336265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:01.382466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:56:01.391012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:56:01.426936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:01.529578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-557515be-49b5-4de0-bca1-95892d610045 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.623373 Oct 03 10:56:01.530178 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2790/5274] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:56:00 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-interface => generated 284 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:01.537589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:01.537589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:01.574333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:01.574834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:01.575340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:01.581042 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-77d1aa81-4495-4714-ba69-74120c603dcf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634347 Oct 03 10:56:01.588484 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2485/5275] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:56:01.609183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:01.609785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:01.610241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:01.620801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2887925-6fa4-40de-9f54-4ad2f3d9c10b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:01.625475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2887925-6fa4-40de-9f54-4ad2f3d9c10b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:01.931384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a2887925-6fa4-40de-9f54-4ad2f3d9c10b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:01.946064 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2887925-6fa4-40de-9f54-4ad2f3d9c10b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1221 microversion: 2.1 time: 0.350672 Oct 03 10:56:01.946928 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2486/5276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:01 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1221 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:02.448835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:02.462440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ee9a94d-5ea3-4f97-892c-77c9b8370aef tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.931201 Oct 03 10:56:02.463033 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2791/5277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:01 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:02.498066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:02.498809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:02.509084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:02.516667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:02.518846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:02.519931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:02.523555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:02.524237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:02.972561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:02.973469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:02.978168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:02.982654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:02.996006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:02.996630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:02.997691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:02.999060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:03.001041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:03.005884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:03.020579 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b04e26f9-4fe1-4531-9932-369852edbce5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.525225 Oct 03 10:56:03.021823 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2487/5278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:02 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:03.048388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:03.049562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:03.067581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:03.073807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:03.074490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:03.078591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:03.079650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:03.082396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:03.282929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:03.294014 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-857cc9b4-febf-48cc-9415-3589391b0af3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1273 microversion: 2.1 time: 0.325326 Oct 03 10:56:03.314430 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2792/5279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:02 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:03.443069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:03.455400 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ecd5655-68aa-4075-87a2-db76828bd833 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.411968 Oct 03 10:56:03.456000 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2488/5280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:03 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:03.484290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:03.485366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:03.531238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:03.532740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:03.538664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:03.541808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:03.543995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:03.546564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:04.322626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:04.324030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:04.339518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:04.340592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:04.341404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:04.342347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:04.343009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:04.343636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:04.452339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:04.460805 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54a9e73d-b3e0-4705-a1de-f97d385b89d6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.980590 Oct 03 10:56:04.469519 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2793/5281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:03 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:04.752523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1079136484", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "9dbf8c82-dfae-4d56-9442-6e6c67d23560"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:04.833863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] validate_networks() for [('9dbf8c82-dfae-4d56-9442-6e6c67d23560', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:56:05.003535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:05.023272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d954172-f117-46e4-ae34-2be5044de51b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1279 microversion: 2.1 time: 0.702349 Oct 03 10:56:05.032853 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2489/5282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:04 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1279 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:05.938528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:56:05.939520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:56:05.940189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:56:05.940789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:56:05.941470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:56:05.952927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:05.953682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:05.954321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:05.955220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:05.955844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:05.956434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:05.979671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:05.989428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for user e3857d14b6f6498c87700ea6ee22c4a6 and project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:06.005679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:56:06.009797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:56:06.054090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:06.056248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:06.064678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:06.065438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:06.066047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:06.066934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:06.067556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:06.068276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:06.120943 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e578c757-8ec6-49e6-ad40-c77eeb44ef66 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.369292 Oct 03 10:56:06.131799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2794/5283] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:56:06.139401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a0129f7c-d0d6-40be-a465-6f94e3aeef94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:06.140154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a0129f7c-d0d6-40be-a465-6f94e3aeef94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:06.224722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a0129f7c-d0d6-40be-a465-6f94e3aeef94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:06.234439 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a0129f7c-d0d6-40be-a465-6f94e3aeef94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1215 microversion: 2.1 time: 0.099907 Oct 03 10:56:06.251999 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2795/5284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:06 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:06.306835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:06.345166 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78dcd4ee-4167-4d76-b356-b2b758ea3efe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1279 microversion: 2.1 time: 0.297373 Oct 03 10:56:06.346547 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2490/5285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:06 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:06.851842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4b2a3e86-af9f-420d-9c6d-823d35f4eada req-f6e857b9-88eb-4240-83af-d2131f428648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31896970-1773-46f8-a675-13c516baaddf", "tag": "a35c13fa-232e-41df-a025-86e8d0f45e73"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:06.875327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4b2a3e86-af9f-420d-9c6d-823d35f4eada req-f6e857b9-88eb-4240-83af-d2131f428648 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:06.875893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4b2a3e86-af9f-420d-9c6d-823d35f4eada req-f6e857b9-88eb-4240-83af-d2131f428648 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:06.876351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4b2a3e86-af9f-420d-9c6d-823d35f4eada req-f6e857b9-88eb-4240-83af-d2131f428648 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:06.927760 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4b2a3e86-af9f-420d-9c6d-823d35f4eada req-f6e857b9-88eb-4240-83af-d2131f428648 service nova] Creating event network-changed:a35c13fa-232e-41df-a025-86e8d0f45e73 for instance 31896970-1773-46f8-a675-13c516baaddf on n-h2-858383-3 Oct 03 10:56:06.944461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4b2a3e86-af9f-420d-9c6d-823d35f4eada req-f6e857b9-88eb-4240-83af-d2131f428648 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345871 Oct 03 10:56:06.953753 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2796/5286] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:07.261679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:07.263086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:07.289640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:07.291776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:07.292509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:07.303155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:07.305307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:07.305783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:07.373661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:07.374681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:07.400864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:07.403570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:07.409304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:07.412054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:07.413509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:07.416313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:07.523900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:07.540193 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01c7ed07-62a8-4632-8fb0-2e77971f0054 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1211 microversion: 2.1 time: 0.283739 Oct 03 10:56:07.542532 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2491/5287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:07 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1211 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:08.265951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:08.283824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f70b0a61-7db6-405b-9224-7c744ceedca8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.914661 Oct 03 10:56:08.297042 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2797/5288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:07 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:08.567976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:08.568602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:08.587981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:08.588576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:08.589159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:08.590515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:08.591376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:08.601121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:08.763696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:08.777707 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-340ec535-e7c2-43f0-80b4-94bf673cf359 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1285 microversion: 2.1 time: 0.213893 Oct 03 10:56:08.780997 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2492/5289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:08 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:09.310039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:09.311330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:09.322251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:09.341818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:09.344468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:09.347738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:09.353513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:09.356376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:09.810757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:09.811402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:09.825869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:09.830791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:09.831918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:09.832938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:09.838746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:09.839475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:09.879913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:09.902856 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-559be7be-1a3a-4df3-9c56-45ec2c37ce1c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.596497 Oct 03 10:56:09.905415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2798/5290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:09 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:09.917713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:09.951965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f3fbdf3a-968c-42ce-bc95-d9aaba8faa46 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1273 microversion: 2.1 time: 0.145558 Oct 03 10:56:09.952149 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2493/5291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:09 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:10.243889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:10.246763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:10.258792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:10.262233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:10.262901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:10.263902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:10.264615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:10.266293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:10.354457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:56:10.404450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:10.566908 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fa784a63-bc83-42b0-bd50-32a5b020f3c6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 204 len: 0 microversion: 2.1 time: 0.326694 Oct 03 10:56:10.568053 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2799/5292] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:56:10 2022] DELETE /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:56:10.577790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:10.578753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:10.593660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:10.593660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:10.594264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:10.595008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:10.595474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:10.595910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:10.628579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:10.938993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:10.940581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:10.956056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:10.959063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:10.969122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:10.980872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:10.981711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:10.982450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:11.305397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:11.575221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:11.598792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c8c035b-a5bc-4b48-a64e-1246f2d56693 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1554 microversion: 2.1 time: 1.025041 Oct 03 10:56:11.599435 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2494/5293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:10 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1554 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:11.625721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:11.640402 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f44a620-9871-4ef4-a4cf-0f5e3193e50b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.713504 Oct 03 10:56:11.641308 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2800/5294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:10 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:11.641435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:11.646964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:11.664627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:11.665656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:11.667028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:11.668293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:11.668982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:11.669980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:11.935700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=16 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:12.182796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:12.191347 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4065b15c-88b0-4ceb-bee6-58e8309395cd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.572113 Oct 03 10:56:12.199673 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2495/5295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:11 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:12.482558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c244e263-4973-4733-bd99-b522dd5e67df req-20bf63d5-7319-4805-a365-d8b0dff7a949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff34bdae-40f6-4351-89c7-5a132ce2506b", "tag": "cc1601f8-0ba7-4302-85ca-ed48c74cfcb1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:12.499731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c244e263-4973-4733-bd99-b522dd5e67df req-20bf63d5-7319-4805-a365-d8b0dff7a949 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:12.501324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c244e263-4973-4733-bd99-b522dd5e67df req-20bf63d5-7319-4805-a365-d8b0dff7a949 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:12.502313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c244e263-4973-4733-bd99-b522dd5e67df req-20bf63d5-7319-4805-a365-d8b0dff7a949 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:12.528964 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c244e263-4973-4733-bd99-b522dd5e67df req-20bf63d5-7319-4805-a365-d8b0dff7a949 service nova] Creating event network-changed:cc1601f8-0ba7-4302-85ca-ed48c74cfcb1 for instance ff34bdae-40f6-4351-89c7-5a132ce2506b on n-h1-858383-3 Oct 03 10:56:12.542402 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c244e263-4973-4733-bd99-b522dd5e67df req-20bf63d5-7319-4805-a365-d8b0dff7a949 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063348 Oct 03 10:56:12.547855 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2801/5296] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:12.645058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:12.646694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:12.661961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:12.664093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:12.666158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:12.667243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:12.667999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:12.668679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:12.675092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:12.676504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:12.690113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:12.696267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:12.697124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:12.698201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:12.698899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:12.699548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:13.243387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:13.262326 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-027a8d92-5cd0-44ff-b6f9-a96087ab59f6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.591636 Oct 03 10:56:13.262932 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2802/5297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:12 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:13.281130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:13.283961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:13.302384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:13.304091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:13.304446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:13.305268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:13.305889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:13.306334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:13.494312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:13.506553 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c382a33-fe05-4698-b97e-d3e4b493580e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1554 microversion: 2.1 time: 0.876838 Oct 03 10:56:13.507369 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2496/5298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:12 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1554 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:13.794573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:13.805350 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0be79099-8229-4bd7-a5df-2fe488bcdf76 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.538567 Oct 03 10:56:13.812886 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2803/5299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:13 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:14.293160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:14.297022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:14.333726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:14.338158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:14.340558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:14.342935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:14.346560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:14.350187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:14.536330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:14.537349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:14.549949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:14.550767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:14.551396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:14.552509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:14.553947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:14.554560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:14.912907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:14.930447 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14da5c67-b670-40f1-87bd-40d5f13447f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1554 microversion: 2.1 time: 0.399217 Oct 03 10:56:14.931920 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2804/5300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:14 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1554 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:14.942586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:14.950522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:14.958418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:14.959071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:14.960420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:14.961303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:14.961881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:14.962422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:15.484988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:15.487761 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a93fbda7-5fc5-4032-a90a-a6f9d12a4c3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.550627 Oct 03 10:56:15.488730 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2805/5301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:14 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:15.959346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:15.960170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:15.972645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:15.989249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:15.997583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:15.998404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:15.999436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:16.000158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:16.000898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:16.187122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:16.204513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-021200c4-34bf-4acb-979c-45d9d7b6303e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1512 microversion: 2.1 time: 0.245714 Oct 03 10:56:16.205886 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2806/5302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:15 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:16.279820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-db7cf2a4-f258-443f-97b0-3c15de4a9c3e req-9c314e1e-b04e-45c2-9408-28e4169e2e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b834cbe8-6ae7-42b7-a3df-ab8802aae6c3", "name": "network-vif-deleted", "tag": "5911a896-e28e-423b-9b2c-99a636e0af21"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:16.296020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:16.310407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-db7cf2a4-f258-443f-97b0-3c15de4a9c3e req-9c314e1e-b04e-45c2-9408-28e4169e2e01 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:16.315101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-db7cf2a4-f258-443f-97b0-3c15de4a9c3e req-9c314e1e-b04e-45c2-9408-28e4169e2e01 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:16.315667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-db7cf2a4-f258-443f-97b0-3c15de4a9c3e req-9c314e1e-b04e-45c2-9408-28e4169e2e01 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:16.341533 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-db7cf2a4-f258-443f-97b0-3c15de4a9c3e req-9c314e1e-b04e-45c2-9408-28e4169e2e01 service nova] Creating event network-vif-deleted:5911a896-e28e-423b-9b2c-99a636e0af21 for instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 on n-h1-858383-3 Oct 03 10:56:16.353760 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-db7cf2a4-f258-443f-97b0-3c15de4a9c3e req-9c314e1e-b04e-45c2-9408-28e4169e2e01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078501 Oct 03 10:56:16.354726 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2807/5303] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:56:16.513372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:16.514086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:16.524206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:16.525860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:16.526303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:16.528472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:16.530420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:16.531111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:16.661149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:16.674342 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29ed5e95-ad50-470c-b42f-e4d8e5984155 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 2.388582 Oct 03 10:56:16.678933 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2497/5304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:14 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:17.232062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:17.232911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:17.246094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:17.246915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:17.247573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:17.250128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:17.250526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:17.250976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:17.267142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:17.277661 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d09ec0a2-566c-4e72-ae17-a0e64bca6108 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.768759 Oct 03 10:56:17.282303 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2808/5305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:16 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:17.517305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:17.529514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-84a3ff78-2e0a-4712-bd28-99a873685d18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1345 microversion: 2.1 time: 0.303188 Oct 03 10:56:17.530119 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2498/5306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:17 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1345 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:17.705752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:17.711374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:17.732316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:17.733172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:17.733786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:17.734998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:17.736587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:17.737072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:17.996901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:18.012350 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e26089f8-8721-4b52-b963-d8a77c952351 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.310346 Oct 03 10:56:18.012983 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2809/5307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:17 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:18.308484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:18.309397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:18.327716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:18.328377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:18.333006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:18.334097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:18.334991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:18.336199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:18.429818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5aa73a14-70c6-4644-9f2c-e1d596eeb52b req-96276684-9712-4699-aaa2-70ddc94021e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90db67a2-ae59-47d0-a5ec-688229b0629d", "tag": "a45a2555-ffb9-4d54-90f2-4d8db5c83405"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:18.456909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5aa73a14-70c6-4644-9f2c-e1d596eeb52b req-96276684-9712-4699-aaa2-70ddc94021e5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:18.457396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5aa73a14-70c6-4644-9f2c-e1d596eeb52b req-96276684-9712-4699-aaa2-70ddc94021e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:18.457828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5aa73a14-70c6-4644-9f2c-e1d596eeb52b req-96276684-9712-4699-aaa2-70ddc94021e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:18.493236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5aa73a14-70c6-4644-9f2c-e1d596eeb52b req-96276684-9712-4699-aaa2-70ddc94021e5 service nova] Creating event network-changed:a45a2555-ffb9-4d54-90f2-4d8db5c83405 for instance 90db67a2-ae59-47d0-a5ec-688229b0629d on n-h2-858383-3 Oct 03 10:56:18.505553 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5aa73a14-70c6-4644-9f2c-e1d596eeb52b req-96276684-9712-4699-aaa2-70ddc94021e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079992 Oct 03 10:56:18.510773 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2810/5308] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:56:18.558914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:18.559940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:18.575102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:18.576009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:18.576727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:18.577736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:18.578452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:18.579154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:18.972502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:18.988263 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b07ca38d-8088-41a0-9b09-d62dc0c561d1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1345 microversion: 2.1 time: 0.434145 Oct 03 10:56:19.001999 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2811/5309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:18 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1345 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:19.041261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:19.042157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:19.054903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:19.055715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:19.056358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:19.057290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:19.059322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:19.059968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:19.163206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:19.182211 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0693ad4b-db8d-43ff-b7ea-20a43057e2c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.878810 Oct 03 10:56:19.197245 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2499/5310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:18 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:19.468630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:19.482804 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-94dbb015-cdfb-4021-8212-982a2cb535c5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.447044 Oct 03 10:56:19.485096 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2812/5311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:19 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:20.016650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:20.017539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:20.029198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:20.030169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:20.030841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:20.035867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:20.037338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:20.039839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:20.210215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:20.210823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:20.219291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:20.220195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:20.220896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:20.222108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:20.222788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:20.223385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:20.348133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:20.369808 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-49d08097-646d-4f37-93e9-02f9b4039c23 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1345 microversion: 2.1 time: 0.359272 Oct 03 10:56:20.376872 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2500/5312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:20 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1345 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:20.506819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:20.507705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:20.529249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:20.530201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:20.530865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:20.531795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:20.532431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:20.533063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:20.582334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:20.594223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-130b51b2-0161-4261-bdb6-2f277dae49ea tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.386240 Oct 03 10:56:20.595577 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2813/5313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:20 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:21.397810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:21.398473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:21.409974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:21.410510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:21.411116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:21.411769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:21.415974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:21.416652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:21.554259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:21.587898 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6571aef2-a4b8-4415-98ee-f3297985ebe9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1345 microversion: 2.1 time: 0.193772 Oct 03 10:56:21.588985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2814/5314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:21 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:21.601563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:21.612743 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae9020d0-6929-48ad-b2a5-dca85e4c34f5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 1.110510 Oct 03 10:56:21.622202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:21.622986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:21.629279 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2501/5315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:20 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:21.630111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:21.630614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:21.631071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:21.632351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:21.632850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:21.633283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:21.935581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:21.954355 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4255bd94-69b1-4a7c-ba4c-136286c61055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.335807 Oct 03 10:56:21.957517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2815/5316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:21 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:22.612419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:22.613370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:22.629359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:22.629908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:22.631901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:22.633819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:22.634964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:22.636189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:22.636732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:22.637238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:22.655425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:22.655939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:22.657419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:22.659452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:22.659940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:22.661649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:22.821044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:22.833483 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e18be15a-7806-4cd3-8664-0caa78550903 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1345 microversion: 2.1 time: 0.226119 Oct 03 10:56:22.851568 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2502/5317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:22 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1345 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:22.983011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:22.983623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:22.996729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:22.997629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:22.998300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:22.999283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:22.999994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:23.000656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:23.110333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:23.129347 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10638f51-9d54-4ec0-a487-118aa87d78e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.497505 Oct 03 10:56:23.129945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2816/5318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:22 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:23.512506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:23.534073 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca74c1ff-56ae-4d4a-a2ad-7e459a64dcb8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.555859 Oct 03 10:56:23.544809 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2503/5319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:22 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:23.669634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b4939f2a-3b22-4a64-b4b5-6ff72ef54954 req-2a52f501-db7b-465b-b1b5-c5b573395874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff34bdae-40f6-4351-89c7-5a132ce2506b", "name": "network-vif-plugged", "status": "completed", "tag": "cc1601f8-0ba7-4302-85ca-ed48c74cfcb1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:23.688535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b4939f2a-3b22-4a64-b4b5-6ff72ef54954 req-2a52f501-db7b-465b-b1b5-c5b573395874 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:23.690086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b4939f2a-3b22-4a64-b4b5-6ff72ef54954 req-2a52f501-db7b-465b-b1b5-c5b573395874 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:23.690824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b4939f2a-3b22-4a64-b4b5-6ff72ef54954 req-2a52f501-db7b-465b-b1b5-c5b573395874 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:23.711105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:23.736157 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b4939f2a-3b22-4a64-b4b5-6ff72ef54954 req-2a52f501-db7b-465b-b1b5-c5b573395874 service nova] Creating event network-vif-plugged:cc1601f8-0ba7-4302-85ca-ed48c74cfcb1 for instance ff34bdae-40f6-4351-89c7-5a132ce2506b on n-h1-858383-3 Oct 03 10:56:23.746937 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b4939f2a-3b22-4a64-b4b5-6ff72ef54954 req-2a52f501-db7b-465b-b1b5-c5b573395874 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080429 Oct 03 10:56:23.751732 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2817/5320] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:23.862318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:23.863044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:23.890462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:23.891773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:23.903544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:23.904940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:23.907356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:23.907835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:24.024622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:24.025151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:24.025602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:24.026069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'fault' on Instance uuid b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:56:24.155232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:24.156482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:24.166377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:24.167229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:24.167954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:24.168985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:24.169648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:24.170277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:24.242370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:24.254722 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71142588-45ab-45ab-82b1-7500e01caa99 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 200 len: 1350 microversion: 2.1 time: 0.397873 Oct 03 10:56:24.256094 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2504/5321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:23 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 1350 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:24.505624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:24.545200 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1752024-3765-49b7-b086-4527f4bdbb55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.395032 Oct 03 10:56:24.547151 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2818/5322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:24 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:24.576344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:24.578021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:24.596836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:24.598941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:24.599674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:24.600686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:24.602352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:24.603235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.096584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:25.112590 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a0fb17e-5b3a-4e25-997a-0baa11737f29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.554290 Oct 03 10:56:25.141666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2505/5323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:24 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:25.280599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:25.281140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:25.290672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:25.291165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:25.291610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.292310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:25.292807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:25.293223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.317335 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 HTTP/1.1 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'b834cbe8-6ae7-42b7-a3df-ab8802aae6c3'} Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:25.319583 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.325111 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:25.325111 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:25.325111 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:25.325111 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:56:25.325111 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:56:25.325111 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.325111 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.326617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:56:25.327664 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09c08416-a888-4003-96ba-8cb3deacedd9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 404 len: 111 microversion: 2.1 time: 0.052759 Oct 03 10:56:25.331218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2819/5324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:25 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:56:25.571837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:25.574745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:25.581860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:25.582486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:25.592329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:25.593162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:25.593791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.594687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:25.595306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:25.595447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:25.595863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:25.596199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.597116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.603845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:25.604667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:25.605872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.653442 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3/os-volume_attachments HTTP/1.1 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': 'b834cbe8-6ae7-42b7-a3df-ab8802aae6c3'} Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:56:25.656080 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 10:56:25.661693 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:25.664434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:56:25.665522 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3c66259-0f34-4b36-8426-5219595ee42f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.101473 Oct 03 10:56:25.666934 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2506/5325] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:56:25 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3/os-volume_attachments => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:56:25.788317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0d78eb0d-1653-4d37-8d1b-927b7de383be req-9ff1bb5b-72d7-4aaf-b043-70a4c944765f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90db67a2-ae59-47d0-a5ec-688229b0629d", "name": "network-vif-plugged", "status": "completed", "tag": "a45a2555-ffb9-4d54-90f2-4d8db5c83405"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:25.799771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0d78eb0d-1653-4d37-8d1b-927b7de383be req-9ff1bb5b-72d7-4aaf-b043-70a4c944765f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:25.800263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0d78eb0d-1653-4d37-8d1b-927b7de383be req-9ff1bb5b-72d7-4aaf-b043-70a4c944765f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:25.800702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0d78eb0d-1653-4d37-8d1b-927b7de383be req-9ff1bb5b-72d7-4aaf-b043-70a4c944765f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:25.812980 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0d78eb0d-1653-4d37-8d1b-927b7de383be req-9ff1bb5b-72d7-4aaf-b043-70a4c944765f service nova] Creating event network-vif-plugged:a45a2555-ffb9-4d54-90f2-4d8db5c83405 for instance 90db67a2-ae59-47d0-a5ec-688229b0629d on n-h2-858383-3 Oct 03 10:56:25.818365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0d78eb0d-1653-4d37-8d1b-927b7de383be req-9ff1bb5b-72d7-4aaf-b043-70a4c944765f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034137 Oct 03 10:56:25.819528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2507/5326] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:25.919140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-326357082", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e8c45795-beb8-40e6-ba51-51a8d24fedd0"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:26.012754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] validate_networks() for [('e8c45795-beb8-40e6-ba51-51a8d24fedd0', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:56:26.030448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:26.041712 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9bb9deae-b5fb-4393-b03e-17d2056ab075 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1321 microversion: 2.1 time: 0.476500 Oct 03 10:56:26.042372 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2820/5327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:25 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:26.141180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:26.142104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:26.150304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:26.151060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:26.151741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:26.152635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:26.153367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:26.153968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:26.457002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:26.470115 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e4f9f3f6-bdaa-471d-bf5b-7f1d8d0d83be tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1315 microversion: 2.1 time: 0.334099 Oct 03 10:56:26.471388 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2821/5328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:26 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:27.068435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:27.070135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:27.080606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.081401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.082106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.083488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.084234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.084845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.376226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:27.388094 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e77720f-e568-457d-8e93-68519f967c60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1503 microversion: 2.1 time: 0.324204 Oct 03 10:56:27.402122 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2822/5329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:27 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1503 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:27.417016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:27.418175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:27.436134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.437128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.437990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.438969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.439551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.440079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.700898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:56:27.702296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:56:27.703248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:56:27.704231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:56:27.704672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:56:27.726173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.728116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.728742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.731118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.733231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.733840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.800826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:27.815432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for user 2a0e22aff3574cb286f2c1aa546c6c78 and project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:27.847659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:56:27.854394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 43641544-9468-4356-89b9-b15fc548aa64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:56:27.911759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:27.923435 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5290df7e-88e4-4504-a667-12ab6c26e831 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1503 microversion: 2.1 time: 0.512385 Oct 03 10:56:27.925929 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2823/5330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:27 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1503 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:27.936094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:27.937147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:27.954797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.955665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.956501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.957528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:27.958226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:27.958929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:27.975533 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dddb4020-4597-4628-94a2-abe12c5e5cda tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.061427 Oct 03 10:56:27.978122 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2508/5331] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:56:27.992835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:27.998399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:28.007337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:28.008118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:28.008689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:28.009528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:28.010140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:28.010672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:28.074837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:56:28.210081 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e412cd44-83c0-408f-a1c1-fdd69486c2c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 204 len: 0 microversion: 2.1 time: 0.220340 Oct 03 10:56:28.214626 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2509/5332] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:56:27 2022] DELETE /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:56:28.228522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-656fd2f6-f7ca-4420-a267-89e129c4e6e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:28.229831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-656fd2f6-f7ca-4420-a267-89e129c4e6e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 43641544-9468-4356-89b9-b15fc548aa64] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:28.503892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-656fd2f6-f7ca-4420-a267-89e129c4e6e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:28.516166 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-656fd2f6-f7ca-4420-a267-89e129c4e6e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64" status: 200 len: 1214 microversion: 2.1 time: 0.299770 Oct 03 10:56:28.517425 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2510/5333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:28 2022] GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 => generated 1214 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:28.527781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:28.530322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:28.558773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:28.560137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:28.562402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:28.567786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:28.568452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:28.570077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:29.078196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:29.095475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c3b202c-dd49-40a2-8ffb-494fb612c61f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1501 microversion: 2.1 time: 1.166253 Oct 03 10:56:29.101312 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2824/5334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:27 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1501 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:29.120342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:29.122779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 43641544-9468-4356-89b9-b15fc548aa64] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:29.178803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 43641544-9468-4356-89b9-b15fc548aa64] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:56:29.200104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:29.202683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:29.203964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:29.230844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'flavor' on Instance uuid 43641544-9468-4356-89b9-b15fc548aa64 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:56:29.251756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'system_metadata' on Instance uuid 43641544-9468-4356-89b9-b15fc548aa64 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:56:29.366654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:29.370114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:29.382508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42d18114-7131-48bf-9f68-7090f6f70496 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1509 microversion: 2.1 time: 0.863815 Oct 03 10:56:29.383719 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2511/5335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:28 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1509 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:29.388854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:29.397507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:29.418741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:29.419430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:29.420046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:29.420993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:29.423586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:29.424239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:29.435720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'metadata' on Instance uuid 43641544-9468-4356-89b9-b15fc548aa64 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:56:29.515964 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc40de1a-6525-4d1a-8557-411376b28ea4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.130148 Oct 03 10:56:29.516916 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2512/5336] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:29 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:56:30.362681 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.scheduler.client.report [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Deleted allocations for instance 43641544-9468-4356-89b9-b15fc548aa64 Oct 03 10:56:30.386812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:30.391765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0ac5d7a2-f2cc-41a7-8a30-0ddc76be890f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64" status: 204 len: 0 microversion: 2.1 time: 1.289116 Oct 03 10:56:30.392652 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2825/5337] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:56:29 2022] DELETE /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 => generated 0 bytes in 1290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:56:30.404070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:30.406954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 43641544-9468-4356-89b9-b15fc548aa64] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:30.424854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:30.425778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:30.426677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:30.427842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:30.429421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:30.430897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:30.491860 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 HTTP/1.1 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '43641544-9468-4356-89b9-b15fc548aa64'} Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:30.494513 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:30.499114 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:30.499114 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:30.499114 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:30.499114 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:56:30.499114 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:56:30.499114 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 10:56:30.499114 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:30.499762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ae151eaf-62a2-4001-8155-390e5821c949 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Action: 'create', calling method: .version_select at 0x7f074ea6cf70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-254849441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKei+yCHCztA2NqvgSgI896WslTYUNuBknBhroQ2SHQioit16s4Z2QyGuPfqyr5AgluzHdk6uNrxDBJu/D4b0h0ZE0oZ/z1hSjU2VXk0JSxzEBjUQnH75Kw7ImcF+8b+A=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:30.505717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:56:30.506947 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfbbc5a4-f3a2-41ba-a743-c17cc79f40b1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64" status: 404 len: 111 microversion: 2.1 time: 0.109418 Oct 03 10:56:30.508319 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2826/5338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:30 2022] GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:56:30.515321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:30.516273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:30.527323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:30.527641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ae151eaf-62a2-4001-8155-390e5821c949 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Getting quotas for project f0b21abdde534eee9e051d694648fbd2. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:30.528320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:30.528890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:30.529887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:30.536005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:30.537099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ae151eaf-62a2-4001-8155-390e5821c949 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Getting quotas for user 828164d97b90461abe6540d1a20023ee and project f0b21abdde534eee9e051d694648fbd2. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:30.538619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:30.603238 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ae151eaf-62a2-4001-8155-390e5821c949 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.488991 Oct 03 10:56:30.603859 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2513/5339] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:56:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:30.844889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:30.847897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:30.857578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:30.858446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:30.859121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:30.861431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:30.862793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:30.863907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:30.936488 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca8c2af2-e815-411b-b60b-b11f0b37f5a6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.316745 Oct 03 10:56:30.938257 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2514/5340] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:30 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:56:30.981222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1484409022", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e8c45795-beb8-40e6-ba51-51a8d24fedd0"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:31.083311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:31.099187 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-169f8ef2-50fb-4086-9a2f-baa4928ef390 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1509 microversion: 2.1 time: 0.588218 Oct 03 10:56:31.099721 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2827/5341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:30 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1509 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:31.105832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] validate_networks() for [('e8c45795-beb8-40e6-ba51-51a8d24fedd0', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:56:31.949030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:31.952248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:31.962923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:31.963734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:31.964345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:31.965303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:31.965927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:31.966523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:32.012199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4aa47c7d-9e53-4678-864e-d514995e9d48 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.068085 Oct 03 10:56:32.017522 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2828/5342] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:31 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:56:32.128082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:32.128851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:32.139423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:32.139924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:32.140372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:32.141131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:32.141597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:32.142027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:32.422460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:32.435487 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bb4a456-30d9-4560-8bd1-07a635f6a03c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1509 microversion: 2.1 time: 0.311608 Oct 03 10:56:32.436963 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2829/5343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:32 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:32.669666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:32.670767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:32.699050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:32.700027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:32.700027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:32.704106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:32.704812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:32.705407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:32.759746 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b63570d7-6969-4011-9cae-3543e6f79680 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/ips" status: 200 len: 150 microversion: 2.1 time: 0.319150 Oct 03 10:56:32.762813 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2830/5344] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:56:32 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/ips => generated 150 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:33.036813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:33.044592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:33.061576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.062190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.062646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.064935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.065417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.068014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.148376 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc0358b8-c824-416c-8218-564cc0e1100b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.128280 Oct 03 10:56:33.150052 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2831/5345] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:33 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:56:33.318634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d8fb1bfd-7ddc-4c86-8ebb-b61f79e42b15 req-e323ef81-2ea5-486f-a0ed-198139b433f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff34bdae-40f6-4351-89c7-5a132ce2506b", "name": "network-vif-deleted", "tag": "cc1601f8-0ba7-4302-85ca-ed48c74cfcb1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:33.351290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8fb1bfd-7ddc-4c86-8ebb-b61f79e42b15 req-e323ef81-2ea5-486f-a0ed-198139b433f6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.356214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8fb1bfd-7ddc-4c86-8ebb-b61f79e42b15 req-e323ef81-2ea5-486f-a0ed-198139b433f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.357195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8fb1bfd-7ddc-4c86-8ebb-b61f79e42b15 req-e323ef81-2ea5-486f-a0ed-198139b433f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.422252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d8fb1bfd-7ddc-4c86-8ebb-b61f79e42b15 req-e323ef81-2ea5-486f-a0ed-198139b433f6 service nova] Creating event network-vif-deleted:cc1601f8-0ba7-4302-85ca-ed48c74cfcb1 for instance ff34bdae-40f6-4351-89c7-5a132ce2506b on n-h1-858383-3 Oct 03 10:56:33.439959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d8fb1bfd-7ddc-4c86-8ebb-b61f79e42b15 req-e323ef81-2ea5-486f-a0ed-198139b433f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125117 Oct 03 10:56:33.440937 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2832/5346] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:33.462814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:33.464074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:33.480345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.480345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.482228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.483736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.484076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.484505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.528398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:56:33.530160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:56:33.531017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:56:33.531601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:56:33.532467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:56:33.535592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:33.569109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.574895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.575523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.577302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.578991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.581041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.603928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:33.604660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:33.605412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:33.606931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lazy-loading 'fault' on Instance uuid ff34bdae-40f6-4351-89c7-5a132ce2506b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:56:33.620042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:33.627916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:33.642722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for user 2a0e22aff3574cb286f2c1aa546c6c78 and project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:33.680311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:56:33.688066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:56:33.779112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:33.788751 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd37af8e-758c-47c5-9818-9c43e819d335 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 200 len: 1311 microversion: 2.1 time: 0.332695 Oct 03 10:56:33.805607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-08aae9a6-b9c9-41bf-92a3-8b94f492da97 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.860377 Oct 03 10:56:33.805607 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2515/5347] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:56:33.806960 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2833/5348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:33 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 1311 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:33.823133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb9483e7-b929-4cb4-a7b3-02f8a83d9ffb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:33.823758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb9483e7-b929-4cb4-a7b3-02f8a83d9ffb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:33.978368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb9483e7-b929-4cb4-a7b3-02f8a83d9ffb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:33.993594 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb9483e7-b929-4cb4-a7b3-02f8a83d9ffb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1215 microversion: 2.1 time: 0.171369 Oct 03 10:56:33.995701 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2516/5349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:33 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:34.160983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:34.165026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:34.184502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:34.185899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:34.188226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:34.189543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:34.190866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:34.205355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:34.288304 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2c0c772-7162-4cbb-9327-6e4963be62ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.130981 Oct 03 10:56:34.289173 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2834/5350] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:34 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:56:34.829235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:34.829941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:34.841934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:34.842437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:34.843094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:34.843978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:34.844602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:34.845266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:34.885384 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b HTTP/1.1 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ff34bdae-40f6-4351-89c7-5a132ce2506b'} Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:34.891166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:34.896668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:34.896668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:34.896668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:34.896668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:56:34.896668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:56:34.896668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:56:34.896668 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:34.906995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:56:34.908694 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6add053b-08a1-4823-ada3-ddb71840f589 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 404 len: 111 microversion: 2.1 time: 0.084195 Oct 03 10:56:34.909472 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2517/5351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:34 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:56:34.925821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cba472ae-f5ac-4bde-86f9-726237f211cb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: .version_select at 0x7f074de8bee0>, body: {"keypair": {"name": "tempest-key-1952057984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkDmvUwCSc/Rp6KY9zNw1/yQyUw4JAW527J2rQl6fPDc97xnNroavVLU7AeeaAMGKwsyCHR+BuPEwWQbu30dZO+kedpWZiKsu7vlm5lzkrFn2xrCkqXfPMb0ly/KM9FvA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:34.959128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-cba472ae-f5ac-4bde-86f9-726237f211cb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:34.969496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-cba472ae-f5ac-4bde-86f9-726237f211cb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:35.020820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:35.021438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:35.029790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:35.030450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:35.035016 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cba472ae-f5ac-4bde-86f9-726237f211cb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.115559 Oct 03 10:56:35.037634 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2835/5352] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:56:34 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:35.038290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:35.039572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:35.040292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:35.041060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:35.051471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c8864267-06d2-4684-a0aa-c116449d3e5e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '.version_select at 0x7f074deb6ee0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:35.063821 n-d-858383-3 devstack@n-api.service[122269]: WARNING oslo_db.sqlalchemy.utils [None req-c8864267-06d2-4684-a0aa-c116449d3e5e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 10:56:35.078963 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c8864267-06d2-4684-a0aa-c116449d3e5e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.034377 Oct 03 10:56:35.080200 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2836/5353] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Oct 3 10:56:35 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:56:35.200335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:35.220677 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e8d5222f-c60d-4dd2-9766-9a681d73071c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1211 microversion: 2.1 time: 0.195241 Oct 03 10:56:35.222027 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2518/5354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:35 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1211 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:35.279900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1524498152", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-key-1952057984", "networks": [{"uuid": "77b7129c-f93b-4c9f-acd6-8c3bb9d62151"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:35.302987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:35.306464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:35.320615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:35.347247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:35.347836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:35.348595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:35.349318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:35.350535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:35.418083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:56:35.431943 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-178afb95-6699-494b-b555-9c15e8958065 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.136002 Oct 03 10:56:35.433073 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2519/5355] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:35 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 10:56:35.604557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48eea6fe-8532-45f9-b7c5-f296e6984250"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:35.607777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:35.622236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:35.622731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:35.623171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:35.623894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:35.625895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:35.626612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:36.012850 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99f709f6-eb7b-4dad-a41d-18ec9adc462f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413107 Oct 03 10:56:36.020090 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2520/5356] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:56:35 2022] POST /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:36.250013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:36.251148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:36.264186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:36.265549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:36.266035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:36.274249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:36.275129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:36.275844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:36.421784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:36.432585 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48e81309-6992-4713-9d61-3cc1ea39da6a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1273 microversion: 2.1 time: 0.187315 Oct 03 10:56:36.437458 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2521/5357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:36 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:36.461427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:36.465312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:36.477196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:36.478161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:36.478916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:36.480800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:36.481597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:36.482750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:36.536403 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-177d64b9-febc-4b5f-8a2c-4416b78fd70a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.083704 Oct 03 10:56:36.540801 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2522/5358] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:36 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:56:37.465745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:37.468609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:37.486608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:37.487980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:37.488732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:37.489731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:37.491326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:37.492018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:37.588373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:56:37.589378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:56:37.590069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:56:37.590645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:56:37.591276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:56:37.608561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:37.609349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:37.614007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:37.617479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:37.618191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:37.619033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:37.684447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:37.696241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:37.714312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:56:37.718044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:56:37.801291 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-794f0793-4f4c-4dcf-af5e-e5c3a31f50a8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.521384 Oct 03 10:56:37.806134 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2837/5359] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:56:37.819661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:37.827189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:37.846598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:37.849183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:37.853441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:37.855140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:37.855887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:37.856934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:37.908331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:37.916428 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e931e870-2a41-42b8-aee9-c8183779b94d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.108160 Oct 03 10:56:37.917241 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2838/5360] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:37 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:56:37.921877 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b798d87-f4f2-448e-a38b-060428feb0a6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1315 microversion: 2.1 time: 0.463531 Oct 03 10:56:37.933252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-81cdbdcf-e3df-46d6-be89-d41cc78c4aec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:37.934370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-81cdbdcf-e3df-46d6-be89-d41cc78c4aec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:37.944473 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2523/5361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:37 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:38.327718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-81cdbdcf-e3df-46d6-be89-d41cc78c4aec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:38.351656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81cdbdcf-e3df-46d6-be89-d41cc78c4aec tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1229 microversion: 2.1 time: 0.429840 Oct 03 10:56:38.355192 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2839/5362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:37 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1229 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:38.930152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:38.933997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:38.950949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:38.952358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:38.967101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:38.968110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:38.968523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:38.969552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:38.969933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:38.970825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:38.971484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:38.972546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:38.973639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:38.973962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:38.974609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:38.975724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:39.051984 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-703deb7b-3b7f-4d40-a285-6e614befab33 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.127253 Oct 03 10:56:39.054558 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2524/5363] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:38 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:56:39.390419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:39.391276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:39.414690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:39.415285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:39.415742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:39.416490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:39.419693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:39.420175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:40.005226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:40.022996 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d5b8a4c-bfe8-44d6-b549-95eb185c8026 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1315 microversion: 2.1 time: 1.075876 Oct 03 10:56:40.026248 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2840/5364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:38 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1315 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:40.036686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9ec954dd-365d-4fbc-96e0-57ae9275d331 req-3f684d6f-349a-4571-8b03-41e10cad6501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6c8909-e1aa-4d50-9578-eacf7b997f7b", "tag": "42c47da7-3f98-4559-aa0b-9f681e644d4d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:40.078678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9ec954dd-365d-4fbc-96e0-57ae9275d331 req-3f684d6f-349a-4571-8b03-41e10cad6501 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:40.082782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9ec954dd-365d-4fbc-96e0-57ae9275d331 req-3f684d6f-349a-4571-8b03-41e10cad6501 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:40.083327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9ec954dd-365d-4fbc-96e0-57ae9275d331 req-3f684d6f-349a-4571-8b03-41e10cad6501 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:40.123788 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9ec954dd-365d-4fbc-96e0-57ae9275d331 req-3f684d6f-349a-4571-8b03-41e10cad6501 service nova] Creating event network-changed:42c47da7-3f98-4559-aa0b-9f681e644d4d for instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b on n-h2-858383-3 Oct 03 10:56:40.137881 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9ec954dd-365d-4fbc-96e0-57ae9275d331 req-3f684d6f-349a-4571-8b03-41e10cad6501 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108868 Oct 03 10:56:40.138539 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2841/5365] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:40.152357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:40.155107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:40.163609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:40.164366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:40.167035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:40.169100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:40.169994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:40.170689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:40.233252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5fdd758-396d-4c51-822a-15ee79709bc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 14 microversion: 2.1 time: 0.092274 Oct 03 10:56:40.236338 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2842/5366] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:40 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:56:40.396147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:40.432032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b6e43b7d-33f1-4f7b-a746-acd3d6be42b0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1281 microversion: 2.1 time: 1.046240 Oct 03 10:56:40.436397 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2525/5367] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:39 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1281 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:41.057194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:41.058616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:41.071777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.073156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.074269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:41.075252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.075902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.076513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:41.246209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:41.248801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:41.275745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.277484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.277890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:41.282864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.284691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.285205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:41.399169 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5d3c5682-55d9-4169-8a81-2577c9c1f145 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action" status: 200 len: 8208 microversion: 2.1 time: 0.157847 Oct 03 10:56:41.404953 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2526/5368] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:41 2022] POST /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d/action => generated 8208 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:41.413476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:41.416113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:41.437617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.438134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.438586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:41.442343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.442848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.443304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:41.769959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:41.786295 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a367959-7a5a-4f56-a438-a847198c5a7d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1315 microversion: 2.1 time: 0.735703 Oct 03 10:56:41.786896 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2843/5369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:41 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:41.810746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:41.811386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:41.839487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.842617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.843326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:41.844272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:41.845942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:41.847874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:42.124090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:42.137151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-515b0f52-f07e-49d7-a241-b65cb81ffe84 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1287 microversion: 2.1 time: 0.348925 Oct 03 10:56:42.144517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2844/5370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:41 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1287 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:42.200575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:42.212561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63645655-42fb-4102-990d-9bab37acb9a1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.805390 Oct 03 10:56:42.221722 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2527/5371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:41 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:42.273382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:42.274610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:42.290643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:42.291729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:42.293302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:42.295465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:42.296202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:42.297457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:42.826956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:42.827580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:42.868941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:42.871621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:42.875092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:42.876164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:42.878817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:42.879588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:42.894595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:42.908159 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5531271d-cb90-4e4e-aeff-1b887f212cc8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.640114 Oct 03 10:56:42.908755 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2845/5372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:42 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:42.939552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:42.941259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:42.965824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:42.972878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:42.973625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:42.974572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:42.976059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:42.976712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:43.546918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:43.556254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c63e95d9-5466-4ccd-ba32-10c06ef631f9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.622721 Oct 03 10:56:43.556864 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2846/5373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:42 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:43.592528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:43.593224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:43.599199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:43.599518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:43.600058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:43.600504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:43.601252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:43.601712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:43.603074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:43.780255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:43.798008 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf14b0c7-757c-4d31-b5c7-8f2e4349a172 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1287 microversion: 2.1 time: 0.219964 Oct 03 10:56:43.805073 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2847/5374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:43 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1287 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:43.810654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:43.816888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:43.831258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:43.835230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:43.837807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:43.839591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:43.841243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:43.842830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:43.985036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=20 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:44.343089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:44.360008 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6e5f3f3-9bfa-407b-ba2b-763146511b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.548774 Oct 03 10:56:44.380801 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2848/5375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:43 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:44.412092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:44.412092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:44.448606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:44.450885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:44.453804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:44.453804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:44.454132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:44.454629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:44.455336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:44.457607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de0ae8f7-7585-40e3-b54d-520797a80ba9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1315 microversion: 2.1 time: 1.635587 Oct 03 10:56:44.469235 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2528/5376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:42 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1315 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:44.551842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Locking {{(pid=122269) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 03 10:56:44.661158 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d1ffa529-fc32-42f1-976c-a3a9503103de tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.264802 Oct 03 10:56:44.669881 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2849/5377] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:44 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:56:44.679307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:44.680480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:44.699028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:44.700040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:44.700864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:44.701872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:44.702571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:44.703238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:44.830590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:44.831145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:44.864664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:44.865401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:44.866402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:44.867167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:44.867616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:44.912248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.363174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:45.395785 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f81b0eb-12ec-40ff-9a9b-6eb7d1b7073b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.721524 Oct 03 10:56:45.402682 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2529/5378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:44 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:45.429776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:45.438878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.439757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.440382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.468161 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] HTTP exception thrown: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc is locked Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Request method failure captured: Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action HTTP/1.1 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 15 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6y3AHd1Q08SBna-TnPCg3TZcMgJ8HFVX3WMFc-D9aSAlKErwb_Y1-floYq-2JNcDtPrx9Cuhg7LWnAh6qzjEAcENv8psqr3qoaVDBR1tT2LBJVSKh5nTXCPjR2VuoltiwZEmO_psDMctAeGeZAOLFEnWk1tUUAVW7fvKpp5aCek08 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 598e28eacadb4e528222edc532abb878 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_598e28eacadb4e528222edc532abb878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/598e28eacadb4e528222edc532abb878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}] Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1743472731 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 598e28eacadb4e528222edc532abb878 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1743472731-project Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e3857d14b6f6498c87700ea6ee22c4a6 Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1743472731-project Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: {"os-stop": {}} Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc is locked Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '0f1bf57f-57f2-4686-a930-078cf2654cbc', 'body': {'os-stop': {}}} Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc is locked Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc is locked Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc is locked Oct 03 10:56:45.470204 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:56:45.477579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Returning 409 to user: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc is locked {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:56:45.478641 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75ea61e6-3bae-41ef-994a-b92b81ef4b56 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 409 len: 107 microversion: 2.1 time: 0.053635 Oct 03 10:56:45.483144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2530/5379] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:45 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 107 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 10:56:45.489892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:45.491262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:45.498636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.499361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.499976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.500926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.501551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.502139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.565631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Unlocking {{(pid=122270) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 03 10:56:45.571408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:45.574600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:45.582477 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-97b099d0-aea1-4cd5-a6aa-f7ff7a7872d6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 0.756539 Oct 03 10:56:45.583068 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2850/5380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:44 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:45.588171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:45.588786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:45.608109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.613709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.614314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.615271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.620732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.621291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.664445 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a4c2b7f9-67c3-49b4-a609-ebcdb3723c2e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.179242 Oct 03 10:56:45.668599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2531/5381] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:45 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:56:45.678016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-029d7490-f3bf-426a-bd88-73c38469d1ac tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:45.700748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-029d7490-f3bf-426a-bd88-73c38469d1ac tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.701318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-029d7490-f3bf-426a-bd88-73c38469d1ac tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.701797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-029d7490-f3bf-426a-bd88-73c38469d1ac tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.729168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-029d7490-f3bf-426a-bd88-73c38469d1ac tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 10:56:45.789864 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-029d7490-f3bf-426a-bd88-73c38469d1ac tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.119515 Oct 03 10:56:45.794263 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2532/5382] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:45 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:56:45.801140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:45.801917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:45.811492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.811929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.812649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:45.813850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:45.814443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:45.814894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:46.430329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:46.440434 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0cebaa20-c980-4745-a317-dad0536446e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1315 microversion: 2.1 time: 0.856251 Oct 03 10:56:46.441839 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2851/5383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:45 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:46.610860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:46.612806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:46.622437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:46.623498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:46.624177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:46.625242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:46.625953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:46.626617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:46.748717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:46.768446 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-acdf3ca7-a6e8-4831-8601-7ec5b61f45ce tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.969660 Oct 03 10:56:46.770787 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2533/5384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:45 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:46.924040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a1c1db34-f306-470a-8e17-e31099d6c875 req-f31aaafd-5f15-4108-8ac7-854e3fe23e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6c8909-e1aa-4d50-9578-eacf7b997f7b", "name": "network-vif-plugged", "status": "completed", "tag": "42c47da7-3f98-4559-aa0b-9f681e644d4d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:46.949492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a1c1db34-f306-470a-8e17-e31099d6c875 req-f31aaafd-5f15-4108-8ac7-854e3fe23e20 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:46.950179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a1c1db34-f306-470a-8e17-e31099d6c875 req-f31aaafd-5f15-4108-8ac7-854e3fe23e20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:46.950784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a1c1db34-f306-470a-8e17-e31099d6c875 req-f31aaafd-5f15-4108-8ac7-854e3fe23e20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:46.970403 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a1c1db34-f306-470a-8e17-e31099d6c875 req-f31aaafd-5f15-4108-8ac7-854e3fe23e20 service nova] Creating event network-vif-plugged:42c47da7-3f98-4559-aa0b-9f681e644d4d for instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b on n-h2-858383-3 Oct 03 10:56:46.978352 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a1c1db34-f306-470a-8e17-e31099d6c875 req-f31aaafd-5f15-4108-8ac7-854e3fe23e20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203850 Oct 03 10:56:46.979428 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2534/5385] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:47.128435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:47.163786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cad10929-f488-4e70-ba82-ba588a6c737f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 0.559723 Oct 03 10:56:47.165050 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2852/5386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:46 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:47.464934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:47.465641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:47.473604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:47.474505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:47.475890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:47.477347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:47.478115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:47.478776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:47.798772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:47.799390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:47.806695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:47.808953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:47.818446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:47.819578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:47.820562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:47.821631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:47.822379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:47.830857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:48.186851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:48.199333 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc282c66-27c1-4a1e-8dc6-e73b2f0bb6de tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1315 microversion: 2.1 time: 0.734563 Oct 03 10:56:48.200415 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2535/5387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:47 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:48.332729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7faa15a9-47ac-4945-aa8c-1018a5816736 req-9b3fa53c-d90a-4c29-a0ce-6d6071ec505c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c24d92e-2d56-4c4e-b8d2-720274e5297c", "tag": "448750d1-b336-4135-b193-babc3370d956"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:48.333714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:48.344695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7faa15a9-47ac-4945-aa8c-1018a5816736 req-9b3fa53c-d90a-4c29-a0ce-6d6071ec505c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:48.345563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7faa15a9-47ac-4945-aa8c-1018a5816736 req-9b3fa53c-d90a-4c29-a0ce-6d6071ec505c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:48.346252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7faa15a9-47ac-4945-aa8c-1018a5816736 req-9b3fa53c-d90a-4c29-a0ce-6d6071ec505c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:48.381994 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7faa15a9-47ac-4945-aa8c-1018a5816736 req-9b3fa53c-d90a-4c29-a0ce-6d6071ec505c service nova] Creating event network-changed:448750d1-b336-4135-b193-babc3370d956 for instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c on n-h2-858383-3 Oct 03 10:56:48.391760 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7faa15a9-47ac-4945-aa8c-1018a5816736 req-9b3fa53c-d90a-4c29-a0ce-6d6071ec505c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189769 Oct 03 10:56:48.392391 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2536/5388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:48.409003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:48.410151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:48.423423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:48.426894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:48.427909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:48.429514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:48.430351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:48.439305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:48.529198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:48.538981 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-07684dca-bc57-4ddd-b24f-f68336904a1f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.744239 Oct 03 10:56:48.543227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2853/5389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:47 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:48.922536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:48.956655 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3fbea15-724b-45d9-9c6c-8642a2184c3d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 0.555078 Oct 03 10:56:48.957310 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2537/5390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:48 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:49.228824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:49.229437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:49.257520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:49.258027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:49.258531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:49.266099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:49.266672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:49.267125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:49.587561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:49.588498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:49.619313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:49.635098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:49.636286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:49.642912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:49.643669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:49.644178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:49.868203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:49.883495 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-edc643c2-3f3d-4515-be1b-dc321b55f844 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1502 microversion: 2.1 time: 0.659721 Oct 03 10:56:49.885414 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2854/5391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:49 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1502 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:49.913817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:49.915670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:49.931803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:49.935764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:49.936510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:49.937557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:49.938204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:49.939562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:50.159564 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1a89fc3-2a49-486d-8b3e-12895654f093 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b/action" status: 202 len: 0 microversion: 2.1 time: 0.251532 Oct 03 10:56:50.162993 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2855/5392] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:49 2022] POST /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:56:50.219775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:50.220710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:50.241318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:50.242902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:50.243861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:50.245439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:50.246469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:50.247239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:50.589027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:50.601112 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ac36c85-6ccc-43fb-9b9a-400f3a798bdc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 0.409594 Oct 03 10:56:50.607697 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2856/5393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:50 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:50.622071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:50.630631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:50.648207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:50.648707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:50.649175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:50.649888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:50.650341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:50.664288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:50.665927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:50.676153 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d1476c0c-eafc-4f9c-8d39-bc585dc80d51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 1.112587 Oct 03 10:56:50.693357 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2538/5394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:49 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:51.141595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:51.156649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d490d077-18e8-48c6-ac52-cad88231a92c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1507 microversion: 2.1 time: 0.546444 Oct 03 10:56:51.157969 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2857/5395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:50 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:51.627262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:51.627894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:51.639361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:51.640158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:51.640814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:51.641713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:51.642704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:51.643522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:51.699979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:51.700590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:51.708419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:51.708946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:51.709417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:51.710122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:51.710624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:51.725692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.130026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:52.152912 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a634bab8-d11c-456d-85df-955472d5493f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.456507 Oct 03 10:56:52.169079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2858/5396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:51 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:52.169079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48eea6fe-8532-45f9-b7c5-f296e6984250"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:52.169079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:52.172801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.173295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.180270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.181213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.182636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.183092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.315478 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Invalid volume: volume 48eea6fe-8532-45f9-b7c5-f296e6984250 is already attached to instances: 31896970-1773-46f8-a675-13c516baaddf Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments HTTP/1.1 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 74 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: {"volumeAttachment": {"volumeId": "48eea6fe-8532-45f9-b7c5-f296e6984250"}} Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid volume: volume 48eea6fe-8532-45f9-b7c5-f296e6984250 is already attached to instances: 31896970-1773-46f8-a675-13c516baaddf Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '31896970-1773-46f8-a675-13c516baaddf', 'body': {'volumeAttachment': {'volumeId': '48eea6fe-8532-45f9-b7c5-f296e6984250'}}} Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 48eea6fe-8532-45f9-b7c5-f296e6984250 is already attached to instances: 31896970-1773-46f8-a675-13c516baaddf Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:56:52.318052 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 48eea6fe-8532-45f9-b7c5-f296e6984250 is already attached to instances: 31896970-1773-46f8-a675-13c516baaddf Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 48eea6fe-8532-45f9-b7c5-f296e6984250 is already attached to instances: 31896970-1773-46f8-a675-13c516baaddf Oct 03 10:56:52.324327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:52.329614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 400 to user: Invalid volume: volume 48eea6fe-8532-45f9-b7c5-f296e6984250 is already attached to instances: 31896970-1773-46f8-a675-13c516baaddf {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:56:52.331454 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ba68c03-936f-4ecc-8baa-2960d319e3b7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.175528 Oct 03 10:56:52.332653 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2859/5397] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:56:52 2022] POST /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 174 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 10:56:52.339118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:52.341397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:52.350532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:52.353409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.354697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.356201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.358014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.360894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.363155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.649237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:52.688370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28bd8019-953e-4578-9174-0897b478d854 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 1.067259 Oct 03 10:56:52.703284 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2539/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:51 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:52.717574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:52.718390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:52.726383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.727200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.727820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.728725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.730007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.730669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.783496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:52.797288 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b92c5443-1380-46fd-9763-8af4f326a57c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1487 microversion: 2.1 time: 0.463128 Oct 03 10:56:52.814945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2860/5399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:52 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1487 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:52.824980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:52.824980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:52.832225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.832729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.833280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.835246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:52.835895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:52.836506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:52.855914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lazy-loading 'services' on Instance uuid 31896970-1773-46f8-a675-13c516baaddf {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:56:52.870079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:56:52.968358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9afe6d0e-758f-485e-9f03-6443aab91f0f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments/48eea6fe-8532-45f9-b7c5-f296e6984250" status: 202 len: 0 microversion: 2.1 time: 0.263310 Oct 03 10:56:52.969345 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2540/5400] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:56:52 2022] DELETE /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments/48eea6fe-8532-45f9-b7c5-f296e6984250 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:56:52.986230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:52.988710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:53.018314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.020081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.021097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.022469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.025331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.026230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.042722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-998b1557-aa2d-471e-93f4-efdf8e7bfee2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 204 len: 0 microversion: 2.1 time: 0.222230 Oct 03 10:56:53.043355 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2861/5401] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:56:52 2022] DELETE /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:56:53.058243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:53.059484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:53.073736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.074666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.075351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.076317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.077334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.078001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.123254 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2a75f9f1-73c7-45e9-ba5b-cf652c0f6baf tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146447 Oct 03 10:56:53.123981 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2541/5402] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:56:52 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:53.179499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:53.180192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:53.198819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.199766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.200474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.201593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.202560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.203284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.382876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:53.392721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3115526-33ee-4493-9fb5-bdb444b6757c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1493 microversion: 2.1 time: 0.344900 Oct 03 10:56:53.393466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2862/5403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:53 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1493 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:53.410573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1896168490-access_point-1366814116", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "6149260f-5d04-4293-bb23-93ae85a144ad"}], "key_name": "tempest-TestSecurityGroupsBasicOps-254849441", "security_groups": [{"name": "tempest-secgroup_access--1389872614"}, {"name": "tempest-secgroup_general--1873187706"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:53.615321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:53.630553 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a501f1a-b865-40e6-a358-fae2a82a9f51 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.454884 Oct 03 10:56:53.633294 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2542/5404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:53 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:53.722369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:53.723016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:53.731640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.732204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.733095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.733840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:53.734310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:53.734745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:53.859211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] validate_networks() for [('6149260f-5d04-4293-bb23-93ae85a144ad', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:56:54.003428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:54.019487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-59d2d8e3-cea4-4264-94ab-6f0e46410b4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 0.304096 Oct 03 10:56:54.039826 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2543/5405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:53 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:54.139706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:54.143136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:54.158074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:54.158600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:54.159057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:54.159798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:54.160263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:54.160701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:54.244882 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5636582f-b03c-48bf-b850-1c4ae6e1fe43 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111331 Oct 03 10:56:54.245738 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2544/5406] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:56:54 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:56:54.427574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:54.429552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:54.446903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:54.449339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:54.453225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:54.454132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:54.454719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:54.455235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:54.830777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:56:54.831808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:56:54.832562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:56:54.832799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:56:54.833220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:56:54.848742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:54.849263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:54.849817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:54.850836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:54.857297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:54.857801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:54.889427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Getting quotas for project f0b21abdde534eee9e051d694648fbd2. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:56:54.901504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Getting quotas for user 828164d97b90461abe6540d1a20023ee and project f0b21abdde534eee9e051d694648fbd2. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:56:54.952677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:54.956191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:56:54.958632 n-d-858383-3 devstack@n-api.service[122269]: WARNING nova.utils [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1896168490-access_point-1366814116 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1896168490-ac Oct 03 10:56:54.960003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:56:54.974588 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-62244580-b3b2-4d13-bf9d-26d791e1fada tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1493 microversion: 2.1 time: 0.558513 Oct 03 10:56:54.984905 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2545/5407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:54 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1493 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:55.002341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:55.003012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:55.019880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:55.020583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:55.026064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:55.027595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:55.028085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:55.028616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:55.084722 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fdcce792-d1ec-4b1d-a0cb-3c68800d2fe7 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.689332 Oct 03 10:56:55.085433 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2863/5408] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:56:53 2022] POST /compute/v2.1/servers => generated 458 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:56:55.090535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-74f6bcb7-9a15-448e-a99c-99e2a032c4c7 req-94aa1326-ed2d-4498-bb7c-1aac7ecc5ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c24d92e-2d56-4c4e-b8d2-720274e5297c", "name": "network-vif-plugged", "status": "completed", "tag": "448750d1-b336-4135-b193-babc3370d956"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:55.103993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:55.117127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-74f6bcb7-9a15-448e-a99c-99e2a032c4c7 req-94aa1326-ed2d-4498-bb7c-1aac7ecc5ab3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:55.124142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-74f6bcb7-9a15-448e-a99c-99e2a032c4c7 req-94aa1326-ed2d-4498-bb7c-1aac7ecc5ab3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:55.125900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-74f6bcb7-9a15-448e-a99c-99e2a032c4c7 req-94aa1326-ed2d-4498-bb7c-1aac7ecc5ab3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:55.147786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-74f6bcb7-9a15-448e-a99c-99e2a032c4c7 req-94aa1326-ed2d-4498-bb7c-1aac7ecc5ab3 service nova] Creating event network-vif-plugged:448750d1-b336-4135-b193-babc3370d956 for instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c on n-h2-858383-3 Oct 03 10:56:55.153065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-74f6bcb7-9a15-448e-a99c-99e2a032c4c7 req-94aa1326-ed2d-4498-bb7c-1aac7ecc5ab3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066015 Oct 03 10:56:55.154452 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2864/5409] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:55.159613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:55.160624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:55.168514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:55.169432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:55.181631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:55.182761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:55.183506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:55.184173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:56.199871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:56.296960 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2f81751c-62cc-46fa-98d8-d3c40aef7a91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 1.136238 Oct 03 10:56:56.322312 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2865/5410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:55 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:56.336568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:56.342052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:56.358341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:56.359273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:56.359959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:56.360968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:56.361667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:56.362354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:56.402858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:56.421903 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0ea9ecd8-433c-4dce-b0ec-ca4f5baaa54a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 1.433257 Oct 03 10:56:56.424067 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2546/5411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:54 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:56.441715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:56.449037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:56.488863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:56.489439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:56.493182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:56.496483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:56.500048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:56.500539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:56.545278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:56.558270 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc40d24d-afb0-4ac3-a6f5-2efe7969c8be tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1290 microversion: 2.1 time: 0.232224 Oct 03 10:56:56.559314 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2866/5412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:56 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1290 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:56.582131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:56.582682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:56.618174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:56.621095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:56.623109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:56.623965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:56.627002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:56.628004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:56.638173 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52104ed4-f715-405e-ae9c-78aa91432cab tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206684 Oct 03 10:56:56.642002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2547/5413] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:56:56 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:56.810513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:56.825066 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-46c0fede-23e9-442f-8219-16690aa476a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1451 microversion: 2.1 time: 0.262996 Oct 03 10:56:56.825693 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2867/5414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:56 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1451 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:57.057323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-cda51103-5bcc-4ba6-a517-914fefb81a23 req-3c6cb9e1-68ec-403f-8917-1a0a6a680609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6c8909-e1aa-4d50-9578-eacf7b997f7b", "name": "network-vif-deleted", "tag": "42c47da7-3f98-4559-aa0b-9f681e644d4d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:57.079519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cda51103-5bcc-4ba6-a517-914fefb81a23 req-3c6cb9e1-68ec-403f-8917-1a0a6a680609 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.080152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cda51103-5bcc-4ba6-a517-914fefb81a23 req-3c6cb9e1-68ec-403f-8917-1a0a6a680609 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.080608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-cda51103-5bcc-4ba6-a517-914fefb81a23 req-3c6cb9e1-68ec-403f-8917-1a0a6a680609 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.109377 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-cda51103-5bcc-4ba6-a517-914fefb81a23 req-3c6cb9e1-68ec-403f-8917-1a0a6a680609 service nova] Creating event network-vif-deleted:42c47da7-3f98-4559-aa0b-9f681e644d4d for instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b on n-h2-858383-3 Oct 03 10:56:57.120800 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-cda51103-5bcc-4ba6-a517-914fefb81a23 req-3c6cb9e1-68ec-403f-8917-1a0a6a680609 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067509 Oct 03 10:56:57.127298 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2548/5415] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:57.328403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:57.329049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:57.342764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.343325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.343855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.350507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.351127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.351810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.405111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:56:57.450213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:57.451707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:57.464985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.465744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.466384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.467270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.467913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.468507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.852207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:57.868745 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54bce88c-c2e5-49a8-91af-5ccd75833d58 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1329 microversion: 2.1 time: 0.545606 Oct 03 10:56:57.883383 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2868/5416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:57 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1329 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:57.900730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:57.901651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:57.909663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.910334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.911048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.912009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.913581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.914187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.929055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:57.944315 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52fd6b63-1f66-4ad8-9997-39297c2401fd tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1655 microversion: 2.1 time: 0.498536 Oct 03 10:56:57.945640 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2549/5417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:57 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1655 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:56:57.961314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:57.963832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:57.970561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.971302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.973811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:57.974757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:57.981457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:57.982371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.054365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0495ae66-5b51-4c5a-b564-b4ede5a49081 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106084 Oct 03 10:56:58.061333 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2550/5418] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:56:57 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:58.071836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:58.073612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:58.083691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.085168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.085782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.086910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.088730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.089997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.107363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:58.142491 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9bdb332-3e89-4519-beb5-c4b900f8588a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1346 microversion: 2.1 time: 0.256988 Oct 03 10:56:58.159560 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2869/5419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:57 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1346 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:58.173032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-490a7563-72ae-437b-bdf5-809c800fea38 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:58.182134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-490a7563-72ae-437b-bdf5-809c800fea38 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.183134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-490a7563-72ae-437b-bdf5-809c800fea38 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.183636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-490a7563-72ae-437b-bdf5-809c800fea38 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.237279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.237787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.238237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.238698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'fault' on Instance uuid 2c6c8909-e1aa-4d50-9578-eacf7b997f7b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:56:58.316511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-490a7563-72ae-437b-bdf5-809c800fea38 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Going to try to start instance {{(pid=122269) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 10:56:58.442129 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-490a7563-72ae-437b-bdf5-809c800fea38 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.281126 Oct 03 10:56:58.444011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2870/5420] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:56:58 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:56:58.455787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:58.461121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:58.475829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.479413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.480433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.481938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.484990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.487372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.627882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:58.646153 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e7e3dd3-fff2-4e17-99fc-e04c28135446 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 200 len: 1305 microversion: 2.1 time: 0.582875 Oct 03 10:56:58.647924 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2551/5421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:58 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 1305 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:58.830348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:58.857533 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1401eb19-9d15-4128-9cc1-8cf67909f430 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1664 microversion: 2.1 time: 0.409270 Oct 03 10:56:58.861883 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2871/5422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:58 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1664 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:58.899541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:58.900161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:58.913911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.914442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.914972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:58.915699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:58.916169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:58.916602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:59.071180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:59.075124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:59.097151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:59.099095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:59.101262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:59.104333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:59.107497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:59.109141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:59.165171 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26b0c8c2-a6f3-48c4-b4e0-2c7f8c4ebe21 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100626 Oct 03 10:56:59.169907 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2872/5423] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:56:59 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:56:59.177041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:59.178165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:59.187179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:59.187900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:59.188469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:59.189713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:59.190180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:59.190608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:59.358403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:56:59.376969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caded609-4c67-4739-b54a-8605e69893e4 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1352 microversion: 2.1 time: 0.204426 Oct 03 10:56:59.394053 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2873/5424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:59 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:56:59.669642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:56:59.670383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:56:59.679805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:59.680336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:59.680805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:59.683306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:56:59.687014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:56:59.687671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:56:59.712612 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b HTTP/1.1 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '2c6c8909-e1aa-4d50-9578-eacf7b997f7b'} Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:56:59.716990 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:59.722965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:56:59.722965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:56:59.722965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:56:59.722965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:56:59.722965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:56:59.722965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 10:56:59.722965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:56:59.735033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:56:59.736578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-349811d2-c16f-42e1-a6c7-28ae8ab330a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 404 len: 111 microversion: 2.1 time: 0.070829 Oct 03 10:56:59.741738 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2874/5425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:59 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:56:59.830893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1695902391", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e8c45795-beb8-40e6-ba51-51a8d24fedd0"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:56:59.979093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] validate_networks() for [('e8c45795-beb8-40e6-ba51-51a8d24fedd0', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:57:00.009821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:00.020084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1bf501f6-c3e4-46eb-a663-953c66f73e34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1511 microversion: 2.1 time: 1.124492 Oct 03 10:57:00.025135 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2552/5426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:56:58 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1511 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:00.040367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:00.050659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:00.075807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:00.076317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:00.076779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:00.082001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:00.085500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:00.086000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:01.172354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:01.187436 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63c6f008-4e19-43bf-8325-4b9d52b023a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1664 microversion: 2.1 time: 1.160583 Oct 03 10:57:01.210759 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2553/5427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:00 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1664 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:01.228229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:01.234455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:01.258049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:01.270217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:01.271534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:01.273188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:01.274252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:01.275031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:01.728607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:57:01.729852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:57:01.730799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:57:01.731499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:57:01.732179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:57:01.754696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:01.762671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:01.763645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:01.767323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:01.769646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:01.770942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:01.831708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:57:01.839851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for user 2a0e22aff3574cb286f2c1aa546c6c78 and project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:57:01.865030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:57:01.868941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:57:01.978764 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8afc962-3b4c-4547-abb5-d1ae38ae2da8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.152371 Oct 03 10:57:01.988696 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2875/5428] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:57:01.996484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:02.002926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:02.018006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.019025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.019650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.020529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.021166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.022331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.179966 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9bcffd8e-3775-4463-935b-cf6f1e939783 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189276 Oct 03 10:57:02.183331 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2876/5429] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:57:01 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:02.205121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:02.210448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:02.224667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.225462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.227321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.231142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.233191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.233872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.328629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:02.338435 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19677033-0dd9-409a-96a9-b96ed3a396c2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1511 microversion: 2.1 time: 1.126246 Oct 03 10:57:02.347124 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2554/5430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:01 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1511 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:02.369205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-36820bfd-8881-400e-8a92-bdf289ed2ae4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:02.373453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-36820bfd-8881-400e-8a92-bdf289ed2ae4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:02.672308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36820bfd-8881-400e-8a92-bdf289ed2ae4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:02.687059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:02.698994 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0f06e85-8f1d-4191-8574-5165a54a7a70 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.513587 Oct 03 10:57:02.702450 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-36820bfd-8881-400e-8a92-bdf289ed2ae4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1215 microversion: 2.1 time: 0.354167 Oct 03 10:57:02.708503 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2877/5431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:02 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:02.714143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:02.718301 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2555/5432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:02 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:02.724108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:02.726104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:02.727757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:02.736596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:02.741273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.742229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.743104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.744065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.744702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.745431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.746390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.748402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.748988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.757810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:02.759484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:02.760309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:02.786561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:57:02.998944 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-561ce236-377b-45e3-9563-b958422bf4dd tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 204 len: 0 microversion: 2.1 time: 0.278771 Oct 03 10:57:03.000927 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2556/5433] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:57:02 2022] DELETE /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:57:03.016324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:03.017990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:03.031943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.032889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.033713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.034948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.035690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.036540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.469661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:03.481578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f15cec99-ba7b-4c47-8a8a-0978340ce8b3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1664 microversion: 2.1 time: 0.771042 Oct 03 10:57:03.482175 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2878/5434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:02 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1664 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:03.486921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:03.495257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:03.498799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:03.503022 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb7cb09d-ed0c-4f9c-a6c4-2971798dc478 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1517 microversion: 2.1 time: 0.495515 Oct 03 10:57:03.504335 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2557/5435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:03 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1517 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:03.526960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.527472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.527926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.536292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.543002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.543499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.601228 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38ae7ba1-04fb-473f-8611-4b493e7170f4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116565 Oct 03 10:57:03.621487 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2879/5436] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:57:03 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:57:03.685428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:03.686682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:03.720423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.721256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.721927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.722862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.723639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.727228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.730707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:03.731267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:03.741645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.753392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.754501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.761794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.762554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.763174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.788329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:57:03.880417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:03.890870 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6489ed2a-1a90-47ba-9e22-351d921e3ae7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1219 microversion: 2.1 time: 0.164226 Oct 03 10:57:03.892167 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2880/5437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:03 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:03.898859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:03.899739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:03.909139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.909988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.910745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.911732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.912541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:03.913327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:03.973377 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0995f40d-9401-4ccd-aed9-d03f93f63313 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 204 len: 0 microversion: 2.1 time: 0.293569 Oct 03 10:57:03.974403 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2558/5438] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:57:03 2022] DELETE /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 10:57:03.983639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7abb8c2b-23e4-4e7f-aeb2-2a85968ca1f3 req-42e000d5-5981-495c-ab8b-fe8dca021cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b808f438-48a6-449f-9ed7-ed6de09d37da", "tag": "5bbed468-f74d-4468-80e2-44eb5ade0560"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:03.998203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7abb8c2b-23e4-4e7f-aeb2-2a85968ca1f3 req-42e000d5-5981-495c-ab8b-fe8dca021cb7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:03.999246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7abb8c2b-23e4-4e7f-aeb2-2a85968ca1f3 req-42e000d5-5981-495c-ab8b-fe8dca021cb7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.000461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7abb8c2b-23e4-4e7f-aeb2-2a85968ca1f3 req-42e000d5-5981-495c-ab8b-fe8dca021cb7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.015164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7abb8c2b-23e4-4e7f-aeb2-2a85968ca1f3 req-42e000d5-5981-495c-ab8b-fe8dca021cb7 service nova] Creating event network-changed:5bbed468-f74d-4468-80e2-44eb5ade0560 for instance b808f438-48a6-449f-9ed7-ed6de09d37da on n-h2-858383-3 Oct 03 10:57:04.022036 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7abb8c2b-23e4-4e7f-aeb2-2a85968ca1f3 req-42e000d5-5981-495c-ab8b-fe8dca021cb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045207 Oct 03 10:57:04.022943 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2559/5439] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:04.030252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:04.031295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:04.039794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.040510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.047712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.049425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.050602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.051342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.141243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:04.153446 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3235758-2900-4f3a-a400-cbc152ee0dcc tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.259757 Oct 03 10:57:04.154639 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2881/5440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:03 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:04.509442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:04.510348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:04.516982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.517783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.518393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.519528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.520163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.520785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.670770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:04.687341 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94c6d2c2-95fa-4cce-99b2-f95950056549 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1681 microversion: 2.1 time: 0.662822 Oct 03 10:57:04.688065 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2560/5441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:04 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1681 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:04.694274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:04.695174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:04.703011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.703764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.704455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.705523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.709233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.710732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.782038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:04.794241 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d680fc45-2736-46ff-98f7-af598152e769 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1664 microversion: 2.1 time: 0.288809 Oct 03 10:57:04.796126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2882/5442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:04 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1664 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:04.925938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:04.926842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:04.935786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.937376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.937906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:04.938702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:04.939435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:04.940238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:05.041413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:05.055672 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77a8ae1d-ad71-4086-aabb-2a279a4e39f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1219 microversion: 2.1 time: 0.138356 Oct 03 10:57:05.057052 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2883/5443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:04 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:05.184173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:05.185250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:05.210379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:05.211741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:05.212443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:05.214238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:05.214956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:05.216095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:05.481431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:05.487558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:05.502073 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b0c1018f-39be-41c5-8ccd-cb461c551121 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1517 microversion: 2.1 time: 0.807352 Oct 03 10:57:05.517206 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2561/5444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:04 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1517 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:05.517865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:05.535517 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caf081fe-f1dc-4a8a-a7fb-9c4bbb6cb45e tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.361840 Oct 03 10:57:05.553844 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2884/5445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:05 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:05.716159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:05.717828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:05.726666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:05.727450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:05.728127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:05.729125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:05.729834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:05.731174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:05.822948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:05.825482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:05.834330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:05.835912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:05.836626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:05.837778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:05.838525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:05.839170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:05.862068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:06.096251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:06.105962 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cbcb3111-4d50-4858-985c-bd2d76c66b8d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1681 microversion: 2.1 time: 0.394764 Oct 03 10:57:06.122051 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2562/5446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:05 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1681 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:06.130039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:06.130944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:06.139628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:06.140453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:06.141185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:06.142439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:06.143434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:06.144396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:06.251118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:06.260141 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0215d352-03bf-4cee-8cff-2960a19fcb90 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1211 microversion: 2.1 time: 0.136691 Oct 03 10:57:06.261081 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2563/5447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:06 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1211 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:06.320287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:06.339593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-738de997-0b89-436e-b972-b75f7641cef8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1664 microversion: 2.1 time: 0.522580 Oct 03 10:57:06.340326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2885/5448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:05 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1664 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:06.562125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:06.563133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:06.563655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:06.566480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:06.574991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:06.575475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:06.580270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:06.581359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:06.582009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:06.582608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:06.588462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:06.589612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:06.590175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:06.591315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:06.593363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:06.593954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:07.213683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:07.234077 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b63c17b4-a7c3-4388-bbcd-13fb248b6561 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1517 microversion: 2.1 time: 0.696231 Oct 03 10:57:07.237357 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2564/5449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:06 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1517 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:07.248964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:07.249901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:07.279958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:07.282264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:07.284443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:07.291261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:07.292472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:07.299037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:07.433945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:07.442460 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b65b63b6-13c3-4658-98d7-ab50581c82cf tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.884588 Oct 03 10:57:07.457227 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2886/5450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:06 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:07.462857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:07.463924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:07.477904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:07.509394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:07.526199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:07.531550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:07.538120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:07.539355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:07.812354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:07.826589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:07.831835 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc7b44d6-1df2-4511-9b82-1e7894d4f0d4 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1681 microversion: 2.1 time: 0.591986 Oct 03 10:57:07.836097 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2565/5451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:07 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1681 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:07.863752 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-944fdda0-553a-4584-9728-803c1e076dde tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1275 microversion: 2.1 time: 0.404507 Oct 03 10:57:07.882975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:07.883852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:07.884966 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2887/5452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:07 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1275 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:07.913147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:07.914439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:07.915383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:07.916519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:07.917273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:07.918186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:08.262071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:08.262071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:08.268703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:08.269612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:08.270600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:08.271970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:08.272679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:08.273365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:08.504149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:08.512716 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c34f4d49-344d-4f15-906d-8e62d7a3e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.667257 Oct 03 10:57:08.513331 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2566/5453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:07 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:08.526100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:08.527003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:08.539099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:08.540338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:08.541361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:08.542827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:08.543509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:08.544315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:08.860750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:08.875603 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-604cabba-baff-4398-ab05-c48a06470c5d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.354989 Oct 03 10:57:08.876222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2567/5454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:08 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:08.882859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:08.883733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:08.898510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:08.899198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:08.899809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:08.901033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:08.901664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:08.902258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.322605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:09.335195 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7bfca207-7d59-48c5-b612-ec9ff8d0dd94 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.456329 Oct 03 10:57:09.335808 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2568/5455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:08 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:09.344101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:09.345078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:09.367121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.367897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.368530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.369635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.370301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.370919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.469519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:09.479011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:09.483627 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c97b294e-7f08-4ea3-bcc9-c0dc22d6b38b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1517 microversion: 2.1 time: 1.223349 Oct 03 10:57:09.484488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2888/5456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:08 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1517 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:09.487489 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a72ea1b-79cf-4a8e-8586-1cc70aaa07ad tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1614 microversion: 2.1 time: 0.148046 Oct 03 10:57:09.491666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2569/5457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:09 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:09.498217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:09.502251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:09.516375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:09.518117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:09.518596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.519156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.519539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.527324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.527850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.528333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.546251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.546753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.547197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.553053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.553579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.554115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.644212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Unlocking {{(pid=122270) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 03 10:57:09.739841 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2474e9be-2ce9-4ddb-a066-bee2f348964b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.245970 Oct 03 10:57:09.741171 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2570/5458] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:57:09 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:57:09.750010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1fd67eb5-0564-4033-8a98-b718891a4bbe req-427d735a-8403-41b8-8b43-27f11aa001fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31896970-1773-46f8-a675-13c516baaddf", "name": "network-vif-deleted", "tag": "a35c13fa-232e-41df-a025-86e8d0f45e73"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:09.763143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:09.772581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39716660-42b3-427c-bd92-af5b0b1e203f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1273 microversion: 2.1 time: 0.285467 Oct 03 10:57:09.790597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1fd67eb5-0564-4033-8a98-b718891a4bbe req-427d735a-8403-41b8-8b43-27f11aa001fe service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.790893 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2889/5459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:09 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:09.791092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1fd67eb5-0564-4033-8a98-b718891a4bbe req-427d735a-8403-41b8-8b43-27f11aa001fe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.792094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1fd67eb5-0564-4033-8a98-b718891a4bbe req-427d735a-8403-41b8-8b43-27f11aa001fe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.798487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b0d24652-f179-4a50-9d67-845254f41964 req-f2791e47-b624-436a-bd94-193bd4eae54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c24d92e-2d56-4c4e-b8d2-720274e5297c", "name": "network-vif-deleted", "tag": "448750d1-b336-4135-b193-babc3370d956"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:09.806774 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1fd67eb5-0564-4033-8a98-b718891a4bbe req-427d735a-8403-41b8-8b43-27f11aa001fe service nova] Creating event network-vif-deleted:a35c13fa-232e-41df-a025-86e8d0f45e73 for instance 31896970-1773-46f8-a675-13c516baaddf on n-h2-858383-3 Oct 03 10:57:09.813487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b0d24652-f179-4a50-9d67-845254f41964 req-f2791e47-b624-436a-bd94-193bd4eae54a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.814324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b0d24652-f179-4a50-9d67-845254f41964 req-f2791e47-b624-436a-bd94-193bd4eae54a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.814981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b0d24652-f179-4a50-9d67-845254f41964 req-f2791e47-b624-436a-bd94-193bd4eae54a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.819099 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1fd67eb5-0564-4033-8a98-b718891a4bbe req-427d735a-8403-41b8-8b43-27f11aa001fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076419 Oct 03 10:57:09.820287 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2571/5460] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:09.827786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:09.829015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:09.837381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.838195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.838811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.839713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.840849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.841461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.847741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b0d24652-f179-4a50-9d67-845254f41964 req-f2791e47-b624-436a-bd94-193bd4eae54a service nova] Creating event network-vif-deleted:448750d1-b336-4135-b193-babc3370d956 for instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c on n-h2-858383-3 Oct 03 10:57:09.862043 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b0d24652-f179-4a50-9d67-845254f41964 req-f2791e47-b624-436a-bd94-193bd4eae54a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068469 Oct 03 10:57:09.866408 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2890/5461] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:09.911810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:09.913434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:09.922801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.923581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.924215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:09.925233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:09.926135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:09.926791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.062480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:10.072561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-befb09ba-457c-49ef-9e84-df35ec67dee4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.250352 Oct 03 10:57:10.074045 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2572/5462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:09 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:10.095827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:10.096448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:10.105887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.106703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.107415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.108397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.109165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.110747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.554674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:10.605709 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b00879f5-c475-4005-b580-af827a79937a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.706160 Oct 03 10:57:10.609340 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2891/5463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:09 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:10.620210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:10.622488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:10.637046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:10.638460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.639239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.639989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.641005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.641697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.642601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.683064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.683853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.684521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.685232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lazy-loading 'fault' on Instance uuid 8c24d92e-2d56-4c4e-b8d2-720274e5297c {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:57:10.692645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:10.703569 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8568e66b-d41a-4595-bbf8-93d808ed6f54 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.611515 Oct 03 10:57:10.718614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2573/5464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:10 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:10.732563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:10.734149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:10.743067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.744971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.746551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.747609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.748341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.749316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.816719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.819819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.820413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.823132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lazy-loading 'fault' on Instance uuid 31896970-1773-46f8-a675-13c516baaddf {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:57:10.870673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:10.879738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c79a4ac-dc52-4050-b339-106105f5a86e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 200 len: 1319 microversion: 2.1 time: 0.269046 Oct 03 10:57:10.880820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2892/5465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:10 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:10.901298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:10.904677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:10.905642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:10.910355 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22a83b1f-0485-48fe-b1aa-45b021336b91 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 200 len: 1331 microversion: 2.1 time: 0.190263 Oct 03 10:57:10.910967 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2574/5466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:10 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 1331 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:10.912523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.913224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.914063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.914966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.915589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.916200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.931934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:10.932483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:10.938879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.939678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.940383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:10.941302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:10.942159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:10.942754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:11.055838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:11.072058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c76f4ac9-a031-49c9-aa37-197dfdfc57eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1273 microversion: 2.1 time: 0.146013 Oct 03 10:57:11.085720 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2575/5467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:10 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:11.631754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:11.632716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:11.645754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:11.646604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:11.647289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:11.648267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:11.648983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:11.649628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:11.669694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:11.808430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:11.851098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:11.860074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:11.876183 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5dc79a3b-6d1a-4c44-8c92-a71011e437ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.975569 Oct 03 10:57:11.898903 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2893/5468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:10 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:11.924480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:11.925805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:11.942912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:11.943422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:11.943979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:11.946827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:11.947602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:11.951069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.025512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:12.048375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16e571fe-dea8-4971-af1c-f775eabb5ee1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.420453 Oct 03 10:57:12.050133 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2576/5469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:11 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:12.058058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:12.059324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:12.082120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.082739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.083199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.084714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.085173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.085641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.106679 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c HTTP/1.1 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '8c24d92e-2d56-4c4e-b8d2-720274e5297c'} Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:57:12.108377 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1541d37e-23b2-4a60-b7e8-48a075b37284 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 404 len: 111 microversion: 2.1 time: 0.057890 Oct 03 10:57:12.115667 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2577/5470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:12 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:57:12.117501 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-649a6e82-b8de-4e68-8a16-c45e45bb5fb3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.215126 Oct 03 10:57:12.119082 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2894/5471] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:57:11 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:57:12.119881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:12.120523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:12.126398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:12.127722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.128442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.129081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.130441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:12.131374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.132074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.132709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.143214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.147605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.149264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.152635 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf HTTP/1.1 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '31896970-1773-46f8-a675-13c516baaddf'} Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:57:12.154686 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.162082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:57:12.162082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:57:12.162082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:57:12.162082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:57:12.162082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:57:12.162082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:57:12.162082 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:57:12.164083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.164083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.164083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.165189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:57:12.166405 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a731081c-be30-487d-b4be-81538f434cc7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 404 len: 111 microversion: 2.1 time: 0.055098 Oct 03 10:57:12.167508 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2578/5472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:12 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:57:12.173109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-737cc79e-dcfc-4107-aaff-ba5b4c5ff798 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '.version_select at 0x7f074ea641f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:12.196933 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-737cc79e-dcfc-4107-aaff-ba5b4c5ff798 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-1952057984" status: 202 len: 0 microversion: 2.1 time: 0.026825 Oct 03 10:57:12.197911 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2579/5473] 10.222.0.27 () {58 vars in 1209 bytes} [Mon Oct 3 10:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1952057984 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:57:12.213773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:12.214411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:12.231955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.236278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.237145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.238171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:12.240379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:12.241455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:12.641480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:12.664614 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b612151f-4208-44ef-8d97-3bd3ce09bf4e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1673 microversion: 2.1 time: 0.462634 Oct 03 10:57:12.667456 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2580/5474] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:12 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1673 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:12.676979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-49cae8c3-64fa-4b5b-b1ac-03b0158b7862 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '.version_select at 0x7f074f56f3a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:12.712919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:12.753301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-49cae8c3-64fa-4b5b-b1ac-03b0158b7862 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385260952" status: 202 len: 0 microversion: 2.1 time: 0.083974 Oct 03 10:57:12.755322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2581/5475] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 10:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385260952 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:57:12.773832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1980386287", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "77b7129c-f93b-4c9f-acd6-8c3bb9d62151"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:12.794674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:12.806067 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b78afaf-9efe-407f-b4b5-c3e30333211e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 0.683302 Oct 03 10:57:12.808912 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2895/5476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:12 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:12.880831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:57:13.077514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:13.078530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:13.090444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:13.090967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:13.091718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:13.092713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:13.093228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:13.093876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:13.661970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:13.678809 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-91344846-f632-4672-ba4d-402e7b388823 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.606334 Oct 03 10:57:13.679749 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2896/5477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:13 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:13.700627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:13.701927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:13.711118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:13.712194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:13.713008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:13.714341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:13.714963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:13.715553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.229121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:57:14.230285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:57:14.230859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:57:14.231435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:57:14.235961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:57:14.258183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.258672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.259116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.259850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.260309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.260734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.287017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:57:14.295679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:57:14.311844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:14.313934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:57:14.316621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:57:14.320182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28fb61cf-13c7-451a-b518-52f85ec687a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1653 microversion: 2.1 time: 0.630713 Oct 03 10:57:14.330221 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2897/5478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:13 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1653 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:14.335676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:14.336410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:14.349966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.351570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.352193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.354683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.355405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.357442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.380293 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-46829273-c31a-4783-9758-7aced0e17ede tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623831 Oct 03 10:57:14.381432 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2582/5479] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:57:14.387687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:14.388475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:14.396155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.397374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.397921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.399109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.399709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.400237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.518341 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e4e6a85-0481-450c-9df1-e95d96e72e42 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.134952 Oct 03 10:57:14.521630 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2583/5480] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:57:14 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:57:14.544522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ed2cda6-58ac-49c9-9899-27a96988bfe0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:14.547857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ed2cda6-58ac-49c9-9899-27a96988bfe0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:14.705235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ed2cda6-58ac-49c9-9899-27a96988bfe0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:14.728201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ed2cda6-58ac-49c9-9899-27a96988bfe0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1209 microversion: 2.1 time: 0.202329 Oct 03 10:57:14.731232 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2584/5481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:14 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1209 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:14.774393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:14.775560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:14.805882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.806717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.807506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:14.808847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:14.809690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:14.810458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.076545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:15.091656 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-66653aff-bcf9-4f30-b3fc-84bd47c9dd3f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.357399 Oct 03 10:57:15.132431 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2585/5482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:14 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:15.142143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:15.143440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:15.156874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.159672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.160367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.161613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.162373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.163087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.450033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:15.459508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e8f2d85-2f12-489d-9d7d-771e6eba8f2f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.324701 Oct 03 10:57:15.473182 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2586/5483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:15 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:15.481376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:15.482329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:15.493028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.493804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.494857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.495779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.496436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.497113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.650983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:15.667892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0ad49fb6-c600-4e76-9fe4-b1d73e312b15 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 1.336422 Oct 03 10:57:15.668488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2898/5484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:14 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:15.755441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:15.765600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:15.766515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:15.767693 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f6ca2ea-afe2-435d-b296-ebfbce27a2b2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.293001 Oct 03 10:57:15.768305 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2587/5485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:15 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:15.796661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.796945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:15.797373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:15.797809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.798428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.799662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.800843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.801439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.806399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.806890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.807329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.808040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:15.808498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:15.808954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:15.920744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:15.944896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-29d0f7bb-ea2e-486d-a428-74d779ec2ec8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1261 microversion: 2.1 time: 0.185858 Oct 03 10:57:15.945635 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2899/5486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:15 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:15.998728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:16.012414 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b53a6ba-96ed-4b3b-ad59-939fd0f38b4d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.219869 Oct 03 10:57:16.019813 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2588/5487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:15 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:16.042023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:16.043362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:16.060455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:16.061427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:16.064070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:16.065087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:16.067917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:16.070007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:16.209839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-28dd476a-c920-4806-aa42-7a4066b15942 req-deae201d-de94-4ad6-81e4-8bdd94d61ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b808f438-48a6-449f-9ed7-ed6de09d37da", "name": "network-vif-plugged", "status": "completed", "tag": "5bbed468-f74d-4468-80e2-44eb5ade0560"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:16.221651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:16.234012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-28dd476a-c920-4806-aa42-7a4066b15942 req-deae201d-de94-4ad6-81e4-8bdd94d61ba5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:16.234706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-28dd476a-c920-4806-aa42-7a4066b15942 req-deae201d-de94-4ad6-81e4-8bdd94d61ba5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:16.235398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-28dd476a-c920-4806-aa42-7a4066b15942 req-deae201d-de94-4ad6-81e4-8bdd94d61ba5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:16.267297 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-28dd476a-c920-4806-aa42-7a4066b15942 req-deae201d-de94-4ad6-81e4-8bdd94d61ba5 service nova] Creating event network-vif-plugged:5bbed468-f74d-4468-80e2-44eb5ade0560 for instance b808f438-48a6-449f-9ed7-ed6de09d37da on n-h2-858383-3 Oct 03 10:57:16.282154 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-28dd476a-c920-4806-aa42-7a4066b15942 req-deae201d-de94-4ad6-81e4-8bdd94d61ba5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090636 Oct 03 10:57:16.283087 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2589/5488] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:57:16.488645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:16.489532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:16.503842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:16.504487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:16.505513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:16.507316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:16.508053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:16.508604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:16.753631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:16.765805 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-424bdd2b-b559-4795-934d-8f8adcd22e61 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 0.283818 Oct 03 10:57:16.767000 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2590/5489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:16 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:16.771817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:16.773269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:16.781128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:16.781946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:16.782572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:16.784426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:16.784426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:16.784426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.002562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:17.019986 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c26b463a-7d8f-48a6-93fa-26f8dc24001d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.986225 Oct 03 10:57:17.022651 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2900/5490] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:16 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:17.028905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1a07e1d6-d1ac-44a1-aeb9-1d42f8a50c5b req-6c8c08c5-47f1-47cf-b964-ebef3a29181e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb46ac5-761a-4efa-9b82-53dda9ad768b", "tag": "3d9551a5-6353-421b-bc71-181efffaae32"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:17.044386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1a07e1d6-d1ac-44a1-aeb9-1d42f8a50c5b req-6c8c08c5-47f1-47cf-b964-ebef3a29181e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:17.045437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1a07e1d6-d1ac-44a1-aeb9-1d42f8a50c5b req-6c8c08c5-47f1-47cf-b964-ebef3a29181e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:17.047448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1a07e1d6-d1ac-44a1-aeb9-1d42f8a50c5b req-6c8c08c5-47f1-47cf-b964-ebef3a29181e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.066484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1a07e1d6-d1ac-44a1-aeb9-1d42f8a50c5b req-6c8c08c5-47f1-47cf-b964-ebef3a29181e service nova] Creating event network-changed:3d9551a5-6353-421b-bc71-181efffaae32 for instance ecb46ac5-761a-4efa-9b82-53dda9ad768b on n-h2-858383-3 Oct 03 10:57:17.072351 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1a07e1d6-d1ac-44a1-aeb9-1d42f8a50c5b req-6c8c08c5-47f1-47cf-b964-ebef3a29181e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047681 Oct 03 10:57:17.073866 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2901/5491] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:17.082892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:17.084094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:17.092383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:17.092967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:17.093844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:17.094434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.095245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:17.096541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:17.097033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.104501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:17.108924 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe17c2df-cbbd-43ed-8e40-6a96e58edd86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 0.339881 Oct 03 10:57:17.145291 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2591/5492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:16 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:17.157424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:17.159204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:17.173020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:17.174095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:17.175060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.179353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:17.181860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:17.184114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.342165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:17.354256 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0eebe516-de39-4073-ad8e-b74e7592b23d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1267 microversion: 2.1 time: 0.278860 Oct 03 10:57:17.355112 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2902/5493] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:17 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1267 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:17.360003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bae8b49a-ac0f-4ec8-ac50-9a943c1cd70b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: .version_select at 0x7f074de45040>, body: {"keypair": {"name": "tempest-keypair-441928615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAynZf0LopSOijxg/ugcgL0Xm9RDA8x2oFB3Kc4gZT4ZqpGrKvYK5kSM79r0pKvujA82HqoqHfffKg7ySrRN/ctet82/H9w/50r8UYh9iRi2pxrnIT479nr2wAEgBluAMg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:17.408489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-bae8b49a-ac0f-4ec8-ac50-9a943c1cd70b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:57:17.423518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-bae8b49a-ac0f-4ec8-ac50-9a943c1cd70b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:57:17.505766 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bae8b49a-ac0f-4ec8-ac50-9a943c1cd70b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149194 Oct 03 10:57:17.515339 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2903/5494] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 10:57:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:17.792263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:17.793010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:17.806608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:17.809922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:17.812590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.815183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:17.816151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:17.819749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:17.969158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:18.000200 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b2e9fb47-f8ca-4d76-a504-ba7f7412f32c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.853048 Oct 03 10:57:18.004335 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2592/5495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:17 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:18.035699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:18.036331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:18.049298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:18.050337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:18.051334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:18.053190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:18.054712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:18.055434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:18.638996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:18.649032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5b1d2d02-9f4b-4f92-bc52-b719948ba028 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.625923 Oct 03 10:57:18.650030 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2593/5496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:18 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:18.657410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:18.658224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:18.670625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:18.671632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:18.672383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:18.673649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:18.674378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:18.675320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:18.878078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:18.887652 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d0cb44e-8c80-4e0f-aba2-f16b41b3d45f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1472 microversion: 2.1 time: 1.101907 Oct 03 10:57:18.901471 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2904/5497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:17 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1472 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:18.910773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:18.911765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:18.918079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:18.918832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:18.919471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:18.920525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:18.921183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:18.921956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:19.007270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:19.016883 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dd5044d-7af2-47c4-a5f9-cc4ad320c660 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 0.364505 Oct 03 10:57:19.018085 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2594/5498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:18 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:19.391641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:19.410553 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2734ae06-e667-4736-8d74-49f076dd1e8b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 0.504325 Oct 03 10:57:19.412174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2905/5499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:18 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:19.901229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-73bc4839-40ef-4331-8b96-eece73be89c3 req-137f1b1a-2dad-4eea-b4f6-1e0c0251832c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d20710-6321-4ddd-8c97-105b08a91a90", "tag": "11536bab-ebc2-402c-9044-f36afc5e82a8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:19.917217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:19.918568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:19.936429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:19.938133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:19.938837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:19.941228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:19.942663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:19.943311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:19.946758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-73bc4839-40ef-4331-8b96-eece73be89c3 req-137f1b1a-2dad-4eea-b4f6-1e0c0251832c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:19.950423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-73bc4839-40ef-4331-8b96-eece73be89c3 req-137f1b1a-2dad-4eea-b4f6-1e0c0251832c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:19.962338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-73bc4839-40ef-4331-8b96-eece73be89c3 req-137f1b1a-2dad-4eea-b4f6-1e0c0251832c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:20.012719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-73bc4839-40ef-4331-8b96-eece73be89c3 req-137f1b1a-2dad-4eea-b4f6-1e0c0251832c service nova] Creating event network-changed:11536bab-ebc2-402c-9044-f36afc5e82a8 for instance a5d20710-6321-4ddd-8c97-105b08a91a90 on n-h2-858383-3 Oct 03 10:57:20.026128 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-73bc4839-40ef-4331-8b96-eece73be89c3 req-137f1b1a-2dad-4eea-b4f6-1e0c0251832c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132096 Oct 03 10:57:20.027372 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2595/5500] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:20.046386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:20.047382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:20.058736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:20.060236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:20.060946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:20.062837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:20.064324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:20.065954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:20.385228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:20.396969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a6016676-5416-4628-a544-6b26de942057 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1644 microversion: 2.1 time: 0.487444 Oct 03 10:57:20.399447 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2906/5501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:19 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1644 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:20.413950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:20.436808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:20.438970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:20.445944 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9803e615-8e23-4212-bddc-e2729d70758f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 0.405861 Oct 03 10:57:20.446940 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2596/5502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:20 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:20.455535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:20.456455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:20.478805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:20.479744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:20.480368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:20.481421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:20.482113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:20.482747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:20.511113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:20.511996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:20.512647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:20.513596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:20.514242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:20.516810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:21.118882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:21.138219 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f4106372-83e5-4845-b30d-301cac2db33f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 0.689821 Oct 03 10:57:21.139480 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2597/5503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:20 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:21.480746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:21.482917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:21.497527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:21.498466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:21.499089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:21.500224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:21.501438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:21.501955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:21.538577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:21.636476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:21.664247 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c893791f-98af-40a7-87f6-03fb029234b6 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1644 microversion: 2.1 time: 1.238424 Oct 03 10:57:21.665850 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2907/5504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:20 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1644 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:21.705344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:21.706861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:21.721501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:21.722470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:21.726247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:21.728534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:21.729880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:21.730557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:22.442469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:22.452218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d965563e-a602-4cde-9918-7270dd7b0fb1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 0.979051 Oct 03 10:57:22.469431 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2598/5505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:21 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:22.475761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:22.476694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:22.485409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:22.486148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:22.486794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:22.487728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:22.488517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:22.489240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:22.618193 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95a398c6-e74d-474f-8129-7cd56f708700 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1795 microversion: 2.1 time: 0.918747 Oct 03 10:57:22.619583 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2908/5506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:21 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1795 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:22.992024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:23.001604 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b1c26fce-0249-4bd1-a9d8-432660f5d333 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 0.530648 Oct 03 10:57:23.013919 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2599/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:22 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:23.477094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:23.477843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:23.502719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:23.503372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:23.504036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:23.505147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:23.505806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:23.506485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:23.524550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-781935916", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89560c86-a183-4349-ab87-bdf14ea2ef6d"}], "security_groups": [{"name": "tempest-securitygroup--1808669174"}], "key_name": "tempest-keypair-441928615", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:23.908025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:23.923402 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-955600bd-f74c-4fe8-8585-90f04f7fb8df tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 0.450726 Oct 03 10:57:23.924001 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2909/5508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:23 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:23.985025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] validate_networks() for [('89560c86-a183-4349-ab87-bdf14ea2ef6d', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:57:24.035673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:24.036624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:24.045062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:24.045879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:24.046547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:24.047490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:24.049327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:24.050165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:24.274311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:24.376162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:24.404966 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7bd4c736-ca00-4a04-8ce2-f9885af1c176 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 0.371585 Oct 03 10:57:24.416920 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2910/5509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:24 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:24.646906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-51a48f18-d80a-4312-9b6f-6fc374947c1d req-068176f2-9d29-4fd7-a6f1-54e877303279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb46ac5-761a-4efa-9b82-53dda9ad768b", "name": "network-vif-plugged", "status": "completed", "tag": "3d9551a5-6353-421b-bc71-181efffaae32"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:24.681001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-51a48f18-d80a-4312-9b6f-6fc374947c1d req-068176f2-9d29-4fd7-a6f1-54e877303279 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:24.682003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-51a48f18-d80a-4312-9b6f-6fc374947c1d req-068176f2-9d29-4fd7-a6f1-54e877303279 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:24.682888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-51a48f18-d80a-4312-9b6f-6fc374947c1d req-068176f2-9d29-4fd7-a6f1-54e877303279 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:24.718540 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-51a48f18-d80a-4312-9b6f-6fc374947c1d req-068176f2-9d29-4fd7-a6f1-54e877303279 service nova] Creating event network-vif-plugged:3d9551a5-6353-421b-bc71-181efffaae32 for instance ecb46ac5-761a-4efa-9b82-53dda9ad768b on n-h2-858383-3 Oct 03 10:57:24.726153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:24.727938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-51a48f18-d80a-4312-9b6f-6fc374947c1d req-068176f2-9d29-4fd7-a6f1-54e877303279 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084518 Oct 03 10:57:24.729756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2911/5510] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:24.959292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:24.961275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:24.980955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:24.982422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:24.983389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:24.985356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:24.986468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:24.987183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:25.488048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:57:25.489324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:57:25.490998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:57:25.491810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:57:25.492848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:57:25.508051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:25.509187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:25.509771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:25.511232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:25.512022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:25.512813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:25.524964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:25.534013 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5105b2c-e933-483e-b5d8-b62bd40bef38 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1315 microversion: 2.1 time: 0.582453 Oct 03 10:57:25.548714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2912/5511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:24 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:25.559043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:25.559934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:25.573387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:25.576523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:25.579265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:25.580282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:25.582018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:25.584703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:57:25.584954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:25.613110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Getting quotas for user e07893383d2a480e942f0fa1a26846f5 and project a02cfe5fc3a948dcbd7bd6871e1b1ac1. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:57:25.654965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:57:25.665283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:57:25.757911 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-62380302-f34d-4e9c-b060-ef0eb1475800 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.241640 Oct 03 10:57:25.760117 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2600/5512] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:57:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:57:25.829635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b4fcc51-5e49-418e-b27f-40f98c15a25d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:25.830452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b4fcc51-5e49-418e-b27f-40f98c15a25d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:26.438207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b4fcc51-5e49-418e-b27f-40f98c15a25d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:26.450048 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b4fcc51-5e49-418e-b27f-40f98c15a25d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1240 microversion: 2.1 time: 0.673587 Oct 03 10:57:26.468887 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2601/5513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:25 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1240 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:26.568444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:26.569448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:26.581721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:26.586373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:26.588126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:26.588999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:26.589485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:26.590028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:26.962313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:26.974429 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89ef4b76-2b45-4bc4-bdae-2bce29798f5c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 1.424290 Oct 03 10:57:26.994064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2913/5514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:25 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:27.171716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:27.190577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-365fa6b2-a393-4c6b-8570-90a7c3b096f2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1502 microversion: 2.1 time: 0.629133 Oct 03 10:57:27.205815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2602/5515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:26 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1502 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:27.239356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:27.241007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:27.261980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:27.263888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:27.265297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:27.268397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:27.273428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:27.274928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:27.335675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'flavor' on Instance uuid ecb46ac5-761a-4efa-9b82-53dda9ad768b {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:57:27.456728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:27.482885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:27.488405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:27.558794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:27.559920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:27.560625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:27.561602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:27.562339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:27.563080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:27.762016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:27.785414 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-92dc0e7b-4d3f-4e75-ae1c-35a07c2127f0 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1292 microversion: 2.1 time: 0.312992 Oct 03 10:57:27.790689 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2603/5516] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:27 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1292 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:27.817964 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-26c9bbfb-6852-4639-be5f-e60851d8982c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b/action" status: 202 len: 0 microversion: 2.1 time: 0.587247 Oct 03 10:57:27.822347 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2914/5517] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:57:27 2022] POST /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:57:27.831183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:27.832548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:27.841434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:27.842580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:27.843355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:27.844666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:27.845880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:27.846512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:28.003578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:28.004581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:28.035589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:28.036802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:28.037998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:28.041124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:28.044110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:28.045212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:28.125914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:28.135606 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c45248bd-fafc-47d8-b9ee-7d03856fabdf tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.311857 Oct 03 10:57:28.140094 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2604/5518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:27 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:28.519969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:28.545673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-386e793e-5c42-4e60-bcf3-79e0eb68ec34 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 0.545300 Oct 03 10:57:28.549788 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2915/5519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:27 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:28.795136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f4dd5265-3626-4c7e-ae04-d6117a2d2ff8 req-299a5efb-e23f-4200-8867-48ae3bc11dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b808f438-48a6-449f-9ed7-ed6de09d37da", "tag": "5bbed468-f74d-4468-80e2-44eb5ade0560"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:28.815278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4dd5265-3626-4c7e-ae04-d6117a2d2ff8 req-299a5efb-e23f-4200-8867-48ae3bc11dc2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:28.815769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4dd5265-3626-4c7e-ae04-d6117a2d2ff8 req-299a5efb-e23f-4200-8867-48ae3bc11dc2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:28.816203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f4dd5265-3626-4c7e-ae04-d6117a2d2ff8 req-299a5efb-e23f-4200-8867-48ae3bc11dc2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:28.816340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:28.816926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:28.830446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:28.831237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:28.831866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:28.832849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:28.833503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:28.834184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:28.850701 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f4dd5265-3626-4c7e-ae04-d6117a2d2ff8 req-299a5efb-e23f-4200-8867-48ae3bc11dc2 service nova] Creating event network-changed:5bbed468-f74d-4468-80e2-44eb5ade0560 for instance b808f438-48a6-449f-9ed7-ed6de09d37da on n-h2-858383-3 Oct 03 10:57:28.864640 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f4dd5265-3626-4c7e-ae04-d6117a2d2ff8 req-299a5efb-e23f-4200-8867-48ae3bc11dc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075132 Oct 03 10:57:28.868599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2605/5520] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:29.006606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:29.045983 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc696bec-6f50-48bb-9ae2-8c36b4c70384 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1298 microversion: 2.1 time: 0.234250 Oct 03 10:57:29.067260 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2916/5521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:28 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1298 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:29.169336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:29.170387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:29.184569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:29.185517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:29.186188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:29.187900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:29.189215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:29.189995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:29.336289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-75d1426b-9adc-41b8-8b44-db58919f0f69 req-a5acbdb4-4484-4391-86b4-65635f41c114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d20710-6321-4ddd-8c97-105b08a91a90", "name": "network-vif-plugged", "status": "completed", "tag": "11536bab-ebc2-402c-9044-f36afc5e82a8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:29.358940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-75d1426b-9adc-41b8-8b44-db58919f0f69 req-a5acbdb4-4484-4391-86b4-65635f41c114 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:29.359753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-75d1426b-9adc-41b8-8b44-db58919f0f69 req-a5acbdb4-4484-4391-86b4-65635f41c114 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:29.360800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-75d1426b-9adc-41b8-8b44-db58919f0f69 req-a5acbdb4-4484-4391-86b4-65635f41c114 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:29.385104 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-75d1426b-9adc-41b8-8b44-db58919f0f69 req-a5acbdb4-4484-4391-86b4-65635f41c114 service nova] Creating event network-vif-plugged:11536bab-ebc2-402c-9044-f36afc5e82a8 for instance a5d20710-6321-4ddd-8c97-105b08a91a90 on n-h2-858383-3 Oct 03 10:57:29.392120 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-75d1426b-9adc-41b8-8b44-db58919f0f69 req-a5acbdb4-4484-4391-86b4-65635f41c114 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068242 Oct 03 10:57:29.394008 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2917/5522] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:29.572671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:29.573734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:29.593813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:29.595004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:29.595004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:29.595669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:29.596488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:29.596622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:29.766249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:29.791065 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fb445252-82b3-4f58-a54c-643531b46329 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.626899 Oct 03 10:57:29.795854 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2606/5523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:29 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:30.073935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:30.074815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:30.083734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:30.085095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:30.085710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:30.086661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:30.088056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:30.088826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:30.658101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:30.662917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:30.670324 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-66175c17-357a-4fb1-a584-4ea51ca2b1d3 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1298 microversion: 2.1 time: 0.597142 Oct 03 10:57:30.676893 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2607/5524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:30 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1298 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:30.706743 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95d90052-642d-42d8-9f15-1fec1c3e7e59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 1.132618 Oct 03 10:57:30.714370 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2918/5525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:29 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:30.819906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:30.821826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:30.828535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:30.829342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:30.829971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:30.830858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:30.831483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:30.832076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:31.373164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:31.387650 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dbb24e2e-8c20-48da-af18-8c4263e3b60e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.571689 Oct 03 10:57:31.388633 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2608/5526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:30 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:31.704758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:31.706930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:31.715044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:31.715842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:31.716468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:31.717381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:31.717995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:31.718596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:31.738500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:31.739817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:31.750572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:31.752851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:31.753602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:31.754235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:31.755182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:31.757542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:31.760332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:32.162278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:32.179987 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a434526f-1e85-4baf-b795-4f28781dc334 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1309 microversion: 2.1 time: 0.445335 Oct 03 10:57:32.183490 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2609/5527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:31 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1309 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:32.399094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:32.411951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-797c9ac0-414b-4691-bad9-bcb29770beee tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.715116 Oct 03 10:57:32.417942 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2919/5528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:31 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:32.438757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:32.439379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:32.452033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:32.452537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:32.453007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:32.457501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:32.461411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:32.462286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:32.836113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:32.852459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b18b34df-b5c8-4b1a-a47e-4f7ff30c665a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.416788 Oct 03 10:57:32.853561 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2610/5529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:32 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:33.205884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:33.206761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:33.213781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:33.214648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:33.215358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:33.216486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:33.217401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:33.218011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:33.441996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:33.442778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:33.466846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:33.467686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:33.471045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:33.472359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:33.477148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:33.488828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:33.759150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:33.783433 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-908c4345-4eac-408e-b4bb-7175caa98832 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1491 microversion: 2.1 time: 0.581217 Oct 03 10:57:33.798914 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2920/5530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:33 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1491 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:33.854010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-afd1cc66-ad07-4039-816f-bc257cf03833 req-e043b848-a522-49c7-95f4-c48681db9623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a479f401-6d47-49e7-9694-6a54de5c8465", "tag": "d539c2e1-c853-4068-b8fe-2a07761c1232"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:33.897419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-afd1cc66-ad07-4039-816f-bc257cf03833 req-e043b848-a522-49c7-95f4-c48681db9623 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:33.904648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-afd1cc66-ad07-4039-816f-bc257cf03833 req-e043b848-a522-49c7-95f4-c48681db9623 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:33.905219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-afd1cc66-ad07-4039-816f-bc257cf03833 req-e043b848-a522-49c7-95f4-c48681db9623 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:33.925329 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-afd1cc66-ad07-4039-816f-bc257cf03833 req-e043b848-a522-49c7-95f4-c48681db9623 service nova] Creating event network-changed:d539c2e1-c853-4068-b8fe-2a07761c1232 for instance a479f401-6d47-49e7-9694-6a54de5c8465 on n-h2-858383-3 Oct 03 10:57:33.942864 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-afd1cc66-ad07-4039-816f-bc257cf03833 req-e043b848-a522-49c7-95f4-c48681db9623 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113985 Oct 03 10:57:33.945218 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2921/5531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:33.955089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:33.956244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:33.968257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:33.970815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:33.971565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:33.973295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:33.974047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:33.974889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:34.032416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:34.045962 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-badcfc6c-29ef-43c5-b0e8-51545e434432 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.608865 Oct 03 10:57:34.051039 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2611/5532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:33 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:34.058628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1980386287", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "77b7129c-f93b-4c9f-acd6-8c3bb9d62151"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:34.148655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:57:35.036275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:57:35.036843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:57:35.037183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:57:35.037630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:57:35.038052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:57:35.047854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:35.048439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:35.048920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:35.049827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:35.050434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:35.050863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:35.070577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:57:35.076300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:57:35.089370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:57:35.091695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:57:35.141600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea42fd6c-4d80-4bcd-ae7a-f4062a3556df tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087621 Oct 03 10:57:35.142663 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2612/5533] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:57:35.147238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:35.147855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:35.154375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:35.154877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:35.155323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:35.156040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:35.156513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:35.157225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:35.252110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:35.268348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1a4ff45-96be-44ac-ad87-97f5bc10807c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 1.321239 Oct 03 10:57:35.269276 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2922/5534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:33 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:35.274674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a85d4c3d-84a1-4512-87f7-4d11a27a422c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:35.275553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a85d4c3d-84a1-4512-87f7-4d11a27a422c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:35.345354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:35.361213 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3a01e3ac-6cef-4f00-a754-72c8fa482c96 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.217241 Oct 03 10:57:35.366123 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2613/5535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:35 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:35.457777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a85d4c3d-84a1-4512-87f7-4d11a27a422c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:35.469139 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a85d4c3d-84a1-4512-87f7-4d11a27a422c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1209 microversion: 2.1 time: 0.198509 Oct 03 10:57:35.469843 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2923/5536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:35 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1209 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:36.297936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:36.300026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:36.308291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:36.309154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:36.309855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:36.310842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:36.312074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:36.312692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:36.392337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:36.394537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:36.404703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:36.405486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:36.406147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:36.406929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:36.407558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:36.408118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:36.648739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:36.660952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:36.661131 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a095de28-9d3f-45aa-9195-d4bcff402477 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.366517 Oct 03 10:57:36.662299 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2614/5537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:36 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:36.668615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:36.669787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:36.682331 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-85f8d445-9599-41fc-aa8e-222ab22599d7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.292978 Oct 03 10:57:36.683377 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2924/5538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:36 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:36.689553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:36.690860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:36.692658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:36.695182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:36.696437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:36.697955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:36.844737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:36.855114 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b2a7ecc-86dc-4081-93bf-5bab9cdbf699 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1261 microversion: 2.1 time: 0.191221 Oct 03 10:57:36.869328 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2615/5539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:36 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:37.692670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:37.695478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:37.705807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:37.706311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:37.706755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:37.707472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:37.707927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:37.708356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:37.714799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:37.715711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:37.729905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:37.730802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:37.731509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:37.732471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:37.733196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:37.734007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:38.130458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:38.134221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:38.142364 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e442020-85e8-4ab7-845f-817cf2b570c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.432586 Oct 03 10:57:38.143914 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f25843d-5857-43d4-a411-5412bd6f0fb2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.459582 Oct 03 10:57:38.156841 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2616/5540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:37 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:38.173401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:38.174437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:38.192455 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2925/5541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:37 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:38.197678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:38.198199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:38.198923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:38.199681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:38.200191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:38.201567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:38.365800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:38.379628 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c8f991d5-8d4c-4397-a910-c91926ebba9f tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1269 microversion: 2.1 time: 0.221614 Oct 03 10:57:38.380401 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2617/5542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:38 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1269 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:39.180275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:39.180951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:39.187817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:39.188093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:39.188731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:39.189669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:39.190296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:39.190896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:39.194383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:39.195678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:39.209419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:39.209927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:39.210376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:39.211102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:39.211570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:39.212005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:39.227056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:39.492280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:39.513706 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7e29d78a-4944-4ff8-953d-2c3daf6c01be tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.337799 Oct 03 10:57:39.514846 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2926/5543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:39 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:39.521188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:39.522064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:39.540639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:39.541294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:39.541855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:39.542721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:39.543266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:39.543840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:39.667699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:39.678801 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f25eb0c-a5bb-4e7d-b017-3643e8c0716a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1267 microversion: 2.1 time: 0.161610 Oct 03 10:57:39.680621 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2927/5544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:39 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:40.036964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:40.054365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-edcacefa-26b2-4969-884f-51209b366dbc tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.864598 Oct 03 10:57:40.054971 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2618/5545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:39 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:40.538632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:40.539831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:40.558679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:40.559460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:40.560093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:40.561025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:40.562241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:40.563048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:40.727211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:40.729603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:40.770055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:40.770760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:40.771383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:40.772951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:40.773637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:40.774515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:40.971836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:40.979812 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-761f9cdb-9883-4b89-b2b6-26305e70e114 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.446202 Oct 03 10:57:40.980726 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2928/5546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:40 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:41.078834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:41.079461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:41.084808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:41.094831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:41.095579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:41.096367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:41.098904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:41.099745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:41.100200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:41.136892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:41.145066 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55e1f561-85af-43c5-ac32-3a81e3d155b5 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.440359 Oct 03 10:57:41.156574 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2619/5547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:40 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:41.524318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c1ea8380-e019-44ab-94af-10bda79f0d8f req-c92eb3bf-ba2f-48ed-a710-1c1d4098c9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a479f401-6d47-49e7-9694-6a54de5c8465", "name": "network-vif-plugged", "status": "completed", "tag": "d539c2e1-c853-4068-b8fe-2a07761c1232"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:41.524690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:41.546260 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-456861fc-9b8c-4b37-87a0-9877d175e328 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.471537 Oct 03 10:57:41.550763 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2929/5548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:41 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:41.554120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c1ea8380-e019-44ab-94af-10bda79f0d8f req-c92eb3bf-ba2f-48ed-a710-1c1d4098c9e9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:41.554879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c1ea8380-e019-44ab-94af-10bda79f0d8f req-c92eb3bf-ba2f-48ed-a710-1c1d4098c9e9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:41.555581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c1ea8380-e019-44ab-94af-10bda79f0d8f req-c92eb3bf-ba2f-48ed-a710-1c1d4098c9e9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:41.569429 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c1ea8380-e019-44ab-94af-10bda79f0d8f req-c92eb3bf-ba2f-48ed-a710-1c1d4098c9e9 service nova] Creating event network-vif-plugged:d539c2e1-c853-4068-b8fe-2a07761c1232 for instance a479f401-6d47-49e7-9694-6a54de5c8465 on n-h2-858383-3 Oct 03 10:57:41.579348 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c1ea8380-e019-44ab-94af-10bda79f0d8f req-c92eb3bf-ba2f-48ed-a710-1c1d4098c9e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061061 Oct 03 10:57:41.580418 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2620/5549] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:42.003686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:42.004420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:42.013066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:42.013650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:42.014378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:42.015462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:42.016201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:42.017576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:42.184144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:42.184880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:42.196816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:42.201669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:42.202393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:42.204617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:42.209572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:42.210773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:42.597959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:42.610174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db359251-01bc-4d73-b615-0b3bd703f044 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.430084 Oct 03 10:57:42.628750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2621/5550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:42 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:42.636474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b41d808d-10d1-4ad6-b8f5-f182f979c3ef req-85a2ff46-731d-42cf-9536-4507eac0ba76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a992806-7263-45c7-ba3c-f3b4209429bc", "tag": "bd559988-5664-4137-8fe5-6efb2c1d4c7d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:42.649388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b41d808d-10d1-4ad6-b8f5-f182f979c3ef req-85a2ff46-731d-42cf-9536-4507eac0ba76 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:42.650224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b41d808d-10d1-4ad6-b8f5-f182f979c3ef req-85a2ff46-731d-42cf-9536-4507eac0ba76 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:42.651132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b41d808d-10d1-4ad6-b8f5-f182f979c3ef req-85a2ff46-731d-42cf-9536-4507eac0ba76 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:42.672052 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b41d808d-10d1-4ad6-b8f5-f182f979c3ef req-85a2ff46-731d-42cf-9536-4507eac0ba76 service nova] Creating event network-changed:bd559988-5664-4137-8fe5-6efb2c1d4c7d for instance 3a992806-7263-45c7-ba3c-f3b4209429bc on n-h2-858383-3 Oct 03 10:57:42.679659 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b41d808d-10d1-4ad6-b8f5-f182f979c3ef req-85a2ff46-731d-42cf-9536-4507eac0ba76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048806 Oct 03 10:57:42.681070 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2622/5551] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:42.690814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:42.692086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:42.701548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:42.708754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:42.710770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:42.711805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:42.713729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:42.715218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:42.716178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:42.854286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:42.876019 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10881bec-dabd-4e2c-8b5c-140c0105ed76 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1366 microversion: 2.1 time: 0.875519 Oct 03 10:57:42.876898 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2930/5552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:41 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1366 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:42.962191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:42.970849 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42ca7353-b5f8-40a4-b451-8d1aa7ecaf18 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.288124 Oct 03 10:57:42.987436 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2623/5553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:42 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:43.636474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:43.637300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:43.657206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:43.657871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:43.658328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:43.659069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:43.659534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:43.659971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:43.905001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:43.905465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:43.916323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:43.920297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:43.921475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:43.922261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:43.922597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:43.923153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:43.957932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:43.979950 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-043ad926-9564-4c89-b1b9-f72944488756 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.347682 Oct 03 10:57:43.980560 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2931/5554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:43 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:44.002795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:44.003407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:44.015510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:44.016241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:44.016894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:44.022613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:44.023284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:44.023917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:44.323506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:44.333677 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d681cc0e-34d4-4109-b200-18726933cd04 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1556 microversion: 2.1 time: 0.437604 Oct 03 10:57:44.336280 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2624/5555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:43 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1556 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:44.360021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:44.360387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:44.367959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:44.368481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:44.368963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:44.369686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:44.370200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:44.370645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:44.460689 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93e9f121-9018-4ebe-94c0-b270599fc84b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105345 Oct 03 10:57:44.461410 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2625/5556] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:57:44 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:57:44.547702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:44.563245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-20a3c056-df12-4b7d-9424-7e2a5afc265b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.564247 Oct 03 10:57:44.577183 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2932/5557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:43 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:45.007527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:45.010545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:45.021477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:45.023342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:45.024068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:45.025925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:45.026883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:45.027558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:45.061128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:45.083864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:45.393874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:45.418686 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75b013ad-3350-4ab5-aa01-fef9e97050e6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.414182 Oct 03 10:57:45.422254 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2626/5558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:45 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:45.592625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:45.594604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:45.607998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:45.610105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:45.611608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:45.612337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:45.613553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:45.614427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:45.615807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:46.194873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:46.211173 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-700fef09-4049-40dc-8106-71cbd060efd1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.623577 Oct 03 10:57:46.227396 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2933/5559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:45 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:46.458239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:46.461100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:46.475073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:46.476176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:46.477029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:46.478566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:46.479307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:46.480003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:46.892918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:46.905996 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ec3a1c1-c2c5-4a71-8e84-87489a2acf60 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.461819 Oct 03 10:57:46.906943 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2627/5560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:46 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:47.244612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:47.246467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:47.256116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:47.257281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:47.257961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:47.258875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:47.261199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:47.261834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:47.576447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-21cebc95-20cd-41d7-b11b-a348992ba591 req-8521126f-9ad2-4fa9-91c6-7212b8a831ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a479f401-6d47-49e7-9694-6a54de5c8465", "tag": "d539c2e1-c853-4068-b8fe-2a07761c1232"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:47.597825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21cebc95-20cd-41d7-b11b-a348992ba591 req-8521126f-9ad2-4fa9-91c6-7212b8a831ed service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:47.598425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21cebc95-20cd-41d7-b11b-a348992ba591 req-8521126f-9ad2-4fa9-91c6-7212b8a831ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:47.606469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21cebc95-20cd-41d7-b11b-a348992ba591 req-8521126f-9ad2-4fa9-91c6-7212b8a831ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:47.632973 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-21cebc95-20cd-41d7-b11b-a348992ba591 req-8521126f-9ad2-4fa9-91c6-7212b8a831ed service nova] Creating event network-changed:d539c2e1-c853-4068-b8fe-2a07761c1232 for instance a479f401-6d47-49e7-9694-6a54de5c8465 on n-h2-858383-3 Oct 03 10:57:47.643269 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-21cebc95-20cd-41d7-b11b-a348992ba591 req-8521126f-9ad2-4fa9-91c6-7212b8a831ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070824 Oct 03 10:57:47.643887 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2628/5561] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:57:47.781072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:47.815713 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0d3ca611-47a9-49ff-ac46-a860fcfaae45 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.576662 Oct 03 10:57:47.834112 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2934/5562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:47 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:47.936613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:47.937356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:47.950125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:47.951159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:47.952187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:47.960116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:47.960694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:47.961308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:48.727523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:48.739201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94f72c57-c704-42c9-aa5e-3a76da9254cf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.806780 Oct 03 10:57:48.752665 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2629/5563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:47 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:48.848694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:48.849852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:48.862729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:48.863885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:48.864997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:48.866543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:48.867770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:48.870220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:49.165730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:49.175045 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bfc91822-c33b-48ac-a9df-54227ee51b81 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.330217 Oct 03 10:57:49.176062 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2935/5564] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:48 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:49.766287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:49.767123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:49.782483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:49.782980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:49.783423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:49.784150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:49.784612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:49.788177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:50.124239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:50.148822 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55ebe440-8b33-4b9a-aad2-f31462557897 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.388516 Oct 03 10:57:50.149763 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2630/5565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:49 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:50.203741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:50.203741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:50.216839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:50.217678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:50.218294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:50.219090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:50.219626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:50.220131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:51.004137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:51.014383 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34c7482a-e231-46f8-8011-c825afd8801b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.815768 Oct 03 10:57:51.015083 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2936/5566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:50 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:51.179088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:51.180903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:51.189465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:51.190151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:51.191553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:51.192631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:51.195945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:51.196931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:51.560121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c6aad848-7771-464b-a39b-336ddd92b101 req-0b7ba515-95b0-4e76-80f3-65aefcde3630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a992806-7263-45c7-ba3c-f3b4209429bc", "name": "network-vif-plugged", "status": "completed", "tag": "bd559988-5664-4137-8fe5-6efb2c1d4c7d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:51.577007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6aad848-7771-464b-a39b-336ddd92b101 req-0b7ba515-95b0-4e76-80f3-65aefcde3630 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:51.577927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6aad848-7771-464b-a39b-336ddd92b101 req-0b7ba515-95b0-4e76-80f3-65aefcde3630 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:51.578800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6aad848-7771-464b-a39b-336ddd92b101 req-0b7ba515-95b0-4e76-80f3-65aefcde3630 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:51.597805 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c6aad848-7771-464b-a39b-336ddd92b101 req-0b7ba515-95b0-4e76-80f3-65aefcde3630 service nova] Creating event network-vif-plugged:bd559988-5664-4137-8fe5-6efb2c1d4c7d for instance 3a992806-7263-45c7-ba3c-f3b4209429bc on n-h2-858383-3 Oct 03 10:57:51.609648 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c6aad848-7771-464b-a39b-336ddd92b101 req-0b7ba515-95b0-4e76-80f3-65aefcde3630 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058352 Oct 03 10:57:51.611189 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2937/5567] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:51.969362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:51.981611 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed4a9111-abc6-41e2-8953-9e606eaf19c8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.807706 Oct 03 10:57:52.001144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2631/5568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:51 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:52.040969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:52.042609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:52.051111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:52.052905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:52.053801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:52.055082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:52.055773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:52.056506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:52.061924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:52.704758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:52.712965 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1994106e-77ba-49c7-b97e-f556e1b52c33 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1508 microversion: 2.1 time: 0.678629 Oct 03 10:57:52.713708 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2938/5569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:52 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1508 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:53.006113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:53.006749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:53.018170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:53.018672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:53.019283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:53.020155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:53.020839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:53.021434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:53.445639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:53.458637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c04e5c6-2660-4ced-9583-7d0ff119df48 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1309 microversion: 2.1 time: 0.454999 Oct 03 10:57:53.460819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2632/5570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:53 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1309 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:53.736421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:53.738773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:53.753993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:53.754493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:53.755100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:53.765898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:53.766409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:53.766851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:54.116950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:54.129802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b23b7a3-5221-4ca0-96d2-684859a75484 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1529 microversion: 2.1 time: 0.397042 Oct 03 10:57:54.130632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2939/5571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:53 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1529 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:54.493192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:54.495941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:54.506309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:54.507215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:54.507980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:54.509003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:54.509863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:54.510788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:54.807226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:54.822918 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a053e611-0f91-4cde-941c-d314ccb829f0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1491 microversion: 2.1 time: 0.335127 Oct 03 10:57:54.824382 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2633/5572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:54 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1491 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:54.846759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:54.847391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:54.862120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:54.862834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:54.863659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:54.865877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:54.866591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:54.867119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.112596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:55.126841 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22f3f8e7-8c0e-4d51-ace7-e3864f642b4e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1491 microversion: 2.1 time: 0.284085 Oct 03 10:57:55.127748 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2940/5573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:54 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1491 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:55.151728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:55.152750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:55.154109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:55.154606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:55.162015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.164480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.164614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.165155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.165596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.165740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.167357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.168229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.168947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.169075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.169541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.172049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.429130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:55.439978 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-60c33262-a931-417f-b232-98a5d44001ee tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1529 microversion: 2.1 time: 0.289782 Oct 03 10:57:55.440571 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2941/5574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:55 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1529 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:55.544598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:55.556271 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6158d361-0995-4f8f-b1d6-201aeea25ecc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1491 microversion: 2.1 time: 0.408675 Oct 03 10:57:55.577604 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2634/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:55 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1491 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:55.583522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:55.585704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:55.599142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.600327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.601054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.602377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.603245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.604056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.643471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:55.647297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:55.660552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.664813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.665711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.666737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.668941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.670011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.681289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:57:55.866121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-025e6147-76c7-414f-b8e5-0b874808e48b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.225719 Oct 03 10:57:55.871044 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2635/5576] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:57:55 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:57:55.874520 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe5584d8-d240-4df5-80e7-4f0972d12ae9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 204 len: 0 microversion: 2.1 time: 0.295527 Oct 03 10:57:55.883028 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2942/5577] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:57:55 2022] DELETE /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:57:55.886145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:55.888931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:55.895531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:55.903291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.903766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.904218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.905052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.905527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.905967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.911877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:57:55.914397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:55.936319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.936962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.937733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:55.941468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:55.942047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:55.942572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:56.175619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:56.185989 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b48a2b61-ba1d-402f-b8ac-841b3c1a9b9c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1670 microversion: 2.1 time: 0.311942 Oct 03 10:57:56.186973 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2636/5578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:55 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1670 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:56.411602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:56.423535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b30ccde-008e-4bc4-a118-0ecfb7d212da tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1497 microversion: 2.1 time: 0.536350 Oct 03 10:57:56.426126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2943/5579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:55 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1497 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:56.463497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:56.464382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:56.471250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:56.472077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:56.472748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:56.473887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:56.475484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:56.476498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:56.908062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:56.924281 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-17215ed6-02e7-480c-bb7a-11b882e18254 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1529 microversion: 2.1 time: 0.464585 Oct 03 10:57:56.943025 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2637/5580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:56 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1529 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:57.218575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:57.220355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:57.302596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:57.303401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:57.306590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:57.308104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:57.309058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:57.312355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:57.450894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:57.451893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:57.469966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:57.470923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:57.473578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:57.475729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:57.477088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:57.479459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:58.031622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:58.045588 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-512c140f-29df-407f-8a74-1a2d09b02486 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1670 microversion: 2.1 time: 0.834426 Oct 03 10:57:58.046916 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2944/5581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:57 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1670 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:58.065562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-87bfb1e4-b369-4461-8874-c5531cdf399c req-88867198-ad67-4203-ab02-232d01acddfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb46ac5-761a-4efa-9b82-53dda9ad768b", "name": "network-vif-plugged", "status": "completed", "tag": "3d9551a5-6353-421b-bc71-181efffaae32"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:58.083685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-87bfb1e4-b369-4461-8874-c5531cdf399c req-88867198-ad67-4203-ab02-232d01acddfb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:58.084590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-87bfb1e4-b369-4461-8874-c5531cdf399c req-88867198-ad67-4203-ab02-232d01acddfb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:58.089457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-87bfb1e4-b369-4461-8874-c5531cdf399c req-88867198-ad67-4203-ab02-232d01acddfb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:58.109550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-87bfb1e4-b369-4461-8874-c5531cdf399c req-88867198-ad67-4203-ab02-232d01acddfb service nova] Creating event network-vif-plugged:3d9551a5-6353-421b-bc71-181efffaae32 for instance ecb46ac5-761a-4efa-9b82-53dda9ad768b on n-h2-858383-3 Oct 03 10:57:58.139041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-87bfb1e4-b369-4461-8874-c5531cdf399c req-88867198-ad67-4203-ab02-232d01acddfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090253 Oct 03 10:57:58.141273 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2945/5582] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:57:58.157348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:58.158654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:58.181652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:58.184135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:58.184717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:58.187533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:58.188628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:58.189404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:58.388028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:58.404112 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5b3b7177-aa14-4601-a679-f315269e1583 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1497 microversion: 2.1 time: 0.959226 Oct 03 10:57:58.430033 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2638/5583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:57 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1497 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:58.733173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:58.743801 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a4a53c1e-0166-42c7-879e-b7ef55a90fe4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.599923 Oct 03 10:57:58.744719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2946/5584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:58 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:57:59.074852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:59.075475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:59.106441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.107094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.107833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:59.111162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.111976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.112744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:59.219913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b98cff8d-f82c-4e30-9722-c7ea48f55606 req-721c4c6d-d721-4b79-90eb-1c696198b3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a992806-7263-45c7-ba3c-f3b4209429bc", "name": "network-vif-deleted", "tag": "bd559988-5664-4137-8fe5-6efb2c1d4c7d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:57:59.242640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b98cff8d-f82c-4e30-9722-c7ea48f55606 req-721c4c6d-d721-4b79-90eb-1c696198b3c4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.243135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b98cff8d-f82c-4e30-9722-c7ea48f55606 req-721c4c6d-d721-4b79-90eb-1c696198b3c4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.243573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b98cff8d-f82c-4e30-9722-c7ea48f55606 req-721c4c6d-d721-4b79-90eb-1c696198b3c4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:59.277702 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b98cff8d-f82c-4e30-9722-c7ea48f55606 req-721c4c6d-d721-4b79-90eb-1c696198b3c4 service nova] Creating event network-vif-deleted:bd559988-5664-4137-8fe5-6efb2c1d4c7d for instance 3a992806-7263-45c7-ba3c-f3b4209429bc on n-h2-858383-3 Oct 03 10:57:59.286909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b98cff8d-f82c-4e30-9722-c7ea48f55606 req-721c4c6d-d721-4b79-90eb-1c696198b3c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070556 Oct 03 10:57:59.288155 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2947/5585] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:57:59.433259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:59.434100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:59.479504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.481777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.483375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:59.485853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.486568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.491536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:59.636059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.636554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.637024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:59.637484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lazy-loading 'fault' on Instance uuid 3a992806-7263-45c7-ba3c-f3b4209429bc {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:57:59.726555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:57:59.738827 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b08f38d-37e6-4a9c-a9b3-dd2e25109781 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1299 microversion: 2.1 time: 0.310441 Oct 03 10:57:59.745473 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2948/5586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:59 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1299 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:57:59.770926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:57:59.776973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:57:59.792153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.794288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.795099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:57:59.797480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:57:59.798180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:57:59.800409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:00.052696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:00.071727 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83f45ff2-1f7f-47c5-ad6b-e9725afa51db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1670 microversion: 2.1 time: 1.002263 Oct 03 10:58:00.072324 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2639/5587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:59 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1670 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:00.262790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:00.286121 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4195691f-178a-40b1-8b4d-aa02b4e98ce4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.520020 Oct 03 10:58:00.288786 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2949/5588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:57:59 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:00.767801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:00.768491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:00.803024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:00.803578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:00.804021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:00.826974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:00.841321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:00.841943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:01.018371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:01.022363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:01.025559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:01.026249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lazy-loading 'fault' on Instance uuid 3a992806-7263-45c7-ba3c-f3b4209429bc {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:58:01.101247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:01.101874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:01.118176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:01.118834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:01.119299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:01.120153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:01.120681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:01.121295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:01.321474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:01.336030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9afc8037-cc4a-43fd-81b7-ae739b1a660b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 200 len: 1299 microversion: 2.1 time: 0.572001 Oct 03 10:58:01.339909 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2640/5589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:00 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 1299 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:01.366387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:01.367762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:01.385815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:01.386906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:01.388810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:01.392963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:01.395725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:01.396731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:01.821632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:01.830290 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c80f08b-0668-45aa-8317-c36ea336e396 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1675 microversion: 2.1 time: 0.734103 Oct 03 10:58:01.836216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2950/5590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:01 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1675 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:01.861594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:01.871134 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c6e96bf-d452-4074-a6c3-632b080a1c80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.520459 Oct 03 10:58:01.875791 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2641/5591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:01 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:02.373471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:02.374811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:02.395823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:02.401331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:02.405636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:02.409528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:02.414390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:02.416091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:02.511949 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc HTTP/1.1 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3a992806-7263-45c7-ba3c-f3b4209429bc'} Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:02.521327 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:02.527799 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:02.527799 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:02.527799 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:02.527799 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:58:02.527799 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:58:02.527799 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:58:02.527799 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:02.530526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:58:02.536236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-94397653-c81d-4794-bb71-33bbfa7e23b8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 404 len: 111 microversion: 2.1 time: 0.168090 Oct 03 10:58:02.541011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2951/5592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:02 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:58:02.552428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:02.553974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:02.604943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:02.608567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:02.609346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:02.610332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:02.613294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:02.614133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:02.738848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:58:02.870595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:02.872376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:02.910772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:02.918911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:02.919689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:02.925910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:02.929538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:02.930233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:03.088615 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a0de20d-b7c6-4250-9ea2-53d81a41162d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 204 len: 0 microversion: 2.1 time: 0.541501 Oct 03 10:58:03.089935 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2642/5593] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:58:02 2022] DELETE /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:58:03.096214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:03.101512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:03.118497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:03.119564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:03.127832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:03.129263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:03.129966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:03.130617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:03.620122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:03.630272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e42b73da-307f-4492-ab44-50b3a32b5f52 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.538848 Oct 03 10:58:03.630908 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2643/5594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:03 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:03.662997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:03.663896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:03.687151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:03.687916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:03.689247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:03.689679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:03.690285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:03.691264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:03.936490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:03.951316 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa9c160f-642f-45c9-ae4f-1aa09f86be6c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1497 microversion: 2.1 time: 0.301217 Oct 03 10:58:03.952956 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2644/5595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:03 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:04.136198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:04.182206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bbc487e6-ff15-42b1-8243-e662d6571fab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.317980 Oct 03 10:58:04.186752 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2952/5596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:02 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:04.660161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:04.660810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:04.668282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:04.673598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:04.674391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:04.675286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:04.685756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:04.686339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:04.982221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:04.982854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:04.996160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:04.996676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:04.997166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:04.999452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:04.999932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:05.000377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:05.122727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:05.139660 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a5d8d11-2048-42eb-8649-f13597701045 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.482495 Oct 03 10:58:05.142221 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2645/5597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:04 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:05.414489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:05.440600 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-238bdc60-cbd2-4df3-977a-fb232d47baa9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1497 microversion: 2.1 time: 0.461717 Oct 03 10:58:05.450156 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2953/5598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:04 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1497 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:06.168458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:06.174067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:06.191780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:06.196815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:06.197849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:06.202076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:06.205604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:06.208853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:06.475940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:06.476630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:06.488129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:06.491160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:06.491635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:06.492367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:06.492920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:06.498385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:06.789342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:06.792391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:06.824506 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-70b55052-fa79-4b39-a067-4c648dc4a11d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 200 len: 1294 microversion: 2.1 time: 0.356947 Oct 03 10:58:06.844316 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2954/5599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:06 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 1294 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:06.866474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-02b6f933-a975-425f-9130-dbd31ebf189e req-060e5f69-25e0-4c6d-b8a1-6d61618b3749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d20710-6321-4ddd-8c97-105b08a91a90", "name": "network-vif-deleted", "tag": "11536bab-ebc2-402c-9044-f36afc5e82a8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:06.879784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-02b6f933-a975-425f-9130-dbd31ebf189e req-060e5f69-25e0-4c6d-b8a1-6d61618b3749 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:06.880554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-02b6f933-a975-425f-9130-dbd31ebf189e req-060e5f69-25e0-4c6d-b8a1-6d61618b3749 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:06.881215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-02b6f933-a975-425f-9130-dbd31ebf189e req-060e5f69-25e0-4c6d-b8a1-6d61618b3749 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:06.895896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-02b6f933-a975-425f-9130-dbd31ebf189e req-060e5f69-25e0-4c6d-b8a1-6d61618b3749 service nova] Creating event network-vif-deleted:11536bab-ebc2-402c-9044-f36afc5e82a8 for instance a5d20710-6321-4ddd-8c97-105b08a91a90 on n-h2-858383-3 Oct 03 10:58:06.902961 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-02b6f933-a975-425f-9130-dbd31ebf189e req-060e5f69-25e0-4c6d-b8a1-6d61618b3749 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056783 Oct 03 10:58:06.903790 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2955/5600] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:07.113094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:07.124338 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-46620c1e-795d-468d-a405-05413676f270 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.962114 Oct 03 10:58:07.125776 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2646/5601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:06 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:07.871083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:07.872584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:07.882017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:07.883018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:07.883602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:07.887256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:07.887924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:07.888534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:07.908088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 HTTP/1.1 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a5d20710-6321-4ddd-8c97-105b08a91a90'} Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:07.931271 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:07.934677 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:07.934677 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:07.934677 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:07.934677 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:58:07.934677 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:58:07.934677 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:58:07.934677 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:07.938054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:58:07.939128 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6ee43cb0-faba-4bfc-a33e-8594b9a86ae7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 404 len: 111 microversion: 2.1 time: 0.075547 Oct 03 10:58:07.941981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2956/5602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:07 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:58:08.157643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:08.158832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:08.176864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:08.177892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:08.180640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:08.183058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:08.183708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:08.187982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:08.308065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1055136099", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "77b7129c-f93b-4c9f-acd6-8c3bb9d62151"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:08.426382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:58:08.763604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:08.772508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3f8ccb9-78a1-4f53-b7e0-14b61d183a69 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.620950 Oct 03 10:58:08.779100 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2647/5603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:08 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:09.291945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:58:09.292931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:58:09.293624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:58:09.294222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:58:09.294843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:58:09.306029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:09.306922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:09.307538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:09.308468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:09.309969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:09.310615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:09.349316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:58:09.356257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:58:09.380562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:58:09.383885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:58:09.450973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8db2bf1-245a-467c-af7b-47fd13a76de1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147141 Oct 03 10:58:09.452373 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2957/5604] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 10:58:09.466254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-28a823a3-5503-4364-aa63-8d4eac211e71 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:09.466869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-28a823a3-5503-4364-aa63-8d4eac211e71 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:09.800402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:09.801632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:09.817117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:09.817964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:09.819089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:09.820479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:09.820833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:09.821623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:10.032712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-28a823a3-5503-4364-aa63-8d4eac211e71 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:10.049979 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-28a823a3-5503-4364-aa63-8d4eac211e71 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1209 microversion: 2.1 time: 0.587496 Oct 03 10:58:10.051328 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2648/5605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:09 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1209 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:10.426036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:10.442179 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aa2efe7d-7d96-46cc-b0ab-7f08fc09e37b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.646761 Oct 03 10:58:10.443944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2958/5606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:09 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:11.097158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:11.099798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:11.142878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:11.143448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:11.147250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:11.148750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:11.149924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:11.152842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:11.418424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:11.431402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d35105fc-af2b-4725-a1aa-5712a5767200 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1261 microversion: 2.1 time: 0.356848 Oct 03 10:58:11.432650 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2649/5607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:11 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1261 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:11.469954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:11.471370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:11.494515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:11.497055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:11.497781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:11.498442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:11.500094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:11.500748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:11.501523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:11.907607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:11.916966 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2113edf8-8e39-4469-99f4-b5ed68c8792e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.453167 Oct 03 10:58:11.938204 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2959/5608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:11 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:12.468979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:12.470534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:12.513683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:12.514238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:12.514689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:12.515433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:12.515891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:12.516317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:12.770802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:12.783642 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c40e8673-f84e-40f2-82f5-9223b9c7a054 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1267 microversion: 2.1 time: 0.318668 Oct 03 10:58:12.785067 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2650/5609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:12 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:12.945970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:12.947171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:12.960852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:12.961364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:12.961801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:12.962525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:12.962981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:12.963408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:13.441225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:13.450829 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66c1ff93-1223-4623-80f5-a59f4a6c70ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.510934 Oct 03 10:58:13.454535 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2960/5610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:12 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:13.809520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:13.810302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:13.813795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:13.829539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:13.830049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:13.830504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:13.834618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:13.837701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:13.838166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:14.468087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:14.473909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:14.484559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:14.485208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:14.498331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c34971ba-f760-4c1c-8dce-39f437144036 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.692220 Oct 03 10:58:14.499998 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2651/5611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:13 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:14.514175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:14.516433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:14.517285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:14.518256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:14.518927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:14.519561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:15.436564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:15.445825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c6b8b2e3-92b0-4fef-a0f0-e19df98529e8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.967116 Oct 03 10:58:15.448191 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2961/5612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:14 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:15.529529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:15.530185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:15.546401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:15.546905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:15.547348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:15.548080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:15.549205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:15.550378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:15.820206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:15.832180 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c733d3f6-00c5-4a5d-b8d4-a2fbf6bf959a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.308475 Oct 03 10:58:15.834773 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2652/5613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:15 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:15.995331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-55303fd9-d817-462c-b253-b56a41ec526d req-942582a6-f0da-48e5-b67b-cb94d7e53cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72433200-68bc-4b8f-8acf-b4dd8e290351", "tag": "9a3b7967-b2fa-46d9-9711-fdf860bb57dc"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:16.029123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55303fd9-d817-462c-b253-b56a41ec526d req-942582a6-f0da-48e5-b67b-cb94d7e53cf3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:16.029123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55303fd9-d817-462c-b253-b56a41ec526d req-942582a6-f0da-48e5-b67b-cb94d7e53cf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:16.035712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55303fd9-d817-462c-b253-b56a41ec526d req-942582a6-f0da-48e5-b67b-cb94d7e53cf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:16.066031 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-55303fd9-d817-462c-b253-b56a41ec526d req-942582a6-f0da-48e5-b67b-cb94d7e53cf3 service nova] Creating event network-changed:9a3b7967-b2fa-46d9-9711-fdf860bb57dc for instance 72433200-68bc-4b8f-8acf-b4dd8e290351 on n-h2-858383-3 Oct 03 10:58:16.080150 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-55303fd9-d817-462c-b253-b56a41ec526d req-942582a6-f0da-48e5-b67b-cb94d7e53cf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094886 Oct 03 10:58:16.080794 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2962/5614] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:16.473153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:16.474176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:16.511463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:16.514136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:16.515983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:16.520236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:16.521709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:16.523615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:16.860806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:16.861635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:16.882115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:16.886229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:16.886952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:16.889681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:16.890325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:16.890936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:17.066177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:17.080265 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-970cb825-fae1-4121-b1bf-84bc3deaba12 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.610263 Oct 03 10:58:17.081195 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2653/5615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:16 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:17.733433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:17.748022 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8c5c304-fdfd-4db9-96fb-075a6c2340e8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.891297 Oct 03 10:58:17.772686 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2963/5616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:16 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:18.110658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:18.111534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:18.132278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:18.132807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:18.135642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:18.136425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:18.137643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:18.139205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:18.776649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:18.777410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:18.790557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:18.795196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:18.795891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:18.799402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:18.801227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:18.802213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:18.889930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:18.900567 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64abd738-6b75-41f0-9c05-23bb1e20d422 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.797849 Oct 03 10:58:18.905962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2654/5617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:18 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:19.260652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:19.274715 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-16d4d859-e4af-45e6-b359-fd940b396ffe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.501500 Oct 03 10:58:19.283927 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2964/5618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:18 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:19.934126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:19.934953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:19.953625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:19.957069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:19.957680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:19.960187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:19.961114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:19.964333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:20.046473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:20.313209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:20.314404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:20.323392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:20.335260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:20.389109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:20.390454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:20.394915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:20.405349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:20.406176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:20.415194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:20.917775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:20.927089 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2936dc50-76cd-4093-ade6-449542216257 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.618308 Oct 03 10:58:20.933636 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2965/5619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:20 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:21.040401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:21.054296 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5143c33-7adf-4cce-8fbb-e6c9ed8be529 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 1.124141 Oct 03 10:58:21.056622 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2655/5620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:19 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:21.982042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:21.986816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:22.016065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:22.019028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:22.019793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:22.025026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:22.026332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:22.030903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:22.080267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:22.081001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:22.092931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:22.093576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:22.096147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:22.096992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:22.097476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:22.097939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:22.948885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:22.957883 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c762b2be-8896-4a83-b5bd-104f80d5ca80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.882142 Oct 03 10:58:22.973006 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2656/5621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:22 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:23.339152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:23.353943 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aceec7d5-db07-4e35-b84a-2d98f963c8f7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 1.379798 Oct 03 10:58:23.372810 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2966/5622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:21 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:23.993750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:23.995176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:24.014691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:24.016498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:24.017286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:24.019111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:24.021368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:24.025659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:24.394440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:24.395378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:24.408430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:24.414158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:24.418836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:24.434205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:24.434720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:24.435759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:24.869606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:24.880118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e01dd077-63b1-41e9-ba14-47dfd5606aa8 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.497442 Oct 03 10:58:24.884208 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2967/5623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:24 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:25.377171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:25.397784 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d2b9aa1-a38b-4822-a28c-e9970f721699 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 1.399751 Oct 03 10:58:25.398504 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2657/5624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:23 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:25.907567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:25.908404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:25.928571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-23ca7e01-9dee-4dce-8cb7-cd7c9490b348 req-514e99ef-769b-41ef-aecd-58dcecbf0530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72433200-68bc-4b8f-8acf-b4dd8e290351", "name": "network-vif-plugged", "status": "completed", "tag": "9a3b7967-b2fa-46d9-9711-fdf860bb57dc"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:25.933342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:25.934198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:25.935394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:25.937830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:25.938528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:25.940408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:25.950305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-23ca7e01-9dee-4dce-8cb7-cd7c9490b348 req-514e99ef-769b-41ef-aecd-58dcecbf0530 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:25.951430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-23ca7e01-9dee-4dce-8cb7-cd7c9490b348 req-514e99ef-769b-41ef-aecd-58dcecbf0530 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:25.953843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-23ca7e01-9dee-4dce-8cb7-cd7c9490b348 req-514e99ef-769b-41ef-aecd-58dcecbf0530 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:25.986488 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-23ca7e01-9dee-4dce-8cb7-cd7c9490b348 req-514e99ef-769b-41ef-aecd-58dcecbf0530 service nova] Creating event network-vif-plugged:9a3b7967-b2fa-46d9-9711-fdf860bb57dc for instance 72433200-68bc-4b8f-8acf-b4dd8e290351 on n-h2-858383-3 Oct 03 10:58:26.022110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-23ca7e01-9dee-4dce-8cb7-cd7c9490b348 req-514e99ef-769b-41ef-aecd-58dcecbf0530 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106863 Oct 03 10:58:26.024159 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2658/5625] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:58:26.329314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:26.345646 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb4a1d1a-5cae-4805-8914-bb8490b35530 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.442547 Oct 03 10:58:26.360802 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2968/5626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:25 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:26.426530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:26.428024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:26.434691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:26.435191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:26.435628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:26.436348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:26.436836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:26.437383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:27.119440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:27.130638 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e783b5f-4c73-4aa6-89dc-9348d8356a67 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1524 microversion: 2.1 time: 0.712158 Oct 03 10:58:27.134758 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2659/5627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:26 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1524 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:27.371193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:27.372400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:27.387858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:27.388363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:27.388992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:27.389867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:27.390476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:27.391100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:27.749320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:27.758499 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-853a9c80-e506-4079-9e31-662cad2d9fdf tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1309 microversion: 2.1 time: 0.391847 Oct 03 10:58:27.759314 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2969/5628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:27 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:28.158813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:28.159418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:28.170643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:28.178334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:28.179070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:28.179979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:28.180604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:28.181262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:28.239188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1128588744", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "998b3d64-3446-49eb-884a-04501cd12771"}], "key_name": "tempest-TestSecurityGroupsBasicOps-254849441", "security_groups": []}, "os:scheduler_hints": {"different_host": ["b808f438-48a6-449f-9ed7-ed6de09d37da"]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:28.345594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] validate_networks() for [('998b3d64-3446-49eb-884a-04501cd12771', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:58:29.077048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:29.086570 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7aabbe02-7731-4dda-bf45-8ad27bcbedc3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1506 microversion: 2.1 time: 0.932680 Oct 03 10:58:29.093812 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2660/5629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:28 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:29.113465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:29.114090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:29.114610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:58:29.116125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:58:29.116914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:58:29.117518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:58:29.118068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:58:29.123322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:29.123839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:29.124283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:29.125034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:29.125497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:29.125931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:29.132394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:29.133654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:29.134329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:29.135278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:29.136013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:29.136688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:29.163518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Getting quotas for project f0b21abdde534eee9e051d694648fbd2. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:58:29.169810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Getting quotas for user 828164d97b90461abe6540d1a20023ee and project f0b21abdde534eee9e051d694648fbd2. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:58:29.186293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:58:29.190991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:58:29.275702 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a33407a-dd6d-4d67-9ab3-2aa4f4a94476 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.040925 Oct 03 10:58:29.291660 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2970/5630] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:58:28 2022] POST /compute/v2.1/servers => generated 361 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:58:29.297362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c31c9f42-8cee-49e6-b2ca-8e18ad32f7ac tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:29.301399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c31c9f42-8cee-49e6-b2ca-8e18ad32f7ac tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:29.377666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c31c9f42-8cee-49e6-b2ca-8e18ad32f7ac tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:29.393970 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c31c9f42-8cee-49e6-b2ca-8e18ad32f7ac tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1241 microversion: 2.1 time: 0.100770 Oct 03 10:58:29.409585 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2971/5631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:29 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:29.793504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:29.803711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f88955a-bb06-41e2-b4a1-dbf0d540c772 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1491 microversion: 2.1 time: 0.707808 Oct 03 10:58:29.809323 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2661/5632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:29 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1491 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:29.838669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:29.843932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:29.854810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:29.855577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:29.857324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:29.858585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:29.859335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:29.861032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:29.955245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-2f2f16ab-46c7-4518-82dc-adbbe590731a req-624f0a7a-9ad4-4fd1-bed9-a1299ddf0b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb46ac5-761a-4efa-9b82-53dda9ad768b", "name": "network-vif-unplugged", "status": "completed", "tag": "3d9551a5-6353-421b-bc71-181efffaae32"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:29.997519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f2f16ab-46c7-4518-82dc-adbbe590731a req-624f0a7a-9ad4-4fd1-bed9-a1299ddf0b4b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:29.998609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f2f16ab-46c7-4518-82dc-adbbe590731a req-624f0a7a-9ad4-4fd1-bed9-a1299ddf0b4b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:29.999270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f2f16ab-46c7-4518-82dc-adbbe590731a req-624f0a7a-9ad4-4fd1-bed9-a1299ddf0b4b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.007995 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9a575fb-0e93-48f9-9c0d-111520adabfe tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "PUT /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1086 microversion: 2.1 time: 0.176186 Oct 03 10:58:30.024243 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2972/5633] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:58:29 2022] PUT /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1086 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:30.033576 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-2f2f16ab-46c7-4518-82dc-adbbe590731a req-624f0a7a-9ad4-4fd1-bed9-a1299ddf0b4b service nova] Creating event network-vif-unplugged:3d9551a5-6353-421b-bc71-181efffaae32 for instance ecb46ac5-761a-4efa-9b82-53dda9ad768b on n-h2-858383-3 Oct 03 10:58:30.036344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:30.039685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:30.040373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-2f2f16ab-46c7-4518-82dc-adbbe590731a req-624f0a7a-9ad4-4fd1-bed9-a1299ddf0b4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090647 Oct 03 10:58:30.041650 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2662/5634] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:30.061989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.063414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.064788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.069868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.070775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.071397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.123521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:30.125223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:30.136325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.137295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.140511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.144425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.145262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.150120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.383501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:30.402924 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f380dd2-395d-4d1b-9d71-1ee8067de973 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1512 microversion: 2.1 time: 0.372760 Oct 03 10:58:30.405343 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2973/5635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:30 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:30.438162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:30.443916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:30.462437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.463870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.464530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.466083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.467045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.467658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.598788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:30.610045 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff99b0f6-4cd4-4e15-82bf-0b18dc93a50b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1506 microversion: 2.1 time: 0.494173 Oct 03 10:58:30.613583 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2663/5636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:30 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:30.619230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:30.630130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:30.642339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.643062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.644202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.645437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:30.647259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:30.648166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:30.785448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:30.806545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4811a117-e396-4897-b4be-617f6df6ec4b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1245 microversion: 2.1 time: 0.385247 Oct 03 10:58:30.807154 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2974/5637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:30 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1245 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:31.292669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:31.319128 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b234198-f930-41a1-b180-652e2d1fd57e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1512 microversion: 2.1 time: 0.703751 Oct 03 10:58:31.320980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2664/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:30 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1512 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:31.355691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:31.358796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:31.375862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:31.379351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:31.379900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:31.385022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:31.388607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:31.389154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:31.409082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:31.489182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:58:31.655157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:31.657622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:31.682741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f91958b-6c31-432c-9e1f-3711f5d64c91 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 204 len: 0 microversion: 2.1 time: 0.340407 Oct 03 10:58:31.684887 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2975/5639] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:58:31 2022] DELETE /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:58:31.688508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:31.689728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:31.690199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:31.697170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:31.703059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:31.704263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:31.707541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:31.714709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:31.738677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:31.739468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:31.740064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:31.741009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:31.741632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:31.742212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:32.054761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:32.067815 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fecfd828-214b-4f63-b35e-33691519684e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1518 microversion: 2.1 time: 0.377945 Oct 03 10:58:32.069090 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2976/5640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:31 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1518 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:32.104738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:32.107014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:32.113573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:32.121637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:32.122218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:32.123021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:32.123480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:32.124035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:32.236353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:32.266901 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a54b7dba-9fe0-41ea-af3c-cba66674bc4b tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 200 len: 1449 microversion: 2.1 time: 0.627947 Oct 03 10:58:32.271091 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2665/5641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:31 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 1449 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:32.294527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:32.304229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:32.306215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:32.317832 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a73efdd7-2d93-4efc-9fb5-03580acb2a27 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.226300 Oct 03 10:58:32.323739 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2977/5642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:32 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:32.341933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:32.342651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:32.344042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:32.344903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:32.345466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:32.346145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:32.347994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:32.348825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:32.360310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:32.364946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:32.364946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:32.364946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:32.370212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:32.370790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:32.405438 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-881d5017-817e-4c71-b896-50eb3c97613f tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/ips" status: 200 len: 150 microversion: 2.1 time: 0.131293 Oct 03 10:58:32.406178 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2666/5643] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 10:58:32 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/ips => generated 150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:32.432956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:58:32.450840 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Working on deleting snapshot c44f18a0-3fa4-4d06-a9f0-08a91f77960d from shelved instance... Oct 03 10:58:33.100382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:33.101778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:33.135308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:33.135828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:33.136301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:33.137086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:33.137632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:33.148562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:34.041398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:34.056281 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4cba34f-cdb4-412c-a26e-924412b47bb2 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1518 microversion: 2.1 time: 0.963733 Oct 03 10:58:34.061664 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2667/5644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:33 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1518 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:34.078539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:34.091791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:34.109347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Doing local delete in cell 5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=122269) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 03 10:58:34.110111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:34.110613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:34.111066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:34.111505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 03 10:58:34.112072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:34.113010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:34.113558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:34.114814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:34.120051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:34.120650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:34.125149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] deallocate_for_instance() {{(pid=122269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 03 10:58:34.527204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:34.543274 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d5585b19-364e-4428-a850-b10aedcb7bd1 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.476096 Oct 03 10:58:34.543929 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2668/5645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:34 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:35.095559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:35.096390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:35.107747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:35.108599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:35.109374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:35.110373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:35.111148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:35.111751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:35.621945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:35.657029 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bcbc447d-1030-48f4-8e34-e498cde9a301 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 200 len: 1518 microversion: 2.1 time: 0.567382 Oct 03 10:58:35.661863 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2669/5646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:35 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 1518 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:35.678222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4a3592a-f4ce-4029-b574-6354a0504add"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:35.681177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:35.715538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:35.715969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:35.716420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:35.717255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:35.718379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:35.718993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:35.786292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:35.998349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Updating instance_info_cache with network_info: [] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 10:58:36.199046 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-88de060f-695a-4948-89fa-dc1bea3ef521 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "POST /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535212 Oct 03 10:58:36.201624 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2670/5647] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 10:58:35 2022] POST /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:36.231166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:36.235630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:36.249200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:36.252620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:36.253257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:36.254147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:36.257392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:36.258735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:36.326244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac76d8b3-0fdb-46cc-8fb7-287596758d2f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 204 len: 0 microversion: 2.1 time: 3.996843 Oct 03 10:58:36.339366 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2978/5648] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:58:32 2022] DELETE /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 0 bytes in 4004 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:58:36.346912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8636b720-ab25-4b82-a1ab-32df20096872 req-374d57ad-38b5-4546-9544-39f2e2bab7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72433200-68bc-4b8f-8acf-b4dd8e290351", "name": "network-vif-deleted", "tag": "9a3b7967-b2fa-46d9-9711-fdf860bb57dc"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:36.367880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8636b720-ab25-4b82-a1ab-32df20096872 req-374d57ad-38b5-4546-9544-39f2e2bab7bf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:36.368375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8636b720-ab25-4b82-a1ab-32df20096872 req-374d57ad-38b5-4546-9544-39f2e2bab7bf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:36.368914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8636b720-ab25-4b82-a1ab-32df20096872 req-374d57ad-38b5-4546-9544-39f2e2bab7bf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:36.384358 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8636b720-ab25-4b82-a1ab-32df20096872 req-374d57ad-38b5-4546-9544-39f2e2bab7bf service nova] Creating event network-vif-deleted:9a3b7967-b2fa-46d9-9711-fdf860bb57dc for instance 72433200-68bc-4b8f-8acf-b4dd8e290351 on n-h2-858383-3 Oct 03 10:58:36.391121 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8636b720-ab25-4b82-a1ab-32df20096872 req-374d57ad-38b5-4546-9544-39f2e2bab7bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059426 Oct 03 10:58:36.392435 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2979/5649] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:36.401275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:36.402265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:36.411333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:36.412286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:36.413138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:36.414077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:36.415423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:36.416301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:36.441400 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b HTTP/1.1 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'ecb46ac5-761a-4efa-9b82-53dda9ad768b'} Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:36.443830 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd39be01-7395-447f-b262-59e47513ec36 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 404 len: 111 microversion: 2.1 time: 0.052302 Oct 03 10:58:36.447465 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2980/5650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:36 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:58:36.483520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:36.520926 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7312701-9f48-433e-90d0-8d41d702bb1b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.311800 Oct 03 10:58:36.525379 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2671/5651] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:36 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:36.697346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:36.702698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:36.720479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:36.724236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:36.726130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:36.727042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:36.729956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:36.732061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:36.754749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1727700010", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e8c45795-beb8-40e6-ba51-51a8d24fedd0"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:36.767897 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 HTTP/1.1 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '72433200-68bc-4b8f-8acf-b4dd8e290351'} Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:36.769861 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.774126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:36.774126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:36.774126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:36.774126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:58:36.774126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:58:36.774126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:58:36.774126 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:58:36.777430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:58:36.779075 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4bc59ea4-6f28-4ab3-8d9f-9a9320f57e5d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 404 len: 111 microversion: 2.1 time: 0.091865 Oct 03 10:58:36.780639 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2981/5652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:36 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:58:36.869302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] validate_networks() for [('e8c45795-beb8-40e6-ba51-51a8d24fedd0', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:58:36.966733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1592919221", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "77b7129c-f93b-4c9f-acd6-8c3bb9d62151"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:37.055601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] validate_networks() for [('77b7129c-f93b-4c9f-acd6-8c3bb9d62151', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:58:38.093561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:58:38.094189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:58:38.094827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:58:38.095807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:58:38.096447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:58:38.111894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:58:38.112945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:58:38.113583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:58:38.114308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.114448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:58:38.114946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:58:38.116107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.117082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.118082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.119582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.120868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.132884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.135061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.135829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.136759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.140206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.141526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.149207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:58:38.160057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Getting quotas for user 894820fad0424024a47c6f54a5425a14 and project 7ac6aaa3c5844a93bf7f8838485e81d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:58:38.177188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:58:38.182290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:58:38.183650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:58:38.192675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for user 2a0e22aff3574cb286f2c1aa546c6c78 and project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:58:38.212419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:58:38.215231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:58:38.273175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8249f36d-0336-4471-9236-05233f9e3716 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326885 Oct 03 10:58:38.279797 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2982/5653] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:58:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:58:38.280866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:38.281624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:38.320353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.325541 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-374782fa-e7b6-4b8a-ad48-19d7404fa9ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575843 Oct 03 10:58:38.326469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.327096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.331553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.332081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.332542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.334771 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2672/5654] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:58:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:58:38.339770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fffcfc52-f7a3-439b-b20a-b9c0522e62a8 req-0ac4379a-a1b3-49a8-ac72-d39e75e12f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e449c5d4-7908-411f-b370-129463e61386", "tag": "95ab993f-c45a-4cff-9f2a-d5841a048049"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:38.389715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fffcfc52-f7a3-439b-b20a-b9c0522e62a8 req-0ac4379a-a1b3-49a8-ac72-d39e75e12f07 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.390211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fffcfc52-f7a3-439b-b20a-b9c0522e62a8 req-0ac4379a-a1b3-49a8-ac72-d39e75e12f07 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.390653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fffcfc52-f7a3-439b-b20a-b9c0522e62a8 req-0ac4379a-a1b3-49a8-ac72-d39e75e12f07 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.420142 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fffcfc52-f7a3-439b-b20a-b9c0522e62a8 req-0ac4379a-a1b3-49a8-ac72-d39e75e12f07 service nova] Creating event network-changed:95ab993f-c45a-4cff-9f2a-d5841a048049 for instance e449c5d4-7908-411f-b370-129463e61386 on n-h1-858383-3 Oct 03 10:58:38.434870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fffcfc52-f7a3-439b-b20a-b9c0522e62a8 req-0ac4379a-a1b3-49a8-ac72-d39e75e12f07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098763 Oct 03 10:58:38.435929 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2673/5655] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:38.441282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9003d81-fd9c-4602-84e1-36b12c2b9817 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:38.442940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9003d81-fd9c-4602-84e1-36b12c2b9817 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:38.521661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:38.531699 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19775f0b-b77d-4679-8041-fa981682222d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.255383 Oct 03 10:58:38.533846 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2983/5656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:38 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:38.540212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d2306227-bc7f-4f11-acc5-4c2dd2d835fe tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:38.541117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d2306227-bc7f-4f11-acc5-4c2dd2d835fe tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:38.649811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d2306227-bc7f-4f11-acc5-4c2dd2d835fe tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:38.659107 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d2306227-bc7f-4f11-acc5-4c2dd2d835fe tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1215 microversion: 2.1 time: 0.124055 Oct 03 10:58:38.660583 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2984/5657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:38 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:38.667768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-256cf8d1-f5ba-4592-9573-75320f1c4509 req-5b9d5a81-db2a-443e-8b6a-213c20e27115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb46ac5-761a-4efa-9b82-53dda9ad768b", "name": "network-vif-deleted", "tag": "3d9551a5-6353-421b-bc71-181efffaae32"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:38.679544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:38.701459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-256cf8d1-f5ba-4592-9573-75320f1c4509 req-5b9d5a81-db2a-443e-8b6a-213c20e27115 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:38.704216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-256cf8d1-f5ba-4592-9573-75320f1c4509 req-5b9d5a81-db2a-443e-8b6a-213c20e27115 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:38.706879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-256cf8d1-f5ba-4592-9573-75320f1c4509 req-5b9d5a81-db2a-443e-8b6a-213c20e27115 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:38.738739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.server_external_events [req-256cf8d1-f5ba-4592-9573-75320f1c4509 req-5b9d5a81-db2a-443e-8b6a-213c20e27115 service nova] Unable to find a host for instance ecb46ac5-761a-4efa-9b82-53dda9ad768b. Dropping event network-vif-deleted {{(pid=122269) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 10:58:38.743064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-256cf8d1-f5ba-4592-9573-75320f1c4509 req-5b9d5a81-db2a-443e-8b6a-213c20e27115 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.079873 Oct 03 10:58:38.747469 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2985/5658] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 10:58:38.860627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d9003d81-fd9c-4602-84e1-36b12c2b9817 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:38.891008 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9003d81-fd9c-4602-84e1-36b12c2b9817 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1209 microversion: 2.1 time: 0.453674 Oct 03 10:58:38.892013 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2674/5659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:38 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1209 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:39.167963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:39.169305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:39.190865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:39.194622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:39.195007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:39.197972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:39.198551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:39.199870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:39.582184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:39.583458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:39.603011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:39.604057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:39.606830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:39.609071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:39.609781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:39.626632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:39.779928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:39.797706 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bd2a8f8c-3470-49be-8290-b12833099bb9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.635773 Oct 03 10:58:39.798983 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2986/5660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:39 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:39.809343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:39.810072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:39.824994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:39.826678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:39.827229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:39.828123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:39.833226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:39.835893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:40.103793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:40.123344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:40.172108 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6d5fb95-3b68-4e50-9ae3-001746028dc1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1211 microversion: 2.1 time: 0.363330 Oct 03 10:58:40.173322 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2987/5661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:39 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1211 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:40.195585 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df2b9ef8-a18d-4492-aa57-8e24fa0d1e90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.627809 Oct 03 10:58:40.217253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2675/5662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:39 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:40.247028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:40.248636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:40.272466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:40.278225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:40.298659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:40.308457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:40.315001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:40.316202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:40.316832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:40.319318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:40.321227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:40.326302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:40.337000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:40.345059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:40.345901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:40.349776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:40.352966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:40.598538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:40.636959 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9ec6521-bf66-4014-97e8-711588d6660c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1205 microversion: 2.1 time: 0.414563 Oct 03 10:58:40.638771 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2676/5663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:40 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1205 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:41.248988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:41.253302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:41.275415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.275981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.276574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:41.277352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.277820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.278313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:41.529853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:41.542085 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3316d4fa-bcbc-4892-8b1c-60d0eca9bde4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.355847 Oct 03 10:58:41.543174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2988/5664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:40 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:41.563713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:41.563713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:41.571685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.575880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.576807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:41.579917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.580400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.580960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:41.712898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:41.731271 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-90638bf3-e116-45a8-b777-68a8a77e7b9c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1275 microversion: 2.1 time: 0.494680 Oct 03 10:58:41.731426 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2677/5665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:41 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1275 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:41.745080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:41.745080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:41.745080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.745632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.755353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:41.757254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.757904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.758504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:41.802078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:41.820538 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b87e371-4737-4fcf-a46b-5af1bad52506 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.275873 Oct 03 10:58:41.821178 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2989/5666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:41 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:41.826241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:41.826859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:41.848436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.849370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.850002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:41.850886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:41.851506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:41.852088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:42.021144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:42.051189 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da9207af-6d35-4dd4-9461-3bf1baf58cdb tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1261 microversion: 2.1 time: 0.224269 Oct 03 10:58:42.052157 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2990/5667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:41 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:42.424614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:42.435787 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1634445-0d88-49c4-ae26-c9e8257dcf6a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.703307 Oct 03 10:58:42.437721 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2678/5668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:41 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:42.460847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:42.461781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:42.469414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:42.470422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:42.471009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:42.471901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:42.472515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:42.473157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:42.758637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:42.759249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:42.769597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:42.779906 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4fa2bc0-5a01-4eff-9c73-d14b2122430f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.323990 Oct 03 10:58:42.782718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:42.783217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:42.783664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:42.793992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:42.794981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2991/5669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:42 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:42.809064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:42.809064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:42.849351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:42.854655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:42.867775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:42.868446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:42.869183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:42.870138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:42.874512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:42.875198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:43.087178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:43.119720 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-763aa302-146e-4b75-acb2-5448a9e6f6c3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.278995 Oct 03 10:58:43.138598 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2992/5670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:42 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:43.155644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1769198856", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "9dbf8c82-dfae-4d56-9442-6e6c67d23560"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:43.283188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] validate_networks() for [('9dbf8c82-dfae-4d56-9442-6e6c67d23560', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:58:43.683370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:43.701560 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da931bbc-e1a8-4dc2-84ef-d8b1d25bbcc6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.947294 Oct 03 10:58:43.702866 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2679/5671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:42 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:43.720859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:43.721844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:43.732205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:43.733224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:43.733911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:43.734817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:43.735712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:43.736631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:43.892408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:43.910192 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c8dbdf1-169d-4814-b774-a9e857aca869 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1267 microversion: 2.1 time: 0.205911 Oct 03 10:58:43.911521 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2680/5672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:43 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:44.150197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:44.151144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:44.169446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:44.179700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:44.181066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:44.186046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:44.188576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:44.192490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:44.193185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:44.646344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:44.662710 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-160b0246-43fc-400b-b90e-6952df16cc57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.520117 Oct 03 10:58:44.663322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2681/5673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:44 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:44.725840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:44.726468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:44.734522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:44.735031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:44.735495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:44.736203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:44.736671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:44.737138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:45.139253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:45.152238 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b746af05-d177-414c-8924-977c2228cd1e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.430046 Oct 03 10:58:45.173349 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2682/5674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:44 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:45.174477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:58:45.176551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:58:45.177297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:58:45.178667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:58:45.179193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:58:45.181813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:45.182791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:45.190631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:45.191536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:45.192254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:45.194439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:45.195540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:45.196254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:45.199113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:45.199759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:45.200201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:45.202876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:45.203353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:45.203793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:45.252244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:58:45.263814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for user e3857d14b6f6498c87700ea6ee22c4a6 and project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:58:45.304717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:58:45.308056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:58:45.348618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:45.369516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bfeed2de-ebcb-43ae-b083-b63aeb97b5be tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1267 microversion: 2.1 time: 0.191813 Oct 03 10:58:45.370402 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2683/5675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:45 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:45.384162 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12bca71a-a0d4-41ed-aef0-23736b11e94a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.242905 Oct 03 10:58:45.390752 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2993/5676] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:58:45.407842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43b84047-1da2-4fc6-961f-c5a8560da184 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:45.409011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43b84047-1da2-4fc6-961f-c5a8560da184 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:45.695283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:45.696508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:45.710651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:45.711601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:45.712338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:45.713456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:45.714203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:45.715420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:45.876131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:45.942786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1803b15-11a0-4911-a457-46025bb5656d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.256722 Oct 03 10:58:45.957347 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2994/5677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:45 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:45.987105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e77c7d0d-2ec1-401c-b986-b3744a968de7 req-22783540-017e-4d2b-9fad-1bc610ba76e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05779e5-9b42-4080-9100-a70a96ac0480", "tag": "270d4354-221f-42a4-9434-78b8fbe68979"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:46.026249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43b84047-1da2-4fc6-961f-c5a8560da184 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:46.032342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e77c7d0d-2ec1-401c-b986-b3744a968de7 req-22783540-017e-4d2b-9fad-1bc610ba76e9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:46.034999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e77c7d0d-2ec1-401c-b986-b3744a968de7 req-22783540-017e-4d2b-9fad-1bc610ba76e9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:46.035187 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43b84047-1da2-4fc6-961f-c5a8560da184 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1215 microversion: 2.1 time: 0.641789 Oct 03 10:58:46.035532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e77c7d0d-2ec1-401c-b986-b3744a968de7 req-22783540-017e-4d2b-9fad-1bc610ba76e9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:46.052037 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2684/5678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:45 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1215 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:46.058804 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e77c7d0d-2ec1-401c-b986-b3744a968de7 req-22783540-017e-4d2b-9fad-1bc610ba76e9 service nova] Creating event network-changed:270d4354-221f-42a4-9434-78b8fbe68979 for instance d05779e5-9b42-4080-9100-a70a96ac0480 on n-h2-858383-3 Oct 03 10:58:46.065236 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e77c7d0d-2ec1-401c-b986-b3744a968de7 req-22783540-017e-4d2b-9fad-1bc610ba76e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087499 Oct 03 10:58:46.066063 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2995/5679] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:58:46.183115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:46.183746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:46.195657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:46.196162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:46.202190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:46.204302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:46.206250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:46.207017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:46.406911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:46.416238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:46.451862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:46.453420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:46.453939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:46.454703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:46.455169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:46.470372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:46.888184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:46.902547 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dede1fc6-53e8-4748-b2d6-218d661e698e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.725137 Oct 03 10:58:46.913721 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2685/5680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:46 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:46.975208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:46.975897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:46.986559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:46.989084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:46.990237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:46.991763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:46.992515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:46.993361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:47.321173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:47.345197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e5f7db27-a912-4852-8148-4c2b660e08ad tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 0.948157 Oct 03 10:58:47.346513 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2996/5681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:46 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:47.353620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:47.354663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:47.362302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:47.363271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:47.363918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:47.364914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:47.365780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:47.366422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:47.493354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:47.504997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec773263-1412-4bcb-bd2f-c870387f42ba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1211 microversion: 2.1 time: 0.156976 Oct 03 10:58:47.508196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2997/5682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:47 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1211 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:47.520205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e20b9d02-7752-4b54-9257-ed3c3922020f req-20bd9cee-58b4-4835-82b0-d6aec594d46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e449c5d4-7908-411f-b370-129463e61386", "name": "network-vif-plugged", "status": "completed", "tag": "95ab993f-c45a-4cff-9f2a-d5841a048049"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:47.560118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e20b9d02-7752-4b54-9257-ed3c3922020f req-20bd9cee-58b4-4835-82b0-d6aec594d46e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:47.561330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e20b9d02-7752-4b54-9257-ed3c3922020f req-20bd9cee-58b4-4835-82b0-d6aec594d46e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:47.564269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e20b9d02-7752-4b54-9257-ed3c3922020f req-20bd9cee-58b4-4835-82b0-d6aec594d46e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:47.574144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:47.585972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f6ed0d74-804c-4ac1-8ac7-2f3cc11baa3a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.617112 Oct 03 10:58:47.595405 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2686/5683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:46 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:47.612553 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e20b9d02-7752-4b54-9257-ed3c3922020f req-20bd9cee-58b4-4835-82b0-d6aec594d46e service nova] Creating event network-vif-plugged:95ab993f-c45a-4cff-9f2a-d5841a048049 for instance e449c5d4-7908-411f-b370-129463e61386 on n-h1-858383-3 Oct 03 10:58:47.627741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e20b9d02-7752-4b54-9257-ed3c3922020f req-20bd9cee-58b4-4835-82b0-d6aec594d46e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112081 Oct 03 10:58:47.629205 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2998/5684] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:47.937300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:47.938373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:47.961195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:47.962438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:47.963043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:47.965458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:47.968887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:47.969516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:48.166732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:48.386451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:48.389897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:48.411656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:48.415466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:48.417328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:48.418362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:48.419797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:48.421199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:48.421773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:48.440186 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-56caee6a-9bd1-44ab-b96a-2228439964eb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.514198 Oct 03 10:58:48.442604 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2687/5685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:47 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:48.540759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:48.541704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:48.565785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:48.566435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:48.566731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:48.567619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:48.568121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:48.582421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:48.707699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:48.711355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:48.730481 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d43d8d99-4d0e-4cf8-835b-41923f0510db tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1267 microversion: 2.1 time: 0.194112 Oct 03 10:58:48.731705 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2688/5686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:48 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:48.745162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:48.746113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:48.767963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:48.769578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:48.772013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:48.773650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:48.778599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:48.779442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:48.926624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:48.938700 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55df0deb-c2e6-427e-8f05-aa67d240f03b tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1299 microversion: 2.1 time: 0.205460 Oct 03 10:58:48.950332 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2689/5687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:48 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:49.033526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:49.089890 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ac549f0-0bee-4cfc-9aa4-b9c285190266 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 0.703744 Oct 03 10:58:49.091703 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 2999/5688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:48 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:49.091954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-591bd258-7f66-4516-8beb-66ce56a62be6 req-be848db3-bba7-490d-8b2f-907280b4eabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "741f7b35-2576-42e9-b962-a33c08e0ae03", "tag": "4b6cf94f-ae70-4f78-946e-71e48b643ae5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:49.103387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-591bd258-7f66-4516-8beb-66ce56a62be6 req-be848db3-bba7-490d-8b2f-907280b4eabd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:49.103868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-591bd258-7f66-4516-8beb-66ce56a62be6 req-be848db3-bba7-490d-8b2f-907280b4eabd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:49.104304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-591bd258-7f66-4516-8beb-66ce56a62be6 req-be848db3-bba7-490d-8b2f-907280b4eabd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:49.128043 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-591bd258-7f66-4516-8beb-66ce56a62be6 req-be848db3-bba7-490d-8b2f-907280b4eabd service nova] Creating event network-changed:4b6cf94f-ae70-4f78-946e-71e48b643ae5 for instance 741f7b35-2576-42e9-b962-a33c08e0ae03 on n-h2-858383-3 Oct 03 10:58:49.134667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-591bd258-7f66-4516-8beb-66ce56a62be6 req-be848db3-bba7-490d-8b2f-907280b4eabd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048726 Oct 03 10:58:49.135352 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2690/5689] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:49.465545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:49.466225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:49.489806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:49.492801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:49.493507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:49.495683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:49.498269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:49.499143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:49.773293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:49.777359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:49.811049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:49.814943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:49.816137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:49.822749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:49.824022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:49.825414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.211425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:50.226497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7581a68-0464-476f-aa8f-12ef878b5d30 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1267 microversion: 2.1 time: 0.466192 Oct 03 10:58:50.242266 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2691/5690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:49 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1267 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:50.256930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:50.258037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:50.272986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.277107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.277735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.278632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.279246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.279821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.342904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:50.355378 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2f95fc6b-3d75-48f2-a232-15f11de616f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.896333 Oct 03 10:58:50.359165 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3000/5691] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:49 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:50.377490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:50.378273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:50.394406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.395122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.395713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.397316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.397937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.398520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.533323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:50.555780 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-adc6edf1-560e-4ce9-abd6-c520892d61df tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1470 microversion: 2.1 time: 0.311861 Oct 03 10:58:50.563139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2692/5692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:50 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:50.591517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:50.592536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:50.611352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.617940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.620022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.621732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.628451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.629212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.808565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:50.817789 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2aea7cc7-e252-40b3-80f4-9b5b3f24f946 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1470 microversion: 2.1 time: 0.231691 Oct 03 10:58:50.819289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2693/5693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:50 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:50.840881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:50.841785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:50.849096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.850049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.850634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.851231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.851700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.852134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.953832 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed862fe1-5992-4426-a14c-1c010aabd49b tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1621 microversion: 2.1 time: 0.116737 Oct 03 10:58:50.954621 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2694/5694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:50 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:50.981195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:50.982124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:50.991440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.992197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.993011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:50.994106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:50.994727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:50.995656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.210526 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9c47e753-01db-4147-9e0c-dd33311e2709 tempest-TestSecurityGroupsBasicOps-526024241 tempest-TestSecurityGroupsBasicOps-526024241-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1914 microversion: 2.1 time: 0.232987 Oct 03 10:58:51.227588 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2695/5695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:50 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1914 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:51.260564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:51.261220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:51.271748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.276470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.276998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.277768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.278250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.278691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.397606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:51.411639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:51.430594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1cc4d05d-e3bb-4cb9-a1d4-ec7f109f765b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 1.070070 Oct 03 10:58:51.431098 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-337bb841-fd9b-4e29-9d52-414e7a891c13 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1273 microversion: 2.1 time: 0.173254 Oct 03 10:58:51.431782 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3001/5696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:50 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:51.433092 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2696/5697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:51 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:51.446793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:51.447505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:51.449481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:51.450045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:51.462898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.467749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.489569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.493715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.497491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.500294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.501230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.502627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.503407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.504662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.505807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.507768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.607478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:58:51.764998 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca4a852e-4c08-4fb6-9900-56c36cfbf32a tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 204 len: 0 microversion: 2.1 time: 0.327344 Oct 03 10:58:51.767121 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3002/5698] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:58:51 2022] DELETE /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:58:51.777575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:51.780501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:51.781376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:51.786083 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6550686d-0846-4087-bb21-401f8c49966d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.350750 Oct 03 10:58:51.800147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.802905 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2697/5699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:51 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:51.809985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.812190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:51.815013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:51.815526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:51.816447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:52.116593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:52.127291 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-33863f15-a45a-41df-8eb8-9275a6ee7af3 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1476 microversion: 2.1 time: 0.351496 Oct 03 10:58:52.129313 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3003/5700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:51 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1476 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:52.463208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:52.464075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:52.464783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:52.466597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:52.481690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:52.481690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:52.481690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:52.482061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:52.482557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:52.482722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:52.483218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:52.483404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:52.485299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:52.486750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:52.497611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:52.500729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:52.721441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:52.743954 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb395d64-3c02-48c6-8e5a-9afe767507f1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1273 microversion: 2.1 time: 0.288918 Oct 03 10:58:52.745321 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3004/5701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:52 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:52.819117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:52.827933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:52.829778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:52.832354 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-293bb2bd-8cc4-49c6-9922-a0902f26cd4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 0.378518 Oct 03 10:58:52.848830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:52.851013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:52.851159 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2698/5702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:52 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:52.851939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:52.853988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:52.859842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:52.860647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:52.870014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:53.165486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:53.166427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:53.175681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:53.176428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:53.177102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:53.178523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:53.179142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:53.184228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:53.300469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:53.319147 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4a3d9a7b-0df5-477c-953e-a95a89987aeb tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.506728 Oct 03 10:58:53.322995 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3005/5703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:52 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:53.559376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:53.575583 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1953f678-2ec1-4602-bdd1-cb1606353528 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1476 microversion: 2.1 time: 0.417795 Oct 03 10:58:53.577547 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2699/5704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:53 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1476 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:53.720416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:53.721854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:53.740809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:53.741493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:53.745995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:53.746934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:53.747493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:53.748014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:53.776242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:53.777162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:53.795034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:53.798925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:53.799587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:53.804194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:53.806334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:53.807449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:53.962727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lazy-loading 'services' on Instance uuid a479f401-6d47-49e7-9694-6a54de5c8465 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:58:54.120699 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e839e79a-4616-48c2-9e13-2c202e0acd4d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments/d4a3592a-f4ce-4029-b574-6354a0504add" status: 202 len: 0 microversion: 2.1 time: 0.403855 Oct 03 10:58:54.121400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3006/5705] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 10:58:53 2022] DELETE /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments/d4a3592a-f4ce-4029-b574-6354a0504add => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:58:54.143269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:54.149340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:54.165697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.166448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.169644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:54.170639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.179150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.180048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:54.516801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:54.547326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-769a92e9-056a-4e69-aac0-91df135e9605 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1315 microversion: 2.1 time: 0.779392 Oct 03 10:58:54.564278 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2700/5706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:53 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:58:54.569670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:54.572483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:54.581652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.582609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.583249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:54.584751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.588688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.589491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:54.630372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d166b439-7e0d-4d65-8cb7-9911d8ce08af tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064797 Oct 03 10:58:54.635781 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2701/5707] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:58:54 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:54.641765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:54.642551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:54.651048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.652139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.652832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:54.653792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.654465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.655116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:54.924978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:54.936698 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ece137f-c3d5-46fa-9f17-a064b2461647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.298778 Oct 03 10:58:54.937531 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2702/5708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:54 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:54.952214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:54.953149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:54.968141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.969937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.971959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:54.972939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:54.976583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:54.978023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:55.050203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:55.063186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5fb8915b-3c7e-4883-a452-4e9adcacca9b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 0.935661 Oct 03 10:58:55.066799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3007/5709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:54 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:55.237730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-43ecbde3-74a1-40e1-9109-97da8f177c37 req-109d6f80-b7f1-42cc-ba71-c5b4d092b052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05779e5-9b42-4080-9100-a70a96ac0480", "name": "network-vif-plugged", "status": "completed", "tag": "270d4354-221f-42a4-9434-78b8fbe68979"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:55.249969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:55.267179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-43ecbde3-74a1-40e1-9109-97da8f177c37 req-109d6f80-b7f1-42cc-ba71-c5b4d092b052 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:55.268939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-43ecbde3-74a1-40e1-9109-97da8f177c37 req-109d6f80-b7f1-42cc-ba71-c5b4d092b052 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:55.274770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-43ecbde3-74a1-40e1-9109-97da8f177c37 req-109d6f80-b7f1-42cc-ba71-c5b4d092b052 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:55.301289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=22 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:55.310581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-43ecbde3-74a1-40e1-9109-97da8f177c37 req-109d6f80-b7f1-42cc-ba71-c5b4d092b052 service nova] Creating event network-vif-plugged:270d4354-221f-42a4-9434-78b8fbe68979 for instance d05779e5-9b42-4080-9100-a70a96ac0480 on n-h2-858383-3 Oct 03 10:58:55.331584 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-43ecbde3-74a1-40e1-9109-97da8f177c37 req-109d6f80-b7f1-42cc-ba71-c5b4d092b052 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102726 Oct 03 10:58:55.334860 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3008/5710] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:55.375941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:55.391893 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-89abd583-e0fa-4edd-a67f-33ccd6456b32 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1476 microversion: 2.1 time: 0.449441 Oct 03 10:58:55.392882 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2703/5711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:54 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1476 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:55.573458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:55.574177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:55.607842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:55.608635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:55.609133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:55.610645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:55.613209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:55.613876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:55.644743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:55.647097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:55.669128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:55.669909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:55.672262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:55.675382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:55.676124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:55.677126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:55.847707 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7cf0fd4-7dd2-409c-85c5-62f3851c9fcb tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206857 Oct 03 10:58:55.863922 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2704/5712] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:58:55 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:58:55.890925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-70549a50-4925-4374-a314-c805e0230569 req-a25d43d1-8856-4d0a-97d4-483c78d85c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e449c5d4-7908-411f-b370-129463e61386", "name": "network-vif-deleted", "tag": "95ab993f-c45a-4cff-9f2a-d5841a048049"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:55.932702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-70549a50-4925-4374-a314-c805e0230569 req-a25d43d1-8856-4d0a-97d4-483c78d85c48 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:55.936558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-70549a50-4925-4374-a314-c805e0230569 req-a25d43d1-8856-4d0a-97d4-483c78d85c48 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:55.938815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-70549a50-4925-4374-a314-c805e0230569 req-a25d43d1-8856-4d0a-97d4-483c78d85c48 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:55.984623 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-70549a50-4925-4374-a314-c805e0230569 req-a25d43d1-8856-4d0a-97d4-483c78d85c48 service nova] Creating event network-vif-deleted:95ab993f-c45a-4cff-9f2a-d5841a048049 for instance e449c5d4-7908-411f-b370-129463e61386 on n-h1-858383-3 Oct 03 10:58:56.027071 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-70549a50-4925-4374-a314-c805e0230569 req-a25d43d1-8856-4d0a-97d4-483c78d85c48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152122 Oct 03 10:58:56.027725 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2705/5713] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:58:56.065950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:56.066694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:56.088034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:56.089958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:56.090464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:56.090910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:56.091648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:56.092112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:56.092542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:56.661862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:56.689762 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e9cdc0af-14c2-4f75-b04d-b86930f7d045 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1315 microversion: 2.1 time: 1.122166 Oct 03 10:58:56.698273 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3009/5714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:55 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1315 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:56.722558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:56.723918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:56.752041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:56.755415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:58:56.762554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:56.763649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:56.764613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:56.765813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:56.766445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:56.767412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:56.775732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-370b002d-d5a1-483d-9b93-4a79d1eec5f8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1315 microversion: 2.1 time: 0.746558 Oct 03 10:58:56.791341 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2706/5715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:56 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:56.791341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:56.793274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:56.805506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:56.806024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:56.806504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:56.809836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:56.810493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:56.813308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:56.897423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:56.900695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:56.906533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:56.907325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lazy-loading 'fault' on Instance uuid e449c5d4-7908-411f-b370-129463e61386 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:58:57.069829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:57.084949 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6061ef97-9132-4aea-ad3d-dc1576487d57 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 200 len: 1331 microversion: 2.1 time: 0.299591 Oct 03 10:58:57.085623 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2707/5716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:56 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 1331 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:57.101024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-025e077e-489e-4648-b6bb-62ecb69bdec8 req-626d7926-8630-4fbf-8f2d-6c0de89ce0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3011f9d-402b-40f9-a96d-24f6e3d8ae0b", "tag": "b586e0cf-3218-40ec-b3ee-ea063ba080c8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:57.117826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-025e077e-489e-4648-b6bb-62ecb69bdec8 req-626d7926-8630-4fbf-8f2d-6c0de89ce0dd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:57.118334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-025e077e-489e-4648-b6bb-62ecb69bdec8 req-626d7926-8630-4fbf-8f2d-6c0de89ce0dd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:57.118764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-025e077e-489e-4648-b6bb-62ecb69bdec8 req-626d7926-8630-4fbf-8f2d-6c0de89ce0dd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:57.148260 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-025e077e-489e-4648-b6bb-62ecb69bdec8 req-626d7926-8630-4fbf-8f2d-6c0de89ce0dd service nova] Creating event network-changed:b586e0cf-3218-40ec-b3ee-ea063ba080c8 for instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b on n-h2-858383-3 Oct 03 10:58:57.156134 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-025e077e-489e-4648-b6bb-62ecb69bdec8 req-626d7926-8630-4fbf-8f2d-6c0de89ce0dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067684 Oct 03 10:58:57.169932 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2708/5717] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:57.175931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:57.179219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:57.187378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:57.188204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:57.188924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:57.189802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:57.190405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:57.190982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:57.208615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:57.217881 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc6f7030-8844-4e55-b689-1d227f48c44e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 0.512927 Oct 03 10:58:57.220505 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3010/5718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:56 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:57.228822 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f48b4fc-9419-4335-a1aa-ab96942c2f03 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057092 Oct 03 10:58:57.233437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2709/5719] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:58:57 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:57.721407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:57.722028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:57.737054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:57.737805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:57.738405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:57.739274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:57.747622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:57.748322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:57.799245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:57.799872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:57.814394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:57.816063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:57.816541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:57.817387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:57.817877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:57.818371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.084567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:58.108162 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9daea5ac-763b-4c77-9102-8a0a15b26c2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1502 microversion: 2.1 time: 0.313027 Oct 03 10:58:58.110874 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2710/5720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:57 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:58.138225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:58.139066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: e449c5d4-7908-411f-b370-129463e61386] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:58.151545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:58.157527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.159884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.163521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.165980 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8889e927-506b-4ab4-af95-055b25acda29 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1315 microversion: 2.1 time: 0.447001 Oct 03 10:58:58.166976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.168117 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3011/5721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:57 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:58.169576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.171068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.180888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8fb11caf-7cfb-4a91-8272-2141cd305e78 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:58.194769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fb11caf-7cfb-4a91-8272-2141cd305e78 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.196566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fb11caf-7cfb-4a91-8272-2141cd305e78 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.197392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fb11caf-7cfb-4a91-8272-2141cd305e78 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.240828 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] HTTP exception thrown: Instance e449c5d4-7908-411f-b370-129463e61386 could not be found. Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Request method failure captured: Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 HTTP/1.1 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr_brWMS_oSatwwqem9fy5h_LeLpxTwhTJxbg2BFZgu9lzPGPebvyh5R9RsccJO1-XjcRMRcIOHGllBQiu6RQsGhbzFMA4kgcgJccf2AvhSweUW0H60w7NQoUVMcpsYfVQjCDMQD8R58Q_ks8oQN94eg_6HnjoSO-lsFWvyxJAgPh4A Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: f0b21abdde534eee9e051d694648fbd2 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1896168490 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f0b21abdde534eee9e051d694648fbd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f0b21abdde534eee9e051d694648fbd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f0b21abdde534eee9e051d694648fbd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f0b21abdde534eee9e051d694648fbd2"}]}] Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1896168490 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: f0b21abdde534eee9e051d694648fbd2 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1896168490 Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestSecurityGroupsBasicOps-1896168490-project Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 828164d97b90461abe6540d1a20023ee Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1896168490-project Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance e449c5d4-7908-411f-b370-129463e61386 could not be found. Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'e449c5d4-7908-411f-b370-129463e61386'} Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e449c5d4-7908-411f-b370-129463e61386 could not be found. Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e449c5d4-7908-411f-b370-129463e61386 could not be found. Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:58:58.248233 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e449c5d4-7908-411f-b370-129463e61386 could not be found. Oct 03 10:58:58.251710 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:58:58.256901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Returning 404 to user: Instance e449c5d4-7908-411f-b370-129463e61386 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:58:58.260606 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f32a7a96-e455-414e-a412-cd920e0e0c9d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386" status: 404 len: 111 microversion: 2.1 time: 0.146447 Oct 03 10:58:58.262668 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2711/5722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:58 2022] GET /compute/v2.1/servers/e449c5d4-7908-411f-b370-129463e61386 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:58:58.263116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8fb11caf-7cfb-4a91-8272-2141cd305e78 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Going to try to stop instance {{(pid=122269) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 10:58:58.301201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:58.330061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:58.353710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.358648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.360407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.366251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.372013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.373666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.391341 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8fb11caf-7cfb-4a91-8272-2141cd305e78 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480/action" status: 202 len: 0 microversion: 2.1 time: 0.221582 Oct 03 10:58:58.392803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3012/5723] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:58:58 2022] POST /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:58:58.408744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:58.412574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:58.436730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.437283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.437737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.442353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.442939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.446569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.528921 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff8b4903-7460-4206-b397-4233ee4eff58 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248533 Oct 03 10:58:58.542484 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2712/5724] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:58:58 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:58.556502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fa3772f9-b6ad-47a2-82e8-1339eab18ac0 req-c1194238-7e58-4dbc-a6bf-fc4b8b440028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741f7b35-2576-42e9-b962-a33c08e0ae03", "name": "network-vif-plugged", "status": "completed", "tag": "4b6cf94f-ae70-4f78-946e-71e48b643ae5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:58:58.590324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa3772f9-b6ad-47a2-82e8-1339eab18ac0 req-c1194238-7e58-4dbc-a6bf-fc4b8b440028 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.591087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa3772f9-b6ad-47a2-82e8-1339eab18ac0 req-c1194238-7e58-4dbc-a6bf-fc4b8b440028 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.591738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa3772f9-b6ad-47a2-82e8-1339eab18ac0 req-c1194238-7e58-4dbc-a6bf-fc4b8b440028 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.606296 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fa3772f9-b6ad-47a2-82e8-1339eab18ac0 req-c1194238-7e58-4dbc-a6bf-fc4b8b440028 service nova] Creating event network-vif-plugged:4b6cf94f-ae70-4f78-946e-71e48b643ae5 for instance 741f7b35-2576-42e9-b962-a33c08e0ae03 on n-h2-858383-3 Oct 03 10:58:58.616822 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fa3772f9-b6ad-47a2-82e8-1339eab18ac0 req-c1194238-7e58-4dbc-a6bf-fc4b8b440028 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069013 Oct 03 10:58:58.621586 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2713/5725] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:58.641514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:58.642543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:58.661076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.662692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.664755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.666024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:58.667315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:58.668672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:58.857889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:58.867592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c273cd8d-2da3-4a75-8d0f-7c59a831cbb3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 0.470696 Oct 03 10:58:58.889201 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3013/5726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:58 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:59.196969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:59.197826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:59.222298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:59.222803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:59.223265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:59.229295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:59.229878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:59.230335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:59.747853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:58:59.757567 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3bef878-c3f2-46bc-bcff-261b960e771e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 1.132500 Oct 03 10:58:59.762162 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2714/5727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:58 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:58:59.780523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:59.785351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:58:59.807886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:59.808471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:59.809639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:59.810414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:58:59.810888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:58:59.811324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:58:59.971389 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0077c73d-fb78-42fb-a7b4-5ef3dc84e96a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204732 Oct 03 10:58:59.977260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2715/5728] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:58:59 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:58:59.985418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:58:59.986054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:00.009415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:00.018541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:00.019016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:00.020185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:00.020668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:00.021130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:01.906091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:01.915048 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d8293e1-383e-46e4-b227-491bb1e06e55 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1309 microversion: 2.1 time: 1.941488 Oct 03 10:59:01.915644 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2716/5729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:59 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1309 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:01.925912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:01.926801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:01.934504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:01.935287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:01.935875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:01.936740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:01.937376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:01.937949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:02.084945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:02.105044 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a627e394-428b-408a-97b7-93f50adadad6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1315 microversion: 2.1 time: 2.913254 Oct 03 10:59:02.120805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3014/5730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:58:59 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1315 bytes in 2917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:02.132743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:02.135456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:02.153855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:02.154526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:02.155165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:02.156015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:02.156588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:02.157564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:02.268586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e710fb4-821c-408a-b769-f63f3e004cb7 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159195 Oct 03 10:59:02.269354 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3015/5731] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:59:02 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:02.754264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:02.769484 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6a725f12-f2fd-46a2-81ea-f1b5fa81d783 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.847612 Oct 03 10:59:02.773139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2717/5732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:01 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:02.947401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:02.948028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:02.958337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:02.958875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:02.959327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:02.960054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:02.960525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:02.981227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.130424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:03.131737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:03.141729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.142005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.142453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.143184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.143648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.144086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.279824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:03.293499 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9bbb92ee-5df9-404e-8b59-b186510ce273 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1491 microversion: 2.1 time: 0.350481 Oct 03 10:59:03.310637 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3016/5733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:02 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1491 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:03.332363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:03.343112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:03.353833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.359644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.360332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.361755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.364921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.365493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.459571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-715b7cdd-5f25-49af-b31d-13fc5a01236d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145767 Oct 03 10:59:03.461524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3017/5734] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:59:03 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:03.472757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-606009338"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:03.482717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:03.491644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.492604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.493315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.494344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.495079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.496342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.620852 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb42b8b3-8c54-47a5-ad99-803c889be84e tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "PUT /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1075 microversion: 2.1 time: 0.157928 Oct 03 10:59:03.628012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3018/5735] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:59:03 2022] PUT /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1075 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:03.642437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:03.643238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:03.669606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.671312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.671312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.671312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.673513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.673513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.933177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:03.947520 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-844fed48-1fe8-418d-ad65-4646bb3c8b65 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1315 microversion: 2.1 time: 0.820966 Oct 03 10:59:03.957846 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2718/5736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:03 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:03.981714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:03.982948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:03.989277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.993231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:03.993758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:03.999051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:03.999623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:04.000135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:04.258195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:04.273036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57168042-b2b3-4def-be5a-2819e7d5cd26 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1501 microversion: 2.1 time: 0.634615 Oct 03 10:59:04.296517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3019/5737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:03 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1501 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:04.307166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:04.307807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:04.323820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:04.325586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:04.326058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:04.329769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:04.330278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:04.330718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:04.398904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:04.715363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:04.718433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:04.749942 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f91c2b8-8b3c-430c-89d1-6048a25e73e7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1501 microversion: 2.1 time: 0.452009 Oct 03 10:59:04.750772 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3020/5738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:04 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1501 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:04.761668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e938c4b2-8062-4084-9b2d-5e0ad8c0117f tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.800687 Oct 03 10:59:04.764211 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2719/5739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:03 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:04.774598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:04.776916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:04.789279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:04.790159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:04.790829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:04.791328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a297725a-6a89-417b-be95-6957c7321678 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:04.792429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:04.793137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:04.793583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:04.812959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a297725a-6a89-417b-be95-6957c7321678 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:04.813487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a297725a-6a89-417b-be95-6957c7321678 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:04.813940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a297725a-6a89-417b-be95-6957c7321678 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:04.840392 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b087991-e31d-466a-85f9-8f3c38b6b837 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077878 Oct 03 10:59:04.841852 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3021/5740] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:59:04 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:04.874836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a297725a-6a89-417b-be95-6957c7321678 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 10:59:04.956639 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a297725a-6a89-417b-be95-6957c7321678 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "POST /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03/action" status: 202 len: 0 microversion: 2.1 time: 0.178579 Oct 03 10:59:04.957739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2720/5741] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:59:04 2022] POST /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 10:59:04.973208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:04.974358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:04.985682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:04.986842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:05.001862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:05.005941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:05.007176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:05.010839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:05.011918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:05.013000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:05.013727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:05.014792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:05.015549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:05.017096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:05.017891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:05.027088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:05.481814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:05.497151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-237fef9a-344f-4cab-8eb2-9d00d5fdea74 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.529693 Oct 03 10:59:05.498001 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3022/5742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:04 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:05.528876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e07c6fd8-3e04-4e29-a5f7-c9e823b57f28 req-d46dcea7-b851-46b3-83c7-8731d3fb2881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3011f9d-402b-40f9-a96d-24f6e3d8ae0b", "name": "network-vif-plugged", "status": "completed", "tag": "b586e0cf-3218-40ec-b3ee-ea063ba080c8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:05.556929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e07c6fd8-3e04-4e29-a5f7-c9e823b57f28 req-d46dcea7-b851-46b3-83c7-8731d3fb2881 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:05.561042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e07c6fd8-3e04-4e29-a5f7-c9e823b57f28 req-d46dcea7-b851-46b3-83c7-8731d3fb2881 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:05.561645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e07c6fd8-3e04-4e29-a5f7-c9e823b57f28 req-d46dcea7-b851-46b3-83c7-8731d3fb2881 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:05.582866 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e07c6fd8-3e04-4e29-a5f7-c9e823b57f28 req-d46dcea7-b851-46b3-83c7-8731d3fb2881 service nova] Creating event network-vif-plugged:b586e0cf-3218-40ec-b3ee-ea063ba080c8 for instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b on n-h2-858383-3 Oct 03 10:59:05.598408 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e07c6fd8-3e04-4e29-a5f7-c9e823b57f28 req-d46dcea7-b851-46b3-83c7-8731d3fb2881 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087331 Oct 03 10:59:05.599631 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3023/5743] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:05.789796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:05.790601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:05.801465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:05.803794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:05.805138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:05.806000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:05.806550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:05.807236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.192669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:06.196935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:06.215703 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-658667d8-2fac-48e5-bb5f-c3ac2cebc38d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.430237 Oct 03 10:59:06.234468 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-159b469d-bcc3-40a1-aefc-3368b5b1cf16 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1315 microversion: 2.1 time: 1.252577 Oct 03 10:59:06.235791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3024/5744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:05 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:06.236811 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2721/5745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:04 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1315 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:06.245240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:06.247870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:06.256165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:06.258738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.260210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.260210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.260427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.261162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.261839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.308871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42bb6801-eda2-4b1a-8c71-b8e45738f2fc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071232 Oct 03 10:59:06.312820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3025/5746] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 10:59:06 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 10:59:06.393263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:06.393760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:06.400604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.401348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.401959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.402820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.406061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.406705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.453211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:59:06.524151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:06.525148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:06.527884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:06.533577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.534085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.534520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.535425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.535679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.536114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.598057 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-549d5208-437c-44fb-b6dc-b45675c3091d tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 204 len: 0 microversion: 2.1 time: 0.208519 Oct 03 10:59:06.603168 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2722/5747] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:06 2022] DELETE /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:59:06.609837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:06.610836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:06.618486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.619354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.620040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.621060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:06.621791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:06.622430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:06.841767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:06.854553 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bcb7fc9b-e716-49fe-a755-ef926b2eead7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.334411 Oct 03 10:59:06.875301 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3026/5748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:06 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:06.924528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:06.938304 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94e8e4d4-0596-4388-8605-554c6ab35abc tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1681 microversion: 2.1 time: 0.333397 Oct 03 10:59:06.951517 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2723/5749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:06 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1681 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:07.239509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:07.241974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:07.250421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.261904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.262660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:07.263508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.263991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.266347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:07.270207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:07.271273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:07.281921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.282817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.283475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:07.286796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.288231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.288960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:07.760323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:07.768187 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-462945b2-54d0-4d0c-92a9-0c526d5cc9c9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1315 microversion: 2.1 time: 0.511046 Oct 03 10:59:07.797036 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2724/5750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:07 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:07.832595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:07.841274 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-580d2a0c-af71-406e-abad-ed7cebf45766 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.605655 Oct 03 10:59:07.841877 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3027/5751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:07 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:07.881756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:07.882520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:07.900635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.901519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.902168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:07.903100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.903766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.904401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:07.966632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:07.967633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:07.974513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.975339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.975842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:07.976752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:07.977991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:07.981157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:08.280232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:08.290484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7319f107-4de6-474b-a72e-75709ae698c9 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1681 microversion: 2.1 time: 0.328707 Oct 03 10:59:08.292060 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3028/5752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:07 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:08.307263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:08.319598 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d87aac9b-5f25-435e-8b77-ab8932f93bff tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.441635 Oct 03 10:59:08.321089 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2725/5753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:07 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:08.809514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:08.811833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:08.819256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:08.822361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:08.823183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:08.824375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:08.825096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:08.825672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:08.867652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:08.868548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:08.871520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:08.893042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:08.895615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:08.897576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:08.899761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:08.901481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:08.904181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:09.200843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:09.209864 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce9641cd-2553-45f2-8c40-b761bcf117e7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.348042 Oct 03 10:59:09.211176 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2726/5754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:08 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:09.316848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:09.318102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:09.327446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:09.327948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:09.328393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:09.329873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:09.330338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:09.332979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:09.376530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:09.388754 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3d36fb7-ecf7-413f-8a7e-48e9bb133fe8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1501 microversion: 2.1 time: 0.588584 Oct 03 10:59:09.390561 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3029/5755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:08 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1501 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:09.398880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:09.399801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:09.408645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:09.409519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:09.410569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:09.411449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:09.412105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:09.412865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:09.714488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:09.726431 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e0294d8-d4a2-4cc6-b730-c9a327229426 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1681 microversion: 2.1 time: 0.414582 Oct 03 10:59:09.735876 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2727/5756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:09 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1681 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:09.745948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:09.746576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:09.756698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:09.760028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:09.760715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:09.761690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:09.762337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:09.770233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:10.073837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:10.082437 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c3749e6-c6bb-42a2-bff8-cdd2f22c1cf4 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.690585 Oct 03 10:59:10.099220 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3030/5757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:09 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:10.110856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.network.security_group_api [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Removing security group 6118784b-5f21-41a4-b43f-5245df15f129 from port b586e0cf-3218-40ec-b3ee-ea063ba080c8 Oct 03 10:59:10.235894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:10.236652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:10.245942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:10.246804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:10.247462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:10.248989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:10.249669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:10.250307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:10.600328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:10.617295 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e611d75c-67d1-493a-b3b8-5a6a0cab08f5 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.385959 Oct 03 10:59:10.643515 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3031/5758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:10 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:10.752401 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3551602-c77d-4e1d-a546-82a5df1cdd6d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b/action" status: 202 len: 0 microversion: 2.1 time: 1.015377 Oct 03 10:59:10.753776 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2728/5759] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:59:09 2022] POST /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b/action => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:59:10.765582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:10.766666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:10.772039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:10.776564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:10.778474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:10.779088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:10.779632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:10.781802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:10.782891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:10.785022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:10.797113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:10.798737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:10.799198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:10.809709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:10.811185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:10.814389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:11.206733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:11.222549 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3aa7f383-624c-4f6d-a7e4-93fff6462bc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1459 microversion: 2.1 time: 0.461268 Oct 03 10:59:11.223207 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3032/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:10 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1459 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:11.236909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c21f4c59-1393-4647-8385-eb151d97b608 req-4008a9d5-b203-430a-8128-6208412381e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3011f9d-402b-40f9-a96d-24f6e3d8ae0b", "tag": "b586e0cf-3218-40ec-b3ee-ea063ba080c8"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:11.259056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c21f4c59-1393-4647-8385-eb151d97b608 req-4008a9d5-b203-430a-8128-6208412381e5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:11.259566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c21f4c59-1393-4647-8385-eb151d97b608 req-4008a9d5-b203-430a-8128-6208412381e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:11.260058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c21f4c59-1393-4647-8385-eb151d97b608 req-4008a9d5-b203-430a-8128-6208412381e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:11.292258 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c21f4c59-1393-4647-8385-eb151d97b608 req-4008a9d5-b203-430a-8128-6208412381e5 service nova] Creating event network-changed:b586e0cf-3218-40ec-b3ee-ea063ba080c8 for instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b on n-h2-858383-3 Oct 03 10:59:11.311169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c21f4c59-1393-4647-8385-eb151d97b608 req-4008a9d5-b203-430a-8128-6208412381e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086345 Oct 03 10:59:11.311831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3033/5761] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:11.321600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:11.322359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:11.339432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:11.339947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:11.340404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:11.341167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:11.341633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:11.346494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:11.682198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:11.692356 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e677257-f22d-46c2-ba77-9422e5567139 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1681 microversion: 2.1 time: 0.930403 Oct 03 10:59:11.712375 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2729/5762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:10 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1681 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:11.718677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:11.719644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:11.728207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:11.728993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:11.729627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:11.730564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:11.732983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:11.733614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:11.849198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:11.862581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d4f74ae4-dcc8-4d38-80d7-dcdc7d6ef9fc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.549510 Oct 03 10:59:11.881491 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3034/5763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:11 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:11.894155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:11.894788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:11.910248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:11.910612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:11.911250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:11.912935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:11.914241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:11.915178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:12.192168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:12.202772 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-70533674-ec7b-456b-9989-ccf260b5a720 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.488829 Oct 03 10:59:12.204444 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2730/5764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:11 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:12.230509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:12.231602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:12.238633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:12.239211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:12.239919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:12.240895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:12.241654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:12.243017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:12.664443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:12.686160 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c2b1043-3242-4dbd-a37a-487c09192ced tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.797774 Oct 03 10:59:12.688025 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3035/5765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:11 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:12.720602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:12.723017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:12.738394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:12.738906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:12.739362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:12.741590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:12.743349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:12.744674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:12.775955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:12.787827 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55515456-d121-4f9c-920d-29d049e16c5e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.560680 Oct 03 10:59:12.797345 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2731/5766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:12 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:12.836288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-eb047542-1f56-4660-8514-d91b3fe3a7be req-fb233136-52cf-41a0-842b-719a35dfa5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a479f401-6d47-49e7-9694-6a54de5c8465", "name": "network-vif-deleted", "tag": "d539c2e1-c853-4068-b8fe-2a07761c1232"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:12.864748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eb047542-1f56-4660-8514-d91b3fe3a7be req-fb233136-52cf-41a0-842b-719a35dfa5a9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:12.865974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eb047542-1f56-4660-8514-d91b3fe3a7be req-fb233136-52cf-41a0-842b-719a35dfa5a9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:12.866513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-eb047542-1f56-4660-8514-d91b3fe3a7be req-fb233136-52cf-41a0-842b-719a35dfa5a9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:12.890272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-eb047542-1f56-4660-8514-d91b3fe3a7be req-fb233136-52cf-41a0-842b-719a35dfa5a9 service nova] Creating event network-vif-deleted:d539c2e1-c853-4068-b8fe-2a07761c1232 for instance a479f401-6d47-49e7-9694-6a54de5c8465 on n-h2-858383-3 Oct 03 10:59:12.895679 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-eb047542-1f56-4660-8514-d91b3fe3a7be req-fb233136-52cf-41a0-842b-719a35dfa5a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086993 Oct 03 10:59:12.896938 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2732/5767] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:12.903845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:12.904876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:12.911679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:12.912533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:12.913217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:12.914139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:12.914855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:12.915494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.086952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:13.099390 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1348691a-a059-4faa-ad56-ce810f239672 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1613 microversion: 2.1 time: 0.381346 Oct 03 10:59:13.113625 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3036/5768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:12 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1613 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:13.125382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:13.126153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:13.134053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.134719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.135170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.135945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.136515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.137062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.339952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:13.348223 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e929ff5-af3e-4106-9c04-c262ee77946e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.449843 Oct 03 10:59:13.348888 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2733/5769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:12 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:13.354466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:13.355225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:13.361678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.362435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.363019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.364292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.364889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.365706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.450853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:59:13.581943 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b0efd43b-8776-48e4-b6a3-623a48602d9f tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 204 len: 0 microversion: 2.1 time: 0.227774 Oct 03 10:59:13.583537 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2734/5770] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:13 2022] DELETE /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:59:13.599217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:13.602621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:13.612826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:13.619726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.620526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.623352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.626971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.627851 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d18d0f0-b7d6-4ebd-892e-d765f968c9dc tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.512681 Oct 03 10:59:13.628881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.628881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.630029 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3037/5771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:13 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:13.636179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-18fb7932-708b-4f63-b800-7470a0c973f1 req-87f9aa2b-9c80-4299-8e39-94aa5c7a3df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b808f438-48a6-449f-9ed7-ed6de09d37da", "tag": "5bbed468-f74d-4468-80e2-44eb5ade0560"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:13.669904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-18fb7932-708b-4f63-b800-7470a0c973f1 req-87f9aa2b-9c80-4299-8e39-94aa5c7a3df7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.672284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-18fb7932-708b-4f63-b800-7470a0c973f1 req-87f9aa2b-9c80-4299-8e39-94aa5c7a3df7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.673012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-18fb7932-708b-4f63-b800-7470a0c973f1 req-87f9aa2b-9c80-4299-8e39-94aa5c7a3df7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.687497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:13.714137 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-18fb7932-708b-4f63-b800-7470a0c973f1 req-87f9aa2b-9c80-4299-8e39-94aa5c7a3df7 service nova] Creating event network-changed:5bbed468-f74d-4468-80e2-44eb5ade0560 for instance b808f438-48a6-449f-9ed7-ed6de09d37da on n-h2-858383-3 Oct 03 10:59:13.728707 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-18fb7932-708b-4f63-b800-7470a0c973f1 req-87f9aa2b-9c80-4299-8e39-94aa5c7a3df7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094075 Oct 03 10:59:13.730315 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3038/5772] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:13.742975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:13.744651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:13.765077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.766974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.767680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:13.771105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:13.772739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:13.774068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:14.085427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:14.096425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6631f256-5cce-415e-a96c-40b4bffd927c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.509865 Oct 03 10:59:14.097280 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2735/5773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:13 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:14.106322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:14.107927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:14.122223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:14.124526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:14.127438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:14.134523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:14.137534 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a29ef4d-91a4-47b5-8809-68f31f299d90 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1769 microversion: 2.1 time: 0.405339 Oct 03 10:59:14.138614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:14.148222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:14.149166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:14.153268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3039/5774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:13 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1769 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:14.194759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:14.195463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:14.219235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:14.220547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:14.221905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:14.225242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:14.225982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:14.229490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:14.302479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:14.303439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:14.304143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:14.304604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lazy-loading 'fault' on Instance uuid a479f401-6d47-49e7-9694-6a54de5c8465 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:59:14.415749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07893383d2a480e942f0fa1a26846f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02cfe5fc3a948dcbd7bd6871e1b1ac1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:14.431297 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea1f54fa-474b-4aff-a658-14c960f58b6b tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 200 len: 1330 microversion: 2.1 time: 0.276798 Oct 03 10:59:14.431881 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3040/5775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:14 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 1330 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:14.442474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-911012061", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "9dbf8c82-dfae-4d56-9442-6e6c67d23560"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:14.523680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] validate_networks() for [('9dbf8c82-dfae-4d56-9442-6e6c67d23560', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:59:14.540933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:14.554285 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-be3f3a3a-b276-48bd-980c-13c5a608189a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.453813 Oct 03 10:59:14.555599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2736/5776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:14 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:14.652344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:14.653381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:14.664627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:14.665033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:14.665472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:14.678390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:14.679379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:14.679825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:15.289178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:15.300823 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e116686-e769-4289-8bb1-2c08189c3ad7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.652353 Oct 03 10:59:15.301426 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2737/5777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:14 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:15.328180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:15.336221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:15.347240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:15.348085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:15.349082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:15.350156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:15.351248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:15.351891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:15.384304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:15.859995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:15.875011 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f7d535ae-39f8-4586-9743-f42727153a52 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1769 microversion: 2.1 time: 0.549905 Oct 03 10:59:15.877716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2738/5778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:15 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1769 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:15.888196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:15.889464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:15.914567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:15.916708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:15.917618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:15.922050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:15.923160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:15.924344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:15.968365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 HTTP/1.1 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'a479f401-6d47-49e7-9694-6a54de5c8465'} Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:15.971447 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:15.977515 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:15.977515 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:15.977515 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:15.977515 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:15.977515 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:15.977515 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:15.977515 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:15.979373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:15.980599 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2dff1153-644c-4db0-b081-1412bea8e7c5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 404 len: 111 microversion: 2.1 time: 0.099751 Oct 03 10:59:15.986461 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2739/5779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:15 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:15.993160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:15.993817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:16.001072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.001560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.002232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:16.002944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.004020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.004508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:16.193335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:59:16.193914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:59:16.194309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:59:16.195184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:59:16.195765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:59:16.210822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.211501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.212118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:16.213225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.213624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.214284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:16.253565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:59:16.265143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Getting quotas for user e3857d14b6f6498c87700ea6ee22c4a6 and project 598e28eacadb4e528222edc532abb878. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:59:16.281693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:59:16.284517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:59:16.355589 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2b81702-a80e-4faa-be50-fb17b946cf5c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917492 Oct 03 10:59:16.362907 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3041/5780] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:59:16.368318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f6761106-5fd2-4b11-bb6f-440f57b857db tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '.version_select at 0x7f074e29b310>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:16.394842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:16.421755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-39d4a6df-0363-4815-b459-745e53aa443c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.434019 Oct 03 10:59:16.423126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f6761106-5fd2-4b11-bb6f-440f57b857db tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441928615" status: 202 len: 0 microversion: 2.1 time: 0.053802 Oct 03 10:59:16.423774 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3042/5781] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 10:59:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441928615 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:59:16.435234 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2740/5782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:15 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:16.440578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c09fb70d-40be-444f-849d-68b3d93ec1c2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:16.449479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:16.450109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:16.452380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c09fb70d-40be-444f-849d-68b3d93ec1c2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:16.480839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.481401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.481862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:16.484759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.486606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.487358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:16.672386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c09fb70d-40be-444f-849d-68b3d93ec1c2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:16.680816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c09fb70d-40be-444f-849d-68b3d93ec1c2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1214 microversion: 2.1 time: 0.243969 Oct 03 10:59:16.700420 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2741/5783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:16 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:16.912160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:16.913649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:16.922766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.923484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.924118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:16.925136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:16.925937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:16.927415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:17.134427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:17.149836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5365ee4b-7b5e-46d3-b4d6-8992d83a22e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.724976 Oct 03 10:59:17.150612 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3043/5784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:16 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:17.309223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828164d97b90461abe6540d1a20023ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b21abdde534eee9e051d694648fbd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:17.328218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3efc9cf3-3959-432b-9193-92857b31f35d tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 200 len: 1530 microversion: 2.1 time: 0.422383 Oct 03 10:59:17.329288 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2742/5785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:16 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 1530 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:17.440083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2277c526-9bea-4718-ab1c-3df053477e19 req-3dec78b1-229f-4fd3-bfe6-59cc0b030dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b808f438-48a6-449f-9ed7-ed6de09d37da", "name": "network-vif-deleted", "tag": "5bbed468-f74d-4468-80e2-44eb5ade0560"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:17.453102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:17.454078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:17.457106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2277c526-9bea-4718-ab1c-3df053477e19 req-3dec78b1-229f-4fd3-bfe6-59cc0b030dfd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:17.457562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2277c526-9bea-4718-ab1c-3df053477e19 req-3dec78b1-229f-4fd3-bfe6-59cc0b030dfd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:17.457996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2277c526-9bea-4718-ab1c-3df053477e19 req-3dec78b1-229f-4fd3-bfe6-59cc0b030dfd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:17.494573 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-2277c526-9bea-4718-ab1c-3df053477e19 req-3dec78b1-229f-4fd3-bfe6-59cc0b030dfd service nova] Creating event network-vif-deleted:5bbed468-f74d-4468-80e2-44eb5ade0560 for instance b808f438-48a6-449f-9ed7-ed6de09d37da on n-h2-858383-3 Oct 03 10:59:17.497515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:17.500619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:17.501382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:17.502540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:17.505216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:17.505938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:17.511386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2277c526-9bea-4718-ab1c-3df053477e19 req-3dec78b1-229f-4fd3-bfe6-59cc0b030dfd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075053 Oct 03 10:59:17.514578 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3044/5786] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:17.714600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:17.716349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:17.724302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:17.725368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:17.726187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:17.728205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:17.729216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:17.744834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:18.454629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:18.477280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0adb08ab-a9d7-44d9-a36c-d555f29adbee tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1266 microversion: 2.1 time: 0.769278 Oct 03 10:59:18.493879 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3045/5787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:17 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1266 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:18.499119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:18.499844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:18.518820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:18.521438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:18.524297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:18.525421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:18.528527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:18.529189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:18.597923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:18.610661 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7a7d205c-2e13-4e91-9faf-21a884d1aa74 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 1.162733 Oct 03 10:59:18.611435 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2743/5788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:17 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:18.654412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:18.655499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] [instance: b808f438-48a6-449f-9ed7-ed6de09d37da] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:18.688938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:18.689460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:18.689912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:18.690635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:18.691100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:18.693204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:18.744637 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] HTTP exception thrown: Instance b808f438-48a6-449f-9ed7-ed6de09d37da could not be found. Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Request method failure captured: Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da HTTP/1.1 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr_brWMS_oSatwwqem9fy5h_LeLpxTwhTJxbg2BFZgu9lzPGPebvyh5R9RsccJO1-XjcRMRcIOHGllBQiu6RQsGhbzFMA4kgcgJccf2AvhSweUW0H60w7NQoUVMcpsYfVQjCDMQD8R58Q_ks8oQN94eg_6HnjoSO-lsFWvyxJAgPh4A Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: f0b21abdde534eee9e051d694648fbd2 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1896168490 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f0b21abdde534eee9e051d694648fbd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f0b21abdde534eee9e051d694648fbd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f0b21abdde534eee9e051d694648fbd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f0b21abdde534eee9e051d694648fbd2"}]}] Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1896168490 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: f0b21abdde534eee9e051d694648fbd2 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1896168490 Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestSecurityGroupsBasicOps-1896168490-project Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 828164d97b90461abe6540d1a20023ee Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1896168490-project Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b808f438-48a6-449f-9ed7-ed6de09d37da could not be found. Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b808f438-48a6-449f-9ed7-ed6de09d37da'} Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b808f438-48a6-449f-9ed7-ed6de09d37da could not be found. Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b808f438-48a6-449f-9ed7-ed6de09d37da could not be found. Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:18.751664 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b808f438-48a6-449f-9ed7-ed6de09d37da could not be found. Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:18.755257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Returning 404 to user: Instance b808f438-48a6-449f-9ed7-ed6de09d37da could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:18.755767 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6dbda332-e73e-4a28-ac81-6b8c76182e54 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da" status: 404 len: 111 microversion: 2.1 time: 0.113548 Oct 03 10:59:18.762433 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2744/5789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:18 2022] GET /compute/v2.1/servers/b808f438-48a6-449f-9ed7-ed6de09d37da => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:19.074021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:19.082264 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc416fda-0951-46d1-bf90-35b6fbd77f4d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.587225 Oct 03 10:59:19.085630 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3046/5790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:18 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:19.511188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:19.511817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:19.528365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:19.528899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:19.529495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:19.530225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:19.530669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:19.531097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:19.641229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:19.643283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:19.662736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:19.663590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:19.665116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:19.666116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:19.668120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:19.668949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:19.696197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:19.711302 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc3db44b-f719-4b5d-8db5-59fc5f5b243c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1272 microversion: 2.1 time: 0.201929 Oct 03 10:59:19.713230 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2745/5791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:19 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:20.112342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:20.112987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:20.124975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:20.125613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:20.126057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:20.128224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:20.128700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:20.129159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:20.250898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:20.267866 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aacf03aa-33f3-4378-ab0a-db46de211fe6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.631465 Oct 03 10:59:20.282481 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3047/5792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:19 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:20.637571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:20.670480 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-241ce800-47ec-4dbb-ade2-b453daf9e16d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.560107 Oct 03 10:59:20.673328 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2746/5793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:20 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:20.737305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:20.737926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:20.751375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:20.751879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:20.752322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:20.753069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:20.755557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:20.758909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:21.183615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:21.212007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6119760-8731-4e07-a6d8-c2698079d66d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1314 microversion: 2.1 time: 0.477601 Oct 03 10:59:21.215696 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3048/5794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:20 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:21.303696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:21.304679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:21.318437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:21.319116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:21.319663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:21.320561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:21.321259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:21.321802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:21.695127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:21.695883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:21.705357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:21.720271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:21.721712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:21.724365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:21.733418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:21.734890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:21.850684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:21.883797 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c0400175-c16a-4064-b5d5-64c1c570a647 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.585679 Oct 03 10:59:21.900191 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2747/5795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:21 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:22.249641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b96ce7a6-9e65-473f-bb0b-71fa810964f3 req-0daa56cd-0304-4e8b-b307-ec96710d18e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18372a0b-5255-46a2-a0d6-f72df9fd27fe", "tag": "94379c78-1f9c-4790-9a0b-5aa515745235"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:22.284442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b96ce7a6-9e65-473f-bb0b-71fa810964f3 req-0daa56cd-0304-4e8b-b307-ec96710d18e4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:22.285304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b96ce7a6-9e65-473f-bb0b-71fa810964f3 req-0daa56cd-0304-4e8b-b307-ec96710d18e4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:22.289576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b96ce7a6-9e65-473f-bb0b-71fa810964f3 req-0daa56cd-0304-4e8b-b307-ec96710d18e4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:22.319531 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b96ce7a6-9e65-473f-bb0b-71fa810964f3 req-0daa56cd-0304-4e8b-b307-ec96710d18e4 service nova] Creating event network-changed:94379c78-1f9c-4790-9a0b-5aa515745235 for instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe on n-h1-858383-3 Oct 03 10:59:22.327545 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b96ce7a6-9e65-473f-bb0b-71fa810964f3 req-0daa56cd-0304-4e8b-b307-ec96710d18e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110206 Oct 03 10:59:22.328684 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2748/5796] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:22.336031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:22.337234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:22.345624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:22.346128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:22.355572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:22.356556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:22.358333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:22.358838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:22.726686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:22.739880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:22.741653 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-46d14067-f22e-4909-ae1a-71c42d6c5a5a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 1.051971 Oct 03 10:59:22.742563 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3049/5797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:21 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:22.781311 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f9ce2795-781f-41d7-a7d9-b89bd2431ccf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1314 microversion: 2.1 time: 0.449550 Oct 03 10:59:22.790604 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2749/5798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:22 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:22.915723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:22.916624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:22.933506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:22.934289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:22.934917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:22.935801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:22.941525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:22.942163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.321959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:23.322546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:23.332164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.334613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.335697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.340192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.341031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.341664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.374220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 HTTP/1.1 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'a479f401-6d47-49e7-9694-6a54de5c8465'} Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:23.376258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.379983 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.383826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:23.394462 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e5f316b2-bfcd-4e83-a130-632c8dbf98fa tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 404 len: 111 microversion: 2.1 time: 0.077535 Oct 03 10:59:23.395818 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2750/5799] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:23 2022] DELETE /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:23.403972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:23.405095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: a479f401-6d47-49e7-9694-6a54de5c8465] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:23.416747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.417602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.418285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.419225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.420133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.421605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.453112 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 HTTP/1.1 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'a479f401-6d47-49e7-9694-6a54de5c8465'} Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:23.459962 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.463389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:23.463389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:23.463389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:23.463389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:23.463389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:23.463389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. Oct 03 10:59:23.463389 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:23.471972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance a479f401-6d47-49e7-9694-6a54de5c8465 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:23.473091 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4da41d4e-77b9-46b7-94f5-ccdc661f17f5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465" status: 404 len: 111 microversion: 2.1 time: 0.073567 Oct 03 10:59:23.473882 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2751/5800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:23 2022] GET /compute/v2.1/servers/a479f401-6d47-49e7-9694-6a54de5c8465 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:59:23.728750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:23.768620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8afdc03a-edfc-4358-bb99-fc269581bc53 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.849921 Oct 03 10:59:23.769370 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3050/5801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:22 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:23.786242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:23.787686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:23.819413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:23.821903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:23.832325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.837174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.838566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.840305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.845032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.845705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.858886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.860796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.861443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:23.863295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:23.871914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:23.872544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:24.124035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:24.132084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-34b8e5fa-2893-491a-a318-594a8d7fb67c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.355008 Oct 03 10:59:24.132671 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2752/5802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:23 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:24.565720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:24.583772 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34b7c0d4-e92e-4efc-a58c-9eac8f697f0d tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1314 microversion: 2.1 time: 0.775862 Oct 03 10:59:24.586140 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3051/5803] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:23 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:24.807114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:24.807653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:24.832242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:24.835962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:24.836554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:24.841935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:24.841935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:24.841935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:25.160911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:25.172220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:25.174258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:25.192441 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-099e1679-5b84-40c4-855b-1cd041c761a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.394982 Oct 03 10:59:25.193103 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2753/5804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:24 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:25.196676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:25.197208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:25.197659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:25.198398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:25.209154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:25.209843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:25.607448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:25.608301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:25.620358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:25.621150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:25.621772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:25.622639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:25.623249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:25.623983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:26.041473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:26.061088 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2476ce27-3f98-4435-a8b6-db3466d9ec2c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1314 microversion: 2.1 time: 0.457308 Oct 03 10:59:26.078967 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2754/5805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:25 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:26.219811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:26.221245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:26.233872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:26.236711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:26.237681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:26.237681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:26.238522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:26.239003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:26.239417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:26.274763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:26.419331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:26.446385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da007a55-b22e-4200-9bf4-1aa9e6200eb7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 1.282822 Oct 03 10:59:26.447010 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3052/5806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:25 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:26.676603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:27.086903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:27.088079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:27.104050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:27.105447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:27.105908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:27.106656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:27.107124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:27.107553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:27.409312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:27.419203 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-398d5b98-eafa-44c4-90a8-fa59bf591842 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 1.203365 Oct 03 10:59:27.427369 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2755/5807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:26 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:27.476196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:27.477518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:27.492307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:27.492883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:27.493978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:27.494886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:27.497691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:27.503068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:27.864113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:27.889662 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2614ddba-96cd-43bc-8471-10a909ad229c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.417812 Oct 03 10:59:27.895000 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2756/5808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:27 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:27.905409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:27.916203 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d48b8a1a-1494-4741-bdef-8080fa297f17 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1314 microversion: 2.1 time: 0.833293 Oct 03 10:59:27.954864 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3053/5809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:27 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:28.451464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:28.453371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:28.462084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:28.464475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:28.465184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:28.468481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:28.469295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:28.473784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:28.933278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:28.933925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:28.954710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:28.956194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:28.958617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:28.962261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:28.963141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:28.965191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.194202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:29.205887 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2764014a-b274-4898-a426-c93bd62c2125 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1512 microversion: 2.1 time: 0.758208 Oct 03 10:59:29.228754 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2757/5810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:28 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1512 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:29.241864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:29.243250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:29.260727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.264336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.265012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.265954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.266578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.269042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.503123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:29.516046 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-899590ce-3863-4129-aa34-5d7e8766d2aa tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.590559 Oct 03 10:59:29.516933 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3054/5811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:28 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:29.530228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:29.530951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:29.548113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.550750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.551378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.552281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.555031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.556035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.596275 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf HTTP/1.1 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '31896970-1773-46f8-a675-13c516baaddf'} Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:29.601070 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.605016 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.608274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:29.612550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c1ec2a2-3fc1-4922-a902-77c56f93243a tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 404 len: 111 microversion: 2.1 time: 0.092442 Oct 03 10:59:29.616143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3055/5812] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:29 2022] DELETE /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:29.625897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:29.627110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 31896970-1773-46f8-a675-13c516baaddf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:29.634470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.635216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.635814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.636873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.638179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.638779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.655588 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf HTTP/1.1 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '31896970-1773-46f8-a675-13c516baaddf'} Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.657797 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.662003 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.662003 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.662003 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.662003 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:29.662003 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:29.662003 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. Oct 03 10:59:29.662003 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.663354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance 31896970-1773-46f8-a675-13c516baaddf could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:29.664384 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-71dc2865-6284-4d48-9de6-075f8622f60c tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf" status: 404 len: 111 microversion: 2.1 time: 0.043990 Oct 03 10:59:29.665504 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3056/5813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:29 2022] GET /compute/v2.1/servers/31896970-1773-46f8-a675-13c516baaddf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:59:29.677073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:29.678112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:29.705619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.706330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.707140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.708030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.708658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.709855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.727561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 HTTP/1.1 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f83af7ea-0bd2-46a1-8c0a-a827b715e111'} Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:29.737492 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bb7b2be-891e-4ddf-b31c-4d309b29bfe5 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 404 len: 111 microversion: 2.1 time: 0.068750 Oct 03 10:59:29.741064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3057/5814] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:29 2022] DELETE /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:29.747752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:29.748381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: f83af7ea-0bd2-46a1-8c0a-a827b715e111] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:29.755437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.756994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.757561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.758288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.758807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.759253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.799884 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 HTTP/1.1 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f83af7ea-0bd2-46a1-8c0a-a827b715e111'} Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:29.801652 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance f83af7ea-0bd2-46a1-8c0a-a827b715e111 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24fd2d58-0945-434c-85e9-655d57536b06 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111" status: 404 len: 111 microversion: 2.1 time: 0.060244 Oct 03 10:59:29.805941 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3058/5815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:29 2022] GET /compute/v2.1/servers/f83af7ea-0bd2-46a1-8c0a-a827b715e111 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:29.833525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-177a76ca-376c-4aff-b61e-8cf447d35e5b req-e1e7a81f-bf87-40de-9f33-3bde1ccaf841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18372a0b-5255-46a2-a0d6-f72df9fd27fe", "name": "network-vif-plugged", "status": "completed", "tag": "94379c78-1f9c-4790-9a0b-5aa515745235"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:29.870623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-177a76ca-376c-4aff-b61e-8cf447d35e5b req-e1e7a81f-bf87-40de-9f33-3bde1ccaf841 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:29.871384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-177a76ca-376c-4aff-b61e-8cf447d35e5b req-e1e7a81f-bf87-40de-9f33-3bde1ccaf841 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:29.871847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-177a76ca-376c-4aff-b61e-8cf447d35e5b req-e1e7a81f-bf87-40de-9f33-3bde1ccaf841 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:29.902102 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-177a76ca-376c-4aff-b61e-8cf447d35e5b req-e1e7a81f-bf87-40de-9f33-3bde1ccaf841 service nova] Creating event network-vif-plugged:94379c78-1f9c-4790-9a0b-5aa515745235 for instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe on n-h1-858383-3 Oct 03 10:59:29.934174 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-177a76ca-376c-4aff-b61e-8cf447d35e5b req-e1e7a81f-bf87-40de-9f33-3bde1ccaf841 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105229 Oct 03 10:59:29.934730 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3059/5816] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:59:30.238649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:30.239565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:30.265244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:30.267934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:30.268982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:30.270351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:30.272557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:30.273401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:30.330390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:30.350855 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3ac50fe3-193d-4267-a4f7-6881c352b39a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1314 microversion: 2.1 time: 1.115671 Oct 03 10:59:30.364889 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2758/5817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:29 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1314 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:30.540198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:30.541011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:30.549565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:30.550064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:30.555046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:30.556020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:30.558475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:30.559292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:30.626369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:30.713574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:30.718997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:30.731085 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c318cac-7dea-4a42-b801-16cca36236c1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1489 microversion: 2.1 time: 0.498872 Oct 03 10:59:30.736511 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3060/5818] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:30 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1489 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:30.756077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad8ad116-0b09-4029-93dc-71a47b476925 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] Calling method '.version_select at 0x7f0757565940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:30.809578 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad8ad116-0b09-4029-93dc-71a47b476925 tempest-TestSecurityGroupsBasicOps-1896168490 tempest-TestSecurityGroupsBasicOps-1896168490-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-254849441" status: 202 len: 0 microversion: 2.1 time: 0.071589 Oct 03 10:59:30.810439 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3061/5819] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 10:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-254849441 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:59:30.817434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:30.819091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:30.831452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:30.837528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:30.838319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:30.840405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:30.841337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:30.842077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:30.897514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:59:30.969865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:30.978594 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-90d91f72-3388-4694-a564-2e4eb28aed56 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.442867 Oct 03 10:59:30.982877 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2759/5820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:30 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:31.030335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:31.045839 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1c33f5e8-0ab4-4f4c-a860-e53df0dd51e0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 204 len: 0 microversion: 2.1 time: 0.232784 Oct 03 10:59:31.047267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3062/5821] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:30 2022] DELETE /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:59:31.057324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:31.057952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:31.070079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:31.077329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:31.077811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:31.078583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:31.079071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:31.079511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:31.366300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:31.390944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:31.392185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:31.403934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:31.408063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:31.408517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:31.411842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:31.412925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:31.413370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:31.414132 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4faeae60-9f98-4e90-b784-bb02a338a1a9 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1495 microversion: 2.1 time: 0.347896 Oct 03 10:59:31.429979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2760/5822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:31 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1495 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:31.761307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:31.782319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec5b53ed-8adc-4743-a4c5-a88ab7ecc036 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1314 microversion: 2.1 time: 0.404867 Oct 03 10:59:31.790881 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3063/5823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:31 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:32.010655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:32.011573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:32.019180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:32.019892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:32.020340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:32.021077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:32.022284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:32.022876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:32.376879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:32.389338 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-77a4393a-2134-46f2-87c0-1cb7f39a6f6d tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.382453 Oct 03 10:59:32.390674 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2761/5824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:32 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:32.441635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:32.442417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:32.459936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:32.461489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:32.462318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:32.467158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:32.470451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:32.472185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:32.809588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:32.810832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:32.821190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:32.822019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:32.822682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:32.823628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:32.824332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:32.825197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:33.185094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:33.203712 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1bc105d2-614c-4a3f-b8ba-b23271b870f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1495 microversion: 2.1 time: 0.764748 Oct 03 10:59:33.217341 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3064/5825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:32 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1495 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:33.239529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:33.250745 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-66847957-2a16-4088-b222-29e387c0bc4a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1501 microversion: 2.1 time: 0.448428 Oct 03 10:59:33.251852 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2762/5826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:32 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1501 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:33.282030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:33.283642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:33.298324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:33.299001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:33.300493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:33.308504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:33.309268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:33.310933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:33.419810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:33.420416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:33.440620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:33.441528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:33.441979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:33.442702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:33.443188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:33.443622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:33.500969 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-756f5282-947a-4b69-b50c-e8ba85e14665 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe/action" status: 202 len: 0 microversion: 2.1 time: 0.224850 Oct 03 10:59:33.503850 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3065/5827] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:59:33 2022] POST /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:59:33.546992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:33.550573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:33.580156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:33.581840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:33.583822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:33.584981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:33.585770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:33.586530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:33.829217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:33.846220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7a1bc0e2-bdab-4498-ab8f-e157e2aae3c0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.430164 Oct 03 10:59:33.849835 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2763/5828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:33 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:34.080407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:34.119751 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17afa115-9970-4c7e-bb5d-f4328286ac10 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1506 microversion: 2.1 time: 0.590107 Oct 03 10:59:34.121597 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3066/5829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:33 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1506 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:34.231789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:34.232403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:34.248227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.248842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.249204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.250622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.251395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.252139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.318078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-af9b9b70-e90e-4230-a1dd-ec82a58e14c9 req-3eaba97b-532a-4649-b913-f9ce75cd9af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05779e5-9b42-4080-9100-a70a96ac0480", "name": "network-vif-deleted", "tag": "270d4354-221f-42a4-9434-78b8fbe68979"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:34.334536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-af9b9b70-e90e-4230-a1dd-ec82a58e14c9 req-3eaba97b-532a-4649-b913-f9ce75cd9af8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.335422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-af9b9b70-e90e-4230-a1dd-ec82a58e14c9 req-3eaba97b-532a-4649-b913-f9ce75cd9af8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.338374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-af9b9b70-e90e-4230-a1dd-ec82a58e14c9 req-3eaba97b-532a-4649-b913-f9ce75cd9af8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.384888 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-af9b9b70-e90e-4230-a1dd-ec82a58e14c9 req-3eaba97b-532a-4649-b913-f9ce75cd9af8 service nova] Creating event network-vif-deleted:270d4354-221f-42a4-9434-78b8fbe68979 for instance d05779e5-9b42-4080-9100-a70a96ac0480 on n-h2-858383-3 Oct 03 10:59:34.392649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-af9b9b70-e90e-4230-a1dd-ec82a58e14c9 req-3eaba97b-532a-4649-b913-f9ce75cd9af8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077981 Oct 03 10:59:34.394242 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3067/5830] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:34.541468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:34.542536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:34.567660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.570145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.570817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.602399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:34.614385 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ec6293bf-4a09-4326-9012-1df4c84b64ce tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 200 len: 1453 microversion: 2.1 time: 0.387264 Oct 03 10:59:34.614989 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2764/5831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:34 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 1453 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:34.619246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.622089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.623937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.687118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 HTTP/1.1 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '04d2546d-4e01-4ab7-89c9-23bd8ede5a59'} Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:34.695008 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.700146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:34.702496 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d394086-4fbd-4b91-a100-13816da4414e tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 404 len: 111 microversion: 2.1 time: 0.168645 Oct 03 10:59:34.708201 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3068/5832] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:34 2022] DELETE /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:59:34.715113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:34.715740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] [instance: 04d2546d-4e01-4ab7-89c9-23bd8ede5a59] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:34.731332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.732408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.733093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.736950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.737901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.738584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.773206 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] HTTP exception thrown: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Request method failure captured: Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 HTTP/1.1 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6igRdC-hvXwkExpa_B_M6psYoCVPrI8IVtDouzUqVaxPBeERVa8umfN0YhtmXdFpoa1wOEB3uvkdjiPhwhIK1BQn7PDTCYecYA1D85GnYgNBkCzw7jaIIGy2dkQPy_RSTQr9e36YcXQujzT91YaHTFIXmueLwkHmaVNjVbEG-rhig Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a02cfe5fc3a948dcbd7bd6871e1b1ac1"}]}] Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: a02cfe5fc3a948dcbd7bd6871e1b1ac1 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1378986859 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e07893383d2a480e942f0fa1a26846f5 Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeNegativeTest-1378986859-project Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '04d2546d-4e01-4ab7-89c9-23bd8ede5a59'} Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:34.781419 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.785554 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:34.785554 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:34.785554 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:34.785554 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:34.785554 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:34.785554 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. Oct 03 10:59:34.785554 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:34.787852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] Returning 404 to user: Instance 04d2546d-4e01-4ab7-89c9-23bd8ede5a59 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:34.789096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2fa8354-dab2-44af-9a73-f0a00bb9d611 tempest-AttachVolumeNegativeTest-1378986859 tempest-AttachVolumeNegativeTest-1378986859-project] 10.222.0.27 "GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59" status: 404 len: 111 microversion: 2.1 time: 0.080047 Oct 03 10:59:34.795034 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2765/5833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:34 2022] GET /compute/v2.1/servers/04d2546d-4e01-4ab7-89c9-23bd8ede5a59 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:34.873307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:34.873940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:34.882970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.883452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.883895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:34.884604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:34.885238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:34.885981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:35.143346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:35.144164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:35.165256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:35.166983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:35.169272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:35.171356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:35.172539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:35.173927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:35.538829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:35.556225 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30fff7ae-3117-44a9-9b03-2b98d1723905 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1511 microversion: 2.1 time: 0.686132 Oct 03 10:59:35.571837 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3069/5834] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:34 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:35.639136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:35.639842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:35.652186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:35.653461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:35.654718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:35.657511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:35.659421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:35.661586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:35.681978 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 10:59:35.683709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 HTTP/1.1 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'd05779e5-9b42-4080-9100-a70a96ac0480'} Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:35.685127 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:35.689253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:35.689253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:35.689253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:35.689253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:35.689253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:35.689253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 10:59:35.689253 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:35.692845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:35.695580 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-806834c7-87fe-4001-959b-2462125b1ba8 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 404 len: 111 microversion: 2.1 time: 0.060927 Oct 03 10:59:35.697061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3070/5835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:35 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:35.703748 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-af388f95-1052-4782-b4f9-71bc371cbcbb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1486 microversion: 2.1 time: 0.564117 Oct 03 10:59:35.721120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2766/5836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:35 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1486 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:35.751440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:35.754497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:35.778801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:35.779642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:35.783140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:35.784272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:35.785337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:35.786783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:35.885131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lazy-loading 'flavor' on Instance uuid 18372a0b-5255-46a2-a0d6-f72df9fd27fe {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 10:59:36.107808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1607369205", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e8c45795-beb8-40e6-ba51-51a8d24fedd0"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:36.253520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] validate_networks() for [('e8c45795-beb8-40e6-ba51-51a8d24fedd0', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 10:59:36.422059 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57294638-73f7-4f17-8be8-e01e150826ff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe/action" status: 202 len: 0 microversion: 2.1 time: 0.677640 Oct 03 10:59:36.425945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3071/5837] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 10:59:35 2022] POST /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 10:59:36.446765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:36.449662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:36.469935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:36.471541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:36.477017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:36.479878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:36.481854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:36.482571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:36.845602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:36.855071 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c2e1927-67a5-4c0d-bc18-7d0004dba125 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1492 microversion: 2.1 time: 0.421345 Oct 03 10:59:36.859669 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3072/5838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:36 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1492 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:36.870124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:36.873141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:36.882320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:36.883472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:36.883926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:36.884744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:36.885533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:36.885998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.212719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:37.222271 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37813ee1-a2a9-4421-9a20-ac4f67f58d4a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1488 microversion: 2.1 time: 0.361018 Oct 03 10:59:37.244944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3073/5839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:36 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1488 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:37.272630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-611695481"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:37.280461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:37.298270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.299940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.301916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.304987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.305677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.307129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.451300 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1af1338-5489-4c53-b5e9-0437134239f1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "PUT /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1061 microversion: 2.1 time: 0.202605 Oct 03 10:59:37.451927 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3074/5840] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 10:59:37 2022] PUT /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1061 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:37.473134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:37.474044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:37.482669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.483114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.483494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.484735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.485225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.486000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.491142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:37.689452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:37.698438 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c58df0ad-2ec6-4d41-8b95-eade8432db7b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1488 microversion: 2.1 time: 0.229037 Oct 03 10:59:37.711519 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3075/5841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:37 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1488 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:37.724842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:37.725856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:37.733400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.734126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.734596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.738549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.738549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.738549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.824731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 10:59:37.825303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 10:59:37.825640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 10:59:37.826220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 10:59:37.826635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 10:59:37.840103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.840603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.841062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.841784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:37.842236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:37.846833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:37.893051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 10:59:37.900122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Getting quotas for user 2a0e22aff3574cb286f2c1aa546c6c78 and project 25d2d134377b45f0bb0f349a14256f30. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 10:59:37.915618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:37.918092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 10:59:37.921216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 10:59:37.937615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:37.961345 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d56ebf5d-42f9-468c-9ba3-b4e13ed216c9 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1488 microversion: 2.1 time: 0.240574 Oct 03 10:59:37.964713 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3076/5842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:37 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1488 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:37.973569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:37.973569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:38.009366 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3cfb6329-3efe-46a3-a1f7-61db44156d86 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.905616 Oct 03 10:59:38.010599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2767/5843] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 10:59:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 10:59:38.020817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:38.022745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:38.029435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:38.031635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:38.035488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:38.036435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:38.036683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:38.037541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:38.040429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:38.041190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:38.041909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:38.045147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:38.046691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:38.046691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:38.128475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:59:38.334473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:38.353186 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c25592d6-44c7-480a-a36f-d71efbe770a0 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1513 microversion: 2.1 time: 0.387761 Oct 03 10:59:38.373261 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3077/5844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:37 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:38.378665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-469e5e17-942f-4cd7-b1b0-1b8923aa5ff7 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 204 len: 0 microversion: 2.1 time: 0.366138 Oct 03 10:59:38.382185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-78d9a242-55f8-4991-aaf3-3f734c8537ca tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:38.383398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-78d9a242-55f8-4991-aaf3-3f734c8537ca tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:38.386290 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2768/5845] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:38 2022] DELETE /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:59:38.400974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:38.403930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:38.418281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:38.420365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:38.421380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:38.428985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:38.431517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:38.433161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:38.457684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-78d9a242-55f8-4991-aaf3-3f734c8537ca tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:38.467027 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-78d9a242-55f8-4991-aaf3-3f734c8537ca tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1215 microversion: 2.1 time: 0.091949 Oct 03 10:59:38.471343 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3078/5846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:38 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:38.869505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:38.887275 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bd026e79-b329-4e65-9ee1-0d38665fc85b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1494 microversion: 2.1 time: 0.496013 Oct 03 10:59:38.889920 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2769/5847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:38 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1494 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:39.397893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:39.399463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:39.413005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:39.415092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:39.416066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:39.417086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:39.417804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:39.418440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:39.494424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:39.495239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:39.519275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:39.519838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:39.520519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:39.521342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:39.522318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:39.522742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:39.645360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:39.663763 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04313f99-f240-4187-a57c-8e97b5cee557 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1267 microversion: 2.1 time: 0.173443 Oct 03 10:59:39.664373 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2770/5848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:39 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:39.923888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:39.924519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:39.957892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:39.965203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:39.970853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:39.975777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:39.981473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:39.981934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:40.080318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:40.114702 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-18d3b898-58b2-45dc-994b-eee1360c12b1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1513 microversion: 2.1 time: 0.733926 Oct 03 10:59:40.120992 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3079/5849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:39 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1513 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:41.246511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:41.247189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:41.258841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:41.259350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:41.259793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:41.260607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:41.261117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:41.261555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:41.401329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:41.409833 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-00576445-5fe9-4a36-987e-0e34afe4b012 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1273 microversion: 2.1 time: 0.726168 Oct 03 10:59:41.415186 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3080/5850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:40 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1273 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:41.420481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7358aac8-b9e9-49ba-aff9-c6d6b3b52219 req-bde40712-278f-4858-bcb2-77f58fb94647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741f7b35-2576-42e9-b962-a33c08e0ae03", "name": "network-vif-deleted", "tag": "4b6cf94f-ae70-4f78-946e-71e48b643ae5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:41.447147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7358aac8-b9e9-49ba-aff9-c6d6b3b52219 req-bde40712-278f-4858-bcb2-77f58fb94647 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:41.447446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7358aac8-b9e9-49ba-aff9-c6d6b3b52219 req-bde40712-278f-4858-bcb2-77f58fb94647 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:41.447890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7358aac8-b9e9-49ba-aff9-c6d6b3b52219 req-bde40712-278f-4858-bcb2-77f58fb94647 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:41.475665 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7358aac8-b9e9-49ba-aff9-c6d6b3b52219 req-bde40712-278f-4858-bcb2-77f58fb94647 service nova] Creating event network-vif-deleted:4b6cf94f-ae70-4f78-946e-71e48b643ae5 for instance 741f7b35-2576-42e9-b962-a33c08e0ae03 on n-h2-858383-3 Oct 03 10:59:41.491549 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7358aac8-b9e9-49ba-aff9-c6d6b3b52219 req-bde40712-278f-4858-bcb2-77f58fb94647 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075231 Oct 03 10:59:41.492897 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3081/5851] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:41.500104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:41.500852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:41.519315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:41.520268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:41.522164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:41.523108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:41.529503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:41.530263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:41.767752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:41.776626 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9dae9f81-b2f5-40c1-9be3-768d802abb9e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1513 microversion: 2.1 time: 0.282505 Oct 03 10:59:41.781148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3082/5852] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:41 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:41.785194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c1d00d3b-cda8-4dea-8975-7bfd8642aae8 req-3b9ded30-fee6-47aa-875a-62d34757e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18372a0b-5255-46a2-a0d6-f72df9fd27fe", "name": "network-vif-plugged", "status": "completed", "tag": "94379c78-1f9c-4790-9a0b-5aa515745235"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:41.825032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1d00d3b-cda8-4dea-8975-7bfd8642aae8 req-3b9ded30-fee6-47aa-875a-62d34757e2ec service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:41.827536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1d00d3b-cda8-4dea-8975-7bfd8642aae8 req-3b9ded30-fee6-47aa-875a-62d34757e2ec service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:41.828048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c1d00d3b-cda8-4dea-8975-7bfd8642aae8 req-3b9ded30-fee6-47aa-875a-62d34757e2ec service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:41.862213 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c1d00d3b-cda8-4dea-8975-7bfd8642aae8 req-3b9ded30-fee6-47aa-875a-62d34757e2ec service nova] Creating event network-vif-plugged:94379c78-1f9c-4790-9a0b-5aa515745235 for instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe on n-h1-858383-3 Oct 03 10:59:41.867782 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c1d00d3b-cda8-4dea-8975-7bfd8642aae8 req-3b9ded30-fee6-47aa-875a-62d34757e2ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085828 Oct 03 10:59:41.868308 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3083/5853] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:41.966903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:41.981976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cd655858-b058-43e7-89af-d362994df7c3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 200 len: 1494 microversion: 2.1 time: 2.070632 Oct 03 10:59:41.985911 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2771/5854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:39 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 1494 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:42.440347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:42.441195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:42.454285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:42.457338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:42.457932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:42.460401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:42.461093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:42.462197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:42.589699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:42.598336 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4668c1ec-42e0-4909-942a-f58ac3d3bd2a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1273 microversion: 2.1 time: 0.163180 Oct 03 10:59:42.599187 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3084/5855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:42 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:42.804116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:42.805094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:42.817821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:42.820606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:42.821134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:42.824362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:42.824978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:42.830940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.012029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.013959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.023187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.024172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.025500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.026606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.027453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.028118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.044838 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 HTTP/1.1 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '741f7b35-2576-42e9-b962-a33c08e0ae03'} Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.046828 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.050491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.050491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.050491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.050491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.050491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.050491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.050491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.053772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.055289 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c97ec586-b5a7-4b70-a460-cd899307f52a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 404 len: 111 microversion: 2.1 time: 0.047585 Oct 03 10:59:43.056060 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3085/5856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:43 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:59:43.078797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.080787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.091244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.091749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.092195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.097127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.097702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.098161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.131989 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 HTTP/1.1 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '741f7b35-2576-42e9-b962-a33c08e0ae03'} Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.133603 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-771c6e1c-cc31-443a-933e-a77eb2cd4274 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 404 len: 111 microversion: 2.1 time: 0.064776 Oct 03 10:59:43.138384 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3086/5857] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:43 2022] DELETE /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.151510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.152183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 741f7b35-2576-42e9-b962-a33c08e0ae03] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.167080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.167581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.168023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.168737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.171594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.172047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.200278 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 HTTP/1.1 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '741f7b35-2576-42e9-b962-a33c08e0ae03'} Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.212433 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 741f7b35-2576-42e9-b962-a33c08e0ae03 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.215965 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cdd9d131-fc9c-49b2-be47-91d014272666 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03" status: 404 len: 111 microversion: 2.1 time: 0.072276 Oct 03 10:59:43.218290 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3087/5858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:43 2022] GET /compute/v2.1/servers/741f7b35-2576-42e9-b962-a33c08e0ae03 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.233900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.234418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.241398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.241851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.242288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.243295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.243762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.244189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.272571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 HTTP/1.1 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '72433200-68bc-4b8f-8acf-b4dd8e290351'} Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.282092 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.285765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a89ce3ad-dac9-4594-a7cc-0b9df4500f83 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 404 len: 111 microversion: 2.1 time: 0.064310 Oct 03 10:59:43.289171 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3088/5859] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:43 2022] DELETE /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.303896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.305739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 72433200-68bc-4b8f-8acf-b4dd8e290351] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.326124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.326630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.333544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.335957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.336970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.337632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.355917 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 HTTP/1.1 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '72433200-68bc-4b8f-8acf-b4dd8e290351'} Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.358691 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.362205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.362205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.362205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.362205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.362205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.362205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. Oct 03 10:59:43.362205 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.364369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 72433200-68bc-4b8f-8acf-b4dd8e290351 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.366004 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b869956-483a-44db-9858-3d5615133984 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351" status: 404 len: 111 microversion: 2.1 time: 0.072227 Oct 03 10:59:43.366922 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3089/5860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:43 2022] GET /compute/v2.1/servers/72433200-68bc-4b8f-8acf-b4dd8e290351 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.375497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.376319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.383003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.384099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.384643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.385436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.386273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.386763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.404037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc HTTP/1.1 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3a992806-7263-45c7-ba3c-f3b4209429bc'} Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.405717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.410182 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.412000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.413877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-10f21cf1-4318-4db4-936b-768cea6829e1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 404 len: 111 microversion: 2.1 time: 0.042537 Oct 03 10:59:43.417819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3090/5861] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:43 2022] DELETE /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.424251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.425090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 3a992806-7263-45c7-ba3c-f3b4209429bc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.433050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.433748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.434202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.435146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.435672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.436862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.455561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc HTTP/1.1 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3a992806-7263-45c7-ba3c-f3b4209429bc'} Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.458028 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.462173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.462173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.462173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.462173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.462173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.462173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. Oct 03 10:59:43.462173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.463898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 3a992806-7263-45c7-ba3c-f3b4209429bc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.465096 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28a2d9d7-5eac-4527-a02d-490e2c1c2a17 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc" status: 404 len: 111 microversion: 2.1 time: 0.045979 Oct 03 10:59:43.469566 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3091/5862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:43 2022] GET /compute/v2.1/servers/3a992806-7263-45c7-ba3c-f3b4209429bc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.478034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.478596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.485574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.486595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.487174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.488064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.488677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.489299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.505859 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 HTTP/1.1 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a5d20710-6321-4ddd-8c97-105b08a91a90'} Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.509059 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.512576 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.515402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.517656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-04c9db14-e957-4539-99d4-e3e52319b4e3 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 404 len: 111 microversion: 2.1 time: 0.045939 Oct 03 10:59:43.518670 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3092/5863] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:43 2022] DELETE /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.540367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.541108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: a5d20710-6321-4ddd-8c97-105b08a91a90] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.562774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.563307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.566662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.569192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.570846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.572147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.603596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 HTTP/1.1 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a5d20710-6321-4ddd-8c97-105b08a91a90'} Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:43.605418 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.609007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:43.609007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:43.609007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:43.609007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:43.609007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:43.609007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. Oct 03 10:59:43.609007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:43.615521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance a5d20710-6321-4ddd-8c97-105b08a91a90 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:43.618266 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c33c766-5ede-4dda-b913-2e219d08bd78 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90" status: 404 len: 111 microversion: 2.1 time: 0.090265 Oct 03 10:59:43.619383 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3093/5864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:43 2022] GET /compute/v2.1/servers/a5d20710-6321-4ddd-8c97-105b08a91a90 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:43.624991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.626719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.635617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.636526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.637276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.638507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.639400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.640063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.890570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:43.897193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:43.914715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3e824a9-b042-4658-88ed-adc3a349d884 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1513 microversion: 2.1 time: 1.116861 Oct 03 10:59:43.914892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75796e48-e18b-4113-85bc-6d7723bee43d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.285762 Oct 03 10:59:43.918619 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2772/5865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:42 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1513 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:43.936236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:43.936377 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3094/5866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:43 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:43.959746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:43.983679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.986256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.986857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:43.988127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:43.990701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:43.996290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.042203 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c HTTP/1.1 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '8c24d92e-2d56-4c4e-b8d2-720274e5297c'} Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:44.051805 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.056351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:44.057113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c2eef8e9-b365-4424-95db-fe24ceea22d0 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 404 len: 111 microversion: 2.1 time: 0.132568 Oct 03 10:59:44.064881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2773/5867] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:43 2022] DELETE /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:44.093477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.094170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 8c24d92e-2d56-4c4e-b8d2-720274e5297c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:44.116991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.118732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.119525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.121048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.122323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.123164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.143053 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c HTTP/1.1 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '8c24d92e-2d56-4c4e-b8d2-720274e5297c'} Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.147648 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.151299 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.151299 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.151299 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.151299 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:44.151299 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:44.151299 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. Oct 03 10:59:44.151299 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.152988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 8c24d92e-2d56-4c4e-b8d2-720274e5297c could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:44.153873 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5aa8ed35-dc4f-45ca-964f-9b53303a724a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c" status: 404 len: 111 microversion: 2.1 time: 0.066488 Oct 03 10:59:44.156475 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3095/5868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:44 2022] GET /compute/v2.1/servers/8c24d92e-2d56-4c4e-b8d2-720274e5297c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:44.166715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.167990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:44.176931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.178549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.179273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.180521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.181928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.182583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.205095 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b HTTP/1.1 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ff34bdae-40f6-4351-89c7-5a132ce2506b'} Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:44.207067 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.210692 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.213168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:44.214769 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8212c697-4343-4489-8570-2326e81ee60c tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 404 len: 111 microversion: 2.1 time: 0.053965 Oct 03 10:59:44.216165 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2774/5869] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:44 2022] DELETE /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:44.227531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.228379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: ff34bdae-40f6-4351-89c7-5a132ce2506b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:44.236030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.236888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.237829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.238939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.239780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.241172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.261605 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b HTTP/1.1 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'ff34bdae-40f6-4351-89c7-5a132ce2506b'} Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.264229 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.268698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.268698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.268698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.268698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:44.268698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:44.268698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. Oct 03 10:59:44.268698 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.271193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance ff34bdae-40f6-4351-89c7-5a132ce2506b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:44.272372 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-92416202-8b46-4bf9-af8f-626124667b0a tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b" status: 404 len: 111 microversion: 2.1 time: 0.051410 Oct 03 10:59:44.273197 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3096/5870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:44 2022] GET /compute/v2.1/servers/ff34bdae-40f6-4351-89c7-5a132ce2506b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 10:59:44.284606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7910c941-0d3c-47e9-a44c-a8e49c6830ef tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.285582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7910c941-0d3c-47e9-a44c-a8e49c6830ef tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 21f76788-edcd-46ca-91c9-1b167c52d40c] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:44.293375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7910c941-0d3c-47e9-a44c-a8e49c6830ef tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7910c941-0d3c-47e9-a44c-a8e49c6830ef tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c HTTP/1.1 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '21f76788-edcd-46ca-91c9-1b167c52d40c'} Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.295124 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.299020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.299020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.299020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.299020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:44.299020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:44.299020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.299020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.302193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7910c941-0d3c-47e9-a44c-a8e49c6830ef tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:44.303867 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7910c941-0d3c-47e9-a44c-a8e49c6830ef tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c" status: 404 len: 111 microversion: 2.1 time: 0.026477 Oct 03 10:59:44.305353 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2775/5871] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:44 2022] DELETE /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:44.314316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c551149d-066e-4270-b2e5-e632b2aaca59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.315177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c551149d-066e-4270-b2e5-e632b2aaca59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 21f76788-edcd-46ca-91c9-1b167c52d40c] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:44.322696 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c551149d-066e-4270-b2e5-e632b2aaca59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c551149d-066e-4270-b2e5-e632b2aaca59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c HTTP/1.1 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '21f76788-edcd-46ca-91c9-1b167c52d40c'} Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:44.324892 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c551149d-066e-4270-b2e5-e632b2aaca59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 21f76788-edcd-46ca-91c9-1b167c52d40c could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c551149d-066e-4270-b2e5-e632b2aaca59 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c" status: 404 len: 111 microversion: 2.1 time: 0.017309 Oct 03 10:59:44.329467 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3097/5872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:44 2022] GET /compute/v2.1/servers/21f76788-edcd-46ca-91c9-1b167c52d40c => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:44.337378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.337884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:44.349712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.351340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.352821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.355268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.357089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.358750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.403357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 10:59:44.486528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:44.563190 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f33b1c0a-7f85-4c0e-a61b-e7ebafc64908 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 204 len: 0 microversion: 2.1 time: 0.229659 Oct 03 10:59:44.572042 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2776/5873] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 10:59:44 2022] DELETE /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 10:59:44.581424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.582080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:44.620114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.621575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.622055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.622820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:44.623295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:44.623737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:44.976889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:44.980273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:45.006552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:45.012178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:45.014794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:45.017843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:45.018549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:45.019224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:45.528919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:45.542277 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61b0ac3b-1574-4c16-b828-8d4aae459a47 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.590382 Oct 03 10:59:45.542979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2777/5874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:44 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:45.588136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:45.588793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:45.602491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:45.603008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:45.603457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:45.606518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:45.613277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:45.613906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:46.039468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:46.051748 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96b643c7-763b-499b-924f-251cc8dd97d1 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1481 microversion: 2.1 time: 1.475580 Oct 03 10:59:46.059160 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3098/5875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:44 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1481 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:46.261348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:46.306836 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d77706fc-ad4a-42d1-9149-a3e6ea216af4 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.736200 Oct 03 10:59:46.311093 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2778/5876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:45 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:46.569727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:46.570349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:46.591942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:46.592443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:46.600351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:46.609863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:46.610371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:46.610821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:46.952918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c184fcba-1c09-4e54-b964-090ff60b524f req-f6d99082-260a-4449-b857-529f5c7a8972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af53f0b3-9565-4494-b514-bd51c24463d1", "tag": "96e7f24f-3795-4ec4-99d7-6b0f61a231e7"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:46.980514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c184fcba-1c09-4e54-b964-090ff60b524f req-f6d99082-260a-4449-b857-529f5c7a8972 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:46.981400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c184fcba-1c09-4e54-b964-090ff60b524f req-f6d99082-260a-4449-b857-529f5c7a8972 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:46.982081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c184fcba-1c09-4e54-b964-090ff60b524f req-f6d99082-260a-4449-b857-529f5c7a8972 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:47.023786 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c184fcba-1c09-4e54-b964-090ff60b524f req-f6d99082-260a-4449-b857-529f5c7a8972 service nova] Creating event network-changed:96e7f24f-3795-4ec4-99d7-6b0f61a231e7 for instance af53f0b3-9565-4494-b514-bd51c24463d1 on n-h1-858383-3 Oct 03 10:59:47.038473 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c184fcba-1c09-4e54-b964-090ff60b524f req-f6d99082-260a-4449-b857-529f5c7a8972 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089309 Oct 03 10:59:47.040620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2779/5877] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:59:47.086937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:47.087660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:47.100655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:47.101207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:47.101639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:47.102396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:47.102834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:47.109672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:47.554352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:47.601561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e651e2bd-b07f-428b-bb13-34c3c4cc57cf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 1.036243 Oct 03 10:59:47.627510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3099/5878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:46 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:47.641335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:47.643845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:47.669374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:47.669932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:47.670392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:47.671144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:47.673502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:47.674139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:47.869274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:47.910591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:48.035687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:48.047113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86e62144-8cc1-491a-a59b-9b12679d2901 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1481 microversion: 2.1 time: 0.964294 Oct 03 10:59:48.055127 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2780/5879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:47 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1481 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:48.231136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:48.243510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7a6b041-0544-4691-aa42-83669c02f110 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.614523 Oct 03 10:59:48.244306 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3100/5880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:47 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:48.629160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:48.629927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:48.644647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:48.648227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:48.649485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:48.651610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:48.654513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:48.655114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:49.082826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:49.083612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:49.093725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:49.104125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:49.104627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:49.105114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:49.105865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:49.106326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:49.106759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:49.404822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:49.415129 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56b5d201-65fc-4fc7-8cba-66a141170789 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1481 microversion: 2.1 time: 0.336405 Oct 03 10:59:49.416168 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3101/5881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:49 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1481 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:49.431486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:49.432104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:49.457596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:49.458102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:49.458540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:49.460135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:49.460864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:49.462329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:49.471385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:49.483086 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26cfd12f-94df-4ac4-964a-c5f14a457c98 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.859056 Oct 03 10:59:49.486112 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2781/5882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:48 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:49.503331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 10:59:50.182818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:50.197334 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1ee4516f-7b93-4138-a506-0ec55be05b80 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.769928 Oct 03 10:59:50.216927 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3102/5883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:49 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:50.446230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:50.446855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:50.481248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:50.481921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:50.482178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:50.482917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:50.483389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:50.483821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:50.514077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:50.514937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:50.524793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:50.525544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:50.533790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:50.535952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:50.537567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:50.538179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:50.719206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:50.740031 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ebbf4f7-6be5-4297-a65d-c3c004cbe2a6 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1439 microversion: 2.1 time: 0.298065 Oct 03 10:59:50.742169 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2782/5884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:50 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1439 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:50.758998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e03186fe-6ac7-4f89-ac67-c47363da8e8d req-41832569-9591-41c3-866c-8b1f59b59a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffad74d-2ed1-407e-9e59-5099546e5903", "name": "network-vif-deleted", "tag": "20e8d843-7a43-4012-a632-08c63fb4810b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:50.811418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e03186fe-6ac7-4f89-ac67-c47363da8e8d req-41832569-9591-41c3-866c-8b1f59b59a1c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:50.813103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e03186fe-6ac7-4f89-ac67-c47363da8e8d req-41832569-9591-41c3-866c-8b1f59b59a1c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:50.815434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e03186fe-6ac7-4f89-ac67-c47363da8e8d req-41832569-9591-41c3-866c-8b1f59b59a1c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:50.863259 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e03186fe-6ac7-4f89-ac67-c47363da8e8d req-41832569-9591-41c3-866c-8b1f59b59a1c service nova] Creating event network-vif-deleted:20e8d843-7a43-4012-a632-08c63fb4810b for instance 6ffad74d-2ed1-407e-9e59-5099546e5903 on n-h1-858383-3 Oct 03 10:59:50.883698 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e03186fe-6ac7-4f89-ac67-c47363da8e8d req-41832569-9591-41c3-866c-8b1f59b59a1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131780 Oct 03 10:59:50.888257 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2783/5885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 10:59:50.925345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:50.936945 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aeca7097-2cf9-4b2b-bc2d-d7330c4d4e32 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.427589 Oct 03 10:59:50.940175 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3103/5886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:50 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:51.225488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:51.226514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:51.238680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:51.244085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:51.244920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:51.246961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:51.247814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:51.248520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:51.731210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:51.771193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:51.779925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:51.796750 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6a425c51-f00a-4412-b4cf-89852d924543 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.551004 Oct 03 10:59:51.808017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2784/5887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:51 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:51.810331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:51.813376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:51.814570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:51.816056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:51.820531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:51.821205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:51.965510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:51.966543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:51.999309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:52.000286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:52.005005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:52.007798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:52.008300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:52.012070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:52.239517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894820fad0424024a47c6f54a5425a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac6aaa3c5844a93bf7f8838485e81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:52.255065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-758e084f-eeb2-4ce8-ad68-697260b47f0b tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 200 len: 1439 microversion: 2.1 time: 0.489953 Oct 03 10:59:52.276714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3104/5888] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:51 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 1439 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 10:59:52.702415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:52.731888 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7eb1ce26-f56f-4ad7-b892-bd6968cca89a tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.771530 Oct 03 10:59:52.735588 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2785/5889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:51 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:52.835519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:52.836755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:52.859654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:52.860413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:52.861044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:52.861949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:52.862570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:52.863161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:53.281620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:53.282246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] [instance: 6ffad74d-2ed1-407e-9e59-5099546e5903] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:53.291190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:53.291695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:53.298648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:53.299674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:53.300313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:53.300759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:53.337765 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] HTTP exception thrown: Instance 6ffad74d-2ed1-407e-9e59-5099546e5903 could not be found. Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Request method failure captured: Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 HTTP/1.1 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr-gkTR-2YbN7_-nFBwE2YNk0a-PyANgUpX_asxPoOzwy-WjnJlJCkTznbypNw54kpS0Nsy2I2tWxnCO09cGW9Jh5tWepAYkVRV_zvwdHlLdLKuR9a3HsYI2OG-tBecdVynxpGldY3TDVd4_rFcr1oPlAfpeJ0xCNOMmAPAdpqBX01o Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7ac6aaa3c5844a93bf7f8838485e81d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7ac6aaa3c5844a93bf7f8838485e81d7"}]}] Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersTestJSON-2028669304 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7ac6aaa3c5844a93bf7f8838485e81d7 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersTestJSON-2028669304 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 894820fad0424024a47c6f54a5425a14 Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersTestJSON-2028669304-project Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 6ffad74d-2ed1-407e-9e59-5099546e5903 could not be found. Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '6ffad74d-2ed1-407e-9e59-5099546e5903'} Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ffad74d-2ed1-407e-9e59-5099546e5903 could not be found. Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ffad74d-2ed1-407e-9e59-5099546e5903 could not be found. Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 10:59:53.342965 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ffad74d-2ed1-407e-9e59-5099546e5903 could not be found. Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 10:59:53.349313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] Returning 404 to user: Instance 6ffad74d-2ed1-407e-9e59-5099546e5903 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 10:59:53.354355 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b6050c3-1cc3-4dcf-8282-36d32b2e0804 tempest-ServersTestJSON-2028669304 tempest-ServersTestJSON-2028669304-project] 10.222.0.27 "GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903" status: 404 len: 111 microversion: 2.1 time: 0.078240 Oct 03 10:59:53.360039 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2786/5890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:53 2022] GET /compute/v2.1/servers/6ffad74d-2ed1-407e-9e59-5099546e5903 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 10:59:53.616148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:53.624783 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-346f2f45-0531-4c41-88ff-3a557db9f032 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.794420 Oct 03 10:59:53.640930 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3105/5891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:52 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:53.762469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:53.763529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:53.778979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:53.779483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:53.779925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:53.784003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:53.785503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:53.788084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:54.474115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:54.483862 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-51b0096c-43de-4acc-aac9-6cfb24244c50 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.727103 Oct 03 10:59:54.487576 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2787/5892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:53 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:54.670653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:54.671908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:54.699628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:54.702596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:54.704695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:54.707344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:54.710459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:54.713061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:55.393213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:55.417856 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-abe89623-02cc-4d31-9cf5-d0a20135d380 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.765140 Oct 03 10:59:55.419261 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3106/5893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:54 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:55.514136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:55.515455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:55.541968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:55.542782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:55.544042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:55.546253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:55.549288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:55.555736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:56.312503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:56.323807 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00f36afb-fcb3-4c7b-8370-d8748beb205c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.813764 Oct 03 10:59:56.343203 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2788/5894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:55 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:56.448398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:56.449061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:56.471486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:56.472000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:56.472455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:56.473215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:56.473682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:56.474118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:57.039599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:57.055480 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f74b42c-95e7-4afb-a503-3c1682eda639 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.611819 Oct 03 10:59:57.059949 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3107/5895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:56 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:57.362334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:57.367415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:57.399240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:57.401041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:57.402144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:57.404363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:57.406285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:57.410423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:58.079968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:58.081567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:58.095184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:58.103916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:58.104734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:58.105730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:58.107823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:58.110223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:58.225480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:58.238813 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c24f341-d5cd-477f-bfff-d851a34c91e5 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.885367 Oct 03 10:59:58.239395 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2789/5896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:57 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:58.826263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:58.840558 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-053ff1fd-b0e4-4c3b-9aab-b64ea10cfa20 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.759575 Oct 03 10:59:58.844524 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3108/5897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:58 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:59.263520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:59.265002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:59.283362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:59.287919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:59.289187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:59.294505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:59.295287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:59.295980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:59.528730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-db14c518-f765-4ae4-8076-7122738b0ec2 req-57b78deb-0fa8-4c9d-8534-4b85729f0b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af53f0b3-9565-4494-b514-bd51c24463d1", "name": "network-vif-plugged", "status": "completed", "tag": "96e7f24f-3795-4ec4-99d7-6b0f61a231e7"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 10:59:59.570187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-db14c518-f765-4ae4-8076-7122738b0ec2 req-57b78deb-0fa8-4c9d-8534-4b85729f0b3c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:59.570682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-db14c518-f765-4ae4-8076-7122738b0ec2 req-57b78deb-0fa8-4c9d-8534-4b85729f0b3c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:59.571120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-db14c518-f765-4ae4-8076-7122738b0ec2 req-57b78deb-0fa8-4c9d-8534-4b85729f0b3c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:59.631206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-db14c518-f765-4ae4-8076-7122738b0ec2 req-57b78deb-0fa8-4c9d-8534-4b85729f0b3c service nova] Creating event network-vif-plugged:96e7f24f-3795-4ec4-99d7-6b0f61a231e7 for instance af53f0b3-9565-4494-b514-bd51c24463d1 on n-h1-858383-3 Oct 03 10:59:59.643608 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-db14c518-f765-4ae4-8076-7122738b0ec2 req-57b78deb-0fa8-4c9d-8534-4b85729f0b3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120063 Oct 03 10:59:59.646948 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3109/5898] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 10:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 10:59:59.741380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 10:59:59.752799 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a424a749-454b-4e50-b1fe-23ad7bcccc27 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.493662 Oct 03 10:59:59.758599 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2790/5899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:59 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 10:59:59.869373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 10:59:59.870851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 10:59:59.889638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:59.896149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:59.897267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 10:59:59.898035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 10:59:59.898509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 10:59:59.898937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:00.337165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:00.348218 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3896ba2-fd48-4d14-9a2e-c00efe4068d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 0.485176 Oct 03 11:00:00.353031 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3110/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 10:59:59 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:00.779723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:00.780251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:00.800801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:00.818796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:00.827692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:00.827692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:00.827692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:00.827692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:01.385511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:01.386121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:01.397326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:01.412869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:01.418120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:01.418747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:01.419672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:01.420290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:01.420890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:02.443004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:02.451037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9105323-635d-4875-ba36-67c39806b044 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1315 microversion: 2.1 time: 1.069467 Oct 03 11:00:02.467721 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3111/5901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:01 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:02.750514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:02.767845 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df05fd9b-3478-4775-90b5-0703e3e1bbbf tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 1.992157 Oct 03 11:00:02.768460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2791/5902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:00 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:03.476257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:03.477675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:03.486799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:03.488092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:03.488874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:03.489824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:03.490561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:03.491236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:03.797554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:03.799084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:03.808346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:03.814434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:03.815115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:03.816128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:03.817747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:03.819109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:03.973751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:03.985829 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2c0c303-013b-4c5b-b94d-31ac7024a1ad tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1503 microversion: 2.1 time: 0.515337 Oct 03 11:00:03.986742 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3112/5903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:03 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1503 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:04.026080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:04.027110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:04.047898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:04.047898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:04.047898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:04.047898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:04.047898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:04.050658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:04.104390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'flavor' on Instance uuid af53f0b3-9565-4494-b514-bd51c24463d1 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:00:04.317376 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bfe89789-75d5-4898-a915-caf3ec598a31 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "POST /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1/action" status: 202 len: 0 microversion: 2.1 time: 0.285055 Oct 03 11:00:04.322041 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3113/5904] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:00:04 2022] POST /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:00:04.331256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:04.331975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:04.352998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:04.354497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:04.355394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:04.356639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:04.357289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:04.358061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:04.787919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:04.800570 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-508e2467-aae4-4896-b0ee-d305420f8ff6 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 1.006719 Oct 03 11:00:04.804911 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2792/5905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:03 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:05.024299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:05.033623 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75c76f00-bc02-4443-b13e-033f78a8be59 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1511 microversion: 2.1 time: 0.706652 Oct 03 11:00:05.038220 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3114/5906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:04 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:05.833073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:05.834260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:05.850547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:05.851329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:05.854094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:05.855771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:05.858844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:05.859846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:06.067954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:06.069115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:06.078842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:06.079355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:06.079806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:06.080523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:06.081018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:06.081450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:06.258842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:06.268719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b090680-f15c-4b00-ba96-f2224063a5ec tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.441494 Oct 03 11:00:06.278129 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2793/5907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:05 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:06.501400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:06.517026 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8596e3a7-1812-404c-9237-92206acf7ae0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1494 microversion: 2.1 time: 0.452881 Oct 03 11:00:06.517637 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3115/5908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:06 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1494 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:06.551218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:06.552240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:06.576672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:06.581799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:06.584488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:06.589591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:06.590327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:06.597582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:06.696240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:00:06.757169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:06.900600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2245ec1d-a951-4b35-b7db-0f35dd5ae0f0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 204 len: 0 microversion: 2.1 time: 0.355200 Oct 03 11:00:06.903033 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2794/5909] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:06 2022] DELETE /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:00:06.911213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:06.912230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:06.926488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:06.927244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:06.927920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:06.928832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:06.929450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:06.932630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:07.302250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:07.305013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:07.327625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:07.328143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:07.328598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:07.329362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:07.347317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:07.347894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:07.350528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:07.363165 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a683f1a-8869-4e85-b717-d2917b6b667d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1500 microversion: 2.1 time: 0.456003 Oct 03 11:00:07.365883 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3116/5910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:06 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1500 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:07.890767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:07.904540 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e254d3a-4db1-41af-856c-c41da0296372 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.607881 Oct 03 11:00:07.908689 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2795/5911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:07 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:08.390269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:08.390884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:08.403458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:08.405442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:08.409008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:08.410212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:08.412090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:08.412725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:08.811626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:08.820650 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-98cc8195-8b0c-45e6-92b1-9074bec329a7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1500 microversion: 2.1 time: 0.434569 Oct 03 11:00:08.824267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3117/5912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:08 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1500 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:08.933355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:08.934509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:08.948958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:08.955597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:08.956587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:08.957302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:08.962180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:08.964279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:08.966956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:09.787083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:09.795145 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26206875-61ac-48c9-9f36-304d35110a52 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.867777 Oct 03 11:00:09.800637 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2796/5913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:08 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:09.845097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:09.845770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:09.860782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:09.861549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:09.864923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:09.866508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:09.867211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:09.867819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:09.878481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:10.155472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:10.168508 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1500 microversion: 2.1 time: 0.327469 Oct 03 11:00:10.170778 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3118/5914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:09 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1500 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:10.730316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-75bcbb0a-d2a6-46b9-8a74-81d5aebb6f9d req-0d9e8e59-bd91-40ed-a582-e408eede9395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af53f0b3-9565-4494-b514-bd51c24463d1", "name": "network-vif-deleted", "tag": "96e7f24f-3795-4ec4-99d7-6b0f61a231e7"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:10.762539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:10.763858 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0d0fd71e-1023-4b36-a544-611515716203 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001661 Oct 03 11:00:10.764359 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3119/5915] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 3 11:00:10 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 03 11:00:10.774715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-75bcbb0a-d2a6-46b9-8a74-81d5aebb6f9d req-0d9e8e59-bd91-40ed-a582-e408eede9395 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:10.775477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-75bcbb0a-d2a6-46b9-8a74-81d5aebb6f9d req-0d9e8e59-bd91-40ed-a582-e408eede9395 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:10.776238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-75bcbb0a-d2a6-46b9-8a74-81d5aebb6f9d req-0d9e8e59-bd91-40ed-a582-e408eede9395 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:10.816411 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-75bcbb0a-d2a6-46b9-8a74-81d5aebb6f9d req-0d9e8e59-bd91-40ed-a582-e408eede9395 service nova] Creating event network-vif-deleted:96e7f24f-3795-4ec4-99d7-6b0f61a231e7 for instance af53f0b3-9565-4494-b514-bd51c24463d1 on n-h1-858383-3 Oct 03 11:00:10.822268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:10.822887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:10.829989 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-75bcbb0a-d2a6-46b9-8a74-81d5aebb6f9d req-0d9e8e59-bd91-40ed-a582-e408eede9395 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105695 Oct 03 11:00:10.837898 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2797/5916] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:00:10.857368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:10.857936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:10.858291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:10.859012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:10.859468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:10.859900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:11.207947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:11.208666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:11.223603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:11.223603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:11.224006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:11.225000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:11.225616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:11.226197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:11.307111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:11.307605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:11.308044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:11.308496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lazy-loading 'fault' on Instance uuid af53f0b3-9565-4494-b514-bd51c24463d1 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:00:11.382637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0e22aff3574cb286f2c1aa546c6c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d2d134377b45f0bb0f349a14256f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:11.398325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-09bddcb2-1716-4137-8eee-9618154c83e1 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 200 len: 1305 microversion: 2.1 time: 0.194584 Oct 03 11:00:11.408875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2798/5917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:11 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:11.691777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:11.709914 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34ee7573-161a-45e0-8b58-fa6a698e715e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.890708 Oct 03 11:00:11.710541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3120/5918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:10 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:12.435434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:12.436364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:12.474782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.479826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.479826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.484680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.487617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.488631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.550538 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 HTTP/1.1 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'af53f0b3-9565-4494-b514-bd51c24463d1'} Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.582344 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-085ec33d-1a61-4c71-854a-8b8ce232513d tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 404 len: 111 microversion: 2.1 time: 0.147992 Oct 03 11:00:12.587418 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2799/5919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:12 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:12.596887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:12.599463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:12.610688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.613226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.614470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.615972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.616646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.617265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.664844 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 HTTP/1.1 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'af53f0b3-9565-4494-b514-bd51c24463d1'} Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:12.670649 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.674463 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.676658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:12.682002 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-843ce03f-79d4-4bd3-a4de-9d411462ab11 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 404 len: 111 microversion: 2.1 time: 0.091920 Oct 03 11:00:12.683065 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3121/5920] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:12 2022] DELETE /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:12.690788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:12.691414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: af53f0b3-9565-4494-b514-bd51c24463d1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:12.702958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.712657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.713251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.716193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.716724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.718789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.738622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:12.739469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:12.758669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.765485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.780538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.783080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.783735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.789426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.795684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 HTTP/1.1 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'af53f0b3-9565-4494-b514-bd51c24463d1'} Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.800028 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.804115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.804115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.804115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.804115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:12.804115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:12.804115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. Oct 03 11:00:12.804115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.806542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance af53f0b3-9565-4494-b514-bd51c24463d1 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:12.813634 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-931429a7-b0ea-493c-a17a-d254c5b8d0f6 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1" status: 404 len: 111 microversion: 2.1 time: 0.126567 Oct 03 11:00:12.821299 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2800/5921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:12 2022] GET /compute/v2.1/servers/af53f0b3-9565-4494-b514-bd51c24463d1 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:12.832637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:12.834843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:12.853480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.854091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.855225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.860815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.861614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.863570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.900115 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 HTTP/1.1 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'd05779e5-9b42-4080-9100-a70a96ac0480'} Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:12.901842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.906144 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.906899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:12.907864 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71e54d99-4c7e-474c-877f-1c90b39b24a3 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 404 len: 111 microversion: 2.1 time: 0.085183 Oct 03 11:00:12.912241 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2801/5922] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:12 2022] DELETE /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:12.917787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:12.918630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: d05779e5-9b42-4080-9100-a70a96ac0480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:12.926301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.928193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.928988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.929948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.931125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.931774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.954946 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 HTTP/1.1 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'd05779e5-9b42-4080-9100-a70a96ac0480'} Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:12.957271 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.960966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:12.960966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:12.960966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:12.960966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:12.960966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:12.960966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. Oct 03 11:00:12.960966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:12.965640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance d05779e5-9b42-4080-9100-a70a96ac0480 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:12.968391 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9719c633-9145-4dfa-aa78-2605ce4579d0 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480" status: 404 len: 111 microversion: 2.1 time: 0.053964 Oct 03 11:00:12.971858 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2802/5923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:12 2022] GET /compute/v2.1/servers/d05779e5-9b42-4080-9100-a70a96ac0480 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:12.982093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:12.984874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:12.996422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:12.997389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:12.998651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:12.999522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.000214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.001251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.052474 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b HTTP/1.1 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ecb46ac5-761a-4efa-9b82-53dda9ad768b'} Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:13.055166 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.058999 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.076682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:13.078253 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-897e0667-81c6-4975-9edf-82928ac7569c tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 404 len: 111 microversion: 2.1 time: 0.101224 Oct 03 11:00:13.081440 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2803/5924] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:12 2022] DELETE /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:00:13.094552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:13.095518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: ecb46ac5-761a-4efa-9b82-53dda9ad768b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:13.103359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.105313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.106031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.107692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.108418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.109188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.155076 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b HTTP/1.1 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ecb46ac5-761a-4efa-9b82-53dda9ad768b'} Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.175430 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.180759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.180759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.180759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.180759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:13.180759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:13.180759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. Oct 03 11:00:13.180759 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.181930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance ecb46ac5-761a-4efa-9b82-53dda9ad768b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:13.187678 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da763c4f-a1fd-49f6-a158-81c66b8c78cd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b" status: 404 len: 111 microversion: 2.1 time: 0.096789 Oct 03 11:00:13.188978 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2804/5925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:13 2022] GET /compute/v2.1/servers/ecb46ac5-761a-4efa-9b82-53dda9ad768b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:13.206948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:13.209252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:13.229630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.236785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.237644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.239494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.240937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.241616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.288240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b HTTP/1.1 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '2c6c8909-e1aa-4d50-9578-eacf7b997f7b'} Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:13.292528 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.296040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:13.301757 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c48cda65-748a-4d43-a96e-5aad80887447 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 404 len: 111 microversion: 2.1 time: 0.101360 Oct 03 11:00:13.303910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2805/5926] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:13 2022] DELETE /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:13.315084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:13.330059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 2c6c8909-e1aa-4d50-9578-eacf7b997f7b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:13.350315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.351685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.352563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.358348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.361164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.362782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.392642 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b HTTP/1.1 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '2c6c8909-e1aa-4d50-9578-eacf7b997f7b'} Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.395227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.402966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.402966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.402966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.402966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:13.402966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:13.402966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. Oct 03 11:00:13.402966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.405676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 2c6c8909-e1aa-4d50-9578-eacf7b997f7b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:13.406852 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16b2d5c6-8f95-4a79-9f13-4d7bf67585d7 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b" status: 404 len: 111 microversion: 2.1 time: 0.098890 Oct 03 11:00:13.407975 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2806/5927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:13 2022] GET /compute/v2.1/servers/2c6c8909-e1aa-4d50-9578-eacf7b997f7b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:13.423587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:13.424098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 43641544-9468-4356-89b9-b15fc548aa64] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:13.466743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.467944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.469159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.470992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.471669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.472266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.495694 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 HTTP/1.1 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '43641544-9468-4356-89b9-b15fc548aa64'} Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:13.497623 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.502920 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.504896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:13.506269 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1151f5f4-aad3-4b97-b69d-be587be81106 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64" status: 404 len: 111 microversion: 2.1 time: 0.094276 Oct 03 11:00:13.507048 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2807/5928] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:13 2022] DELETE /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:13.521167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:13.522698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 43641544-9468-4356-89b9-b15fc548aa64] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:13.542069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.542569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.543008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.543727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:13.544182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:13.544606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:13.620578 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 HTTP/1.1 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '43641544-9468-4356-89b9-b15fc548aa64'} Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:13.623764 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.627845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:13.627845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:13.627845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:13.627845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:13.627845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:13.627845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. Oct 03 11:00:13.627845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:13.630599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 43641544-9468-4356-89b9-b15fc548aa64 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:13.631727 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bff55ae9-9733-483a-b993-fee0d3bd8fdd tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64" status: 404 len: 111 microversion: 2.1 time: 0.120226 Oct 03 11:00:13.634356 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2808/5929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:13 2022] GET /compute/v2.1/servers/43641544-9468-4356-89b9-b15fc548aa64 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:13.837733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:13.850535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0099b9f5-a758-4695-a961-785ba03dbe85 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 1.116095 Oct 03 11:00:13.863020 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3122/5930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:12 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:14.875367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:14.876664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:14.889752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:14.890316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:14.892601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:14.893961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:14.895436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:14.897331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:15.396975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:15.409104 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-143b8e34-b128-4317-a72d-c349e8a98a0b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1508 microversion: 2.1 time: 0.538070 Oct 03 11:00:15.411044 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2809/5931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:14 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1508 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:16.438325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:16.439209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:16.454767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:16.455271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:16.457303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:16.459126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:16.464282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:16.465208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:16.801506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:16.812740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9725db62-18e5-4a78-bece-0a703966086f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1505 microversion: 2.1 time: 0.379283 Oct 03 11:00:16.817593 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3123/5932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:16 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:17.839848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:17.840629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:17.860472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:17.863182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:17.863652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:17.864552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:17.867207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:17.867700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:18.233354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:18.247510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94c452d1-4ba1-463a-98e7-c03c6dd8b576 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1505 microversion: 2.1 time: 0.411748 Oct 03 11:00:18.256889 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2810/5933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:17 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:19.285384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:19.285384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:19.295613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:19.296114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:19.296794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:19.297764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:19.298241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:19.298681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:19.484341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-16c79fa4-9e2e-4a1e-ae0b-31abe0e4bcd9 req-cfc36025-a4c7-4f19-8ea4-2074b49be638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18372a0b-5255-46a2-a0d6-f72df9fd27fe", "name": "network-vif-unplugged", "status": "completed", "tag": "94379c78-1f9c-4790-9a0b-5aa515745235"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:19.549668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16c79fa4-9e2e-4a1e-ae0b-31abe0e4bcd9 req-cfc36025-a4c7-4f19-8ea4-2074b49be638 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:19.565884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16c79fa4-9e2e-4a1e-ae0b-31abe0e4bcd9 req-cfc36025-a4c7-4f19-8ea4-2074b49be638 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:19.566457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-16c79fa4-9e2e-4a1e-ae0b-31abe0e4bcd9 req-cfc36025-a4c7-4f19-8ea4-2074b49be638 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:19.600221 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-16c79fa4-9e2e-4a1e-ae0b-31abe0e4bcd9 req-cfc36025-a4c7-4f19-8ea4-2074b49be638 service nova] Creating event network-vif-unplugged:94379c78-1f9c-4790-9a0b-5aa515745235 for instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe on n-h1-858383-3 Oct 03 11:00:19.611184 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-16c79fa4-9e2e-4a1e-ae0b-31abe0e4bcd9 req-cfc36025-a4c7-4f19-8ea4-2074b49be638 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152981 Oct 03 11:00:19.619829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2811/5934] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:00:19.798208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:19.807886 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2e4a9dd2-f49f-4fc6-a4a5-591ff73cd165 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1505 microversion: 2.1 time: 0.528319 Oct 03 11:00:19.814540 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3124/5935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:19 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:20.767653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:20.768431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:20.788835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:20.792463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:20.795192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:20.807302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:20.808222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:20.810387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:20.854166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:20.855639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:20.877625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:20.882307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:20.884888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:20.888319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:20.891907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:20.893959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:20.897374 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 HTTP/1.1 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b834cbe8-6ae7-42b7-a3df-ab8802aae6c3'} Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:20.908514 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:20.913565 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:20.917585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:20.925611 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5b44e6e4-9c3b-41df-9880-89cafe0f252e tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 404 len: 111 microversion: 2.1 time: 0.162602 Oct 03 11:00:20.926494 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2812/5936] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:20 2022] DELETE /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:20.941786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:20.947857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: b834cbe8-6ae7-42b7-a3df-ab8802aae6c3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:21.007652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.012124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.015725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.016919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.017626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.018274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.045725 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 HTTP/1.1 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b834cbe8-6ae7-42b7-a3df-ab8802aae6c3'} Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:21.047820 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.053613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.053613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:21.053613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:21.053613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:21.053613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:21.053613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. Oct 03 11:00:21.053613 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.057196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:21.058704 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6eb418f8-daa0-4684-8310-cf917709c235 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3" status: 404 len: 111 microversion: 2.1 time: 0.127693 Oct 03 11:00:21.059830 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2813/5937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:20 2022] GET /compute/v2.1/servers/b834cbe8-6ae7-42b7-a3df-ab8802aae6c3 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:21.072344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:21.074069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:21.089222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.092179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.094045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.095810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.098093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.100610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.158526 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 HTTP/1.1 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '33e2d49c-7ac1-412e-8ac9-30c97b169716'} Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:21.160113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8be66cfc-12be-4857-9f57-35d88dda05b2 tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 404 len: 111 microversion: 2.1 time: 0.098036 Oct 03 11:00:21.166374 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2814/5938] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:21 2022] DELETE /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:21.192692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:21.196122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] [instance: 33e2d49c-7ac1-412e-8ac9-30c97b169716] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:21.216063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.217423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.221065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.222111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.224153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.225311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.296253 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] HTTP exception thrown: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Request method failure captured: Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 HTTP/1.1 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr9vu62s7P9YKpWhQxFoxklba2WUHvwJQrT5L5wRSxZWxClW1k7JI6TSU6ceUpxZnhczSQMrEr6hUEKsyULKuN2Mtgugb1NXrb8iBmpBJyuJi2QaI4ZjcrovaQXVagp_7T0lbhYjidLrmeSkfIxZ1VizZYTJ1pM16PMFhDp6-EdqYWU Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25d2d134377b45f0bb0f349a14256f30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25d2d134377b45f0bb0f349a14256f30"}]}] Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 25d2d134377b45f0bb0f349a14256f30 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-256400011 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2a0e22aff3574cb286f2c1aa546c6c78 Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-256400011-project Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '33e2d49c-7ac1-412e-8ac9-30c97b169716'} Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:21.302203 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.307525 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:21.307525 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:21.307525 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:21.307525 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:21.307525 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:21.307525 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. Oct 03 11:00:21.307525 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:21.312150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] Returning 404 to user: Instance 33e2d49c-7ac1-412e-8ac9-30c97b169716 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:21.317845 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f3ab2c61-42f4-4369-8e77-9458f6d20d5a tempest-DeleteServersTestJSON-256400011 tempest-DeleteServersTestJSON-256400011-project] 10.222.0.27 "GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716" status: 404 len: 111 microversion: 2.1 time: 0.139410 Oct 03 11:00:21.326756 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2815/5939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:21 2022] GET /compute/v2.1/servers/33e2d49c-7ac1-412e-8ac9-30c97b169716 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:21.434497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:21.457823 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c0da569-2e77-4882-9879-5eb8b7cb7c4b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 200 len: 1448 microversion: 2.1 time: 0.609226 Oct 03 11:00:21.458633 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3125/5940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:20 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 1448 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:21.488012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:21.488655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:21.524852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.525379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.525838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.526592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:21.527065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:21.527506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:21.933004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:21.949120 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7769fdbc-a09a-4612-aeb4-6ece997692fb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.462688 Oct 03 11:00:21.950292 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2816/5941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:21 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:22.008691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:22.011971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:22.034218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:22.035801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:22.036353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:22.037692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:22.050853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:22.054285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:23.133862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:23.160870 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-49cfb557-ebcc-4c15-9a8e-017baf069b74 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 1.164271 Oct 03 11:00:23.177516 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3126/5942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:21 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:23.197854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:23.198604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:23.221423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:23.221423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:23.221423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:23.221423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:23.221423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:23.222338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:23.447767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:23.463375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a9369e33-093d-46ee-af2e-2c4a5e607fc2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.271514 Oct 03 11:00:23.464028 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2817/5943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:23 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:23.490183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:23.490957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:23.501192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:23.501192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:23.501192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:23.502038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:23.502609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:23.503142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:23.829916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:23.841557 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bc6ac80a-beae-4ca0-97a0-78b9c3444592 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.357845 Oct 03 11:00:23.844701 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3127/5944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:23 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:23.874317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4029d904-8cb7-4378-ad28-bb2295644a09 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:23.887744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4029d904-8cb7-4378-ad28-bb2295644a09 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:23.891326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4029d904-8cb7-4378-ad28-bb2295644a09 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:23.893478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4029d904-8cb7-4378-ad28-bb2295644a09 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:23.944409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4029d904-8cb7-4378-ad28-bb2295644a09 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 11:00:24.023524 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4029d904-8cb7-4378-ad28-bb2295644a09 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.157434 Oct 03 11:00:24.027079 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2818/5945] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:00:23 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:00:24.035858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:24.036525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:24.053305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:24.053843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:24.054307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:24.055061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:24.055645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:24.056220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:24.580009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:24.598520 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ee57cb9-1eee-4e29-ab88-1ab7868f2ec8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.567523 Oct 03 11:00:24.603387 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3128/5946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:24 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:25.628504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:25.629258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:25.656137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:25.656645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:25.657120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:25.657869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:25.658332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:25.658769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:25.715490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:26.054626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:26.064064 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29643e8b-837c-4595-91fd-2d1d925af110 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.441352 Oct 03 11:00:26.064673 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2819/5947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:25 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:27.098187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:27.101748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:27.121195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:27.121584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:27.122480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:27.124171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:27.125045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:27.125729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:28.303682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:28.345840 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a2b14225-8646-43eb-afe3-6efcccd6883e tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 1.253489 Oct 03 11:00:28.351648 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3129/5948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:27 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:29.376624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:29.379013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:29.385631 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:00:29.386614 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:00:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc (ip 10.222.0.27) !!! Oct 03 11:00:29.397803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:29.399543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:29.400290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:29.402234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:29.404299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:29.405073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:30.595308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:30.610135 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-823df078-c271-4046-a508-7c6079cb33a4 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 1.238382 Oct 03 11:00:30.612079 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2820/5949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:29 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:31.638814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:31.640050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:31.658834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=36 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:31.662566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:31.663067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:31.663509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:31.667283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:31.667778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:31.669241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:32.054926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:32.064551 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5df562fc-8977-4610-84e2-1f16c16a6b49 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.432188 Oct 03 11:00:32.065669 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3130/5950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:31 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:33.094402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:33.095690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:33.111188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:33.111687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:33.112122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:33.112869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:33.113317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:33.117512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:33.302380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:33.315130 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df27962a-f89c-467b-90ee-69bbda8f1fc9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1678 microversion: 2.1 time: 0.227870 Oct 03 11:00:33.316530 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2821/5951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:33 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:34.341443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:34.342293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:34.368642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:34.373627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:34.377403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:34.380175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:34.381930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:34.384088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:34.657260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:34.666169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-85e00954-7c07-45a3-aa91-04d67b4a6a87 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1655 microversion: 2.1 time: 0.330534 Oct 03 11:00:34.698146 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3131/5952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:34 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1655 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:34.705557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4f32781-4278-4d19-9961-c0caaa248ced tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:34.713401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f32781-4278-4d19-9961-c0caaa248ced tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:34.713901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f32781-4278-4d19-9961-c0caaa248ced tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:34.714347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4f32781-4278-4d19-9961-c0caaa248ced tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:34.761330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f4f32781-4278-4d19-9961-c0caaa248ced tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Going to try to start instance {{(pid=122270) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 11:00:34.843607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f4f32781-4278-4d19-9961-c0caaa248ced tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.141612 Oct 03 11:00:34.844584 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2822/5953] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:00:34 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:00:34.854628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:34.855400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:34.872042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:34.873294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:34.875113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:34.878360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:34.883541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:34.884423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:35.294128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:35.307913 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fbb5cc24-edb6-4d8e-91e1-1d7f69335bba tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1664 microversion: 2.1 time: 0.456804 Oct 03 11:00:35.309490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3132/5954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:34 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1664 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:35.447470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1521710376", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": "none"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:35.648761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:00:35.649302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:00:35.649870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:00:35.650359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:00:35.651446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:00:35.677236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:35.677824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:35.678350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:35.679227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:35.680684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:35.683079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:35.728221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Getting quotas for project d182d12913634e6787de36b422a9666f. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:00:35.745109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Getting quotas for user 3eced43c1e1e424d90eec66db2d93cf2 and project d182d12913634e6787de36b422a9666f. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:00:35.772548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:00:35.782054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:00:35.861657 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86fa0765-a74d-40cd-ab08-1080de83f608 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.887625 Oct 03 11:00:35.862914 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2823/5955] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 11:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 11:00:35.874541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-faaf6b9a-d58f-4b1f-8f4e-d613ff071907 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:35.875152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-faaf6b9a-d58f-4b1f-8f4e-d613ff071907 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:36.001752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-faaf6b9a-d58f-4b1f-8f4e-d613ff071907 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:36.015119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-faaf6b9a-d58f-4b1f-8f4e-d613ff071907 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:36.022139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-faaf6b9a-d58f-4b1f-8f4e-d613ff071907 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:36.023561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-faaf6b9a-d58f-4b1f-8f4e-d613ff071907 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5" status: 200 len: 1278 microversion: 2.47 time: 0.153266 Oct 03 11:00:36.024291 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3133/5956] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:35 2022] GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:36.335110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:36.336236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:36.350082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:36.353417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:36.357341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:36.358302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:36.359187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:36.363133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:36.571267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-506572938", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": "none"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:36.681072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:36.691120 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c4e6f06-80e0-4493-87b0-43bc6d9d2538 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1664 microversion: 2.1 time: 0.361439 Oct 03 11:00:36.696516 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2824/5957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:36 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1664 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:36.740218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:00:36.740726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:00:36.741358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:00:36.741976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:00:36.742524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:00:36.770424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:36.770918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:36.771901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:36.784522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:36.785142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:36.785682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:36.834898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Getting quotas for project d182d12913634e6787de36b422a9666f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:00:36.841612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Getting quotas for user 3eced43c1e1e424d90eec66db2d93cf2 and project d182d12913634e6787de36b422a9666f. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:00:36.858496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:00:36.861444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:00:36.920486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c19050a1-e113-4adf-b85c-feba47d25739 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.354458 Oct 03 11:00:36.934859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74887593-ba95-4a88-b4c1-f177f03e8858 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:36.938802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-74887593-ba95-4a88-b4c1-f177f03e8858 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:36.943977 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3134/5958] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 11:00:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 11:00:36.986697 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-74887593-ba95-4a88-b4c1-f177f03e8858 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "PUT /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 991 microversion: 2.47 time: 0.056490 Oct 03 11:00:37.003909 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2825/5959] 10.222.0.27 () {62 vars in 1297 bytes} [Mon Oct 3 11:00:36 2022] PUT /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 11:00:37.009560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-662c95d5-41c8-4ab5-82d5-be0f78e6f85d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:37.010358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-662c95d5-41c8-4ab5-82d5-be0f78e6f85d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:37.075843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-662c95d5-41c8-4ab5-82d5-be0f78e6f85d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:37.094315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-662c95d5-41c8-4ab5-82d5-be0f78e6f85d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:37.097719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-662c95d5-41c8-4ab5-82d5-be0f78e6f85d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:37.099200 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-662c95d5-41c8-4ab5-82d5-be0f78e6f85d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1277 microversion: 2.47 time: 0.093712 Oct 03 11:00:37.105389 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3135/5960] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:37 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:37.725910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:37.726756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:37.742911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:37.747832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:37.753627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:37.754400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:37.758862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:37.760644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.103727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:38.112418 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-158b24f2-2af1-42f0-bd2a-65f8af860627 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.390706 Oct 03 11:00:38.114110 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2826/5961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:37 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:38.135037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:38.135656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:38.149568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:38.154232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.154735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.155172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.155894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.156355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.156798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.162367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:38.200606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.201803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.202430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.203322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.203946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.204528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.344328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:38.364618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:38.377571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:38.379173 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4594c9f4-24fe-4bff-b1b1-870734c2f906 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1281 microversion: 2.47 time: 0.248646 Oct 03 11:00:38.381711 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3136/5962] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:38 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:38.483035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:38.494023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-70c19158-9337-426e-bd78-eefe2735cb68 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.349135 Oct 03 11:00:38.496053 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2827/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:38 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:38.524123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:38.525555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:38.537766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.540687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.541410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.547088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.549016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.551208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.817153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:38.828977 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0efbf9d7-64cd-4cea-a966-c54aab4ed1d8 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.309216 Oct 03 11:00:38.830330 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3137/5964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:38 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:38.854381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:38.855380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:38.873338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.876358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.877353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:38.879251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:38.881764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:38.883553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:39.271705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:39.283036 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e5cfcd5-c668-497e-886e-e398ab21c5f2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.433296 Oct 03 11:00:39.286509 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2828/5965] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:38 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:39.324074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:39.324694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:39.339867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:39.340376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:39.341234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:39.343507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:39.343999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:39.344507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:39.432304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:39.437581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:39.443837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:39.489304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:39.503005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:39.505025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:39.511338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:39.511818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:39.512256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:39.740832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:39.757966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:39.763866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:39.767089 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5d729b2a-f89c-42c5-86d8-63bf765e56c5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1337 microversion: 2.47 time: 0.356652 Oct 03 11:00:39.767696 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2829/5966] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:39 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1337 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:39.845237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:39.871998 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a3ff3d04-01a3-4e5a-9d59-19ac351155bb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.565206 Oct 03 11:00:39.874957 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3138/5967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:39 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:39.903237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:39.903776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:39.914448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:39.915276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:39.915943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:39.916862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:39.917674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:39.918267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:39.948196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lazy-loading 'flavor' on Instance uuid 0f1bf57f-57f2-4686-a930-078cf2654cbc {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:00:40.071158 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68398126-56fa-4e3c-a588-f11f2c729bb1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.172566 Oct 03 11:00:40.081846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:40.082476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:40.087057 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2830/5968] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:00:39 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:00:40.093451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:40.094693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:40.095351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:40.096294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:40.097235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:40.097836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:40.105600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:40.357785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:40.375315 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-290afe64-70cf-4048-bcb4-6b2622cacbe2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1676 microversion: 2.1 time: 0.298050 Oct 03 11:00:40.377793 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3139/5969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:40 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1676 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:40.798094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:40.799770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:40.817926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:40.820408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:40.820887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:40.821613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:40.822229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:40.823214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:40.946684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:40.965242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:40.975471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:40.981611 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3545c017-f6c0-4291-b8bb-eff1f1bf4239 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1337 microversion: 2.47 time: 0.188350 Oct 03 11:00:40.984166 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2831/5970] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:40 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1337 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:41.403166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:41.403793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:41.410375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:41.411109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:41.411729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:41.412642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:41.413312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:41.413903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:41.578188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:41.589600 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbee5d86-3d32-4527-a094-73bad8a6d426 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1659 microversion: 2.1 time: 0.190144 Oct 03 11:00:41.590685 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3140/5971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:41 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1659 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:41.619023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:41.619570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:41.626489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:41.626991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:41.627434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:41.629869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:41.631363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:41.632373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:41.734749 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc46cb32-90d4-4063-8da5-c73516d6a69f tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.118957 Oct 03 11:00:41.735964 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2832/5972] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:00:41 2022] POST /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:00:41.745059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:41.746105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:41.759756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:41.759756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:41.760599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:41.761703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:41.762414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:41.763126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:42.018838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:42.019717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:42.045858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:42.048686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:42.049264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:42.056850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:42.058094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:42.059494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:42.234891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:42.252098 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e2e6358-2f4c-4ac4-9d85-71fd80f00c41 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1665 microversion: 2.1 time: 0.510849 Oct 03 11:00:42.252970 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3141/5973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:41 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1665 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:42.309380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:42.327221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:42.335415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:42.340558 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-439a907a-099a-4663-b289-a05386b1e984 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1335 microversion: 2.47 time: 0.327183 Oct 03 11:00:42.342462 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2833/5974] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:42 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1335 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:00:43.279952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:43.280560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:43.306115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:43.312003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:43.312818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:43.313774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:43.314503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:43.315235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:43.380048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:43.381599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:43.390269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:43.391281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:43.392101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:43.395636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:43.398272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:43.399762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:43.467438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:43.567360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:43.640194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:43.653238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:43.660610 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf1422d6-9cfc-47b1-983c-bffc171dc693 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1335 microversion: 2.47 time: 0.283548 Oct 03 11:00:43.663585 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2834/5975] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:43 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1335 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:43.667309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:43.681557 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-67bc4325-84ed-440f-9a67-fe82679ae226 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1665 microversion: 2.1 time: 0.404998 Oct 03 11:00:43.687366 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3142/5976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:43 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1665 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:44.715941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:44.722610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:44.724564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:44.726641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:44.745992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:44.747808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:44.749263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:44.750607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:44.751978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:44.752276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:44.753139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:44.753892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:44.756275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:44.757247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:44.757951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:44.759450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:44.889279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:44.901604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:44.903830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:44.906363 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-31239854-7825-4a5f-b502-9c04183f6306 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1335 microversion: 2.47 time: 0.195869 Oct 03 11:00:44.907701 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2835/5977] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:44 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1335 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:44.976888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:44.987589 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80e04d90-73b4-4bca-b311-a56a98848cfb tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.268127 Oct 03 11:00:44.989765 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3143/5978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:44 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:45.015426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:45.016351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:45.026170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:45.027090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:45.027810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:45.028737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:45.029862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:45.031055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:45.298112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:45.310776 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-220db6d0-7ab4-4b9f-933a-337b05a4e6c7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1668 microversion: 2.1 time: 0.301572 Oct 03 11:00:45.311593 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2836/5979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:45 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1668 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:45.342053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:45.342548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:45.350757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:45.351344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:45.351791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:45.352589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:45.355290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:45.355755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:45.418114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:00:45.425930 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Working on deleting snapshot 92f0e143-0717-4f7a-97e8-ae6836546cd5 from shelved instance... Oct 03 11:00:45.937368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:45.938244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:45.953839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:45.960113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:45.970400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:45.970915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:45.971365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:45.972102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:45.972566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:45.973035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:46.157198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:46.166947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:46.177341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:46.179410 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11108ddd-add6-4351-892f-86da4d23db9c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1356 microversion: 2.47 time: 0.247280 Oct 03 11:00:46.183398 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2837/5980] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:45 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:00:46.217425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:46.223636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:46.243205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:46.244063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:46.245129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:46.247026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:46.247515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:46.249663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:46.437978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:00:46.442784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:00:46.442987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:00:46.443409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:00:46.443826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:00:46.703831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:46.752334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:46.752853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:46.753301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:46.754062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:46.754465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:46.754891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:46.817985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:46.975635 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c86f7fef-cfaf-4d50-913e-360b40f5322e tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "POST /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877/action" status: 202 len: 1078 microversion: 2.47 time: 0.762701 Oct 03 11:00:46.996059 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2838/5981] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Oct 3 11:00:46 2022] POST /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877/action => generated 1078 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 03 11:00:47.029400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:47.035156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:47.064478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:47.075474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:47.077195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:47.080693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:47.085074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:47.090764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:47.092678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:47.387154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:47.401195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:47.403219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:47.404697 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2efa3e9c-bf96-4406-96b5-9c1c5801461d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.405179 Oct 03 11:00:47.406183 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2839/5982] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:46 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:47.534116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Doing local delete in cell 5d809412-179d-487a-a3ff-24b9afa0366c(cell1) {{(pid=122269) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 03 11:00:47.537319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:47.539301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:47.540910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:47.543386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 03 11:00:47.556369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] deallocate_for_instance() {{(pid=122269) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 03 11:00:48.441825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:48.442619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:48.493994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:48.496510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:48.501857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:48.508673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:48.509936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:48.519095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:48.727880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:48.774179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:48.791941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:48.795089 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-323e8961-4075-4f03-814b-0b968c355eed tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.357925 Oct 03 11:00:48.806047 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2840/5983] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:48 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:00:49.322810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Updating instance_info_cache with network_info: [] {{(pid=122269) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 11:00:49.434426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-48d991eb-f1c7-494f-bd7f-1f79baf2a9f2 req-e798cf16-ca3a-455b-803f-16003b0f63f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18372a0b-5255-46a2-a0d6-f72df9fd27fe", "name": "network-vif-deleted", "tag": "94379c78-1f9c-4790-9a0b-5aa515745235"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:49.501935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48d991eb-f1c7-494f-bd7f-1f79baf2a9f2 req-e798cf16-ca3a-455b-803f-16003b0f63f6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:49.502587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48d991eb-f1c7-494f-bd7f-1f79baf2a9f2 req-e798cf16-ca3a-455b-803f-16003b0f63f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:49.502872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-48d991eb-f1c7-494f-bd7f-1f79baf2a9f2 req-e798cf16-ca3a-455b-803f-16003b0f63f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:49.569133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.server_external_events [req-48d991eb-f1c7-494f-bd7f-1f79baf2a9f2 req-e798cf16-ca3a-455b-803f-16003b0f63f6 service nova] Unable to find a host for instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe. Dropping event network-vif-deleted {{(pid=122270) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 11:00:49.570517 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-48d991eb-f1c7-494f-bd7f-1f79baf2a9f2 req-e798cf16-ca3a-455b-803f-16003b0f63f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.150536 Oct 03 11:00:49.573675 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2841/5984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 154 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 11:00:49.863054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:49.863746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:49.902053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:49.906398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:49.910656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:49.911802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:49.916870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:49.922112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:50.130265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d7088f4-174d-48e5-8866-a087dd9a778c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "DELETE /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 204 len: 0 microversion: 2.1 time: 4.788875 Oct 03 11:00:50.131554 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3144/5985] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:45 2022] DELETE /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 0 bytes in 4796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:00:50.146258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:50.152374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:50.153297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 18372a0b-5255-46a2-a0d6-f72df9fd27fe] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:50.170061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:50.171977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:50.172627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:50.178069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:50.178989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:50.180298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:50.203278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:50.210445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:50.215957 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cdc0c03c-cc9e-48eb-a4f0-efac9e5f2900 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.360238 Oct 03 11:00:50.222044 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] HTTP exception thrown: Instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe could not be found. Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Request method failure captured: Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe HTTP/1.1 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6y3AHd1Q08SBna-TnPCg3TZcMgJ8HFVX3WMFc-D9aSAlKErwb_Y1-floYq-2JNcDtPrx9Cuhg7LWnAh6qzjEAcENv8psqr3qoaVDBR1tT2LBJVSKh5nTXCPjR2VuoltiwZEmO_psDMctAeGeZAOLFEnWk1tUUAVW7fvKpp5aCek08 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_598e28eacadb4e528222edc532abb878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/598e28eacadb4e528222edc532abb878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}] Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e3857d14b6f6498c87700ea6ee22c4a6 Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe could not be found. Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '18372a0b-5255-46a2-a0d6-f72df9fd27fe'} Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe could not be found. Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe could not be found. Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:50.223606 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe could not be found. Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:00:50.232128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Returning 404 to user: Instance 18372a0b-5255-46a2-a0d6-f72df9fd27fe could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:50.238962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2842/5986] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:49 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:50.243391 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-238a2ac0-36ee-4e67-b114-500a69e4d30b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe" status: 404 len: 111 microversion: 2.1 time: 0.095798 Oct 03 11:00:50.252748 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3145/5987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:50 2022] GET /compute/v2.1/servers/18372a0b-5255-46a2-a0d6-f72df9fd27fe => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:50.262699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:50.263258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:50.282261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:50.282788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:50.283592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:50.293309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:50.296501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:50.297015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:50.370460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:00:50.549176 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64c6ab7e-4b39-4f59-bc04-149a00fecfab tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 204 len: 0 microversion: 2.1 time: 0.295611 Oct 03 11:00:50.555338 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2843/5988] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:50 2022] DELETE /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:00:50.574146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:50.575377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:50.584556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:50.586770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:50.591476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:50.592495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:50.593163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:50.593762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:50.790270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:50.806869 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79a532fc-ea29-4ea8-be31-2fd89872a3a2 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1465 microversion: 2.1 time: 0.231417 Oct 03 11:00:50.812541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3146/5989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:50 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:51.249291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:51.251216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:51.258625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:51.259200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:51.259568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:51.260291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:51.260976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:51.261564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:51.388248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:51.405296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:51.408693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:51.410617 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db68056b-66b1-49ac-bdb7-9ab0f46f40f5 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.167443 Oct 03 11:00:51.423993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2844/5990] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:51 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:51.841225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:51.842513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:51.868717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:51.871993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:51.873024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:51.882332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:51.892379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:51.900467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:52.307686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:52.331888 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8a9c68f-71c0-4f84-b72c-affc727e2055 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1465 microversion: 2.1 time: 0.496044 Oct 03 11:00:52.336261 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3147/5991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:51 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1465 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:52.463946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:52.467308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:52.525087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:52.527102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:52.527783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:52.532155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:52.543321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:52.544626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:52.783121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:52.806919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:52.814163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:52.817668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3351f68-8055-4abe-97cf-f16792502d92 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.364179 Oct 03 11:00:52.825340 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2845/5992] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:52 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:53.373236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:53.373855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:53.382054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:53.382540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:53.382981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:53.383685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:53.384136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:53.384563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:53.547513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:53.561802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0ba9ab0a-7624-4802-80f0-afc4f646caaa tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1465 microversion: 2.1 time: 0.196295 Oct 03 11:00:53.562824 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3148/5993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:53 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1465 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:53.821291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9954e288-0342-4c98-94fd-abf54bd1a0da req-629bb61d-a14e-44fc-a39b-110439289f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3011f9d-402b-40f9-a96d-24f6e3d8ae0b", "name": "network-vif-deleted", "tag": "b586e0cf-3218-40ec-b3ee-ea063ba080c8"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:53.834907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9954e288-0342-4c98-94fd-abf54bd1a0da req-629bb61d-a14e-44fc-a39b-110439289f2e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:53.838361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9954e288-0342-4c98-94fd-abf54bd1a0da req-629bb61d-a14e-44fc-a39b-110439289f2e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:53.839601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9954e288-0342-4c98-94fd-abf54bd1a0da req-629bb61d-a14e-44fc-a39b-110439289f2e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:53.852923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:53.853840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:53.870448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:53.871316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:53.873612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:53.874787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:53.876987 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9954e288-0342-4c98-94fd-abf54bd1a0da req-629bb61d-a14e-44fc-a39b-110439289f2e service nova] Creating event network-vif-deleted:b586e0cf-3218-40ec-b3ee-ea063ba080c8 for instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b on n-h2-858383-3 Oct 03 11:00:53.882000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:53.882354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:53.892200 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9954e288-0342-4c98-94fd-abf54bd1a0da req-629bb61d-a14e-44fc-a39b-110439289f2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075923 Oct 03 11:00:53.901213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2846/5994] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:00:54.075065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:54.093793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:54.098113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:54.101710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6402ed5f-cb9c-4ffa-81a8-1b3e9c8ea4cd tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.252936 Oct 03 11:00:54.102569 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3149/5995] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:53 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:54.587395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:54.588317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:54.616504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:54.617039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:54.617487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:54.618216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:54.618687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:54.619109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:54.733096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:54.735922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:54.738833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:54.739659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lazy-loading 'fault' on Instance uuid b3011f9d-402b-40f9-a96d-24f6e3d8ae0b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:00:54.841689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:54.852230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c5dd9ab0-2a5b-4901-8916-4213dda69ed9 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 200 len: 1305 microversion: 2.1 time: 0.269866 Oct 03 11:00:54.855200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2847/5996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:54 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 1305 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:00:55.131320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:55.131945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:55.142082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:55.143025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:55.145898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:55.147472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:55.149857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:55.151061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:55.193692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:55.279179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:55.297564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:55.302214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:55.306470 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0030c68-3d3d-4f49-9645-fa2ca1529321 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.180255 Oct 03 11:00:55.308503 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3150/5997] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:55 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:55.878549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:55.879167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: b3011f9d-402b-40f9-a96d-24f6e3d8ae0b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:55.894252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:55.894681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:55.895133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:55.895874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:55.896511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:55.901148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:55.911034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:00:55.960446 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] HTTP exception thrown: Instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b could not be found. Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Request method failure captured: Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b HTTP/1.1 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6y3AHd1Q08SBna-TnPCg3TZcMgJ8HFVX3WMFc-D9aSAlKErwb_Y1-floYq-2JNcDtPrx9Cuhg7LWnAh6qzjEAcENv8psqr3qoaVDBR1tT2LBJVSKh5nTXCPjR2VuoltiwZEmO_psDMctAeGeZAOLFEnWk1tUUAVW7fvKpp5aCek08 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_598e28eacadb4e528222edc532abb878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/598e28eacadb4e528222edc532abb878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}] Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e3857d14b6f6498c87700ea6ee22c4a6 Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b could not be found. Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b3011f9d-402b-40f9-a96d-24f6e3d8ae0b'} Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b could not be found. Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b could not be found. Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:00:55.963293 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b could not be found. Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Returning 404 to user: Instance b3011f9d-402b-40f9-a96d-24f6e3d8ae0b could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:00:55.969792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0bd665b2-02ba-4b94-91cb-577e0ba1b581 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b" status: 404 len: 111 microversion: 2.1 time: 0.090939 Oct 03 11:00:55.972631 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2848/5998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:55 2022] GET /compute/v2.1/servers/b3011f9d-402b-40f9-a96d-24f6e3d8ae0b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:00:55.975646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:55.975796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:55.987029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:55.991320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:55.992967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:55.993757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:55.994243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:55.994683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:56.067862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:00:56.347819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:56.348584 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ca82556-6261-4be6-9545-750cced0e7ad tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "DELETE /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 204 len: 0 microversion: 2.1 time: 0.376962 Oct 03 11:00:56.349433 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3151/5999] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:00:55 2022] DELETE /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:00:56.362962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:56.364471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:56.374499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:56.393694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:56.394204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:56.398033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:56.398957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:56.399517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:56.400030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:56.401705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:56.402641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:56.407828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:56.409121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:56.409981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:56.410777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:56.651655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:56.661454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:56.666763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:56.668537 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4edfc5be-db2d-41b4-ab70-c5106cb2be25 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.333433 Oct 03 11:00:56.670241 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2849/6000] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:56 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:56.727172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:56.743586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89a4884c-27f1-4e69-91ba-2439d548126b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1507 microversion: 2.1 time: 0.387929 Oct 03 11:00:56.744856 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3152/6001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:56 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:57.701622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:57.703614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:57.718144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:57.719242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:57.720984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:57.722574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:57.723628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:57.725182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:57.768365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:57.769274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:57.784131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:57.784625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:57.788730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:57.789693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:57.790331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:57.790786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:57.888559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:57.907938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:57.910268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:57.912569 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a7c2174-40f4-4c49-b5a9-597d51e0413c tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.216013 Oct 03 11:00:57.916733 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2850/6002] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:57 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:58.411183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:58.424158 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ccedd371-37b4-4b7b-bca7-653e26b5257c tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1507 microversion: 2.1 time: 0.658070 Oct 03 11:00:58.441407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3153/6003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:57 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:00:58.946421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:58.948060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:58.968092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:58.970913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:58.971345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:58.973189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:58.977193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:58.978122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:59.220426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:59.238273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:59.239764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:59.241062 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-95b2e9f1-cdd8-4952-b2ff-18ed4e331a20 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.301781 Oct 03 11:00:59.250720 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2851/6004] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:00:58 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:00:59.452699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:00:59.454643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:00:59.473612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:59.476245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:59.479897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:59.481010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:59.481766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:59.483528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:59.652579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bbc835b9-012f-41de-98bc-41c7393967e1 req-d92030a2-77a8-4a55-b777-908d72caff7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90db67a2-ae59-47d0-a5ec-688229b0629d", "name": "network-vif-deleted", "tag": "a45a2555-ffb9-4d54-90f2-4d8db5c83405"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:00:59.679737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bbc835b9-012f-41de-98bc-41c7393967e1 req-d92030a2-77a8-4a55-b777-908d72caff7d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:00:59.683002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bbc835b9-012f-41de-98bc-41c7393967e1 req-d92030a2-77a8-4a55-b777-908d72caff7d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:00:59.683458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bbc835b9-012f-41de-98bc-41c7393967e1 req-d92030a2-77a8-4a55-b777-908d72caff7d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:00:59.733849 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bbc835b9-012f-41de-98bc-41c7393967e1 req-d92030a2-77a8-4a55-b777-908d72caff7d service nova] Creating event network-vif-deleted:a45a2555-ffb9-4d54-90f2-4d8db5c83405 for instance 90db67a2-ae59-47d0-a5ec-688229b0629d on n-h2-858383-3 Oct 03 11:00:59.758424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bbc835b9-012f-41de-98bc-41c7393967e1 req-d92030a2-77a8-4a55-b777-908d72caff7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113092 Oct 03 11:00:59.772156 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2852/6005] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 03 11:00:59.775208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:00:59.799269 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54fd5a6a-d59f-4540-921f-900bbac39e00 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1465 microversion: 2.1 time: 0.349756 Oct 03 11:00:59.800644 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3154/6006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:00:59 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1465 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:00.282843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:00.283591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:00.310438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:00.311184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:00.311631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:00.316330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:00.317084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:00.319565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:00.835613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:00.836898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:00.854947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:00.855622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:00.856241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:00.857707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:00.859668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:00.860693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:00.942682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:00.944571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:00.945208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:00.945855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lazy-loading 'fault' on Instance uuid 90db67a2-ae59-47d0-a5ec-688229b0629d {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:01:01.019392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:01.031721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff2272a0-2e7f-4ec2-8769-476d78e54c55 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 200 len: 1305 microversion: 2.1 time: 0.208537 Oct 03 11:01:01.036293 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3155/6007] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:00 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 1305 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:01.274697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:01.291758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:01.295767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:01.301684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c414950b-027c-438c-b0af-61a00839563b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 1.023423 Oct 03 11:01:01.309638 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2853/6008] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:00 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:02.084288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:02.085460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 90db67a2-ae59-47d0-a5ec-688229b0629d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:02.106203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:02.114145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.118923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.120631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.122547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.127658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.129109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.174734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] HTTP exception thrown: Instance 90db67a2-ae59-47d0-a5ec-688229b0629d could not be found. Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Request method failure captured: Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d HTTP/1.1 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6y3AHd1Q08SBna-TnPCg3TZcMgJ8HFVX3WMFc-D9aSAlKErwb_Y1-floYq-2JNcDtPrx9Cuhg7LWnAh6qzjEAcENv8psqr3qoaVDBR1tT2LBJVSKh5nTXCPjR2VuoltiwZEmO_psDMctAeGeZAOLFEnWk1tUUAVW7fvKpp5aCek08 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_598e28eacadb4e528222edc532abb878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/598e28eacadb4e528222edc532abb878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}] Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e3857d14b6f6498c87700ea6ee22c4a6 Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 90db67a2-ae59-47d0-a5ec-688229b0629d could not be found. Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '90db67a2-ae59-47d0-a5ec-688229b0629d'} Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90db67a2-ae59-47d0-a5ec-688229b0629d could not be found. Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90db67a2-ae59-47d0-a5ec-688229b0629d could not be found. Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:02.182153 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:02.185985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:02.185985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:02.185985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:02.185985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:01:02.185985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:01:02.185985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90db67a2-ae59-47d0-a5ec-688229b0629d could not be found. Oct 03 11:01:02.185985 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:02.189546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Returning 404 to user: Instance 90db67a2-ae59-47d0-a5ec-688229b0629d could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:01:02.192571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0669b757-4e1d-47b5-9270-68d67b0fe9e7 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d" status: 404 len: 111 microversion: 2.1 time: 0.111507 Oct 03 11:01:02.196397 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3156/6009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:02 2022] GET /compute/v2.1/servers/90db67a2-ae59-47d0-a5ec-688229b0629d => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:01:02.205620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:02.206173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:02.227834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.228693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.231692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.232666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.238354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.239254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.355778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:02.356873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:02.390014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:01:02.393615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.394430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.395152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.398563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.401247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.402304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.646972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-764cefb2-6d9f-42b2-88e6-adff9171eb88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 204 len: 0 microversion: 2.1 time: 0.442071 Oct 03 11:01:02.648923 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2854/6010] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:01:02 2022] DELETE /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:01:02.659647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:02.665200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:02.687267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.688005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.688659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.689643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:02.690764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:02.691321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:02.692383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:02.729694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:02.735594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:02.738859 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34cb0b37-c642-4fcd-9d46-79af485239c9 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.387837 Oct 03 11:01:02.740946 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3157/6011] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:02 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:01:03.104101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:03.113948 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0b3c993a-7d52-470e-b290-6b5b808ba91b tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1494 microversion: 2.1 time: 0.458474 Oct 03 11:01:03.133776 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2855/6012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:02 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1494 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:03.777569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:03.778808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:03.798834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:03.804258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:03.805481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:03.806786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:03.807755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:03.808811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:04.089829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:04.105987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:04.112356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:04.115986 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-973f1ecb-7b03-4621-b1a6-83b1fbbf5582 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.340978 Oct 03 11:01:04.133374 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3158/6013] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:03 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:04.150476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:04.151101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:04.165656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:04.166222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:04.166832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:04.167774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:04.168420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:04.169040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:04.235758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a087ad6c-1826-4065-ac2c-2b8fc497dd55 req-d23099e2-fdbc-4aaa-af94-b3affb166d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6462b873-02b8-4e3e-8371-df0fde41951e", "name": "network-vif-deleted", "tag": "8cb9dccd-e037-40bd-9b93-0840f9991a8a"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:04.249075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a087ad6c-1826-4065-ac2c-2b8fc497dd55 req-d23099e2-fdbc-4aaa-af94-b3affb166d01 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:04.249636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a087ad6c-1826-4065-ac2c-2b8fc497dd55 req-d23099e2-fdbc-4aaa-af94-b3affb166d01 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:04.250304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a087ad6c-1826-4065-ac2c-2b8fc497dd55 req-d23099e2-fdbc-4aaa-af94-b3affb166d01 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:04.268065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a087ad6c-1826-4065-ac2c-2b8fc497dd55 req-d23099e2-fdbc-4aaa-af94-b3affb166d01 service nova] Creating event network-vif-deleted:8cb9dccd-e037-40bd-9b93-0840f9991a8a for instance 6462b873-02b8-4e3e-8371-df0fde41951e on n-h2-858383-3 Oct 03 11:01:04.284255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a087ad6c-1826-4065-ac2c-2b8fc497dd55 req-d23099e2-fdbc-4aaa-af94-b3affb166d01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052554 Oct 03 11:01:04.296290 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3159/6014] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:01:04.464964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:04.479427 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f18c3a99-53b3-43cb-86f5-8cb34e34de71 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 200 len: 1452 microversion: 2.1 time: 0.333593 Oct 03 11:01:04.482586 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2856/6015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:04 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 1452 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:05.145477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:05.146562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:05.164110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.165700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.167019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:05.167854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.169784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.171164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:05.297249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:05.311428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:05.313098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:05.314315 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0a9a1264-42ee-45e5-9ef9-8dc4ef2f90f4 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.174204 Oct 03 11:01:05.314871 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3160/6016] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:05 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:05.512251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:05.514115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 6462b873-02b8-4e3e-8371-df0fde41951e] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:05.535107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.538245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.538738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:05.539536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.553662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.554148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:05.611006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] HTTP exception thrown: Instance 6462b873-02b8-4e3e-8371-df0fde41951e could not be found. Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Request method failure captured: Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e HTTP/1.1 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOr6y3AHd1Q08SBna-TnPCg3TZcMgJ8HFVX3WMFc-D9aSAlKErwb_Y1-floYq-2JNcDtPrx9Cuhg7LWnAh6qzjEAcENv8psqr3qoaVDBR1tT2LBJVSKh5nTXCPjR2VuoltiwZEmO_psDMctAeGeZAOLFEnWk1tUUAVW7fvKpp5aCek08 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_598e28eacadb4e528222edc532abb878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/598e28eacadb4e528222edc532abb878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}] Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: e3857d14b6f6498c87700ea6ee22c4a6 Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 6462b873-02b8-4e3e-8371-df0fde41951e could not be found. Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '6462b873-02b8-4e3e-8371-df0fde41951e'} Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6462b873-02b8-4e3e-8371-df0fde41951e could not be found. Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6462b873-02b8-4e3e-8371-df0fde41951e could not be found. Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:05.615972 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:01:05.620473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:05.620473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:05.620473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:05.620473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:01:05.620473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:01:05.620473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6462b873-02b8-4e3e-8371-df0fde41951e could not be found. Oct 03 11:01:05.620473 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:01:05.621911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Returning 404 to user: Instance 6462b873-02b8-4e3e-8371-df0fde41951e could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:01:05.626121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf8d611b-a538-4562-9640-57a23ad7dd88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e" status: 404 len: 111 microversion: 2.1 time: 0.121120 Oct 03 11:01:05.627928 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2857/6017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:05 2022] GET /compute/v2.1/servers/6462b873-02b8-4e3e-8371-df0fde41951e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:01:05.642018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:05.643802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:05.654531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.655579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.656274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:05.657881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.658960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.665185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:05.725426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:01:05.825053 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d6dafeb-8afb-4e63-bdad-88010a9ec931 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 204 len: 0 microversion: 2.1 time: 0.188407 Oct 03 11:01:05.825838 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3161/6018] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:01:05 2022] DELETE /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:01:05.851824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:05.852514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:05.867214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.871114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.871621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:05.874022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:05.874522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:05.876208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:06.300344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:06.315742 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f0479282-b1f4-4ae6-ade9-084c5ecddc40 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1674 microversion: 2.1 time: 0.485845 Oct 03 11:01:06.320251 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2858/6019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:05 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1674 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:06.343166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:06.344426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:06.359805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:06.360310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:06.367738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:06.368785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:06.369415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:06.370037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:06.581857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:06.598959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:06.605005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:06.608889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0daef059-ab7f-4654-b5be-6548b219f247 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.270379 Oct 03 11:01:06.612237 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3162/6020] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:06 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:07.342899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:07.344225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:07.359379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:07.360235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:07.360965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:07.362808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:07.364715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:07.366098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:07.638113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:07.639568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:07.653579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:07.658244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:07.658904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:07.659819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:07.660432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:07.662647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:07.870028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:07.894200 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d557b8c-acc1-46af-86a0-79071e75b2ca tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1674 microversion: 2.1 time: 0.542040 Oct 03 11:01:07.908983 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2859/6021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:07 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1674 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:07.961271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:07.984854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:07.988489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:07.997252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5fab8c1a-fffd-4beb-9191-2d4b2c852124 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.361058 Oct 03 11:01:07.999689 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3163/6022] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:07 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:01:08.918816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:08.919644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:08.933045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:08.934072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:08.936224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:08.937093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:08.937664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:08.940123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:09.030514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:09.031762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:09.046029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:09.046712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:09.047506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:09.048399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:09.051962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:09.052626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:09.086654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:09.907261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:09.934256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:09.946366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:09.948833 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c30b4422-e11f-4ede-b1af-68a82c5f9675 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.922207 Oct 03 11:01:09.953604 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3164/6023] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:09 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:10.028646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:10.062013 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4fc73d4d-4324-4305-a314-52d3cd6d2d88 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1674 microversion: 2.1 time: 1.146926 Oct 03 11:01:10.065487 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2860/6024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:08 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1674 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:10.980258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:10.981221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:10.991708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:10.992200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:10.992653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:10.998143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:10.998639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:10.999106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:11.091856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:11.093267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:11.096496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:11.115583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:11.127300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:11.127909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:11.129622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:11.130189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:11.131269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:11.197508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:11.214155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:11.217673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:11.219182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f7782186-dec9-4847-8185-98b3dc1e98a0 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.245219 Oct 03 11:01:11.219771 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3165/6025] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:10 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:11.262271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:11.277373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d85f0288-e037-4b05-b8ae-fb7a234e21c1 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1606 microversion: 2.1 time: 0.185252 Oct 03 11:01:11.279761 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2861/6026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:11 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1606 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:11.679930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-dd698ecb-32a9-438f-bd88-34be584e63f7 req-301df524-2a2c-4abd-a4bc-a018f165dc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1bf57f-57f2-4686-a930-078cf2654cbc", "name": "network-vif-deleted", "tag": "f7e07b83-bae4-4208-ad31-ae53ae04b39f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:11.731351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dd698ecb-32a9-438f-bd88-34be584e63f7 req-301df524-2a2c-4abd-a4bc-a018f165dc1a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:11.732146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dd698ecb-32a9-438f-bd88-34be584e63f7 req-301df524-2a2c-4abd-a4bc-a018f165dc1a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:11.732808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dd698ecb-32a9-438f-bd88-34be584e63f7 req-301df524-2a2c-4abd-a4bc-a018f165dc1a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:11.795105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-dd698ecb-32a9-438f-bd88-34be584e63f7 req-301df524-2a2c-4abd-a4bc-a018f165dc1a service nova] Creating event network-vif-deleted:f7e07b83-bae4-4208-ad31-ae53ae04b39f for instance 0f1bf57f-57f2-4686-a930-078cf2654cbc on n-h2-858383-3 Oct 03 11:01:11.809321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-dd698ecb-32a9-438f-bd88-34be584e63f7 req-301df524-2a2c-4abd-a4bc-a018f165dc1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134917 Oct 03 11:01:11.814748 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3166/6027] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:01:12.248711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:12.250060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:12.266409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:12.267275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:12.268095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:12.269063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:12.269803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:12.270436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:12.309612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:12.310991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:12.349209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:12.350650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:12.351346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:12.359560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:12.360578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:12.361314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:12.502852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:12.509392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:12.511091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:12.512459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lazy-loading 'fault' on Instance uuid 0f1bf57f-57f2-4686-a930-078cf2654cbc {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:01:12.594017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3857d14b6f6498c87700ea6ee22c4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e28eacadb4e528222edc532abb878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:12.599374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:12.614176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:12.616747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:12.618160 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-af1c4300-4f87-4727-a8a7-b389261d90f3 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 200 len: 1327 microversion: 2.1 time: 0.315274 Oct 03 11:01:12.620383 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3167/6028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:12 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 1327 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:01:12.622197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b2e1223-9e39-406f-a50e-6f9c825d1874 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.378647 Oct 03 11:01:12.624862 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2862/6029] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:12 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:13.647903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:13.657235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:13.659381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:13.659511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] [instance: 0f1bf57f-57f2-4686-a930-078cf2654cbc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:13.676959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:13.687983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:13.688687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:13.689270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:13.690258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:13.690955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:13.691666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:13.692408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:13.701836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:13.702798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:13.710723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:13.711944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:13.756903 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] HTTP exception thrown: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc could not be found. Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Request method failure captured: Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc HTTP/1.1 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOr6y3AHd1Q08SBna-TnPCg3TZcMgJ8HFVX3WMFc-D9aSAlKErwb_Y1-floYq-2JNcDtPrx9Cuhg7LWnAh6qzjEAcENv8psqr3qoaVDBR1tT2LBJVSKh5nTXCPjR2VuoltiwZEmO_psDMctAeGeZAOLFEnWk1tUUAVW7fvKpp5aCek08 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_598e28eacadb4e528222edc532abb878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/598e28eacadb4e528222edc532abb878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/598e28eacadb4e528222edc532abb878"}]}] Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 598e28eacadb4e528222edc532abb878 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1743472731 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: e3857d14b6f6498c87700ea6ee22c4a6 Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1743472731-project Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc could not be found. Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '0f1bf57f-57f2-4686-a930-078cf2654cbc'} Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc could not be found. Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc could not be found. Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:13.763373 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:13.767831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:13.767831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:13.767831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:13.767831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:01:13.767831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:01:13.767831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc could not be found. Oct 03 11:01:13.767831 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:13.769895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Returning 404 to user: Instance 0f1bf57f-57f2-4686-a930-078cf2654cbc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:01:13.785795 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d15f328-6430-4fa7-9785-3f77db562eff tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc" status: 404 len: 111 microversion: 2.1 time: 0.142715 Oct 03 11:01:13.787280 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3168/6030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:13 2022] GET /compute/v2.1/servers/0f1bf57f-57f2-4686-a930-078cf2654cbc => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:01:13.795388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-040e61e1-0d41-4b9a-b904-269f367e0e18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] Calling method '.version_select at 0x7f074ec3e430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:13.850803 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-040e61e1-0d41-4b9a-b904-269f367e0e18 tempest-ServerActionsTestJSON-1743472731 tempest-ServerActionsTestJSON-1743472731-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327078302" status: 202 len: 0 microversion: 2.1 time: 0.059204 Oct 03 11:01:13.852026 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3169/6031] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 11:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327078302 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:01:14.062762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:14.073179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:14.078805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:14.080520 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a33e16b-08c1-4404-81d2-2f5e46197772 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.428551 Oct 03 11:01:14.083359 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2863/6032] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:13 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:15.118643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:15.119327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:15.175493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:15.176241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:15.179866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:15.183195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:15.185152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:15.186833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:15.397731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:15.428364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:15.438134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:15.442594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-513cd05d-d784-47da-b61d-a7a7df0f4bda tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1365 microversion: 2.47 time: 0.328129 Oct 03 11:01:15.444676 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3170/6033] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:15 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:16.475360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:16.475940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:16.487952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:16.489745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:16.490903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:16.492797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:16.493450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:16.494253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:16.867139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:16.885716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:16.905484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:16.913256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-67ee1eac-4046-4761-b10a-2a58bd54d87f tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1371 microversion: 2.47 time: 0.442097 Oct 03 11:01:16.914512 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2864/6034] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:16 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:17.952740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:17.954478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:17.970403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:17.971514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:17.986446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:17.992102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:17.993238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:17.993877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:18.290768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:18.309869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:18.311361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:18.323141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a4a8abcb-120d-488d-81c6-8ae751484713 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1371 microversion: 2.47 time: 0.376329 Oct 03 11:01:18.324409 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3171/6035] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:17 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:19.355574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:19.356201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:19.367098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:19.367596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:19.368041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:19.375583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:19.376511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:19.377769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:19.385606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:19.551458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:19.561553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:19.570170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:19.572220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-992a926f-4f8e-476c-9183-32ca782daf23 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1371 microversion: 2.47 time: 0.221632 Oct 03 11:01:19.573725 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2865/6036] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:19 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:20.601340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:20.602294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:20.625371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:20.625874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:20.631341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:20.633340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:20.633840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:20.634285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:20.788657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:20.799671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:20.803457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:20.805737 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40e7b4fa-b218-420e-b43d-12ea66b58f5b tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1356 microversion: 2.47 time: 0.210572 Oct 03 11:01:20.806878 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3172/6037] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:20 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1356 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:20.834734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:20.860600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:20.862030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Searching by: {'deleted': False, 'project_id': 'd182d12913634e6787de36b422a9666f'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 11:01:20.871529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:20.872341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:20.873032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:20.874013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:20.874977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:20.875743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:21.172944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 11:01:21.922567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:21.938829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:21.939691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:21.940824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:21.962110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:21.964373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:22.159023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e634efc7-32ff-48ec-9062-4345c386f00a tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.311336 Oct 03 11:01:22.161791 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2866/6038] 10.222.0.27 () {60 vars in 1187 bytes} [Mon Oct 3 11:01:20 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:22.215810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:22.218347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:22.232135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:22.233030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:22.233693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:22.234748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:22.236752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:22.237784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:22.269015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:01:22.469375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-437e98e7-625d-453c-a904-1ec7840f6a75 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 204 len: 0 microversion: 2.47 time: 0.268152 Oct 03 11:01:22.470837 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3173/6039] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 11:01:22 2022] DELETE /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 11:01:22.479799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:22.480701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:22.491552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:22.492382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:22.497048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:22.498064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:22.498815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:22.499441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:22.844014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:22.859925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:22.861312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:22.862508 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7508fe8a-5662-4187-b01f-559f0a3b0ca6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1362 microversion: 2.47 time: 0.386964 Oct 03 11:01:22.872994 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2867/6040] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:22 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:01:23.891451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:23.893823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:23.917546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:23.918081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:23.918539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:23.922880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:23.923796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:23.925542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:24.210543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:24.225623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:24.227578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:24.230240 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c2e829c9-1ff3-41c0-bbbb-21fed513dea6 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1362 microversion: 2.47 time: 0.344740 Oct 03 11:01:24.233843 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3174/6041] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:23 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:25.266181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:25.273376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:25.304087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:25.306516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:25.307109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:25.308962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:25.310448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:25.311407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:25.409465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:25.411328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:25.412154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:25.418553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lazy-loading 'fault' on Instance uuid 08517642-e949-4861-b532-1c247fde8877 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:01:25.756451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:25.777646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:25.784451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:25.786254 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff3a531e-1a4a-4129-80b6-a2e9dbd13027 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 200 len: 1367 microversion: 2.47 time: 0.530472 Oct 03 11:01:25.795115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2868/6042] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:25 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 1367 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:26.829047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:26.830307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 08517642-e949-4861-b532-1c247fde8877] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:26.837760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:26.848487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:26.850727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:26.854854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:26.856148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:26.858874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:26.941041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] HTTP exception thrown: Instance 08517642-e949-4861-b532-1c247fde8877 could not be found. Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Request method failure captured: Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 HTTP/1.1 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsDSxCwj1p_76sAFdZ_I0Jf9dTaAJSAIq7Hw-av-K0ouh0LWRFgb_oNcu1BICo6QgnQlopVLqGY8GBaDwhhvwDqt253QnOqVl1jV18DVbKCrnufN9A-CGtYe29G2UabODGFjJ7RG-lB-J6F2P3fLCDPCNU_jZ7312qka6glSTNl1Pqs Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.47 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d182d12913634e6787de36b422a9666f Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerShowV247Test-2023027987 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d182d12913634e6787de36b422a9666f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d182d12913634e6787de36b422a9666f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d182d12913634e6787de36b422a9666f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d182d12913634e6787de36b422a9666f"}]}] Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerShowV247Test-2023027987 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d182d12913634e6787de36b422a9666f Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerShowV247Test-2023027987 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerShowV247Test-2023027987-project Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3eced43c1e1e424d90eec66db2d93cf2 Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerShowV247Test-2023027987-project Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 08517642-e949-4861-b532-1c247fde8877 could not be found. Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '08517642-e949-4861-b532-1c247fde8877'} Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08517642-e949-4861-b532-1c247fde8877 could not be found. Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08517642-e949-4861-b532-1c247fde8877 could not be found. Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:26.942779 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08517642-e949-4861-b532-1c247fde8877 could not be found. Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Returning 404 to user: Instance 08517642-e949-4861-b532-1c247fde8877 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c128e40d-2131-40b6-99da-67407dc1e872 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877" status: 404 len: 111 microversion: 2.47 time: 0.119688 Oct 03 11:01:26.949767 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3175/6043] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:26 2022] GET /compute/v2.1/servers/08517642-e949-4861-b532-1c247fde8877 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 11:01:26.953527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:26.954012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:26.963160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:26.963675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:26.964120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:26.977055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:26.977880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:26.981480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:27.068487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:01:27.279757 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e36c75ba-f8ee-47a5-af93-87c989500f3d tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5" status: 204 len: 0 microversion: 2.47 time: 0.329716 Oct 03 11:01:27.280705 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2869/6044] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 11:01:26 2022] DELETE /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 11:01:27.289533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:27.290452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:27.319444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:27.320031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:27.320498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:27.326703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:27.327234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:27.327669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:27.653104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:27.681276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:27.695372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:27.710020 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32abbe7d-934b-4bf3-a398-039bb9802548 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5" status: 200 len: 1363 microversion: 2.47 time: 0.411773 Oct 03 11:01:27.712465 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3176/6045] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:27 2022] GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5 => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:28.746975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:28.761622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:28.783338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:28.786387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:28.788513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:28.795464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:28.796091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:28.796760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:29.000017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:29.031043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:29.032798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:29.040538 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-328911d4-8ed6-4ca0-898d-b17cd9c55859 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5" status: 200 len: 1363 microversion: 2.47 time: 0.304223 Oct 03 11:01:29.047561 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2870/6046] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:28 2022] GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:29.754605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e5866e42-ebe2-4129-b7f5-6bf80f9e1f11 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'create', calling method: .version_select at 0x7f0757510280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-422323642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKckNErUe2OHBZCDC+MaF7UCTHQApN19Rf7BSnBhVVYFCC8Wq8I5/ZLwC4VU3owcbcLbHUHzfb0k3YRiKTbVvFHuE7W8gm7nTCZ5ZnflklTiw2zZR8OngHbcUdhg+iJbVQ=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:29.843289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e5866e42-ebe2-4129-b7f5-6bf80f9e1f11 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:01:29.875636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e5866e42-ebe2-4129-b7f5-6bf80f9e1f11 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for user a49f0fdcb5ec457c8ef571a791fb0e12 and project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:01:29.986586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e5866e42-ebe2-4129-b7f5-6bf80f9e1f11 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.241197 Oct 03 11:01:29.988508 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3177/6047] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:01:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:01:30.078319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:30.080226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:30.112888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:30.114771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:30.116042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:30.116992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:30.117689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:30.119335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:30.494060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:30.515208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:30.519544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eced43c1e1e424d90eec66db2d93cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd182d12913634e6787de36b422a9666f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:30.526185 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33778ddf-2a37-42fd-9e1b-fe8052cff814 tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5" status: 200 len: 1363 microversion: 2.47 time: 0.452343 Oct 03 11:01:30.530291 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2871/6048] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:30 2022] GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5 => generated 1363 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:31.561211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:31.562310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] [instance: 5eb6afc1-a81f-4c62-b83c-913654728db5] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:31.598837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:31.600884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:31.604679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:31.605762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:31.608366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:31.610861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:31.652625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] HTTP exception thrown: Instance 5eb6afc1-a81f-4c62-b83c-913654728db5 could not be found. Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Request method failure captured: Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5 HTTP/1.1 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsDSxCwj1p_76sAFdZ_I0Jf9dTaAJSAIq7Hw-av-K0ouh0LWRFgb_oNcu1BICo6QgnQlopVLqGY8GBaDwhhvwDqt253QnOqVl1jV18DVbKCrnufN9A-CGtYe29G2UabODGFjJ7RG-lB-J6F2P3fLCDPCNU_jZ7312qka6glSTNl1Pqs Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.47 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d182d12913634e6787de36b422a9666f Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerShowV247Test-2023027987 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d182d12913634e6787de36b422a9666f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d182d12913634e6787de36b422a9666f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d182d12913634e6787de36b422a9666f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d182d12913634e6787de36b422a9666f"}]}] Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerShowV247Test-2023027987 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d182d12913634e6787de36b422a9666f Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerShowV247Test-2023027987 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerShowV247Test-2023027987-project Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3eced43c1e1e424d90eec66db2d93cf2 Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerShowV247Test-2023027987-project Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 5eb6afc1-a81f-4c62-b83c-913654728db5 could not be found. Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '5eb6afc1-a81f-4c62-b83c-913654728db5'} Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb6afc1-a81f-4c62-b83c-913654728db5 could not be found. Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb6afc1-a81f-4c62-b83c-913654728db5 could not be found. Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:31.658010 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:31.663150 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:31.663150 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:31.663150 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:31.663150 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:01:31.663150 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:01:31.663150 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb6afc1-a81f-4c62-b83c-913654728db5 could not be found. Oct 03 11:01:31.663150 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:31.673268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] Returning 404 to user: Instance 5eb6afc1-a81f-4c62-b83c-913654728db5 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:01:31.676311 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7247ce74-239f-447d-8bb5-4180512827ad tempest-ServerShowV247Test-2023027987 tempest-ServerShowV247Test-2023027987-project] 10.222.0.27 "GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5" status: 404 len: 111 microversion: 2.47 time: 0.120109 Oct 03 11:01:31.678805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3178/6049] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:31 2022] GET /compute/v2.1/servers/5eb6afc1-a81f-4c62-b83c-913654728db5 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 11:01:33.169065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1644295490", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "dbdadad6-428c-4e39-ab3a-bee829bd080b"}], "key_name": "tempest-TestNetworkBasicOps-422323642", "security_groups": [{"name": "tempest-secgroup-smoke-510648587"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:33.208138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:33.214918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:33.622181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] validate_networks() for [('dbdadad6-428c-4e39-ab3a-bee829bd080b', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:01:35.688365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:01:35.689716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:01:35.690494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:01:35.691131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:01:35.691795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:01:35.706170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:35.706963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:35.708283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:35.709797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:35.713428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:35.714199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:35.778508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:01:35.797740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for user a49f0fdcb5ec457c8ef571a791fb0e12 and project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:01:35.835529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:01:35.845488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:01:36.056126 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ed8a2947-ac97-4a24-ab13-7f09eb8a58ce tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.894489 Oct 03 11:01:36.066197 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2872/6050] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:01:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:01:36.071955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70499bc7-8bbc-4205-83fb-8ca382eadae4 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:36.073277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-70499bc7-8bbc-4205-83fb-8ca382eadae4 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:36.081876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:36.193541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70499bc7-8bbc-4205-83fb-8ca382eadae4 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:36.202263 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-70499bc7-8bbc-4205-83fb-8ca382eadae4 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1248 microversion: 2.1 time: 0.135564 Oct 03 11:01:36.213953 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3179/6051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:36 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1248 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:37.243482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5907cbba-81ec-481b-80c5-0a3db37a5ab2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:37.245000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5907cbba-81ec-481b-80c5-0a3db37a5ab2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:37.825617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5907cbba-81ec-481b-80c5-0a3db37a5ab2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:37.838872 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5907cbba-81ec-481b-80c5-0a3db37a5ab2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1248 microversion: 2.1 time: 0.601578 Oct 03 11:01:37.842109 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2873/6052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:37 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1248 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:01:38.655412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1857291043", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": "none"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:38.829791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:01:38.834865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:01:38.835525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:01:38.835940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:01:38.844034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:01:38.866158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:38.869725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:38.871939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:38.872974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:38.873097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:38.874206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:38.877150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:38.893278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:38.900228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:38.902105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:38.905422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:38.907010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:38.913300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:38.921870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:38.980749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Getting quotas for project 82732ced71fe4435b1f7638c16ed3a84. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:01:39.013501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Getting quotas for user d223581eaed748b786237db2dd38b88b and project 82732ced71fe4435b1f7638c16ed3a84. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:01:39.078077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:01:39.080469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:01:39.250818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-16ae2cf8-709c-4c59-ac30-5456f006410e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.917701 Oct 03 11:01:39.254776 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3180/6053] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Oct 3 11:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 11:01:39.272592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fdcb3560-4c94-4219-a2fa-873a547c1e59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:39.288527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fdcb3560-4c94-4219-a2fa-873a547c1e59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:39.757003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:39.774046 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-74beca3d-3975-4e00-886e-37e2dd517399 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1300 microversion: 2.1 time: 0.913604 Oct 03 11:01:39.774734 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2874/6054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:38 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1300 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:39.778472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fdcb3560-4c94-4219-a2fa-873a547c1e59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:39.874232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fdcb3560-4c94-4219-a2fa-873a547c1e59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:39.880299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fdcb3560-4c94-4219-a2fa-873a547c1e59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:39.883446 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fdcb3560-4c94-4219-a2fa-873a547c1e59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1278 microversion: 2.57 time: 0.620793 Oct 03 11:01:39.886840 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3181/6055] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:39 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1278 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:40.798662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:40.800729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:40.825093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:40.827514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:40.828559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:40.829566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:40.830454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:40.831161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:40.915819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:40.917481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:40.948024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:40.949415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:40.950062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:40.951764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:40.954809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:40.955420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:40.967590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:41.058720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:41.094181 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8f3f23c5-2027-4697-bd6d-755b760b2139 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1306 microversion: 2.1 time: 0.298807 Oct 03 11:01:41.100176 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2875/6056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:40 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1306 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:41.327566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:41.359893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:41.367067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:41.368297 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d618d68-8255-44dd-a53a-8c25448a94e7 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1282 microversion: 2.57 time: 0.460786 Oct 03 11:01:41.387009 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3182/6057] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:40 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1282 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:42.123523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:42.124114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:42.139857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:42.147200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:42.148014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:42.150793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:42.154118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:42.154980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:42.155694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:42.420484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:42.422549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:42.466965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:42.470260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:42.470736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:42.476454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:42.480893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:42.482626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:42.524533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:42.540406 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ca81a27-c003-4954-a0e1-b3a22ec5dc0f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1306 microversion: 2.1 time: 0.420610 Oct 03 11:01:42.549586 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2876/6058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:42 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1306 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:42.941302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:42.980504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:42.983614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:42.985863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd813618-28a7-4248-8357-1ad4c8138366 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1336 microversion: 2.57 time: 0.573732 Oct 03 11:01:42.996172 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3183/6059] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:42 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1336 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:01:43.582893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:43.583938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:43.636314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:43.636860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:43.637322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:43.638067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:43.644300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:43.644873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:44.031673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:44.033007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:44.047897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:44.049362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:44.054316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:44.055884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:44.056737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:44.057378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:44.395604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:44.416002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:44.417587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:44.422694 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-05b223c5-9ecc-4fe3-92c7-c7f76f2611d2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1336 microversion: 2.57 time: 0.391840 Oct 03 11:01:44.423346 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3184/6060] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:44 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1336 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:01:44.723373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:44.757032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-496bf282-50f8-4c8c-a413-f79da01771e7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 1.194015 Oct 03 11:01:44.766264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2877/6061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:43 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:45.459290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:45.460229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:45.500357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:45.501835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:45.502911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:45.506656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:45.507896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:45.509084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:45.789956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:45.791694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:45.808864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:45.815289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:45.816001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:45.817437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:45.822586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:45.823375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:45.824539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:45.934669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:45.947354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:45.958521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:45.958521 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c85401e1-3755-4155-9359-42c005484e83 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1336 microversion: 2.57 time: 0.503978 Oct 03 11:01:45.958521 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3185/6062] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:45 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1336 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:46.733685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3fa048f7-c296-48e9-a2c0-51e7b07d754e req-b7325d81-326e-4749-8a6d-97ce9e409e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1246e2c-2bdd-4240-8e52-897f6d2ee394", "tag": "cc47180c-ce46-4d12-a8f2-0522bae2efc1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:46.775301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3fa048f7-c296-48e9-a2c0-51e7b07d754e req-b7325d81-326e-4749-8a6d-97ce9e409e6e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:46.775791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3fa048f7-c296-48e9-a2c0-51e7b07d754e req-b7325d81-326e-4749-8a6d-97ce9e409e6e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:46.778175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3fa048f7-c296-48e9-a2c0-51e7b07d754e req-b7325d81-326e-4749-8a6d-97ce9e409e6e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:46.811732 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3fa048f7-c296-48e9-a2c0-51e7b07d754e req-b7325d81-326e-4749-8a6d-97ce9e409e6e service nova] Creating event network-changed:cc47180c-ce46-4d12-a8f2-0522bae2efc1 for instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 on n-h1-858383-3 Oct 03 11:01:46.822011 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3fa048f7-c296-48e9-a2c0-51e7b07d754e req-b7325d81-326e-4749-8a6d-97ce9e409e6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.618294 Oct 03 11:01:46.822945 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3186/6063] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:01:46.954279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:46.969299 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-454f8f75-e319-4d9e-bf95-d8a7ebdd46d2 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 1.185698 Oct 03 11:01:46.973345 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2878/6064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:45 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:01:47.007942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:47.009556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:47.023051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:47.024454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:47.026504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:47.027886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:47.029938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:47.030755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:47.529626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:47.550497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:47.553386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:47.559162 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-edd51c3e-0ce0-4032-acc8-6f4a47496b4f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1357 microversion: 2.57 time: 0.553446 Oct 03 11:01:47.561454 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3187/6065] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:47 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1357 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:01:47.591937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:47.596598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:47.613966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:47.615549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:47.616127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:47.618644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:47.619601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:47.621481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:47.754044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:01:47.754472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:01:47.754953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:01:47.755370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:01:47.755826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:01:47.865184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:47.877390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:47.947655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:47.954637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:47.958191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:47.959493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:47.960618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:47.963648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:47.964514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:48.021734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:48.023181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:48.023493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0505834e-843b-4dfc-80ed-90d6c7335bb3 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "POST /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727/action" status: 202 len: 1138 microversion: 2.57 time: 0.437061 Oct 03 11:01:48.033161 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2879/6066] 10.222.0.27 () {62 vars in 1320 bytes} [Mon Oct 3 11:01:47 2022] POST /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727/action => generated 1138 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 03 11:01:48.037443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:48.040362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:48.043868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:48.044936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:48.045585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:48.046028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:48.071830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:48.073150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:48.085395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:48.085905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:48.086343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:48.087240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:48.087971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:48.088558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:48.233262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:48.245726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:48.248193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:48.250363 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c30504c1-0ac4-40ec-ac8e-39fc6240c1ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.182717 Oct 03 11:01:48.251496 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2880/6067] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:48 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:48.875645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:48.897634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1ba2f5d9-ad48-4adf-a75e-59f224441a88 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.881492 Oct 03 11:01:48.913189 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3188/6068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:48 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:49.284132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:49.290435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:49.316443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:49.317457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:49.318220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:49.319225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:49.319916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:49.320708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:49.486102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:49.500453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:49.502277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:49.504369 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d646930e-ed3a-4871-b00a-3876cce15d4b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.228207 Oct 03 11:01:49.517259 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2881/6069] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:49 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:49.927335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:49.928567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:49.939650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:49.956906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:01:49.967973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:49.972669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:49.973324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:49.975028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:49.975715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:49.976469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:50.533878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:50.540916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:50.541543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:50.562398 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dea4ea58-c20a-44fc-9438-6fa0745322ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.639313 Oct 03 11:01:50.589250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:50.589758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:50.590227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:50.590967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:50.591762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:50.592297 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3189/6070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:49 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:50.605268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:50.968635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:51.001751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:51.003625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:51.008318 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-14f90d96-8daf-422b-9126-e7f9ec284e3e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.471244 Oct 03 11:01:51.018171 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2882/6071] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:50 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:51.594799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:51.595434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:51.617534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:51.619847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:51.620568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:51.624412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:51.625525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:51.626233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:52.053015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:52.054367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:52.076600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:52.077706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:52.078399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:52.079342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:52.080558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:52.081695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:52.128517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:52.164638 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ca38327-3cb8-4b76-b11d-4583b849f05d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.563587 Oct 03 11:01:52.171328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3190/6072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:51 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:52.448432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:52.470938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:52.481040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:52.505923 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cd5e771a-fe51-4819-92e1-8ef10b1ea123 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.459896 Oct 03 11:01:52.512425 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2883/6073] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:52 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:53.208185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:53.241830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:53.283441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:53.284280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:53.286217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:53.291774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:53.294455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:53.295271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:53.543317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:53.544052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:53.567256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:53.574404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:53.578746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:53.586758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:53.588799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:53.590976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:53.703419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:53.714455 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4487052f-cc0e-42ff-83e0-4f96de23427d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.517442 Oct 03 11:01:53.717486 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3191/6074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:53 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:53.902759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:53.925691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:53.930987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:53.938025 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f3090bf5-6d75-4b09-8ffd-f063d9e72887 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.398262 Oct 03 11:01:53.956352 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2884/6075] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:53 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:54.101505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b23cb23-7e82-4859-8a5a-a1915bfa341d tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Action: 'create', calling method: .version_select at 0x7f074f21e310>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:01:54.143056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9b23cb23-7e82-4859-8a5a-a1915bfa341d tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Getting quotas for project 8c377d24846a4a45837f3ed02c00b8a6. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:01:54.160365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9b23cb23-7e82-4859-8a5a-a1915bfa341d tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Getting quotas for user 8ba7d5fd519f4f57bae6ce11c294522b and project 8c377d24846a4a45837f3ed02c00b8a6. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:01:54.250935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9b23cb23-7e82-4859-8a5a-a1915bfa341d tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Getting quotas for project 8c377d24846a4a45837f3ed02c00b8a6. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:01:54.271532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-9b23cb23-7e82-4859-8a5a-a1915bfa341d tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Getting quotas for user 8ba7d5fd519f4f57bae6ce11c294522b and project 8c377d24846a4a45837f3ed02c00b8a6. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:01:54.313856 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b23cb23-7e82-4859-8a5a-a1915bfa341d tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.594882 Oct 03 11:01:54.314888 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3192/6076] 10.222.0.27 () {62 vars in 1214 bytes} [Mon Oct 3 11:01:53 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:01:54.333629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61e69394-d77b-4f03-ab03-18abb75cfbe6 tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:54.400094 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61e69394-d77b-4f03-ab03-18abb75cfbe6 tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.073638 Oct 03 11:01:54.409466 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2885/6077] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Oct 3 11:01:54 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:01:54.416373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02685e8e-5b64-4938-8984-6202c76c99de tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:54.436072 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02685e8e-5b64-4938-8984-6202c76c99de tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/9cdaeb08-bd44-4027-88be-beb496de13e3" status: 200 len: 235 microversion: 2.64 time: 0.024995 Oct 03 11:01:54.437304 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3193/6078] 10.222.0.27 () {60 vars in 1304 bytes} [Mon Oct 3 11:01:54 2022] GET /compute/v2.1/os-server-groups/9cdaeb08-bd44-4027-88be-beb496de13e3 => generated 235 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:01:54.448294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3175601e-2a39-4763-9c47-363205e7b066 tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:54.518204 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3175601e-2a39-4763-9c47-363205e7b066 tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/9cdaeb08-bd44-4027-88be-beb496de13e3" status: 204 len: 0 microversion: 2.64 time: 0.073209 Oct 03 11:01:54.527303 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2886/6079] 10.222.0.27 () {60 vars in 1307 bytes} [Mon Oct 3 11:01:54 2022] DELETE /compute/v2.1/os-server-groups/9cdaeb08-bd44-4027-88be-beb496de13e3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 11:01:54.532699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bdbae86-abf8-43dd-9e1d-06df3e819acb tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:54.541906 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4bdbae86-abf8-43dd-9e1d-06df3e819acb tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] HTTP exception thrown: Instance group 9cdaeb08-bd44-4027-88be-beb496de13e3 could not be found. Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bdbae86-abf8-43dd-9e1d-06df3e819acb tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Request method failure captured: Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-server-groups/9cdaeb08-bd44-4027-88be-beb496de13e3 HTTP/1.1 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsEhcAxwITTIbpvIZ_CGnjCB2otluepszLpC0cMBo9KUUYUGYMdxEAbRdEgYrqsKhq05z_K35u7lWdew-IJ6O3Hsxhj_0vhDhJqdM3o1_1cZMOIFidQLKFVCr60cPiNkEpu0CmkP4P5wwqLINeqP2JpH8UyoHjQUeVi2KXigX4zZ6-Y Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.64 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8c377d24846a4a45837f3ed02c00b8a6 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerGroup264TestJSON-2122178793 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c377d24846a4a45837f3ed02c00b8a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8c377d24846a4a45837f3ed02c00b8a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8c377d24846a4a45837f3ed02c00b8a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8c377d24846a4a45837f3ed02c00b8a6"}]}] Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerGroup264TestJSON-2122178793 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8c377d24846a4a45837f3ed02c00b8a6 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2122178793 Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerGroup264TestJSON-2122178793-project Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8ba7d5fd519f4f57bae6ce11c294522b Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerGroup264TestJSON-2122178793-project Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance group 9cdaeb08-bd44-4027-88be-beb496de13e3 could not be found. Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '9cdaeb08-bd44-4027-88be-beb496de13e3'} Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9cdaeb08-bd44-4027-88be-beb496de13e3 could not be found. Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9cdaeb08-bd44-4027-88be-beb496de13e3 could not be found. Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:54.549957 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:01:54.558704 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:01:54.558704 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:01:54.558704 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:01:54.558704 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:01:54.558704 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9cdaeb08-bd44-4027-88be-beb496de13e3 could not be found. Oct 03 11:01:54.558704 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:01:54.560851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4bdbae86-abf8-43dd-9e1d-06df3e819acb tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] Returning 404 to user: Instance group 9cdaeb08-bd44-4027-88be-beb496de13e3 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:01:54.562475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4bdbae86-abf8-43dd-9e1d-06df3e819acb tempest-ServerGroup264TestJSON-2122178793 tempest-ServerGroup264TestJSON-2122178793-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/9cdaeb08-bd44-4027-88be-beb496de13e3" status: 404 len: 117 microversion: 2.64 time: 0.033733 Oct 03 11:01:54.564281 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3194/6080] 10.222.0.27 () {60 vars in 1307 bytes} [Mon Oct 3 11:01:54 2022] DELETE /compute/v2.1/os-server-groups/9cdaeb08-bd44-4027-88be-beb496de13e3 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 03 11:01:54.766764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:54.767483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:54.801091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:54.801704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:54.827219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:54.833326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:54.834387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:54.834848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:54.971228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:54.971884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:54.985966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:54.988258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:54.988511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:54.989334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:54.992469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:54.993177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:55.267715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:55.298595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:55.304133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:55.313974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-017ba3e3-9e51-484d-a9d8-e0be36b3e756 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.347939 Oct 03 11:01:55.315884 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3195/6081] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:54 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:55.353376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:55.373823 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-23443010-a282-44e7-81e6-d7ef649df61a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.633606 Oct 03 11:01:55.389641 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2887/6082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:54 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:56.359273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:56.359893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:56.369688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:56.383271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:56.384009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:56.384956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:56.390346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:56.391079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:56.403993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:56.404836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:56.418730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:56.420788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:56.421572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:56.424215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:56.426925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:56.427650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:56.707315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:56.731963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:56.735188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:56.744608 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-03258e33-1e8f-4771-a705-c09667d8bd39 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.385508 Oct 03 11:01:56.745339 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3196/6083] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:56 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:01:57.088743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:57.137120 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-083fb980-39e1-49d0-9f6c-2b4442de4b7b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.727497 Oct 03 11:01:57.137120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2888/6084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:56 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:57.776137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:57.776881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:57.803946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:57.811605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:57.812958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:57.815500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:57.816048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:57.817214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:58.010647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:58.031503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:58.031503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:58.038026 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95e86e37-0bce-4513-95c6-9091c7906791 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.265507 Oct 03 11:01:58.041804 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3197/6085] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:57 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:58.154282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:58.155067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:58.172503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:58.177308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:58.178619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:58.180266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:58.181004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:58.182547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:58.604010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:58.691254 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-250cdedc-69a1-43d7-9a0c-9474ad46bd47 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.541513 Oct 03 11:01:58.697834 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2889/6086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:58 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:01:59.074136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:59.074763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:59.090370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:59.091736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:59.092916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:59.094267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:59.097918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:59.098967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:59.698547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:59.716675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:59.726936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:01:59.728366 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-41bd4a92-16e7-45bd-bfc8-8b74836e3ee1 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.658291 Oct 03 11:01:59.730358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:01:59.730997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:01:59.734093 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3198/6087] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:01:59 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:01:59.774619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:59.779181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:59.780859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:01:59.783084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:01:59.794141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:01:59.794519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:00.702170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5aecdcec-6b80-4798-aee3-1e6b5795aeed req-f4edc0be-b49c-4c7f-b294-bd4332272965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1246e2c-2bdd-4240-8e52-897f6d2ee394", "name": "network-vif-plugged", "status": "completed", "tag": "cc47180c-ce46-4d12-a8f2-0522bae2efc1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:00.728206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5aecdcec-6b80-4798-aee3-1e6b5795aeed req-f4edc0be-b49c-4c7f-b294-bd4332272965 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:00.728696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5aecdcec-6b80-4798-aee3-1e6b5795aeed req-f4edc0be-b49c-4c7f-b294-bd4332272965 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:00.732586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5aecdcec-6b80-4798-aee3-1e6b5795aeed req-f4edc0be-b49c-4c7f-b294-bd4332272965 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:00.778330 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5aecdcec-6b80-4798-aee3-1e6b5795aeed req-f4edc0be-b49c-4c7f-b294-bd4332272965 service nova] Creating event network-vif-plugged:cc47180c-ce46-4d12-a8f2-0522bae2efc1 for instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 on n-h1-858383-3 Oct 03 11:02:00.803460 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5aecdcec-6b80-4798-aee3-1e6b5795aeed req-f4edc0be-b49c-4c7f-b294-bd4332272965 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.829596 Oct 03 11:02:00.814773 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3199/6088] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:00.837369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:00.843831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:00.903596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:00.904130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:00.904558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:00.905946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:00.906602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:00.907513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:01.269479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:01.304825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:01.318261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:01.326079 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68f87896-b9f4-4038-bcb4-636c36dbbfd8 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.503916 Oct 03 11:02:01.328925 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3200/6089] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:00 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:01.706327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:01.722732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3ce00c04-9672-4467-b5b9-7009698ef787 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 1.998871 Oct 03 11:02:01.732223 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2890/6090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:01:59 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:02:02.361329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:02.361954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:02.375963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:02.376463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:02.376934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:02.401866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:02.402371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:02.402818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:02.788900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:02.796405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:02.830092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:02.835106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:02.839700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:02.845427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:02.847523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:02.850220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:02.878997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:02.902342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:02.916455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:02.917986 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15c2fb7e-c4fc-41c8-84cc-370a9e4b41cd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.564051 Oct 03 11:02:02.937254 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3201/6091] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:02 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:03.575471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:03.622918 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-160e7539-cf19-46b3-a17a-1f4956491a1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1373 microversion: 2.1 time: 0.838255 Oct 03 11:02:03.623287 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2891/6092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:02 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1373 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:03.947232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:03.948942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:03.971245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:03.975720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:03.976745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:03.982263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:03.983109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:03.997685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:04.307516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:04.570729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:04.608387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:04.640015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:04.641947 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e04019e6-c579-4193-8ac2-859f41cbb218 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.700379 Oct 03 11:02:04.647784 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3202/6093] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:03 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:04.667588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:04.668305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:04.689092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:04.689789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:04.690315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:04.694748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:04.695798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:04.697332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:05.199260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:05.210846 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3a45d37-0316-44dc-b3fc-9036eb55bddb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1545 microversion: 2.1 time: 0.547077 Oct 03 11:02:05.213786 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2892/6094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:04 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1545 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:05.243143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:05.243918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:05.263588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:05.264677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:05.265935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:05.270278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:05.273340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:05.274839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:05.283297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:05.587097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:05.608118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d5a0640-e940-4ef2-94a7-10c21760348f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1545 microversion: 2.1 time: 0.365641 Oct 03 11:02:05.610739 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3203/6095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:05 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1545 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:05.697362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:05.698663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:05.729719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:05.730241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:05.730705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:05.731446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:05.731916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:05.732356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:05.929302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:05.951126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:05.957453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:05.961770 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11a0d829-b99a-4883-a999-116e7c2e5a9e tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.270358 Oct 03 11:02:05.963757 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2893/6096] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:05 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:02:06.999000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:07.006525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:07.016225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:07.040541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:07.047574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:07.056875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:07.061585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:07.062086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:07.062529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:07.361405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:07.399461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:07.403693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:07.406289 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9aac2862-0fe7-4c36-99d2-e1e24a033cf2 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.414673 Oct 03 11:02:07.412228 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3204/6097] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:06 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:08.458492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:08.459785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:08.486401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:08.486901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:08.487486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:08.488297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:08.488659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:08.489109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:08.626093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:08.652570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:08.659230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:08.660828 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b426848-e28b-493b-a8b7-7c1f1f8d3b0f tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.206756 Oct 03 11:02:08.663296 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2894/6098] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:08 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:09.691673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:09.693606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:09.715883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:09.721081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:09.721795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:09.722991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:09.723677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:09.724397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:09.976982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:09.988798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:09.999524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:10.010544 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5df4a462-dddc-4589-bdf9-840070811148 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.313612 Oct 03 11:02:10.011774 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3205/6099] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:09 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:11.042630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:11.044097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:11.068962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:11.069884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:11.071281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:11.073700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:11.075391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:11.079157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:11.716230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:11.742591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:11.747403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:11.757676 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb36e564-a02a-4378-a3a2-359d695528fd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.717963 Oct 03 11:02:11.774091 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2895/6100] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:11 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:12.780513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7cdb167d-0126-4a96-b921-f898c9645cf0 req-ac8a335c-9e68-4ca3-b82d-a5b1b0d2aa55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1246e2c-2bdd-4240-8e52-897f6d2ee394", "tag": "cc47180c-ce46-4d12-a8f2-0522bae2efc1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:12.805451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:12.810053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:12.822772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cdb167d-0126-4a96-b921-f898c9645cf0 req-ac8a335c-9e68-4ca3-b82d-a5b1b0d2aa55 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:12.824375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:12.824734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cdb167d-0126-4a96-b921-f898c9645cf0 req-ac8a335c-9e68-4ca3-b82d-a5b1b0d2aa55 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:12.827541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cdb167d-0126-4a96-b921-f898c9645cf0 req-ac8a335c-9e68-4ca3-b82d-a5b1b0d2aa55 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:12.828475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:12.830210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:12.830922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:12.835857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:12.836914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:12.837759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:12.878752 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7cdb167d-0126-4a96-b921-f898c9645cf0 req-ac8a335c-9e68-4ca3-b82d-a5b1b0d2aa55 service nova] Creating event network-changed:cc47180c-ce46-4d12-a8f2-0522bae2efc1 for instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 on n-h1-858383-3 Oct 03 11:02:12.903332 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7cdb167d-0126-4a96-b921-f898c9645cf0 req-ac8a335c-9e68-4ca3-b82d-a5b1b0d2aa55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465054 Oct 03 11:02:12.909981 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3206/6101] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:12.976919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:12.996573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:12.999213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:13.000627 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-08bb389d-549b-4dd3-a04c-e1f24c5265bd tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.208694 Oct 03 11:02:13.002122 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2896/6102] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:12 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:14.050274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:14.051678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:14.094640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:14.095035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:14.101117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:14.102828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:14.103526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:14.104312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:14.367374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:14.408155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:14.419198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:14.420616 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe7a031e-6fbd-4540-84ba-b2e28a9c7c59 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1366 microversion: 2.57 time: 0.391448 Oct 03 11:02:14.437702 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3207/6103] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:14 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:15.455788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:15.456504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:15.484894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:15.485695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:15.486291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:15.488659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:15.489363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:15.500985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:15.540146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:15.863243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:15.882177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:15.889559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:15.894575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e94bb2a8-ee15-4bdd-b32f-15deafaac36b tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1372 microversion: 2.57 time: 0.445139 Oct 03 11:02:15.895865 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2897/6104] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:15 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1372 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:16.924695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:16.928918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:16.962926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:16.963684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:16.964292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:16.965131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:16.965591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:16.966089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:17.222907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:17.246903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:17.248296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:17.291128 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c67622de-57ac-4069-9d0d-0fee7c2e52ee tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1372 microversion: 2.57 time: 0.369052 Oct 03 11:02:17.305150 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3208/6105] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:16 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:18.326148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:18.326795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:18.341254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:18.341969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:18.342245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:18.342921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:18.343362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:18.343787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:18.481089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:18.500127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:18.504944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:18.509549 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3fe85fa0-599e-435d-95e5-9374622673fe tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1357 microversion: 2.57 time: 0.187319 Oct 03 11:02:18.512750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2898/6106] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:18 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 11:02:18.543196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:18.543731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:18.567838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:18.569526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:18.570231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:18.571189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:18.571869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:18.572604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:18.603781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:02:18.809701 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9cd06b5e-77ae-4c5c-b0da-d11c5a9230a0 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 204 len: 0 microversion: 2.57 time: 0.256448 Oct 03 11:02:18.820216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3209/6107] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Oct 3 11:02:18 2022] DELETE /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 11:02:18.830421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:18.832882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:18.840073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:18.840582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:18.841200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:18.841948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:18.842778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:18.843100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:19.044427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:19.062704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:19.066610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:19.072380 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bbac747b-9a2c-4777-8db5-5bec75f2992a tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1363 microversion: 2.57 time: 0.248494 Oct 03 11:02:19.077859 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2899/6108] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:18 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:20.120138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:20.135697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:20.158109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:20.158883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:20.159086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:20.169563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:20.170055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:20.178132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:20.595220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:20.606927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:20.623135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:20.629605 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f380240-a395-4c98-a160-cd6724584556 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1363 microversion: 2.57 time: 0.526026 Oct 03 11:02:20.631563 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3210/6109] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:20 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:21.666283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:21.667587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:21.688402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:21.689498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:21.690393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:21.691645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:21.692528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:21.694079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:21.918430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:21.921936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:21.923344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:21.924154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lazy-loading 'fault' on Instance uuid dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:02:22.123560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:22.176299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:22.183613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd223581eaed748b786237db2dd38b88b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82732ced71fe4435b1f7638c16ed3a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:22.193421 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d863e5dc-ec90-4336-b590-645415aafc75 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 200 len: 1368 microversion: 2.57 time: 0.530637 Oct 03 11:02:22.215129 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2900/6110] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:21 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 1368 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 11:02:23.221491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:23.223495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] [instance: dfc7f9ef-ae4b-4d52-88f9-1b606fb96727] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:23.241080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:23.242154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:23.242850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:23.243916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:23.246816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:23.249760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:23.304755 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] HTTP exception thrown: Instance dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 could not be found. Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Request method failure captured: Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 HTTP/1.1 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsERFUHQEqEnWDIxat5hLbEtWCamHq0oMavAHbc34rF4lcmKiY60bvCB6cHemTqOTJJ_xHclkMkUjmA55PxsQ-ajcSgozwVihkLyfti71DDE95mIe8L1JsaJ3C6NAS4j_G8q7x1wt7O-1ZynV94hEQ9cZivyOSPFKCunRPldysxdqto Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Openstack-Nova-Api-Version: 2.57 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 82732ced71fe4435b1f7638c16ed3a84 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerShowV257Test-1607838668 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82732ced71fe4435b1f7638c16ed3a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_82732ced71fe4435b1f7638c16ed3a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/82732ced71fe4435b1f7638c16ed3a84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/82732ced71fe4435b1f7638c16ed3a84"}]}] Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerShowV257Test-1607838668 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 82732ced71fe4435b1f7638c16ed3a84 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerShowV257Test-1607838668 Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerShowV257Test-1607838668-project Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d223581eaed748b786237db2dd38b88b Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerShowV257Test-1607838668-project Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 could not be found. Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'dfc7f9ef-ae4b-4d52-88f9-1b606fb96727'} Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 could not be found. Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 could not be found. Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:23.306668 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 could not be found. Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] Returning 404 to user: Instance dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1263b6c1-87fa-44fb-806d-77c989b4bc13 tempest-ServerShowV257Test-1607838668 tempest-ServerShowV257Test-1607838668-project] 10.222.0.27 "GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727" status: 404 len: 111 microversion: 2.57 time: 0.091146 Oct 03 11:02:23.315328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3211/6111] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Oct 3 11:02:23 2022] GET /compute/v2.1/servers/dfc7f9ef-ae4b-4d52-88f9-1b606fb96727 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 11:02:24.286180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e91a721-c5bc-418b-8dde-a72f71206961 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Action: 'create', calling method: .version_select at 0x7f074df76d30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-726610399", "policies": ["affinity"]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:24.351983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1e91a721-c5bc-418b-8dde-a72f71206961 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:24.376113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1e91a721-c5bc-418b-8dde-a72f71206961 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:24.605477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1e91a721-c5bc-418b-8dde-a72f71206961 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:24.631537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1e91a721-c5bc-418b-8dde-a72f71206961 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:24.708973 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e91a721-c5bc-418b-8dde-a72f71206961 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.177976 Oct 03 11:02:24.717818 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2901/6112] 10.222.0.27 () {60 vars in 1174 bytes} [Mon Oct 3 11:02:23 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:24.722457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-655a00e3-6582-47a9-9195-d21dae7c79d1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Action: 'create', calling method: .version_select at 0x7f074e55b280>, body: {"server_group": {"name": "tempest-server-group-652195922", "policies": ["affinity"]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:24.803525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-655a00e3-6582-47a9-9195-d21dae7c79d1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:24.828653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-655a00e3-6582-47a9-9195-d21dae7c79d1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:25.011611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-655a00e3-6582-47a9-9195-d21dae7c79d1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:25.027546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-655a00e3-6582-47a9-9195-d21dae7c79d1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:25.081272 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-655a00e3-6582-47a9-9195-d21dae7c79d1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.362611 Oct 03 11:02:25.091023 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3212/6113] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 3 11:02:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:25.101831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b24481ed-00e3-497e-b902-8dd8725715ad tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Action: 'create', calling method: .version_select at 0x7f074e180160>, body: {"server_group": {"name": "tempest-server-group-652195922", "policies": ["affinity"]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:25.132197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b24481ed-00e3-497e-b902-8dd8725715ad tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:25.138832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b24481ed-00e3-497e-b902-8dd8725715ad tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:25.229131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b24481ed-00e3-497e-b902-8dd8725715ad tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:25.252424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b24481ed-00e3-497e-b902-8dd8725715ad tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:25.310721 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b24481ed-00e3-497e-b902-8dd8725715ad tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.217700 Oct 03 11:02:25.313513 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2902/6114] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 3 11:02:25 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:25.324627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-590dcaf8-c24c-4c39-af27-148e6bf8fdee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:25.370877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-590dcaf8-c24c-4c39-af27-148e6bf8fdee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/bad52cdc-0918-4519-bcff-4e585e0c7f12" status: 204 len: 0 microversion: 2.1 time: 0.050465 Oct 03 11:02:25.371842 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3213/6115] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:25 2022] DELETE /compute/v2.1/os-server-groups/bad52cdc-0918-4519-bcff-4e585e0c7f12 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:02:25.381085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b00ac8f-01c1-4184-856a-9506b801310f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:25.393966 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b00ac8f-01c1-4184-856a-9506b801310f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.017111 Oct 03 11:02:25.410274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2df70caf-6142-4da9-b08b-bb4a09cd1f22 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:25.415991 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2903/6116] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 11:02:25 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:25.453936 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2df70caf-6142-4da9-b08b-bb4a09cd1f22 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3fec7411-32b3-41df-ba67-9d4643addce9" status: 204 len: 0 microversion: 2.1 time: 0.047810 Oct 03 11:02:25.458330 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3214/6117] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:25 2022] DELETE /compute/v2.1/os-server-groups/3fec7411-32b3-41df-ba67-9d4643addce9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:02:25.465343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6ed7eddb-e523-4309-889f-74389ae0b603 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:25.494706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6ed7eddb-e523-4309-889f-74389ae0b603 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.033917 Oct 03 11:02:25.496073 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2904/6118] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 11:02:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:25.510071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-907fb804-b004-417c-b3ea-649c2055200a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Action: 'create', calling method: .version_select at 0x7f074e55bca0>, body: {"server_group": {"name": "tempest-server-group-1853354026", "policies": ["affinity"]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:25.544425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-907fb804-b004-417c-b3ea-649c2055200a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:25.552086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-907fb804-b004-417c-b3ea-649c2055200a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:25.654185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-907fb804-b004-417c-b3ea-649c2055200a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:25.665808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-907fb804-b004-417c-b3ea-649c2055200a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:25.689202 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-907fb804-b004-417c-b3ea-649c2055200a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.184252 Oct 03 11:02:25.690153 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3215/6119] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 3 11:02:25 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:25.705887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-50c3363d-1f46-4235-b68c-384a395d3e58 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:25.776629 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-50c3363d-1f46-4235-b68c-384a395d3e58 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/9aa36c5b-9a34-4731-8f66-a34b4fabd753" status: 204 len: 0 microversion: 2.1 time: 0.074923 Oct 03 11:02:25.782762 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2905/6120] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:25 2022] DELETE /compute/v2.1/os-server-groups/9aa36c5b-9a34-4731-8f66-a34b4fabd753 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:02:25.795355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-23e630bd-32cd-45fe-95a8-5a54ce890867 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:25.825889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-23e630bd-32cd-45fe-95a8-5a54ce890867 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.043693 Oct 03 11:02:25.832895 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3216/6121] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 11:02:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:25.845532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b23046c1-1226-46f7-b3e1-2d40d24db80f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Action: 'create', calling method: .version_select at 0x7f074e02cee0>, body: {"server_group": {"name": "tempest-server-group-92299094", "policies": ["anti-affinity"]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:25.871026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b23046c1-1226-46f7-b3e1-2d40d24db80f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:25.884055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b23046c1-1226-46f7-b3e1-2d40d24db80f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:25.974300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b23046c1-1226-46f7-b3e1-2d40d24db80f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:25.998648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:26.000737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b23046c1-1226-46f7-b3e1-2d40d24db80f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_groups'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:26.026811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b23046c1-1226-46f7-b3e1-2d40d24db80f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.188344 Oct 03 11:02:26.028822 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2906/6122] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 3 11:02:25 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:26.038601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68097e20-8934-417c-9bdb-f26d493c5721 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:26.068961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:26.077450 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68097e20-8934-417c-9bdb-f26d493c5721 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/6eae8431-a55a-4342-854d-dbd3e515235a" status: 204 len: 0 microversion: 2.1 time: 0.042936 Oct 03 11:02:26.092287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:26.095512 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3217/6123] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:26 2022] DELETE /compute/v2.1/os-server-groups/6eae8431-a55a-4342-854d-dbd3e515235a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:02:26.116370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032473 Oct 03 11:02:26.135286 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2907/6124] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 11:02:26 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:26.337927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-496793214", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "1bd09b6a-659e-4ade-98d6-3afd34bd53c7"}]}, "os:scheduler_hints": {"group": "e94321e8-572b-457c-bc6e-bf440f4d7375"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:26.457812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] validate_networks() for [('1bd09b6a-659e-4ade-98d6-3afd34bd53c7', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:02:27.183614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:27.185625 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002365 Oct 03 11:02:27.186593 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2908/6125] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 3 11:02:27 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 03 11:02:27.196001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:27.197657 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002200 Oct 03 11:02:27.198579 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2909/6126] 10.222.0.27 () {54 vars in 1035 bytes} [Mon Oct 3 11:02:27 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 03 11:02:27.205892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:27.207082 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001571 Oct 03 11:02:27.219347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2910/6127] 10.222.0.27 () {54 vars in 1041 bytes} [Mon Oct 3 11:02:27 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:27.220755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:27.222161 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6561dbc0-69d0-4ce2-9340-0caf5cbe7ac0 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001635 Oct 03 11:02:27.222615 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2911/6128] 10.222.0.27 () {56 vars in 886 bytes} [Mon Oct 3 11:02:27 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 03 11:02:27.926447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:02:27.926978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:02:27.927852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:02:27.928280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:02:27.928693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:02:27.972988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:27.973810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:27.978152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:27.982057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:27.984298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:27.987519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:28.069251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:28.094732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:28.169989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:02:28.172471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:02:28.337106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:28.351849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:28.444464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:28.454131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Getting quotas for user d1ef278bc1b44c119c4f4a651f025d5b and project 7c28c3b0799149a387c311ca1b1f8102. Resources: {'server_group_members'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:28.556024 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7602f74-ab0f-46c9-a27d-2ad2d06f30c2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.215271 Oct 03 11:02:28.572785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc9004a3-eeca-4600-8dad-5235c0ad586d tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:28.579471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc9004a3-eeca-4600-8dad-5235c0ad586d tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:28.584115 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3218/6129] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:02:29.046884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc9004a3-eeca-4600-8dad-5235c0ad586d tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:29.055658 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc9004a3-eeca-4600-8dad-5235c0ad586d tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1212 microversion: 2.1 time: 0.487438 Oct 03 11:02:29.086082 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2912/6130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:28 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1212 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:30.086083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d5b3688-c62a-41f1-8ad5-b8a0558630f3 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:30.087308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d5b3688-c62a-41f1-8ad5-b8a0558630f3 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:30.881748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d5b3688-c62a-41f1-8ad5-b8a0558630f3 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:30.920871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d5b3688-c62a-41f1-8ad5-b8a0558630f3 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1212 microversion: 2.1 time: 0.840731 Oct 03 11:02:30.936817 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3219/6131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:30 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1212 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:31.965825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:31.966888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:31.996093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:32.003358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:32.008352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:32.011901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:32.014917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:32.015788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:32.263090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:32.306080 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-af199f8c-83a4-483d-80b6-cf30929f7dd2 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1270 microversion: 2.1 time: 0.346389 Oct 03 11:02:32.307979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2913/6132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:31 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1270 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:32.698729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d88bf8dc-46c5-4ec0-b7bf-0225e7d7805b tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Action: 'create', calling method: .version_select at 0x7f074e0408b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1093953436", "metadata": {"Type": "work"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:33.339945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:33.340830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:33.358679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:33.359619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:33.360819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:33.365378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:33.367162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:33.369770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:33.564151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d88bf8dc-46c5-4ec0-b7bf-0225e7d7805b tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.477226 Oct 03 11:02:33.565253 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3220/6133] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Oct 3 11:02:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1479 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 11:02:33.580349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6be26a3c-96fb-4009-8151-a7c736a26a08 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074f1e6940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:33.689916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:33.704442 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-25a86cea-d115-48bd-890c-f9b231c33d0f tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1270 microversion: 2.1 time: 0.372294 Oct 03 11:02:33.722254 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2914/6134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:33 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1270 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:33.768025 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6be26a3c-96fb-4009-8151-a7c736a26a08 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 200 len: 353 microversion: 2.1 time: 0.191663 Oct 03 11:02:33.769560 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3221/6135] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:33 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:34.739271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:34.740260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:34.788364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-14ad9b16-7b8e-482e-8394-19ab72e57036 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074f661280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:34.814344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:34.814856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:34.815302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:34.816037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:34.816540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:34.841135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:34.953665 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-14ad9b16-7b8e-482e-8394-19ab72e57036 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 200 len: 353 microversion: 2.1 time: 0.170354 Oct 03 11:02:34.954942 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3222/6136] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:34 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:35.970127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e116c2e-a9ea-438c-9859-66a42f0f02ca tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074e1a4280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:36.081888 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e116c2e-a9ea-438c-9859-66a42f0f02ca tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 200 len: 354 microversion: 2.1 time: 0.116580 Oct 03 11:02:36.084428 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3223/6137] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:35 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:36.103420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc3e99e0-fdd8-4db1-8bad-09e97a12fa5b tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074f1b59d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:36.195995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:36.220350 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc3e99e0-fdd8-4db1-8bad-09e97a12fa5b tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 200 len: 354 microversion: 2.1 time: 0.124757 Oct 03 11:02:36.220959 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3224/6138] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:36 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:36.222083 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c99d16c5-9b8f-417c-887d-7f9aef566cd1 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1312 microversion: 2.1 time: 1.483212 Oct 03 11:02:36.233812 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2915/6139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:34 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1312 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:36.247273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6cbfeba8-12bb-4a7d-b7b6-dd2560788bde tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074fdcd940>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:36.346488 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6cbfeba8-12bb-4a7d-b7b6-dd2560788bde tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 202 len: 0 microversion: 2.1 time: 0.106349 Oct 03 11:02:36.347260 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3225/6140] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 11:02:36 2022] DELETE /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:02:36.356058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7fbcfb6-228e-49af-ad8c-00a321231f90 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074e1eb0d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:36.458449 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7fbcfb6-228e-49af-ad8c-00a321231f90 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 200 len: 353 microversion: 2.1 time: 0.106599 Oct 03 11:02:36.462597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2916/6141] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:36 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:37.255159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:37.255827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:37.278925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:37.279451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:37.280075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:37.281680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:37.282816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:37.283416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:37.331487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:37.477648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-784f2fd4-048b-4f4c-8a7e-b8e701b01ebf tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074e221430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:37.648165 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-784f2fd4-048b-4f4c-8a7e-b8e701b01ebf tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 200 len: 353 microversion: 2.1 time: 0.177063 Oct 03 11:02:37.649042 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2917/6142] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:37 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:38.019761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:38.340832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:38.348061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:38.357499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:38.358450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:38.359183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:38.361192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:38.362373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:38.363195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:38.410489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:38.451586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6616e189-5396-4cc2-8739-5b548a4035be tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1312 microversion: 2.1 time: 1.200085 Oct 03 11:02:38.477257 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3226/6143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:37 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1312 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:38.498765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1b864523-1858-4e0e-bd68-00cd170da82b req-f7736229-5965-4f4f-b345-7e18f4caecbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a", "tag": "cc3297cb-73b8-4db7-91c8-651e9f223c6b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:38.502588 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58abb9e1-972f-45cd-a553-534613a9e769 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394/action" status: 200 len: 24562 microversion: 2.1 time: 0.182156 Oct 03 11:02:38.512923 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2918/6144] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:02:38 2022] POST /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394/action => generated 24562 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:02:38.516429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b864523-1858-4e0e-bd68-00cd170da82b req-f7736229-5965-4f4f-b345-7e18f4caecbe service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:38.517111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b864523-1858-4e0e-bd68-00cd170da82b req-f7736229-5965-4f4f-b345-7e18f4caecbe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:38.517702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1b864523-1858-4e0e-bd68-00cd170da82b req-f7736229-5965-4f4f-b345-7e18f4caecbe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:38.532183 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1b864523-1858-4e0e-bd68-00cd170da82b req-f7736229-5965-4f4f-b345-7e18f4caecbe service nova] Creating event network-changed:cc3297cb-73b8-4db7-91c8-651e9f223c6b for instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a on n-h2-858383-3 Oct 03 11:02:38.540868 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1b864523-1858-4e0e-bd68-00cd170da82b req-f7736229-5965-4f4f-b345-7e18f4caecbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055280 Oct 03 11:02:38.541673 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3227/6145] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:38.668622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-31de4b87-a900-4b21-9f89-1e687fa467a0 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074e1eb5e0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:38.752075 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-31de4b87-a900-4b21-9f89-1e687fa467a0 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 200 len: 353 microversion: 2.1 time: 0.092299 Oct 03 11:02:38.753577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2919/6146] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:38 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:39.495675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:39.496456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:39.522941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:39.524059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:39.525500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:39.526609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:39.527440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:39.528212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:39.766996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f3000ca-83ca-4ee8-a817-d81b7058f399 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Calling method '.version_select at 0x7f074e076160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:39.789622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=26 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:39.868885 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9f3000ca-83ca-4ee8-a817-d81b7058f399 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] HTTP exception thrown: Volume 18160bb2-4e86-4f32-8a9b-6a1392168c22 could not be found. Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f3000ca-83ca-4ee8-a817-d81b7058f399 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Request method failure captured: Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 HTTP/1.1 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsFHkDRYuzToXyixseVkfXFYz5jUIa4eA4Ju12ab4lEQ68IBeOJ8eux3q6FELSLfptq-L-oI_ZxGJY2CuHb7wdke7Msv2_U1NbISVjpzr_tGndLwlb-JSCbVhG7sGirBuZtlpYePfIE8xhtcoR2y-hJL-Qk9gj_XSQUP2le32EnaVhI Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 78278b3f85ba44fa80ef5b9971ff47b6 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-VolumesGetTestJSON-706272734 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/78278b3f85ba44fa80ef5b9971ff47b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_78278b3f85ba44fa80ef5b9971ff47b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/78278b3f85ba44fa80ef5b9971ff47b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/78278b3f85ba44fa80ef5b9971ff47b6"}]}] Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-VolumesGetTestJSON-706272734 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 78278b3f85ba44fa80ef5b9971ff47b6 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-VolumesGetTestJSON-706272734 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-VolumesGetTestJSON-706272734-project Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 01d0ae07897e47c4a09079e1e9921b69 Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-VolumesGetTestJSON-706272734-project Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: method: Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: exception: Volume 18160bb2-4e86-4f32-8a9b-6a1392168c22 could not be found. Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '18160bb2-4e86-4f32-8a9b-6a1392168c22'} Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18160bb2-4e86-4f32-8a9b-6a1392168c22 could not be found. (HTTP 404) (Request-ID: req-aa92b603-9b56-469b-bf77-2c8d595eff4b) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 11:02:39.871297 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18160bb2-4e86-4f32-8a9b-6a1392168c22 could not be found. Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18160bb2-4e86-4f32-8a9b-6a1392168c22 could not be found. Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18160bb2-4e86-4f32-8a9b-6a1392168c22 could not be found. Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f3000ca-83ca-4ee8-a817-d81b7058f399 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] Returning 404 to user: Volume 18160bb2-4e86-4f32-8a9b-6a1392168c22 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f3000ca-83ca-4ee8-a817-d81b7058f399 tempest-VolumesGetTestJSON-706272734 tempest-VolumesGetTestJSON-706272734-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22" status: 404 len: 109 microversion: 2.1 time: 0.110142 Oct 03 11:02:39.875353 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2920/6147] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:39 2022] GET /compute/v2.1/os-volumes/18160bb2-4e86-4f32-8a9b-6a1392168c22 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:02:40.090915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:40.109876 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38733bb5-aa28-469b-b522-f0bec1aa4587 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1312 microversion: 2.1 time: 0.617919 Oct 03 11:02:40.111974 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3228/6148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:39 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1312 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:41.135979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:41.137373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:41.162517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:41.164723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:41.165655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:41.170914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:41.171651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:41.172328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:41.668826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:41.683255 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0072d9fe-a857-464c-88d7-db58d11dd858 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1312 microversion: 2.1 time: 0.551381 Oct 03 11:02:41.685698 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2921/6149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:41 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1312 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:42.714670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:42.716008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:42.721164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=32 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:42.740437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:42.745684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:42.748193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:42.756947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:42.757895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:42.758667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:43.255174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:43.277141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75fc83b1-7f0c-4b7b-9ae4-983375e1f752 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1312 microversion: 2.1 time: 0.562934 Oct 03 11:02:43.278427 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3229/6150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:42 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:43.452512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-920908500", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:43.539956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] validate_networks() for None {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:02:44.067485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:02:44.068870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:02:44.069602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:02:44.070249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:02:44.071735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:02:44.115468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:44.118538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:44.120330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:44.126094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:44.127864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:44.131547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:44.223548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Getting quotas for project 504899de1f4b4f86a5d829a368b3073d. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:02:44.250040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Getting quotas for user 3bdc2305002d4c67b50a80fd01ed5d66 and project 504899de1f4b4f86a5d829a368b3073d. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:02:44.283801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:02:44.294359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:02:44.311414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:44.313449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:44.339781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:44.346903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:44.347595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:44.349556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:44.353998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:44.354762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:44.499812 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff1b56d6-3914-4db5-9a1f-d55a1978cf32 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051757 Oct 03 11:02:44.503894 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2922/6151] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:02:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:02:44.521147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-80e311c6-08d1-46ee-a2c4-5de583f4129b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:44.527867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-80e311c6-08d1-46ee-a2c4-5de583f4129b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:44.715225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-80e311c6-08d1-46ee-a2c4-5de583f4129b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:44.730870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-80e311c6-08d1-46ee-a2c4-5de583f4129b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1214 microversion: 2.1 time: 0.216863 Oct 03 11:02:44.753243 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2923/6152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:44 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:44.918088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:44.932709 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f98eb086-c11e-4618-af2f-86951b81b3ee tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1312 microversion: 2.1 time: 0.624570 Oct 03 11:02:44.934813 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3230/6153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:44 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1312 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:45.761262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:45.761974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:45.787015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:45.787445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:45.787895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:45.788627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:45.789118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:45.789549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:45.799356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3805acec-1cb1-4ebf-852b-b55c4bd86a71 req-a3e820b3-9350-49a5-a1c9-a54906c926b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a", "name": "network-vif-plugged", "status": "completed", "tag": "cc3297cb-73b8-4db7-91c8-651e9f223c6b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:45.820807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=54 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:45.829811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3805acec-1cb1-4ebf-852b-b55c4bd86a71 req-a3e820b3-9350-49a5-a1c9-a54906c926b6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:45.830851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3805acec-1cb1-4ebf-852b-b55c4bd86a71 req-a3e820b3-9350-49a5-a1c9-a54906c926b6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:45.830851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3805acec-1cb1-4ebf-852b-b55c4bd86a71 req-a3e820b3-9350-49a5-a1c9-a54906c926b6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:45.889673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3805acec-1cb1-4ebf-852b-b55c4bd86a71 req-a3e820b3-9350-49a5-a1c9-a54906c926b6 service nova] Creating event network-vif-plugged:cc3297cb-73b8-4db7-91c8-651e9f223c6b for instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a on n-h2-858383-3 Oct 03 11:02:45.925909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3805acec-1cb1-4ebf-852b-b55c4bd86a71 req-a3e820b3-9350-49a5-a1c9-a54906c926b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128982 Oct 03 11:02:45.933688 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3231/6154] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:45.958295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:45.959150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:45.981328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:45.983051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:45.984617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:45.987836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:45.988495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:45.989170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:46.186540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:46.195844 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da13218e-673e-49f4-b868-9a7cfc1ca972 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1218 microversion: 2.1 time: 0.439143 Oct 03 11:02:46.215512 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2924/6155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:45 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1218 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:46.725477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:46.735997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4713f3f5-b528-4a37-ad58-0c5e0098e49c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1312 microversion: 2.1 time: 0.782180 Oct 03 11:02:46.738081 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3232/6156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:45 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1312 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:02:47.228663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:47.231177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:47.248166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:47.248699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:47.249372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:47.250097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:47.250563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:47.251152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:47.363790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:47.381297 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5617af3-d7d7-4d3f-b346-2b3cf4753d8a tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1272 microversion: 2.1 time: 0.161996 Oct 03 11:02:47.402205 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2925/6157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:47 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:47.429625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd5fa6e7-086d-4372-80c9-675c62431006 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074e005e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:47.496654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd5fa6e7-086d-4372-80c9-675c62431006 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6bf4537b-4a94-4e35-a8b6-27ba79c02d49" status: 200 len: 351 microversion: 2.1 time: 0.070278 Oct 03 11:02:47.497518 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3233/6158] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:47 2022] GET /compute/v2.1/os-volumes/6bf4537b-4a94-4e35-a8b6-27ba79c02d49 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:47.760521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:47.761445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:47.777383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:47.778236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:47.779098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:47.780015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:47.784035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:47.785210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:48.410393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:48.411153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:48.421448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:48.425127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:48.426908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:48.427826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:48.428704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:48.430472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:48.445164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:48.462409 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9c8d3d93-c5d0-4b1a-a6b5-daf8c7e40a96 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1496 microversion: 2.1 time: 0.706661 Oct 03 11:02:48.463104 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2926/6159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:47 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1496 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:48.488419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c5fe6c99-da82-4fa7-8649-5e088bf71573 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:48.528720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.server_groups [None req-c5fe6c99-da82-4fa7-8649-5e088bf71573 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Querying cell 5d809412-179d-487a-a3ff-24b9afa0366c(cell1) for 1 instances {{(pid=122270) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 11:02:48.529505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fe6c99-da82-4fa7-8649-5e088bf71573 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:48.529994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fe6c99-da82-4fa7-8649-5e088bf71573 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:48.530432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5fe6c99-da82-4fa7-8649-5e088bf71573 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:48.603169 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c5fe6c99-da82-4fa7-8649-5e088bf71573 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/e94321e8-572b-457c-bc6e-bf440f4d7375" status: 200 len: 221 microversion: 2.1 time: 0.118377 Oct 03 11:02:48.603778 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2927/6160] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 11:02:48 2022] GET /compute/v2.1/os-server-groups/e94321e8-572b-457c-bc6e-bf440f4d7375 => generated 221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:48.615868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:48.616384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:48.653878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:48.655257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:48.657117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:48.658014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:48.658651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:48.659326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:48.701398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:02:48.906972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8ce3d1d0-bee1-4a3b-abfa-8a3369bbee90 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 204 len: 0 microversion: 2.1 time: 0.295263 Oct 03 11:02:48.911829 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2928/6161] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:02:48 2022] DELETE /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:02:48.926921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:48.946505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:48.964660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:48.965699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:48.966341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:48.967812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:48.969320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:48.975575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:49.051872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:49.072684 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-010c12b1-306f-4577-927e-aec907513b6b tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 0.666349 Oct 03 11:02:49.073340 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3234/6162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:48 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:02:50.031350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:50.040193 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3dc6a499-c101-4ce0-ae81-0afce950bd5e tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1502 microversion: 2.1 time: 1.126326 Oct 03 11:02:50.045192 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2929/6163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:48 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1502 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:50.098954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:50.100908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:50.116685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:50.117672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:50.120609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:50.122190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:50.123554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:50.125479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:50.321417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3c3987d9-fb4c-423f-9a41-fd1639e9b43c tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074e271280>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:50.436135 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3c3987d9-fb4c-423f-9a41-fd1639e9b43c tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1fb93c21-0742-48ac-b117-414be566d581" status: 200 len: 351 microversion: 2.1 time: 0.118690 Oct 03 11:02:50.436718 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2930/6164] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:50 2022] GET /compute/v2.1/os-volumes/1fb93c21-0742-48ac-b117-414be566d581 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:51.053736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:51.065299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:51.067863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:51.071580 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ae699f3-a7d0-474e-9b20-825a6646d19c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 0.976969 Oct 03 11:02:51.074130 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3235/6165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:50 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:51.092597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:51.093419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:51.094251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:51.095162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:51.095782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:51.096372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:51.541468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:51.556195 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20760cbb-22f7-4d62-b0b1-ebc8c09f51dd tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1502 microversion: 2.1 time: 0.496508 Oct 03 11:02:51.566270 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2931/6166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:51 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1502 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:52.008514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-16b65b2b-0f41-4966-a40b-afdd436bfbbd req-90a47107-ae0e-4e2b-b557-5038729a234c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f147cda-9861-4059-a2c6-144d26aa5cd2", "tag": "bfcc6658-4ee4-4b18-a78d-c10a3bfe9389"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:52.075585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-16b65b2b-0f41-4966-a40b-afdd436bfbbd req-90a47107-ae0e-4e2b-b557-5038729a234c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:52.076835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-16b65b2b-0f41-4966-a40b-afdd436bfbbd req-90a47107-ae0e-4e2b-b557-5038729a234c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:52.077832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-16b65b2b-0f41-4966-a40b-afdd436bfbbd req-90a47107-ae0e-4e2b-b557-5038729a234c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:52.103100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:52.104218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:52.132192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:52.133055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:52.146806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:52.152402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:52.153356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:52.154127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:52.154330 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-16b65b2b-0f41-4966-a40b-afdd436bfbbd req-90a47107-ae0e-4e2b-b557-5038729a234c service nova] Creating event network-changed:bfcc6658-4ee4-4b18-a78d-c10a3bfe9389 for instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 on n-h1-858383-3 Oct 03 11:02:52.167250 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-16b65b2b-0f41-4966-a40b-afdd436bfbbd req-90a47107-ae0e-4e2b-b557-5038729a234c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172317 Oct 03 11:02:52.171269 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3236/6167] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:52.603682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:52.627010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:52.690725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:52.709775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:52.710515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:52.713096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:52.717681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:52.722274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:52.953463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:52.962589 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fcc314d0-7825-4473-a63f-8646101bd973 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 0.868249 Oct 03 11:02:52.984947 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2932/6168] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:52 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:53.051036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ef278bc1b44c119c4f4a651f025d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c28c3b0799149a387c311ca1b1f8102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:53.066661 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-35b20e08-be4a-4a74-99cd-29d151ab5a0c tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 200 len: 1297 microversion: 2.1 time: 0.478330 Oct 03 11:02:53.069709 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3237/6169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:52 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 1297 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:53.286220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e72c688-7541-4ead-98ca-5283c6f98e98 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074dfa9ca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:53.404800 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e72c688-7541-4ead-98ca-5283c6f98e98 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4fb5a5f4-9942-44dc-b5e2-a3a245dc0d54" status: 200 len: 350 microversion: 2.1 time: 0.122691 Oct 03 11:02:53.412819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2933/6170] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Oct 3 11:02:53 2022] GET /compute/v2.1/os-volumes/4fb5a5f4-9942-44dc-b5e2-a3a245dc0d54 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:53.420392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-853675f7-80d6-44ba-b02a-f4e65fe4d94e tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f0757510280>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:53.522423 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-853675f7-80d6-44ba-b02a-f4e65fe4d94e tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.105710 Oct 03 11:02:53.523407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3238/6171] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 3 11:02:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:53.544061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c8dd908-15e2-426a-a61e-7dbfd0fd5f8d tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074e1eb160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:53.707781 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c8dd908-15e2-426a-a61e-7dbfd0fd5f8d tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.170079 Oct 03 11:02:53.718815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2934/6172] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Oct 3 11:02:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:53.729062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-514a09b6-21c9-4ef9-a9c0-53292760b704 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074f210ca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:53.901498 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-514a09b6-21c9-4ef9-a9c0-53292760b704 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.180603 Oct 03 11:02:53.902461 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3239/6173] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Oct 3 11:02:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:02:53.918442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-61166a01-2b08-420b-af28-795bf597461b tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074e1eb700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:53.991455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:53.992677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:53.999769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.000588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.001293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.002214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.003035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.003716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.054235 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-61166a01-2b08-420b-af28-795bf597461b tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.141027 Oct 03 11:02:54.055135 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2935/6174] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Oct 3 11:02:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:54.073043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2078938c-06f8-4577-b44b-8eac8e1ca8ef tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074e076160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.180093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:54.200244 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2078938c-06f8-4577-b44b-8eac8e1ca8ef tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.132382 Oct 03 11:02:54.203278 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2936/6175] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:54.209627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.210280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:54.234447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.234952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.235397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.236125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.236587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.237045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.270276 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] HTTP exception thrown: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Request method failure captured: Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a HTTP/1.1 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsE_AOiSgaxcmwKAobLPFyaOt-xPZGZb2fWr1woTPtlijaV4hiDuW8Epki1rTybHjZ9zkd7Qv_A6aUH-AswsIF29T_jWqjdkSNA2mmNgzn5poqYOPR1xxUA8M-RYqBoQpVZ4ZXdJF2k3xcri3rP7VNUR1A9haRYl9zQmdyOexXDZbl4 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}] Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d1ef278bc1b44c119c4f4a651f025d5b Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a'} Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.272508 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.277985 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.277985 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.277985 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.277985 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:54.277985 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:54.277985 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.277985 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.280540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Returning 404 to user: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:54.282130 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-770d90e8-c494-4bfb-b449-e0fbc7a08a8a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 404 len: 111 microversion: 2.1 time: 0.077616 Oct 03 11:02:54.283288 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2937/6176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:02:54.295948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-957d6bc2-93fd-499e-9e6d-f36eea17b48f tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074e1ebb80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.341353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:54.376021 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8872910-5a41-4802-a7f5-2e7cc04a2787 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 0.391490 Oct 03 11:02:54.376974 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3240/6177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:53 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:02:54.382317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d2472aa4-8545-465e-925c-59729ace7210 req-797fa1d3-f934-46d4-bbaa-e0a761d16772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a", "name": "network-vif-deleted", "tag": "cc3297cb-73b8-4db7-91c8-651e9f223c6b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:54.392838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d2472aa4-8545-465e-925c-59729ace7210 req-797fa1d3-f934-46d4-bbaa-e0a761d16772 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.393611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d2472aa4-8545-465e-925c-59729ace7210 req-797fa1d3-f934-46d4-bbaa-e0a761d16772 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.394213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d2472aa4-8545-465e-925c-59729ace7210 req-797fa1d3-f934-46d4-bbaa-e0a761d16772 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.406704 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d2472aa4-8545-465e-925c-59729ace7210 req-797fa1d3-f934-46d4-bbaa-e0a761d16772 service nova] Creating event network-vif-deleted:cc3297cb-73b8-4db7-91c8-651e9f223c6b for instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a on n-h2-858383-3 Oct 03 11:02:54.413680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d2472aa4-8545-465e-925c-59729ace7210 req-797fa1d3-f934-46d4-bbaa-e0a761d16772 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035288 Oct 03 11:02:54.415035 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3241/6178] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:54.420692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e15a401d-6b95-4874-860d-a3e14144cb40 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.449976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.server_groups [None req-e15a401d-6b95-4874-860d-a3e14144cb40 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Querying cell 5d809412-179d-487a-a3ff-24b9afa0366c(cell1) for 1 instances {{(pid=122269) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 11:02:54.450709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e15a401d-6b95-4874-860d-a3e14144cb40 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.451719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e15a401d-6b95-4874-860d-a3e14144cb40 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.452181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e15a401d-6b95-4874-860d-a3e14144cb40 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.466552 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e15a401d-6b95-4874-860d-a3e14144cb40 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.049837 Oct 03 11:02:54.467170 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3242/6179] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:54.480702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27ab77fc-2770-4221-9b60-0fb4746b94e4 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.502852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.server_groups [None req-27ab77fc-2770-4221-9b60-0fb4746b94e4 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Querying cell 5d809412-179d-487a-a3ff-24b9afa0366c(cell1) for 1 instances {{(pid=122269) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 11:02:54.503099 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-957d6bc2-93fd-499e-9e6d-f36eea17b48f tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.218315 Oct 03 11:02:54.503962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2938/6180] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:54.505228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27ab77fc-2770-4221-9b60-0fb4746b94e4 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.506166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27ab77fc-2770-4221-9b60-0fb4746b94e4 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.506996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27ab77fc-2770-4221-9b60-0fb4746b94e4 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.522363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-998db68f-e1e9-4192-b488-dbfe3219fbe7 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f075736bca0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.526393 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27ab77fc-2770-4221-9b60-0fb4746b94e4 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/e94321e8-572b-457c-bc6e-bf440f4d7375" status: 200 len: 183 microversion: 2.1 time: 0.049516 Oct 03 11:02:54.533595 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3243/6181] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/os-server-groups/e94321e8-572b-457c-bc6e-bf440f4d7375 => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:54.542879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.544468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:54.558900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.559408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.559860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.564897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.565467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.565920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.609795 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] HTTP exception thrown: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Request method failure captured: Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a HTTP/1.1 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsE_AOiSgaxcmwKAobLPFyaOt-xPZGZb2fWr1woTPtlijaV4hiDuW8Epki1rTybHjZ9zkd7Qv_A6aUH-AswsIF29T_jWqjdkSNA2mmNgzn5poqYOPR1xxUA8M-RYqBoQpVZ4ZXdJF2k3xcri3rP7VNUR1A9haRYl9zQmdyOexXDZbl4 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}] Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d1ef278bc1b44c119c4f4a651f025d5b Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a'} Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:02:54.613073 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Returning 404 to user: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd3ff464-a569-462f-b8ac-52bd717bae1a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 404 len: 111 microversion: 2.1 time: 0.080973 Oct 03 11:02:54.618168 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3244/6182] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:02:54 2022] DELETE /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:02:54.636818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.639592 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-998db68f-e1e9-4192-b488-dbfe3219fbe7 tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.122643 Oct 03 11:02:54.639804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] [instance: 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:54.644937 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2939/6183] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:02:54.654459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ece27fc9-7235-4f75-83b5-42571310897d tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] Calling method '.version_select at 0x7f074e1e03a0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.665903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.666953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.667613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.668879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:54.669505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:54.670111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:54.713643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] HTTP exception thrown: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Request method failure captured: Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a HTTP/1.1 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsE_AOiSgaxcmwKAobLPFyaOt-xPZGZb2fWr1woTPtlijaV4hiDuW8Epki1rTybHjZ9zkd7Qv_A6aUH-AswsIF29T_jWqjdkSNA2mmNgzn5poqYOPR1xxUA8M-RYqBoQpVZ4ZXdJF2k3xcri3rP7VNUR1A9haRYl9zQmdyOexXDZbl4 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}] Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d1ef278bc1b44c119c4f4a651f025d5b Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a'} Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.717144 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.722671 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.722671 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.722671 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.722671 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:54.722671 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:54.722671 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. Oct 03 11:02:54.722671 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.723134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:54.729132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Returning 404 to user: Instance 7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:54.732007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fb99ed05-8848-47f8-ab02-eedd7ad28390 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a" status: 404 len: 111 microversion: 2.1 time: 0.104163 Oct 03 11:02:54.740015 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3245/6184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/servers/7be5c4ee-a730-4a18-aabf-bdf79d6b0b7a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:02:54.752283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9de471b-094f-463f-b503-3fef8db0aa27 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.778825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b9de471b-094f-463f-b503-3fef8db0aa27 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] HTTP exception thrown: Instance group 6eae8431-a55a-4342-854d-dbd3e515235a could not be found. Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9de471b-094f-463f-b503-3fef8db0aa27 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Request method failure captured: Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-server-groups/6eae8431-a55a-4342-854d-dbd3e515235a HTTP/1.1 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsE_AOiSgaxcmwKAobLPFyaOt-xPZGZb2fWr1woTPtlijaV4hiDuW8Epki1rTybHjZ9zkd7Qv_A6aUH-AswsIF29T_jWqjdkSNA2mmNgzn5poqYOPR1xxUA8M-RYqBoQpVZ4ZXdJF2k3xcri3rP7VNUR1A9haRYl9zQmdyOexXDZbl4 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}] Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d1ef278bc1b44c119c4f4a651f025d5b Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance group 6eae8431-a55a-4342-854d-dbd3e515235a could not be found. Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '6eae8431-a55a-4342-854d-dbd3e515235a'} Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6eae8431-a55a-4342-854d-dbd3e515235a could not be found. Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6eae8431-a55a-4342-854d-dbd3e515235a could not be found. Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.782699 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6eae8431-a55a-4342-854d-dbd3e515235a could not be found. Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b9de471b-094f-463f-b503-3fef8db0aa27 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Returning 404 to user: Instance group 6eae8431-a55a-4342-854d-dbd3e515235a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:54.786838 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b9de471b-094f-463f-b503-3fef8db0aa27 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/6eae8431-a55a-4342-854d-dbd3e515235a" status: 404 len: 117 microversion: 2.1 time: 0.043932 Oct 03 11:02:54.793095 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3246/6185] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:54 2022] DELETE /compute/v2.1/os-server-groups/6eae8431-a55a-4342-854d-dbd3e515235a => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:02:54.800894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f8c082f-13d0-4941-a1f9-22844c1c772a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.801609 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ece27fc9-7235-4f75-83b5-42571310897d tempest-VolumesTestJSON-809982823 tempest-VolumesTestJSON-809982823-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.151265 Oct 03 11:02:54.804596 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2940/6186] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 11:02:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:54.832626 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6f8c082f-13d0-4941-a1f9-22844c1c772a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] HTTP exception thrown: Instance group 9aa36c5b-9a34-4731-8f66-a34b4fabd753 could not be found. Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f8c082f-13d0-4941-a1f9-22844c1c772a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Request method failure captured: Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-server-groups/9aa36c5b-9a34-4731-8f66-a34b4fabd753 HTTP/1.1 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsE_AOiSgaxcmwKAobLPFyaOt-xPZGZb2fWr1woTPtlijaV4hiDuW8Epki1rTybHjZ9zkd7Qv_A6aUH-AswsIF29T_jWqjdkSNA2mmNgzn5poqYOPR1xxUA8M-RYqBoQpVZ4ZXdJF2k3xcri3rP7VNUR1A9haRYl9zQmdyOexXDZbl4 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}] Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d1ef278bc1b44c119c4f4a651f025d5b Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance group 9aa36c5b-9a34-4731-8f66-a34b4fabd753 could not be found. Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '9aa36c5b-9a34-4731-8f66-a34b4fabd753'} Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9aa36c5b-9a34-4731-8f66-a34b4fabd753 could not be found. Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9aa36c5b-9a34-4731-8f66-a34b4fabd753 could not be found. Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.836009 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.839994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.839994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.839994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:54.839994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:54.839994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9aa36c5b-9a34-4731-8f66-a34b4fabd753 could not be found. Oct 03 11:02:54.839994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.841679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f8c082f-13d0-4941-a1f9-22844c1c772a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Returning 404 to user: Instance group 9aa36c5b-9a34-4731-8f66-a34b4fabd753 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:54.842872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f8c082f-13d0-4941-a1f9-22844c1c772a tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/9aa36c5b-9a34-4731-8f66-a34b4fabd753" status: 404 len: 117 microversion: 2.1 time: 0.046843 Oct 03 11:02:54.844098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3247/6187] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:54 2022] DELETE /compute/v2.1/os-server-groups/9aa36c5b-9a34-4731-8f66-a34b4fabd753 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:02:54.857347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94e0d0ab-d939-47a0-82e7-6d479ebb5f01 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.863966 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-94e0d0ab-d939-47a0-82e7-6d479ebb5f01 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] HTTP exception thrown: Instance group 3fec7411-32b3-41df-ba67-9d4643addce9 could not be found. Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94e0d0ab-d939-47a0-82e7-6d479ebb5f01 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Request method failure captured: Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/os-server-groups/3fec7411-32b3-41df-ba67-9d4643addce9 HTTP/1.1 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsE_AOiSgaxcmwKAobLPFyaOt-xPZGZb2fWr1woTPtlijaV4hiDuW8Epki1rTybHjZ9zkd7Qv_A6aUH-AswsIF29T_jWqjdkSNA2mmNgzn5poqYOPR1xxUA8M-RYqBoQpVZ4ZXdJF2k3xcri3rP7VNUR1A9haRYl9zQmdyOexXDZbl4 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}] Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: d1ef278bc1b44c119c4f4a651f025d5b Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance group 3fec7411-32b3-41df-ba67-9d4643addce9 could not be found. Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '3fec7411-32b3-41df-ba67-9d4643addce9'} Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3fec7411-32b3-41df-ba67-9d4643addce9 could not be found. Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3fec7411-32b3-41df-ba67-9d4643addce9 could not be found. Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.866610 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.870988 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.870988 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.870988 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:54.870988 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:54.870988 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3fec7411-32b3-41df-ba67-9d4643addce9 could not be found. Oct 03 11:02:54.870988 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.870988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94e0d0ab-d939-47a0-82e7-6d479ebb5f01 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Returning 404 to user: Instance group 3fec7411-32b3-41df-ba67-9d4643addce9 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:54.872978 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94e0d0ab-d939-47a0-82e7-6d479ebb5f01 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/3fec7411-32b3-41df-ba67-9d4643addce9" status: 404 len: 117 microversion: 2.1 time: 0.024629 Oct 03 11:02:54.873694 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2941/6188] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:54 2022] DELETE /compute/v2.1/os-server-groups/3fec7411-32b3-41df-ba67-9d4643addce9 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:02:54.882568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de8ef172-392d-4436-9134-e3d5d5cf19a6 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.891350 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-de8ef172-392d-4436-9134-e3d5d5cf19a6 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] HTTP exception thrown: Instance group bad52cdc-0918-4519-bcff-4e585e0c7f12 could not be found. Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de8ef172-392d-4436-9134-e3d5d5cf19a6 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Request method failure captured: Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/os-server-groups/bad52cdc-0918-4519-bcff-4e585e0c7f12 HTTP/1.1 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsE_AOiSgaxcmwKAobLPFyaOt-xPZGZb2fWr1woTPtlijaV4hiDuW8Epki1rTybHjZ9zkd7Qv_A6aUH-AswsIF29T_jWqjdkSNA2mmNgzn5poqYOPR1xxUA8M-RYqBoQpVZ4ZXdJF2k3xcri3rP7VNUR1A9haRYl9zQmdyOexXDZbl4 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7c28c3b0799149a387c311ca1b1f8102"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7c28c3b0799149a387c311ca1b1f8102"}]}] Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 7c28c3b0799149a387c311ca1b1f8102 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerGroupTestJSON-432708239 Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d1ef278bc1b44c119c4f4a651f025d5b Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerGroupTestJSON-432708239-project Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance group bad52cdc-0918-4519-bcff-4e585e0c7f12 could not be found. Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'bad52cdc-0918-4519-bcff-4e585e0c7f12'} Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bad52cdc-0918-4519-bcff-4e585e0c7f12 could not be found. Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bad52cdc-0918-4519-bcff-4e585e0c7f12 could not be found. Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.893313 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:02:54.899264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:02:54.899264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:02:54.899264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:02:54.899264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:02:54.899264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bad52cdc-0918-4519-bcff-4e585e0c7f12 could not be found. Oct 03 11:02:54.899264 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:02:54.902208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de8ef172-392d-4436-9134-e3d5d5cf19a6 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Returning 404 to user: Instance group bad52cdc-0918-4519-bcff-4e585e0c7f12 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:02:54.902208 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-de8ef172-392d-4436-9134-e3d5d5cf19a6 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/bad52cdc-0918-4519-bcff-4e585e0c7f12" status: 404 len: 117 microversion: 2.1 time: 0.023049 Oct 03 11:02:54.902437 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3248/6189] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:54 2022] DELETE /compute/v2.1/os-server-groups/bad52cdc-0918-4519-bcff-4e585e0c7f12 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:02:54.910273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-62628adf-3395-4fe1-85f7-61bc1ca73248 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:54.983999 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-62628adf-3395-4fe1-85f7-61bc1ca73248 tempest-ServerGroupTestJSON-432708239 tempest-ServerGroupTestJSON-432708239-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/e94321e8-572b-457c-bc6e-bf440f4d7375" status: 204 len: 0 microversion: 2.1 time: 0.077577 Oct 03 11:02:54.987507 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2942/6190] 10.222.0.27 () {58 vars in 1266 bytes} [Mon Oct 3 11:02:54 2022] DELETE /compute/v2.1/os-server-groups/e94321e8-572b-457c-bc6e-bf440f4d7375 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:02:55.399656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:55.400448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:55.415443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:55.416796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:55.421623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:55.423282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:55.424505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:55.425702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:55.817108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:55.825357 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e37a31a-8b5a-4fa1-b773-8ce6bc02adf7 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 0.429849 Oct 03 11:02:55.829709 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3249/6191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:55 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:56.853343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:56.855014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:56.868702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:56.875503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:56.876112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:56.876554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:56.885750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:56.886288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:56.888788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:57.419955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:57.444474 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63a417a8-474b-4591-a967-91433a4bf5bd tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 0.596545 Oct 03 11:02:57.445120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2943/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:56 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:58.482918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:58.484404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:58.488927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:02:58.504237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:58.504755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:58.505235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:58.506558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:58.511449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:58.511938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:58.851430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:02:58.882437 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d9be9625-17e8-49fe-bf8e-7cb68f24c22d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 0.396457 Oct 03 11:02:58.883234 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3250/6193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:58 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:02:59.392115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4779194e-a665-4491-8565-9a54955f545c req-3fb17d2c-f004-4db5-be56-6cc94c577a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f147cda-9861-4059-a2c6-144d26aa5cd2", "name": "network-vif-plugged", "status": "completed", "tag": "bfcc6658-4ee4-4b18-a78d-c10a3bfe9389"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:02:59.412518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4779194e-a665-4491-8565-9a54955f545c req-3fb17d2c-f004-4db5-be56-6cc94c577a86 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:59.419184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4779194e-a665-4491-8565-9a54955f545c req-3fb17d2c-f004-4db5-be56-6cc94c577a86 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:59.419651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4779194e-a665-4491-8565-9a54955f545c req-3fb17d2c-f004-4db5-be56-6cc94c577a86 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:59.468950 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4779194e-a665-4491-8565-9a54955f545c req-3fb17d2c-f004-4db5-be56-6cc94c577a86 service nova] Creating event network-vif-plugged:bfcc6658-4ee4-4b18-a78d-c10a3bfe9389 for instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 on n-h1-858383-3 Oct 03 11:02:59.479092 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4779194e-a665-4491-8565-9a54955f545c req-3fb17d2c-f004-4db5-be56-6cc94c577a86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090443 Oct 03 11:02:59.488597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2944/6194] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:02:59.919823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:02:59.920692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:02:59.957468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:59.958243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:59.959339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:02:59.960225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:02:59.960672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:02:59.964165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:01.333261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:01.350056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-704272b4-d372-4ac7-81a0-c085a965558d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 1.436983 Oct 03 11:03:01.353112 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3251/6195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:02:59 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:02.381836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:02.384953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:02.418425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:02.418923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:02.419367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:02.420085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:02.420543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:02.429214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:03.931873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:03.961800 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b49ff34-69eb-4d62-a229-c6ded79e526f tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1314 microversion: 2.1 time: 1.582113 Oct 03 11:03:03.962798 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2945/6196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:02 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1314 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:04.989029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:04.990333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:05.019640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:05.025843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:05.034378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:05.036789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:05.038057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:05.042698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:05.526320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:05.549255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2300bee9-f646-4f93-acf0-88e2ecc2f79d tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1462 microversion: 2.1 time: 0.562744 Oct 03 11:03:05.555159 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3252/6197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:04 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1462 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:05.692538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:05.694668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:05.713574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:05.725538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:05.727984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:05.730116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:05.735455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:05.736633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:05.864628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:03:06.177603 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-77bc9d28-8cea-494a-bbec-0cd2c1b9e9ce tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 204 len: 0 microversion: 2.1 time: 0.490120 Oct 03 11:03:06.182175 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2946/6198] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:03:05 2022] DELETE /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:03:06.195238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:06.195886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:06.227569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:06.228565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:06.229052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:06.231815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:06.232637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:06.233123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:06.693874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:06.716652 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e74221af-b6cb-4d45-aa33-9360a4baf123 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1468 microversion: 2.1 time: 0.528497 Oct 03 11:03:06.743689 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3253/6199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:06 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1468 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:07.755565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:07.756351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:07.775804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:07.776655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:07.782324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:07.785725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:07.788232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:07.789521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:08.389493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:08.402809 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8fb3bc9f-315c-4437-8509-0ab3dc864cc4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1468 microversion: 2.1 time: 0.653732 Oct 03 11:03:08.409263 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2947/6200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:07 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1468 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:08.936983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b29a6b13-21d2-4f2e-a1da-d23357fb647c tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] Calling method '.version_select at 0x7f074e287e50>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:09.065580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f6c57595-6606-499e-8428-156dcb0d0632 req-fe02402d-0a4b-4ab0-a64e-e4d188decf02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f147cda-9861-4059-a2c6-144d26aa5cd2", "name": "network-vif-deleted", "tag": "bfcc6658-4ee4-4b18-a78d-c10a3bfe9389"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:09.099215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f6c57595-6606-499e-8428-156dcb0d0632 req-fe02402d-0a4b-4ab0-a64e-e4d188decf02 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:09.107042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f6c57595-6606-499e-8428-156dcb0d0632 req-fe02402d-0a4b-4ab0-a64e-e4d188decf02 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:09.111634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f6c57595-6606-499e-8428-156dcb0d0632 req-fe02402d-0a4b-4ab0-a64e-e4d188decf02 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:09.151728 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f6c57595-6606-499e-8428-156dcb0d0632 req-fe02402d-0a4b-4ab0-a64e-e4d188decf02 service nova] Creating event network-vif-deleted:bfcc6658-4ee4-4b18-a78d-c10a3bfe9389 for instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 on n-h1-858383-3 Oct 03 11:03:09.170879 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f6c57595-6606-499e-8428-156dcb0d0632 req-fe02402d-0a4b-4ab0-a64e-e4d188decf02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114799 Oct 03 11:03:09.173056 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2948/6201] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:03:09.385511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b29a6b13-21d2-4f2e-a1da-d23357fb647c tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44/defaults" status: 200 len: 371 microversion: 2.1 time: 1.086787 Oct 03 11:03:09.385980 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3254/6202] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 11:03:08 2022] GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44/defaults => generated 371 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:09.401010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eeb9ffbb-a785-4135-bf97-6b9e8378db20 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] Calling method '.version_select at 0x7f074e271430>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:09.440744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:09.440744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:09.460468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:09.461298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:09.461903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:09.462792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:09.463421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:09.464204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:09.468975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:09.568390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:09.568893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:09.569542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:09.570199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lazy-loading 'fault' on Instance uuid 7f147cda-9861-4059-a2c6-144d26aa5cd2 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:03:09.586467 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eeb9ffbb-a785-4135-bf97-6b9e8378db20 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44" status: 200 len: 371 microversion: 2.1 time: 0.190986 Oct 03 11:03:09.587711 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2949/6203] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 11:03:09 2022] GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:09.608324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ebc429cd-5868-45a2-acdd-5a70e9f08575 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] Calling method '.version_select at 0x7f074e1eb160>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:09.640390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bdc2305002d4c67b50a80fd01ed5d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '504899de1f4b4f86a5d829a368b3073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:09.649439 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b26d25dd-179b-4503-80b5-0ed57c528bd4 tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 200 len: 1304 microversion: 2.1 time: 0.219501 Oct 03 11:03:09.650636 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3255/6204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:09 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 1304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:09.691719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ebc429cd-5868-45a2-acdd-5a70e9f08575 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44/defaults" status: 200 len: 371 microversion: 2.1 time: 0.092634 Oct 03 11:03:09.703226 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2950/6205] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Oct 3 11:03:09 2022] GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44/defaults => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:09.709738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e84692bb-b981-4257-89fb-cc179338d669 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] Calling method '.version_select at 0x7f074e1a4430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:09.817337 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e84692bb-b981-4257-89fb-cc179338d669 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44" status: 200 len: 371 microversion: 2.1 time: 0.111984 Oct 03 11:03:09.818661 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3256/6206] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 11:03:09 2022] GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:09.837969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f189a3b1-e405-4da1-b491-2046c5ff5871 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] Calling method '.version_select at 0x7f074e1fbd30>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:10.064981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f189a3b1-e405-4da1-b491-2046c5ff5871 tempest-QuotasTestJSON-2065318355 tempest-QuotasTestJSON-2065318355-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44?user_id=a0595a7fdd29468dbe418c9054a9fd56" status: 200 len: 371 microversion: 2.1 time: 0.235143 Oct 03 11:03:10.066260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2951/6207] 10.222.0.27 () {58 vars in 1323 bytes} [Mon Oct 3 11:03:09 2022] GET /compute/v2.1/os-quota-sets/fa69bb23e6c94a6a90a4f97758761f44?user_id=a0595a7fdd29468dbe418c9054a9fd56 => generated 371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:10.679770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:10.680816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] [instance: 7f147cda-9861-4059-a2c6-144d26aa5cd2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:10.700938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:10.701451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:10.701904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:10.702642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:10.707604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:10.708230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:10.728946 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] HTTP exception thrown: Instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 could not be found. Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Request method failure captured: Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 HTTP/1.1 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsFPMq9xdxmTOFvU_smHhTdKFTuUt7purrKW5FXn7-Vgwsu4OONqjeqN3g1juO5gD7lvJNUGvQQtDWKwhEKzUiC21YliPr1Ry5rdwt43Ivu6S3yvJ6JkOdRC1XfZUKJsrG_zQgMKYRkMBXAOm2g8ec92PjZrBFOVQVqDaVu843SWfFg Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 504899de1f4b4f86a5d829a368b3073d Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesNegativeTest-1633262133 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/504899de1f4b4f86a5d829a368b3073d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_504899de1f4b4f86a5d829a368b3073d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/504899de1f4b4f86a5d829a368b3073d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/504899de1f4b4f86a5d829a368b3073d"}]}] Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesNegativeTest-1633262133 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 504899de1f4b4f86a5d829a368b3073d Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesNegativeTest-1633262133 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesNegativeTest-1633262133-project Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 3bdc2305002d4c67b50a80fd01ed5d66 Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesNegativeTest-1633262133-project Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 could not be found. Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '7f147cda-9861-4059-a2c6-144d26aa5cd2'} Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 could not be found. Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 could not be found. Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:03:10.731511 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:03:10.736482 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:03:10.736482 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:03:10.736482 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:03:10.736482 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:03:10.736482 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:03:10.736482 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 could not be found. Oct 03 11:03:10.736482 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:03:10.738269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] Returning 404 to user: Instance 7f147cda-9861-4059-a2c6-144d26aa5cd2 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:03:10.739463 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e7b4e036-2300-4bbc-8eb8-0fbe09363b7c tempest-VolumesNegativeTest-1633262133 tempest-VolumesNegativeTest-1633262133-project] 10.222.0.27 "GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2" status: 404 len: 111 microversion: 2.1 time: 0.065429 Oct 03 11:03:10.741187 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3257/6208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:10 2022] GET /compute/v2.1/servers/7f147cda-9861-4059-a2c6-144d26aa5cd2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:03:23.745966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-993a5b46-e562-4c37-81f5-a02fbc0e9b2b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'create', calling method: .version_select at 0x7f074dfed5e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-475259873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0s0lq/q7Ot2ig/2RExViXJ3Mbh2Pla7Ar76HGyZG4i3AoI0cC4IRxA5W8B1O0wRh5TuCfhPUL6pqnXSZrE+6kyDNqHQ7hUprsxh+CCGRT5aKdxMs/SwjfacOwH4LOQtQ=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:23.762258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:23.763867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:23.764674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:23.800385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-993a5b46-e562-4c37-81f5-a02fbc0e9b2b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:03:23.811744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-993a5b46-e562-4c37-81f5-a02fbc0e9b2b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for user a49f0fdcb5ec457c8ef571a791fb0e12 and project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:03:23.886968 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-993a5b46-e562-4c37-81f5-a02fbc0e9b2b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.144858 Oct 03 11:03:23.897185 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2952/6209] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:03:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:26.106010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:26.106820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=19 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:26.107663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=9 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:26.537992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f8da66e-f84b-40f9-a20c-4b1ec5ec8733 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'create', calling method: .version_select at 0x7f074e562790>, body: {"keypair": {"name": "tempest-keypair-698901041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1nPz5MJi2ZOsP3H+W55yQOlYX+9AIHm3SPo0/NzLzlktTDa+cbQpfO2i3BRi3ANiVtV+uZMVGvqEpIhyc0eikPGByOdN+G6ZsvZ2hW6LMXGiYneqDoyY6/azEeqfSgZg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:26.593315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5f8da66e-f84b-40f9-a20c-4b1ec5ec8733 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for project fc63853293434222952d42b069d89171. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:03:26.603722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-5f8da66e-f84b-40f9-a20c-4b1ec5ec8733 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for user becae64c9329457c9c58aec414f89934 and project fc63853293434222952d42b069d89171. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:03:26.637129 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f8da66e-f84b-40f9-a20c-4b1ec5ec8733 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.535889 Oct 03 11:03:26.645230 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3258/6210] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:03:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:27.917124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1579395347", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "eab13db5-9c21-44d9-b83d-6c0a5f4ade95"}], "key_name": "tempest-TestNetworkBasicOps-475259873", "security_groups": [{"name": "tempest-secgroup-smoke-890382463"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:28.271868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] validate_networks() for [('eab13db5-9c21-44d9-b83d-6c0a5f4ade95', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:03:29.952725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:03:29.953412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:03:29.953915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:03:29.954341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:03:29.954830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:03:30.000252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:30.006801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:30.007489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:30.008461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:30.023138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:30.023795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:30.140176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:03:30.166755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for user a49f0fdcb5ec457c8ef571a791fb0e12 and project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:03:30.217908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:03:30.237430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:03:30.480349 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e951576d-e189-49c1-a845-ff165f7a6fc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.567618 Oct 03 11:03:30.488639 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2953/6211] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:03:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:03:30.495346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eb022403-8414-4951-9527-d43da88e642c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:30.496578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eb022403-8414-4951-9527-d43da88e642c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:30.654037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eb022403-8414-4951-9527-d43da88e642c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:30.672637 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eb022403-8414-4951-9527-d43da88e642c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1248 microversion: 2.1 time: 0.183934 Oct 03 11:03:30.673272 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3259/6212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:30 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1248 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:03:30.952726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1259194168", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "944a6f9a-9923-408c-9fb0-c7b7b6c4d728"}], "security_groups": [{"name": "tempest-securitygroup--598217514"}], "key_name": "tempest-keypair-698901041", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:31.704701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:31.706853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:31.897309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:31.901672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:31.905735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:31.907502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:31.910504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:31.920114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:32.145548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] validate_networks() for [('944a6f9a-9923-408c-9fb0-c7b7b6c4d728', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:03:32.152691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:32.189105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a3dedf73-ea76-40d3-a9d9-0c810fdc0ad5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1252 microversion: 2.1 time: 0.478326 Oct 03 11:03:32.190703 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3260/6213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:31 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1252 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:33.221135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:33.221766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:33.237778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:33.238501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:33.239129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:33.240139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:33.240796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:33.241401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:33.433443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:33.447884 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dcae68ed-a181-47ed-9dec-614a61206a48 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1306 microversion: 2.1 time: 0.230843 Oct 03 11:03:33.450364 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3261/6214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:33 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1306 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:03:33.995397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:03:33.995989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:03:33.996306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:03:33.996722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:03:33.997223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:03:34.039841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:34.040422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:34.045477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:34.049063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:34.054408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:34.057753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:34.139444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for project fc63853293434222952d42b069d89171. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:03:34.165196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for user becae64c9329457c9c58aec414f89934 and project fc63853293434222952d42b069d89171. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:03:34.238740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:03:34.245259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:03:34.424878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d15b5a0-c9e8-4232-96dc-5798a35bb581 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.478108 Oct 03 11:03:34.425860 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2954/6215] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:03:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:03:34.438065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bfd7d8bb-2df2-44ad-bd4e-6e1199e8992e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:34.438759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bfd7d8bb-2df2-44ad-bd4e-6e1199e8992e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:34.481189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:34.482087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:34.527254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:34.540939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:34.545504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:34.549084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:34.552392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:34.554121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:34.809297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bfd7d8bb-2df2-44ad-bd4e-6e1199e8992e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:34.821363 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bfd7d8bb-2df2-44ad-bd4e-6e1199e8992e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1237 microversion: 2.1 time: 0.387346 Oct 03 11:03:34.851406 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3262/6216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:34 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1237 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:35.038269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:35.050178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bdca2e7e-295b-4b45-bda9-d08f76e3e50e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1306 microversion: 2.1 time: 0.577143 Oct 03 11:03:35.055050 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2955/6217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:34 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1306 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:35.851462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-648ce8bd-2b46-433d-9379-c3ec64c9a698 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:35.852251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-648ce8bd-2b46-433d-9379-c3ec64c9a698 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:36.044785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-648ce8bd-2b46-433d-9379-c3ec64c9a698 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:36.061356 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-648ce8bd-2b46-433d-9379-c3ec64c9a698 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1237 microversion: 2.1 time: 0.207181 Oct 03 11:03:36.062941 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3263/6218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:35 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1237 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:36.082345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:36.085398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:36.111323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:36.113542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:36.116262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:36.118459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:36.132510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:36.133357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:37.089860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:37.091479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:37.103427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:37.104201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:37.104861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:37.106076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:37.106706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:37.107359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:37.254483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:37.268630 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96de0c83-7bcd-4cbe-9617-8f0850693ea9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1297 microversion: 2.1 time: 0.181270 Oct 03 11:03:37.269679 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3264/6219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:37 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1297 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:03:37.521083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:37.530492 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-088634d4-8d35-43cd-aec6-eca4990e0b65 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 1.455877 Oct 03 11:03:37.536597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2956/6220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:36 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:38.321203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:38.322685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:38.352834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:38.353744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:38.355506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:38.362693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:38.363960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:38.366554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:38.560404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:38.561073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:38.588979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:38.592152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:38.595335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:38.599308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:38.603063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:38.603914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:38.900875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:38.922415 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3584cbcd-ab5e-44ad-919d-36e1201f6300 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1295 microversion: 2.1 time: 0.626815 Oct 03 11:03:38.925601 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3265/6221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:38 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1295 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:39.100200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:39.125157 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-02eaef20-0e0b-4595-b40e-8989f1167c5e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 0.559019 Oct 03 11:03:39.127534 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2957/6222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:38 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:03:39.843175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-15f66109-f187-48c6-bdb1-6bf673a0ec7d req-d7ec66af-9fce-4ee9-a4b0-166b98e96889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa01a91-e081-4cb2-89ed-a4430ac7ee79", "tag": "a6235317-dee4-4290-a20c-fe4c73ba4bbc"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:39.856798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15f66109-f187-48c6-bdb1-6bf673a0ec7d req-d7ec66af-9fce-4ee9-a4b0-166b98e96889 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:39.857601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15f66109-f187-48c6-bdb1-6bf673a0ec7d req-d7ec66af-9fce-4ee9-a4b0-166b98e96889 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:39.858316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15f66109-f187-48c6-bdb1-6bf673a0ec7d req-d7ec66af-9fce-4ee9-a4b0-166b98e96889 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:39.907371 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-15f66109-f187-48c6-bdb1-6bf673a0ec7d req-d7ec66af-9fce-4ee9-a4b0-166b98e96889 service nova] Creating event network-changed:a6235317-dee4-4290-a20c-fe4c73ba4bbc for instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 on n-h2-858383-3 Oct 03 11:03:39.929684 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-15f66109-f187-48c6-bdb1-6bf673a0ec7d req-d7ec66af-9fce-4ee9-a4b0-166b98e96889 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090916 Oct 03 11:03:39.933658 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3266/6223] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:39.956460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:39.957121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:39.974093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:39.974638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:39.981715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:39.982553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:39.983042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:39.989595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:40.157220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:40.158695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:40.167394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:40.168211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:40.168893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:40.169794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:40.171123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:40.171860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:40.330321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:40.340575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9a2d5c1e-6ab5-4df0-9c06-01d36d6c4dda tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1295 microversion: 2.1 time: 0.389349 Oct 03 11:03:40.345577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2958/6224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:39 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1295 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:40.765424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:40.780907 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-43080ffe-527d-4ad1-ba18-8c9ccc19781d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 0.627981 Oct 03 11:03:40.781738 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3267/6225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:40 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:41.373965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:41.374597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:41.394608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:41.398757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:41.399746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:41.402991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:41.407159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:41.407939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:41.804549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:41.805596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:41.823157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:41.823594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:41.824042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:41.824786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:41.825245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:41.825679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:42.092500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:42.120444 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f290492b-aba3-4988-87bd-af17aa92978f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 0.320158 Oct 03 11:03:42.121241 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3268/6226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:41 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:03:42.276398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:42.285555 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8b7cc6d2-6334-4a3d-b06d-3df4723411db tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.916543 Oct 03 11:03:42.305221 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2959/6227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:41 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:43.148548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:43.150821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:43.165419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:43.168122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:43.171374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:43.177037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:43.179911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:43.182523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:43.313335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:43.314927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:43.330949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:43.331763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:43.332436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:43.335536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:43.336295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:43.336995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:43.825067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:43.835158 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a3a4c183-ac39-4a1b-9f9b-34e7c29b5091 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.526289 Oct 03 11:03:43.839440 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2960/6228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:43 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:43.843663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:43.857468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51a6427d-8b73-4bd9-bb64-47492e9880f1 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 0.713513 Oct 03 11:03:43.860232 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3269/6229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:43 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:44.392667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-6510758f-3a7e-4471-a0f6-527c49821825 req-985dd94a-cb1f-4ffd-aa32-2b229223abab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068e551a-dff3-4556-8b68-70485a0ff892", "tag": "6f129fce-3650-4d44-9dcd-244ba2d16de6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:44.419021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:44.420264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=16 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:44.425677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6510758f-3a7e-4471-a0f6-527c49821825 req-985dd94a-cb1f-4ffd-aa32-2b229223abab service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:44.431022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6510758f-3a7e-4471-a0f6-527c49821825 req-985dd94a-cb1f-4ffd-aa32-2b229223abab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:44.431806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6510758f-3a7e-4471-a0f6-527c49821825 req-985dd94a-cb1f-4ffd-aa32-2b229223abab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:44.468691 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-6510758f-3a7e-4471-a0f6-527c49821825 req-985dd94a-cb1f-4ffd-aa32-2b229223abab service nova] Creating event network-changed:6f129fce-3650-4d44-9dcd-244ba2d16de6 for instance 068e551a-dff3-4556-8b68-70485a0ff892 on n-h1-858383-3 Oct 03 11:03:44.490081 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-6510758f-3a7e-4471-a0f6-527c49821825 req-985dd94a-cb1f-4ffd-aa32-2b229223abab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100572 Oct 03 11:03:44.493691 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2961/6230] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:44.869244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:44.869861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:44.891250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:44.892174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:44.905261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:44.905749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:44.908837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:44.911114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:44.913723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:44.914831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:44.915263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:44.916331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:44.920022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:44.920860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:44.923383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:44.924297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:45.470791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:45.481120 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-011e09dc-12e0-4a11-9ee1-ade87420850f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.615999 Oct 03 11:03:45.481975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3270/6231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:44 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:46.512148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:46.513157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:46.528501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:46.530259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:46.530758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:46.531351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:46.532202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:46.533017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:46.552975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:46.724816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:46.742902 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-171f30d8-ff26-48b1-a522-1ac6bf8fa8ed tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 1.848977 Oct 03 11:03:46.760856 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2962/6232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:44 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:47.423491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:47.445971 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b00e432d-fa8b-49c7-8982-29a2d7696993 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.937281 Oct 03 11:03:47.462038 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3271/6233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:46 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:03:47.775395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:47.777023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:47.793716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:47.796000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:47.796628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:47.798908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:47.800661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:47.801319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:48.130384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e7a7fbe7-003b-4fa2-83b8-2438a72d8bfd req-b9737594-ed46-40f8-b774-e322d44c484e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa01a91-e081-4cb2-89ed-a4430ac7ee79", "name": "network-vif-plugged", "status": "completed", "tag": "a6235317-dee4-4290-a20c-fe4c73ba4bbc"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:48.151857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e7a7fbe7-003b-4fa2-83b8-2438a72d8bfd req-b9737594-ed46-40f8-b774-e322d44c484e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:48.152338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e7a7fbe7-003b-4fa2-83b8-2438a72d8bfd req-b9737594-ed46-40f8-b774-e322d44c484e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:48.152796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e7a7fbe7-003b-4fa2-83b8-2438a72d8bfd req-b9737594-ed46-40f8-b774-e322d44c484e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:48.187222 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e7a7fbe7-003b-4fa2-83b8-2438a72d8bfd req-b9737594-ed46-40f8-b774-e322d44c484e service nova] Creating event network-vif-plugged:a6235317-dee4-4290-a20c-fe4c73ba4bbc for instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 on n-h2-858383-3 Oct 03 11:03:48.199487 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e7a7fbe7-003b-4fa2-83b8-2438a72d8bfd req-b9737594-ed46-40f8-b774-e322d44c484e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071196 Oct 03 11:03:48.202623 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3272/6234] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:48.485804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:48.491147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:48.500656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:48.501386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:48.502027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:48.502939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:48.505150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:48.506430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:48.510831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:48.520120 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04bff1f3-9166-4f15-8ac6-fae3f8b8b2f3 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 0.750521 Oct 03 11:03:48.520735 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2963/6235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:47 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:49.169005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:49.183729 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ab17e51-1a28-4a13-a264-24020633164a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.713004 Oct 03 11:03:49.187812 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3273/6236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:48 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:49.556659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:49.558390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:49.572421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:49.573347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:49.574017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:49.575946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:49.576642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:49.577360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:50.154442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:50.173027 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d605e7c-0d12-4f40-9f3c-fff2b764ed66 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1373 microversion: 2.1 time: 0.622573 Oct 03 11:03:50.174002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2964/6237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:49 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1373 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:50.214629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:50.215990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:50.253866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:50.259249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:50.260222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:50.263565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:50.265560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:50.266295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:50.598857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:50.608538 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c1ab28d-3991-4a93-b07f-327de9fdf359 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.400358 Oct 03 11:03:50.616287 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3274/6238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:50 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:51.202875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:51.207393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:51.222330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:51.225676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:51.229241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:51.230966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:51.231715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:51.232350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:51.639865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:51.647159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:51.663712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:51.667996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:51.668883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:51.669884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:51.670895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:51.671705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:51.866635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:51.878624 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d22f365a-a79d-4538-9080-c5758d4c7a36 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1545 microversion: 2.1 time: 0.684320 Oct 03 11:03:51.879901 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2965/6239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:51 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1545 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:51.908946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:51.909864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:51.918864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:51.919694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:51.920620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:51.921582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:51.922459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:51.923141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:52.067528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:52.082423 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bfea8dc0-2142-4df5-b546-d60b4478cfd6 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.446553 Oct 03 11:03:52.084944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3275/6240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:51 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:52.171616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:52.184402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7bafc8c1-ec3a-484e-b77e-783b167b86d8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1545 microversion: 2.1 time: 0.281151 Oct 03 11:03:52.185469 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2966/6241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:51 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1545 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:53.100089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-47e77345-0c53-435a-bc5f-3332e2859298 req-791c7984-8c5c-4e7e-92d5-6a9c485931ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068e551a-dff3-4556-8b68-70485a0ff892", "name": "network-vif-plugged", "status": "completed", "tag": "6f129fce-3650-4d44-9dcd-244ba2d16de6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:03:53.108101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:53.108723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:53.136019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:53.141978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:53.142529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:53.143299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:53.143780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:53.150688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:53.152658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47e77345-0c53-435a-bc5f-3332e2859298 req-791c7984-8c5c-4e7e-92d5-6a9c485931ee service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:53.153199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47e77345-0c53-435a-bc5f-3332e2859298 req-791c7984-8c5c-4e7e-92d5-6a9c485931ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:53.155510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-47e77345-0c53-435a-bc5f-3332e2859298 req-791c7984-8c5c-4e7e-92d5-6a9c485931ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:53.212261 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-47e77345-0c53-435a-bc5f-3332e2859298 req-791c7984-8c5c-4e7e-92d5-6a9c485931ee service nova] Creating event network-vif-plugged:6f129fce-3650-4d44-9dcd-244ba2d16de6 for instance 068e551a-dff3-4556-8b68-70485a0ff892 on n-h1-858383-3 Oct 03 11:03:53.237807 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-47e77345-0c53-435a-bc5f-3332e2859298 req-791c7984-8c5c-4e7e-92d5-6a9c485931ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141561 Oct 03 11:03:53.240076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3276/6242] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:03:54.408328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:54.422369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=77 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:54.425834 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-89120d08-819f-4b65-b00a-2b498db05673 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 1.321441 Oct 03 11:03:54.428564 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2967/6243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:53 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:55.457688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:55.459117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:55.501326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:55.512636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:55.514058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:55.514855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:55.517718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:55.518202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:56.109813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:56.116801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=83 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:56.124721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f44506db-0b03-474b-a34b-5577e548b9b2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1362 microversion: 2.1 time: 0.671220 Oct 03 11:03:56.128196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3277/6244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:55 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1362 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:03:57.164295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:57.165873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:57.194586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:57.205250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:57.206832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:57.207560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:57.212823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:57.214398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:57.224832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:57.759406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:03:57.777257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24a5724f-59c9-4c38-b503-2fe25e421ef7 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1549 microversion: 2.1 time: 0.627140 Oct 03 11:03:57.779968 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2968/6245] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:03:57 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1549 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:03:57.810321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:03:57.811479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:03:57.822942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:03:57.845690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:57.846216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:57.847703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:57.849807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:03:57.854219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:03:57.855693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:03:58.110358 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30de7f26-d3d1-4212-af60-79f1086078d9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.305797 Oct 03 11:03:58.112118 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3278/6246] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 11:03:57 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-interface => generated 285 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:03.237612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e26bd59c-a524-4c59-b1c3-fc4634eb8119 req-c6eafbce-a184-4928-bff1-813c5282d2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068e551a-dff3-4556-8b68-70485a0ff892", "tag": "6f129fce-3650-4d44-9dcd-244ba2d16de6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:03.259487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e26bd59c-a524-4c59-b1c3-fc4634eb8119 req-c6eafbce-a184-4928-bff1-813c5282d2a1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:03.259974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e26bd59c-a524-4c59-b1c3-fc4634eb8119 req-c6eafbce-a184-4928-bff1-813c5282d2a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:03.260409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e26bd59c-a524-4c59-b1c3-fc4634eb8119 req-c6eafbce-a184-4928-bff1-813c5282d2a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:03.320580 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e26bd59c-a524-4c59-b1c3-fc4634eb8119 req-c6eafbce-a184-4928-bff1-813c5282d2a1 service nova] Creating event network-changed:6f129fce-3650-4d44-9dcd-244ba2d16de6 for instance 068e551a-dff3-4556-8b68-70485a0ff892 on n-h1-858383-3 Oct 03 11:04:03.334735 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e26bd59c-a524-4c59-b1c3-fc4634eb8119 req-c6eafbce-a184-4928-bff1-813c5282d2a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100787 Oct 03 11:04:03.338542 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2969/6247] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:04:11.189569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:11.190883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=5 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:11.514564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-402781374", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "1dfdb628-50ab-4c5a-be3a-bb9148de9160"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:11.611281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] validate_networks() for [('1dfdb628-50ab-4c5a-be3a-bb9148de9160', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:04:12.897136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:04:12.900537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:04:12.902143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:04:12.902725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:04:12.903403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:04:12.921287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:12.921785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:12.922234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:12.931125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:12.931688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:12.932149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:12.996351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Getting quotas for project 130e21c8149644f597b7561314ee8afe. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:04:13.010526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Getting quotas for user d9d2268057544f389a9f4b168e87cc89 and project 130e21c8149644f597b7561314ee8afe. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:04:13.041353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:04:13.043715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:04:13.160467 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59029dcc-3b44-4a58-b629-7708a1d300f3 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973014 Oct 03 11:04:13.169328 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3279/6248] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:04:13.174300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cd5ca09f-749f-438f-870c-fcf3a0fbc854 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:13.175142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cd5ca09f-749f-438f-870c-fcf3a0fbc854 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:13.265861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=9 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:13.362770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cd5ca09f-749f-438f-870c-fcf3a0fbc854 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:13.382229 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cd5ca09f-749f-438f-870c-fcf3a0fbc854 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1214 microversion: 2.1 time: 0.212520 Oct 03 11:04:13.412073 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2970/6249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:13 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:14.421860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:14.422468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:14.433022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:14.437443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:14.438735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:14.441612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:14.445880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:14.448008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:14.619005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:14.628117 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4e076014-015c-4480-85aa-97ca655c0263 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1266 microversion: 2.1 time: 0.211574 Oct 03 11:04:14.631262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3280/6250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:14 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:15.675069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:15.676946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:15.698126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:15.699033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:15.700242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:15.704272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:15.705071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:15.705759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:15.850988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:15.863976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-69eeac76-83bb-4571-aebd-d65e3e9f84ad tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1272 microversion: 2.1 time: 0.208803 Oct 03 11:04:15.865293 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2971/6251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:15 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:16.900282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:16.900985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:16.919551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:16.920377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:16.921536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:16.923790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:16.924577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:16.925916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:17.066307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:17.081785 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-799a141a-55c2-4ead-a721-ab4c68d0c5ae tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1272 microversion: 2.1 time: 0.185969 Oct 03 11:04:17.082415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3281/6252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:16 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:18.106799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:18.107415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:18.120722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:18.121256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:18.121700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:18.122413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:18.122871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:18.123312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:18.806607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:18.818911 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e1d17db-7832-4e4d-b4ec-706b2c14f532 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.715962 Oct 03 11:04:18.835759 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2972/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:18 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:19.858572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:19.861844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:19.890824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:19.891693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:19.892975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:19.894504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:19.895635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:19.896288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:20.435494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:20.470594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a96b345-b9f7-41a6-8f12-35b87535b295 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.631360 Oct 03 11:04:20.471225 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3282/6254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:19 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:21.500501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:21.501704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:21.528091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:21.529428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:21.532487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:21.535716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:21.536449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:21.537560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:22.744102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:22.772914 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-be179a34-c245-4b21-b807-b8730249a7cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 1.277492 Oct 03 11:04:22.781156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c7fcb343-3347-4885-81de-61fe6cc56c87 req-0ab605b4-24d9-4b93-8e4a-66d350030d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ca3677-b198-4757-acf0-0870c398e32a", "tag": "fb474094-96f7-4c88-9c86-c533658d03f6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:22.795505 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2973/6255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:21 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:22.798304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c7fcb343-3347-4885-81de-61fe6cc56c87 req-0ab605b4-24d9-4b93-8e4a-66d350030d55 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:22.803184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c7fcb343-3347-4885-81de-61fe6cc56c87 req-0ab605b4-24d9-4b93-8e4a-66d350030d55 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:22.805988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c7fcb343-3347-4885-81de-61fe6cc56c87 req-0ab605b4-24d9-4b93-8e4a-66d350030d55 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:22.831356 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c7fcb343-3347-4885-81de-61fe6cc56c87 req-0ab605b4-24d9-4b93-8e4a-66d350030d55 service nova] Creating event network-changed:fb474094-96f7-4c88-9c86-c533658d03f6 for instance 49ca3677-b198-4757-acf0-0870c398e32a on n-h2-858383-3 Oct 03 11:04:22.844981 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c7fcb343-3347-4885-81de-61fe6cc56c87 req-0ab605b4-24d9-4b93-8e4a-66d350030d55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068721 Oct 03 11:04:22.850541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3283/6256] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:23.811644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:23.813245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:23.822813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:23.834547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:23.835313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:23.836266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:23.837302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:23.838020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:23.838787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:24.170409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:24.174095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:24.193697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:24.196565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:24.202587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:24.207018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:24.210867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:24.214042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:24.214764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:24.218467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:24.298356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:04:24.386026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:24.399788 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa261da9-a213-4cf1-bc08-e965f4ab4c30 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.592963 Oct 03 11:04:24.413715 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2974/6257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:23 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:24.516562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28b520f3-9b5c-489b-874c-e85278f4e02d tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 204 len: 0 microversion: 2.1 time: 0.355395 Oct 03 11:04:24.517757 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3284/6258] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:04:24 2022] DELETE /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:04:24.526249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:24.527185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:24.541656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:24.542467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:24.543096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:24.544171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:24.547591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:24.548054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:25.040508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:25.054111 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d2fa8d9d-ec34-43fd-8141-baafc805540c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1551 microversion: 2.1 time: 0.531637 Oct 03 11:04:25.055054 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2975/6259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:24 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1551 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:25.438530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:25.439380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:25.450859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:25.456796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:25.459135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:25.461279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:25.462060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:25.463655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:25.550394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24638730-9bfa-44dd-a3df-e573c4728f6f tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-960580732", "availability_zone": "foo_zone"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:25.557210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.aggregate [None req-24638730-9bfa-44dd-a3df-e573c4728f6f tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Generated uuid 37991c81-37b0-4a33-b0f6-c3a3ae862ab4 for aggregate {{(pid=122269) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 11:04:25.611836 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24638730-9bfa-44dd-a3df-e573c4728f6f tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.321818 Oct 03 11:04:25.620051 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3285/6260] 10.222.0.27 () {60 vars in 1164 bytes} [Mon Oct 3 11:04:25 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:25.625458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-710d9433-3aa4-4086-a596-1601bd107eee tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:25.662707 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-710d9433-3aa4-4086-a596-1601bd107eee tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.041204 Oct 03 11:04:25.672262 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3286/6261] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 11:04:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:25.683735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:25.689315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:25.689807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:25.692112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:25.699631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:25.701356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:25.702772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:25.765900 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-048e54b2-abc9-4b6a-b4fd-33f4cfaba2b7 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092404 Oct 03 11:04:25.767603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3287/6262] 10.222.0.27 () {58 vars in 1176 bytes} [Mon Oct 3 11:04:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:25.785841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:25.786385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c31b8c3e-5096-427d-8477-a87fcc902f96 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:25.797091 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c31b8c3e-5096-427d-8477-a87fcc902f96 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019928 Oct 03 11:04:25.799187 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3288/6263] 10.222.0.27 () {58 vars in 1143 bytes} [Mon Oct 3 11:04:25 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:25.810548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de741b75-cbe4-4bb3-946a-cec3ca30b18e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.377214 Oct 03 11:04:25.811854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c0e66ea-c362-4870-bd05-69be044f2622 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:25.812042 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2976/6264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:25 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:25.834869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0e66ea-c362-4870-bd05-69be044f2622 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:25.835372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0e66ea-c362-4870-bd05-69be044f2622 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:25.835810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c0e66ea-c362-4870-bd05-69be044f2622 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:26.082053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:26.083504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:26.093090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:26.093848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:26.094524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:26.095827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:26.096675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:26.097552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:26.366680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c0e66ea-c362-4870-bd05-69be044f2622 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.554243 Oct 03 11:04:26.377755 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3289/6265] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 11:04:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:04:26.385419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4173ed1b-ac45-4446-90b2-4e18b8258a54 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:26.416325 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4173ed1b-ac45-4446-90b2-4e18b8258a54 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.035554 Oct 03 11:04:26.422297 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3290/6266] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 11:04:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:26.441715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bccaa77b-028c-41f3-893d-09bfffda559c tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1757320190", "availability_zone": "foo_zone"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:26.554249 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bccaa77b-028c-41f3-893d-09bfffda559c tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.122748 Oct 03 11:04:26.557444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3291/6267] 10.222.0.27 () {60 vars in 1173 bytes} [Mon Oct 3 11:04:26 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:04:26.586753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d3b10f28-5e67-4c56-b2cd-a3ce161a7259 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:26.630281 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d3b10f28-5e67-4c56-b2cd-a3ce161a7259 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.058279 Oct 03 11:04:26.632183 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3292/6268] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 11:04:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:26.651996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d06f4586-ef30-424b-8513-36505fe54492 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:26.666746 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d06f4586-ef30-424b-8513-36505fe54492 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.023219 Oct 03 11:04:26.668458 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3293/6269] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Oct 3 11:04:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:26.671132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:26.681644 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b74fc63f-761b-45ec-acba-eb11315a01e8 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1551 microversion: 2.1 time: 0.604662 Oct 03 11:04:26.684260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2977/6270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:26 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1551 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:26.685171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75cafe10-2742-4b90-9a38-85ec1c4330fb tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-3"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:26.715800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cafe10-2742-4b90-9a38-85ec1c4330fb tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:26.716452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cafe10-2742-4b90-9a38-85ec1c4330fb tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:26.716752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cafe10-2742-4b90-9a38-85ec1c4330fb tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:26.842651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:26.844151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:26.853282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:26.856260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:26.857295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:26.859763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:26.860450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:26.865875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:26.923949 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75cafe10-2742-4b90-9a38-85ec1c4330fb tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.248106 Oct 03 11:04:26.926653 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3294/6271] 10.222.0.27 () {60 vars in 1194 bytes} [Mon Oct 3 11:04:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:26.938921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c38d1297-fb81-4992-9342-517036f3d269 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:26.982403 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c38d1297-fb81-4992-9342-517036f3d269 tempest-TestAggregatesBasicOps-1063211033 tempest-TestAggregatesBasicOps-1063211033-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.048338 Oct 03 11:04:26.983646 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3295/6272] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Oct 3 11:04:26 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 11:04:27.324701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:27.339650 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72e652a5-8c1b-4331-abb3-487ee69bc92b tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.499506 Oct 03 11:04:27.346061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2978/6273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:26 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:27.716189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:27.717417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:27.753940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:27.756335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:27.760175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:27.760175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:27.763560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:27.764236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:28.144362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:28.159503 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28c2bf95-e0b8-46af-bbbf-84efa3edddab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1551 microversion: 2.1 time: 0.454159 Oct 03 11:04:28.161589 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3296/6274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:27 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1551 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:28.370491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:28.371716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:28.375245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=24 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:28.392433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:28.392973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:28.393429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:28.394156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:28.394631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:28.395160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:28.618538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1439f8a4-ad71-4e73-9296-00933eb0d19d req-cbe6e246-1a39-4f76-9050-1981a0242e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa01a91-e081-4cb2-89ed-a4430ac7ee79", "name": "network-vif-deleted", "tag": "a6235317-dee4-4290-a20c-fe4c73ba4bbc"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:28.648524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:28.661750 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e4e1b07-b177-4b29-9fd9-f6b95b239d06 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.295048 Oct 03 11:04:28.662930 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2979/6275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:28 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:28.678298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1439f8a4-ad71-4e73-9296-00933eb0d19d req-cbe6e246-1a39-4f76-9050-1981a0242e43 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:28.680346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1439f8a4-ad71-4e73-9296-00933eb0d19d req-cbe6e246-1a39-4f76-9050-1981a0242e43 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:28.680875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1439f8a4-ad71-4e73-9296-00933eb0d19d req-cbe6e246-1a39-4f76-9050-1981a0242e43 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:28.712337 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1439f8a4-ad71-4e73-9296-00933eb0d19d req-cbe6e246-1a39-4f76-9050-1981a0242e43 service nova] Creating event network-vif-deleted:a6235317-dee4-4290-a20c-fe4c73ba4bbc for instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 on n-h2-858383-3 Oct 03 11:04:28.722771 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1439f8a4-ad71-4e73-9296-00933eb0d19d req-cbe6e246-1a39-4f76-9050-1981a0242e43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116096 Oct 03 11:04:28.723546 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3297/6276] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:04:29.190357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:29.193130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:29.211779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:29.214073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:29.216821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:29.218691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:29.223077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:29.227878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:29.298664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:29.299700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:29.300441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:29.301108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lazy-loading 'fault' on Instance uuid 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:04:29.410828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:29.424905 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1d89782c-dd85-497c-8aaa-f66b4741d5eb tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 200 len: 1338 microversion: 2.1 time: 0.239921 Oct 03 11:04:29.432184 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2980/6277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:29 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 1338 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:29.688310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:29.689150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:29.702570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:29.711715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:29.720583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:29.721374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:29.724920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:29.729120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:29.730060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:30.460119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:30.460805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 0fa01a91-e081-4cb2-89ed-a4430ac7ee79] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:30.479863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:30.480382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:30.480860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:30.481600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:30.482067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:30.482496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:30.534691 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] HTTP exception thrown: Instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 could not be found. Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Request method failure captured: Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 HTTP/1.1 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsDxbze3z120ev90jDxHDMtkUFD-yG7bzkRuXWwkM2108Godz02e3GXIoWfj00pCg-koPFBNM8z3j8Ca9jQViUqFR7iiCQ-fi5qzaG7jLH19AiK7qwIEiUXEFEAKuXx9bwqKep7S_CwYT1KZKsKu9YRSACdJ1NJPqCgeKrVDmpSui0M Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: d466d7c7cd6f4fcba0488c51907d3037 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d466d7c7cd6f4fcba0488c51907d3037"}]}] Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: d466d7c7cd6f4fcba0488c51907d3037 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestNetworkBasicOps-1356814400-project Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a49f0fdcb5ec457c8ef571a791fb0e12 Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestNetworkBasicOps-1356814400-project Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 could not be found. Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '0fa01a91-e081-4cb2-89ed-a4430ac7ee79'} Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 could not be found. Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 could not be found. Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:04:30.536740 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 could not be found. Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Returning 404 to user: Instance 0fa01a91-e081-4cb2-89ed-a4430ac7ee79 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0d58c07d-b0ba-41c3-8e6c-709d9785b187 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79" status: 404 len: 111 microversion: 2.1 time: 0.084715 Oct 03 11:04:30.547041 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2981/6278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:30 2022] GET /compute/v2.1/servers/0fa01a91-e081-4cb2-89ed-a4430ac7ee79 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:04:30.571925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:30.619457 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d3f694f-c7c8-49c8-8ad1-a81196701321 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.928564 Oct 03 11:04:30.620535 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3298/6279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:29 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:30.992174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5bea100e-0fb9-45a1-b709-ac7d0b3e26a7 req-e3e0310a-878d-453e-affa-c16868e8cc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ca3677-b198-4757-acf0-0870c398e32a", "name": "network-vif-plugged", "status": "completed", "tag": "fb474094-96f7-4c88-9c86-c533658d03f6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:31.011154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5bea100e-0fb9-45a1-b709-ac7d0b3e26a7 req-e3e0310a-878d-453e-affa-c16868e8cc6f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:31.011922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5bea100e-0fb9-45a1-b709-ac7d0b3e26a7 req-e3e0310a-878d-453e-affa-c16868e8cc6f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:31.012794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5bea100e-0fb9-45a1-b709-ac7d0b3e26a7 req-e3e0310a-878d-453e-affa-c16868e8cc6f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:31.038291 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5bea100e-0fb9-45a1-b709-ac7d0b3e26a7 req-e3e0310a-878d-453e-affa-c16868e8cc6f service nova] Creating event network-vif-plugged:fb474094-96f7-4c88-9c86-c533658d03f6 for instance 49ca3677-b198-4757-acf0-0870c398e32a on n-h2-858383-3 Oct 03 11:04:31.049166 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5bea100e-0fb9-45a1-b709-ac7d0b3e26a7 req-e3e0310a-878d-453e-affa-c16868e8cc6f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065642 Oct 03 11:04:31.050474 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2982/6280] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:31.156466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-34904ff4-4ad9-4883-85f8-dd156cec911a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '.version_select at 0x7f074e005af0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:31.210939 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-34904ff4-4ad9-4883-85f8-dd156cec911a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-475259873" status: 202 len: 0 microversion: 2.1 time: 0.058154 Oct 03 11:04:31.213236 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3299/6281] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 3 11:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-475259873 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 11:04:31.647632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:31.648626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:31.665528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:31.672387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:31.673915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:31.675808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:31.678135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:31.679483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:32.584979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:32.623821 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b4fb86e-7768-4153-a6ff-5f6778269ba8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1314 microversion: 2.1 time: 0.983644 Oct 03 11:04:32.628739 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2983/6282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:31 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:33.652846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:33.653479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:33.673058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:33.674679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:33.675148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:33.675891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:33.678773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:33.680959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:34.146600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:34.165837 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-adf799b0-aa1d-4c24-989d-c9cade94fc60 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1501 microversion: 2.1 time: 0.515519 Oct 03 11:04:34.169634 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3300/6283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:33 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1501 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:34.191707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:34.193372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:34.216475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:34.219705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:34.220990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:34.222280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:34.222904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:34.223860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:34.616436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:34.632127 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0cbdaa1-1d7e-42c6-a170-9ee9e73291ec tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1501 microversion: 2.1 time: 0.445472 Oct 03 11:04:34.632976 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2984/6284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:34 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1501 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:34.658908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:34.660343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:34.674197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:34.675042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:34.675737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:34.676650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:34.677253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:34.677853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:34.707834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lazy-loading 'flavor' on Instance uuid 49ca3677-b198-4757-acf0-0870c398e32a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:04:34.874766 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4ef21317-b859-4fbb-ad76-9386ec4dabf4 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action" status: 202 len: 0 microversion: 2.1 time: 0.220530 Oct 03 11:04:34.877231 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3301/6285] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:04:34 2022] POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:04:34.887764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:34.888403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:34.903406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:34.907291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:34.907671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:34.908425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:34.912606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:34.913181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:35.372135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:35.391134 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-18a574b1-6113-4296-a0b2-8d8ebb01e366 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1509 microversion: 2.1 time: 0.508740 Oct 03 11:04:35.399854 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2985/6286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:34 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1509 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:36.453454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:36.460126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:36.464272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:36.483292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:36.484683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:36.488923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:36.491704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:36.493063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:36.496286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.106679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:37.107435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:37.125057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.126508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.128844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.134816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.135594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.136243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.204405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:04:37.265348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:37.281463 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f767310-cc3f-4eaf-97e7-c4f5388ab6cf tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1492 microversion: 2.1 time: 0.830260 Oct 03 11:04:37.282449 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3302/6287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:36 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1492 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:37.292244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-07cf3fef-2a1b-42b9-8211-734d9d9062ca req-c64db8af-80b7-4e97-afce-6945b0510b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1246e2c-2bdd-4240-8e52-897f6d2ee394", "tag": "cc47180c-ce46-4d12-a8f2-0522bae2efc1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:37.321527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-07cf3fef-2a1b-42b9-8211-734d9d9062ca req-c64db8af-80b7-4e97-afce-6945b0510b38 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.322275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-07cf3fef-2a1b-42b9-8211-734d9d9062ca req-c64db8af-80b7-4e97-afce-6945b0510b38 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.322920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-07cf3fef-2a1b-42b9-8211-734d9d9062ca req-c64db8af-80b7-4e97-afce-6945b0510b38 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.328975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:37.353474 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-07cf3fef-2a1b-42b9-8211-734d9d9062ca req-c64db8af-80b7-4e97-afce-6945b0510b38 service nova] Creating event network-changed:cc47180c-ce46-4d12-a8f2-0522bae2efc1 for instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 on n-h1-858383-3 Oct 03 11:04:37.371105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-07cf3fef-2a1b-42b9-8211-734d9d9062ca req-c64db8af-80b7-4e97-afce-6945b0510b38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087333 Oct 03 11:04:37.376261 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3303/6288] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:37.387201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:37.391079 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47a0e428-7b7b-4487-b7fe-0f434aa9adc7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 204 len: 0 microversion: 2.1 time: 0.289547 Oct 03 11:04:37.395900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:37.397213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2986/6289] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:04:37 2022] DELETE /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:04:37.406780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:37.408419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:37.419124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.419701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.420377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.421094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.424324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.425801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.426791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.443822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.445230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.446928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.447909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.448806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.546341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:04:37.582734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e030efa1-67dc-4279-8f83-802bab40dd98 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action" status: 202 len: 0 microversion: 2.1 time: 0.204376 Oct 03 11:04:37.584250 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3304/6290] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:04:37 2022] POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:04:37.614678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:37.617555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:37.625714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.626923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.627637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.628576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:37.629328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:37.629941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:37.923789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:37.936177 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bea3adbd-3027-4af7-8305-41b1442dbc37 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1670 microversion: 2.1 time: 0.537084 Oct 03 11:04:37.945397 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2987/6291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:37 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1670 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:38.170777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:38.180151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ffa0074c-2b49-4f85-93c6-ec97a923288e tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1498 microversion: 2.1 time: 0.578299 Oct 03 11:04:38.182868 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3305/6292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:37 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1498 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:38.963679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:38.965479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:38.975246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:38.976340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:38.977087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:38.978084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:38.978994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:38.979837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:39.214379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:39.217406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:39.238570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:39.239385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:39.241920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:39.244374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:39.247560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:39.248965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:39.717590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:39.728070 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42d6fce1-2cde-469c-8859-d0e795e25a2c tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1670 microversion: 2.1 time: 0.770016 Oct 03 11:04:39.740826 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2988/6293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:38 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1670 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:40.355437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:40.369245 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-695e4430-9f41-449c-b212-5347f82cb4eb tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1498 microversion: 2.1 time: 1.159269 Oct 03 11:04:40.372754 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3306/6294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:39 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1498 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:40.757918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:40.758793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:40.771978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:40.774078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:40.774643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:40.775490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:40.785553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:40.786450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:40.983852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:40.994009 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e81d9dc6-13a3-48a5-8107-1241c5472148 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1603 microversion: 2.1 time: 0.239946 Oct 03 11:04:40.995208 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2989/6295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:40 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1603 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:41.399894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:41.400604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:41.425351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:41.426163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:41.427317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:41.429132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:41.429761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:41.430452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:41.448158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9bb0c334-a31b-45e5-b8bb-1f3b8e845c44 req-74b2a381-606c-47af-8007-518207dc3e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1246e2c-2bdd-4240-8e52-897f6d2ee394", "name": "network-vif-deleted", "tag": "cc47180c-ce46-4d12-a8f2-0522bae2efc1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:41.469207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9bb0c334-a31b-45e5-b8bb-1f3b8e845c44 req-74b2a381-606c-47af-8007-518207dc3e87 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:41.469849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9bb0c334-a31b-45e5-b8bb-1f3b8e845c44 req-74b2a381-606c-47af-8007-518207dc3e87 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:41.470195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9bb0c334-a31b-45e5-b8bb-1f3b8e845c44 req-74b2a381-606c-47af-8007-518207dc3e87 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:41.492669 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9bb0c334-a31b-45e5-b8bb-1f3b8e845c44 req-74b2a381-606c-47af-8007-518207dc3e87 service nova] Creating event network-vif-deleted:cc47180c-ce46-4d12-a8f2-0522bae2efc1 for instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 on n-h1-858383-3 Oct 03 11:04:41.498147 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9bb0c334-a31b-45e5-b8bb-1f3b8e845c44 req-74b2a381-606c-47af-8007-518207dc3e87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053780 Oct 03 11:04:41.498980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2990/6296] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:04:41.843696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:41.857692 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d090b4e-b902-4141-901e-9f705993415a tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1501 microversion: 2.1 time: 0.462087 Oct 03 11:04:41.858487 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3307/6297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:41 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1501 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:41.895116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:41.896362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:41.902298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:41.903062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:41.903754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:41.904701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:41.905369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:41.905992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:41.942451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lazy-loading 'flavor' on Instance uuid 49ca3677-b198-4757-acf0-0870c398e32a {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:04:42.017775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:42.018395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:42.027581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:42.028288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:42.029154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:42.030086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:42.030741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:42.031875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:42.087354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:42.088200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:42.088911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:42.089544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lazy-loading 'fault' on Instance uuid c1246e2c-2bdd-4240-8e52-897f6d2ee394 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:04:42.135918 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24b9d23a-9774-402f-95fb-12be2b222938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action" status: 202 len: 0 microversion: 2.1 time: 0.242654 Oct 03 11:04:42.157248 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2991/6298] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:04:41 2022] POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:04:42.163447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:42.165172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:42.197081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:42.197860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:42.198947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:42.200206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:42.201207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:42.202022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:42.331814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:42.339617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22d457bd-744d-42fd-a9a5-75120de9a6aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 200 len: 1338 microversion: 2.1 time: 0.325686 Oct 03 11:04:42.342865 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3308/6299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:42 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 1338 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:42.575177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:42.593487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-39ed0022-4ed3-4ade-8e7e-1dff052436c8 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1509 microversion: 2.1 time: 0.434445 Oct 03 11:04:42.594483 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2992/6300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:42 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:43.364032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:43.365966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: c1246e2c-2bdd-4240-8e52-897f6d2ee394] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:43.384920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:43.385779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:43.386432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:43.387398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:43.388068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:43.388705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:43.418830 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] HTTP exception thrown: Instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 could not be found. Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Request method failure captured: Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 HTTP/1.1 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsDxbze3z120ev90jDxHDMtkUFD-yG7bzkRuXWwkM2108Godz02e3GXIoWfj00pCg-koPFBNM8z3j8Ca9jQViUqFR7iiCQ-fi5qzaG7jLH19AiK7qwIEiUXEFEAKuXx9bwqKep7S_CwYT1KZKsKu9YRSACdJ1NJPqCgeKrVDmpSui0M Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d466d7c7cd6f4fcba0488c51907d3037 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d466d7c7cd6f4fcba0488c51907d3037"}]}] Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d466d7c7cd6f4fcba0488c51907d3037 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestNetworkBasicOps-1356814400-project Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a49f0fdcb5ec457c8ef571a791fb0e12 Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestNetworkBasicOps-1356814400-project Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 could not be found. Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c1246e2c-2bdd-4240-8e52-897f6d2ee394'} Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 could not be found. Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 could not be found. Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:04:43.423871 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:43.430124 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:43.430124 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:04:43.430124 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:04:43.430124 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:04:43.430124 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:04:43.430124 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 could not be found. Oct 03 11:04:43.430124 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:43.445248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Returning 404 to user: Instance c1246e2c-2bdd-4240-8e52-897f6d2ee394 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:04:43.446580 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac067c82-b19a-4dff-a9b7-e1c29f287810 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394" status: 404 len: 111 microversion: 2.1 time: 0.086730 Oct 03 11:04:43.447360 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3309/6301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:43 2022] GET /compute/v2.1/servers/c1246e2c-2bdd-4240-8e52-897f6d2ee394 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:04:43.619865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:43.621254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:43.640508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:43.641449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:43.642177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:43.643143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:43.643844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:43.644515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:44.085201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:44.094347 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4d11af49-54e9-4096-9993-6f86098bb3e2 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1492 microversion: 2.1 time: 0.478988 Oct 03 11:04:44.095681 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2993/6302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:43 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1492 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:44.134424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:44.134903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:44.147457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:44.148290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:44.148965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:44.149893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:44.150563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:44.151200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:44.241562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-043ef927-80ae-4ae5-a32a-6ef29843ec5d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action" status: 202 len: 0 microversion: 2.1 time: 0.114970 Oct 03 11:04:44.245744 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3310/6303] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:04:44 2022] POST /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:04:44.254436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:44.255721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:44.268976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:44.271023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:44.272364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:44.274810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:44.276718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:44.278569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:44.340290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f11590b7-26c2-4fee-911a-1e9703e28aab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '.version_select at 0x7f074f1beaf0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:44.414781 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f11590b7-26c2-4fee-911a-1e9703e28aab tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-422323642" status: 202 len: 0 microversion: 2.1 time: 0.078972 Oct 03 11:04:44.419622 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3311/6304] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 3 11:04:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-422323642 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:04:44.739247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:44.754833 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc8a8fc4-d99a-4492-b929-88ab26d691af tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1498 microversion: 2.1 time: 0.504868 Oct 03 11:04:44.758339 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2994/6305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:44 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1498 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:45.782994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:45.786196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:45.802642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:45.806460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:45.807306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:45.808249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:45.809791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:45.812981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:46.529081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:46.537889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a5e77bd7-5905-4e5f-a838-a8e30cb88eee tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1498 microversion: 2.1 time: 0.759882 Oct 03 11:04:46.549415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3312/6306] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:45 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1498 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:47.563332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:47.564299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:47.575468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:47.582708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:47.583529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:47.597327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:47.599114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:47.599702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:48.002245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:48.011504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f356957-396b-4b7a-a912-23c25d76ec07 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1498 microversion: 2.1 time: 0.453132 Oct 03 11:04:48.016992 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2995/6307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:47 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:49.034485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:49.035896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:49.046941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:49.048935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:49.050154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:49.052099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:49.056630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:49.059026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:50.326843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:50.336142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca315c58-1621-4dae-a7a1-d9a3f3867e2c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1501 microversion: 2.1 time: 1.305442 Oct 03 11:04:50.339448 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3313/6308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:49 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1501 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:50.367269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:50.367812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:50.387564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:50.388073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:50.388523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:50.400530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:50.401215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:50.401730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:50.463833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:04:50.680560 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13cc6e9d-d767-4b22-9453-eaff382e4c0f tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "DELETE /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 204 len: 0 microversion: 2.1 time: 0.317873 Oct 03 11:04:50.680968 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2996/6309] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:04:50 2022] DELETE /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:04:50.693610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:50.694530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:50.710717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:50.711214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:50.715945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:50.716833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:50.717313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:50.725361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:51.794908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:51.808804 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-011792de-896c-4d76-a92f-537ea9d10aa0 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1507 microversion: 2.1 time: 1.123516 Oct 03 11:04:51.815477 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3314/6310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:50 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1507 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:52.844802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:52.846345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:52.866114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:52.868113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:52.873930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:52.876371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:52.878016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:52.881680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:53.633222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:53.641767 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-658ceb3a-5d92-4e5e-9704-cb9a6c02b938 tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1507 microversion: 2.1 time: 0.801628 Oct 03 11:04:53.642696 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2997/6311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:52 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1507 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:54.031423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-60552e88-fc5f-43a9-bcbf-4a18324a7b0e req-5d43e445-ae59-4a58-ad28-277e8727b74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ca3677-b198-4757-acf0-0870c398e32a", "name": "network-vif-deleted", "tag": "fb474094-96f7-4c88-9c86-c533658d03f6"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:04:54.057331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-60552e88-fc5f-43a9-bcbf-4a18324a7b0e req-5d43e445-ae59-4a58-ad28-277e8727b74e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:54.057941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-60552e88-fc5f-43a9-bcbf-4a18324a7b0e req-5d43e445-ae59-4a58-ad28-277e8727b74e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:54.058392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-60552e88-fc5f-43a9-bcbf-4a18324a7b0e req-5d43e445-ae59-4a58-ad28-277e8727b74e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:54.113814 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-60552e88-fc5f-43a9-bcbf-4a18324a7b0e req-5d43e445-ae59-4a58-ad28-277e8727b74e service nova] Creating event network-vif-deleted:fb474094-96f7-4c88-9c86-c533658d03f6 for instance 49ca3677-b198-4757-acf0-0870c398e32a on n-h2-858383-3 Oct 03 11:04:54.135685 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-60552e88-fc5f-43a9-bcbf-4a18324a7b0e req-5d43e445-ae59-4a58-ad28-277e8727b74e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107751 Oct 03 11:04:54.140343 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3315/6312] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:04:54.668801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:54.671317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:54.682441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:54.684257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:54.685053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:54.686115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:54.686813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:54.687580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:54.730655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:54.731792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:54.732552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:54.733534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lazy-loading 'fault' on Instance uuid 49ca3677-b198-4757-acf0-0870c398e32a {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:04:54.803111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d2268057544f389a9f4b168e87cc89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130e21c8149644f597b7561314ee8afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:04:54.811932 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-49a2fea3-02fa-4389-8ad4-ec9b6a63465d tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 200 len: 1304 microversion: 2.1 time: 0.147856 Oct 03 11:04:54.813494 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2998/6313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:54 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:04:55.841576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:04:55.842563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] [instance: 49ca3677-b198-4757-acf0-0870c398e32a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:04:55.850677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:55.851173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:55.851602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:55.852316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:04:55.852812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:04:55.853235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:04:55.870216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] HTTP exception thrown: Instance 49ca3677-b198-4757-acf0-0870c398e32a could not be found. Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Request method failure captured: Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a HTTP/1.1 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsGnJKts7xNO1yC8GJPNrE7Fm0A3iv8bUJGBi0aRYqxzgRHPONu5s8tRbx-O_2F-MemBP-zD552R4l_2r7iNvh5d9ZzqQ76KZ0ZkPXLzxI0zT3O7aiQrI8VyhxW93AeZ6QMVbg205yyOvofZ7z4nY-HBu-UwX-bGSNzeK3JEo_L1ijY Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 130e21c8149644f597b7561314ee8afe Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestServerAdvancedOps-573939900 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/130e21c8149644f597b7561314ee8afe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_130e21c8149644f597b7561314ee8afe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/130e21c8149644f597b7561314ee8afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/130e21c8149644f597b7561314ee8afe"}]}] Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestServerAdvancedOps-573939900 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 130e21c8149644f597b7561314ee8afe Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestServerAdvancedOps-573939900 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestServerAdvancedOps-573939900-project Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d9d2268057544f389a9f4b168e87cc89 Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestServerAdvancedOps-573939900-project Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 49ca3677-b198-4757-acf0-0870c398e32a could not be found. Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '49ca3677-b198-4757-acf0-0870c398e32a'} Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ca3677-b198-4757-acf0-0870c398e32a could not be found. Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ca3677-b198-4757-acf0-0870c398e32a could not be found. Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:04:55.871905 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:55.876946 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:04:55.876946 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:04:55.876946 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:04:55.876946 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:04:55.876946 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:04:55.876946 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ca3677-b198-4757-acf0-0870c398e32a could not be found. Oct 03 11:04:55.876946 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:04:55.878436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] Returning 404 to user: Instance 49ca3677-b198-4757-acf0-0870c398e32a could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:04:55.879643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7d8da81-68bd-4135-b18a-0c8dd97c331c tempest-TestServerAdvancedOps-573939900 tempest-TestServerAdvancedOps-573939900-project] 10.222.0.27 "GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a" status: 404 len: 111 microversion: 2.1 time: 0.045016 Oct 03 11:04:55.880574 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3316/6314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:04:55 2022] GET /compute/v2.1/servers/49ca3677-b198-4757-acf0-0870c398e32a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:05:01.610423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1919563594", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "c165e5ba-293c-42e3-9ff1-0d8b01e00612"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:01.628672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:01.722515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] validate_networks() for [('c165e5ba-293c-42e3-9ff1-0d8b01e00612', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:05:04.199310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:05:04.199952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:05:04.200303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:05:04.200822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:05:04.201383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:05:04.222256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:04.223215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:04.223751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:04.227134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:04.227780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:04.228361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:04.321520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Getting quotas for project 9cbe977d485a4a74be29cb603aa4a2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:05:04.363113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Getting quotas for user ab494d4d5e1146d28e6d5c687cb67ef2 and project 9cbe977d485a4a74be29cb603aa4a2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:05:04.409574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:05:04.420850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:05:04.567674 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-85fd908b-5eb2-4066-ade6-c18508988c88 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.961571 Oct 03 11:05:04.583226 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 2999/6315] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:05:04.597415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-265b0495-452a-4394-893b-71d9f29f1bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:04.598225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-265b0495-452a-4394-893b-71d9f29f1bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:04.612002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:04.947101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-265b0495-452a-4394-893b-71d9f29f1bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:04.989178 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-265b0495-452a-4394-893b-71d9f29f1bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1214 microversion: 2.1 time: 0.397310 Oct 03 11:05:04.990207 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3317/6316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:04 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1214 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:06.028651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:06.029921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:06.050654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:06.053409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:06.057265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:06.058479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:06.059235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:06.061282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:06.216452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:06.227646 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d1c4bf49-9d17-483b-a042-6b352da556ae tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1266 microversion: 2.1 time: 0.211288 Oct 03 11:05:06.228132 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3000/6317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:06 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:06.623120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=62,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:06.627654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:06.628286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:06.674799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:06.678006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:06.678688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:06.679815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:06.680332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:06.681044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:06.735350 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ffa89703-d282-4779-b5fc-38edbedd9bff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/ips" status: 200 len: 146 microversion: 2.1 time: 0.113776 Oct 03 11:05:06.737763 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3318/6318] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 11:05:06 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/ips => generated 146 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:07.253416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:07.254652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:07.266459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:07.266970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:07.267418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:07.268186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:07.268589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:07.269049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:07.290704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:07.957581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:07.973136 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64a88425-66d2-4da1-bac2-ee98919fade1 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1272 microversion: 2.1 time: 0.723619 Oct 03 11:05:07.973765 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3001/6319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:07 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1272 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:09.014011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:09.016480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:09.041516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:09.043456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:09.044652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:09.046041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:09.047965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:09.049675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:09.856983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:09.883529 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2fbf599d-92ed-496b-81aa-7e97f9438292 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 0.880267 Oct 03 11:05:09.887398 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3319/6320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:09 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:10.908982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:10.909883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:10.924640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:10.925210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:10.925644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:10.926374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:10.940545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:10.941335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:12.013671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:12.029409 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea2a3b58-414d-42b6-bd61-d494174c0f24 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 1.124155 Oct 03 11:05:12.044823 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3002/6321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:10 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:12.309152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21bb5842-11e9-4171-9933-4f4b2f0c429b"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:12.312249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:12.329956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:12.330451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:12.331082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:12.331979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:12.332599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:12.333245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:12.845545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c5449849-b147-4f8a-a3a0-c91091813736 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540150 Oct 03 11:05:12.847175 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3320/6322] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:05:12 2022] POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:12.852236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fe1ff23f-ffc3-4829-baa3-986498f56584 req-ba502116-49a6-4fbb-a510-ead8a043edf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0aab93-8cdd-4aeb-b767-3df97439c21f", "tag": "bf969bf6-b4cc-4d1d-a324-720cf1eb6825"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:12.905971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fe1ff23f-ffc3-4829-baa3-986498f56584 req-ba502116-49a6-4fbb-a510-ead8a043edf3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:12.906566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fe1ff23f-ffc3-4829-baa3-986498f56584 req-ba502116-49a6-4fbb-a510-ead8a043edf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:12.912207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fe1ff23f-ffc3-4829-baa3-986498f56584 req-ba502116-49a6-4fbb-a510-ead8a043edf3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:12.929752 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fe1ff23f-ffc3-4829-baa3-986498f56584 req-ba502116-49a6-4fbb-a510-ead8a043edf3 service nova] Creating event network-changed:bf969bf6-b4cc-4d1d-a324-720cf1eb6825 for instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f on n-h2-858383-3 Oct 03 11:05:12.943084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fe1ff23f-ffc3-4829-baa3-986498f56584 req-ba502116-49a6-4fbb-a510-ead8a043edf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096834 Oct 03 11:05:12.944981 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3003/6323] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:05:13.081486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:13.082205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:13.089013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:13.089516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:13.105378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:13.106197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:13.106696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:13.107147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:13.443881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:13.452710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-373cc515-6749-4489-ad3c-121893d64bbf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 0.376793 Oct 03 11:05:13.458168 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3321/6324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:13 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:13.605377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-759641eb-3f08-423a-952e-f7e5a843f9a5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'create', calling method: .version_select at 0x7f074e2e3310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1028524134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEW40opuQ7T1wOmM6oJuE1RQrx5n4e7xw0uFRWV+1zu3I+h7S/7lksVOh4smG/ZIjxpzP2NPffoiQpWiMBBhYUfwVCuh4Al7R6/bDY8DaDGr3uRRn7DI4dApfiSF4CRu6Q=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:13.639128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-759641eb-3f08-423a-952e-f7e5a843f9a5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:05:13.652930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-759641eb-3f08-423a-952e-f7e5a843f9a5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for user a49f0fdcb5ec457c8ef571a791fb0e12 and project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:05:13.702682 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-759641eb-3f08-423a-952e-f7e5a843f9a5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.103319 Oct 03 11:05:13.703604 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3004/6325] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:05:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:05:14.483370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:14.484190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:14.502476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:14.502966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:14.503611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:14.504530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:14.513577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:14.519883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:14.986134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:15.077793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:15.093818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf1f6b7f-436f-44ab-a21f-070d8257342a tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 0.614300 Oct 03 11:05:15.095152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3322/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:14 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:16.121897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:16.128506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:16.129292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:16.154214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:16.154730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:16.155186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:16.155918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:16.156390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:16.161139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:17.175920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:17.192260 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c50a5fc2-92ee-469a-a29c-5f8d579419dc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 1.072122 Oct 03 11:05:17.194193 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3005/6327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:16 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:18.225593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:18.226213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:18.235481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:18.235996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:18.236432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:18.237180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:18.237638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:18.238070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:19.165229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1365713164", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "9d33f9b0-75ce-42f3-bdfa-0f817d24d90e"}], "key_name": "tempest-TestNetworkBasicOps-1028524134", "security_groups": [{"name": "tempest-secgroup-smoke-1059469499"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:19.229359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:19.238895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d2bd431b-4967-49a2-bfe1-8962e566dde5 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 1.017780 Oct 03 11:05:19.239485 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3323/6328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:18 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:19.576294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] validate_networks() for [('9d33f9b0-75ce-42f3-bdfa-0f817d24d90e', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:05:20.266554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:20.271874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:20.304818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:20.305327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:20.305774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:20.306694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:20.307163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:20.307599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:20.801104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:20.814556 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95453078-5471-4213-875b-d188e5c07725 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 0.552328 Oct 03 11:05:20.816657 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3324/6329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:20 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:21.031754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:05:21.032330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:05:21.032664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:05:21.033115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:05:21.033540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:05:21.050718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:21.051511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:21.052310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:21.058288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:21.059052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:21.059679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:21.109199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:05:21.116855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Getting quotas for user a49f0fdcb5ec457c8ef571a791fb0e12 and project d466d7c7cd6f4fcba0488c51907d3037. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:05:21.135606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d686d123-38d4-48e5-8094-7e0cf991497f req-65424378-b3b0-437f-9084-2360f4b845d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aab93-8cdd-4aeb-b767-3df97439c21f", "name": "network-vif-plugged", "status": "completed", "tag": "bf969bf6-b4cc-4d1d-a324-720cf1eb6825"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:21.152590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d686d123-38d4-48e5-8094-7e0cf991497f req-65424378-b3b0-437f-9084-2360f4b845d2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:21.153117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d686d123-38d4-48e5-8094-7e0cf991497f req-65424378-b3b0-437f-9084-2360f4b845d2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:21.153549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d686d123-38d4-48e5-8094-7e0cf991497f req-65424378-b3b0-437f-9084-2360f4b845d2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:21.171396 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d686d123-38d4-48e5-8094-7e0cf991497f req-65424378-b3b0-437f-9084-2360f4b845d2 service nova] Creating event network-vif-plugged:bf969bf6-b4cc-4d1d-a324-720cf1eb6825 for instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f on n-h2-858383-3 Oct 03 11:05:21.172559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:05:21.182515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:05:21.188680 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d686d123-38d4-48e5-8094-7e0cf991497f req-65424378-b3b0-437f-9084-2360f4b845d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064048 Oct 03 11:05:21.196879 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3325/6330] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:05:21.294542 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b159fbf1-a1f2-4d35-9f1d-de649fbb48a9 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.137464 Oct 03 11:05:21.303474 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3006/6331] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:05:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 11:05:21.308669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff2a7fe4-5b31-4aaa-bd40-dd8485502425 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:21.309428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff2a7fe4-5b31-4aaa-bd40-dd8485502425 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:21.541285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff2a7fe4-5b31-4aaa-bd40-dd8485502425 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:21.549797 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff2a7fe4-5b31-4aaa-bd40-dd8485502425 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1249 microversion: 2.1 time: 0.246696 Oct 03 11:05:21.551472 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3326/6332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:21 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1249 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:21.844531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:21.845891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:21.875722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:21.881847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:21.882523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:21.883584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:21.884229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:21.886939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:22.538778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:22.554115 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-09fb4724-907d-4b59-bcf0-a2d5f73f020e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1314 microversion: 2.1 time: 0.715686 Oct 03 11:05:22.554820 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3007/6333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:21 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:22.581885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:22.583356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:22.594118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:22.594642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:22.595100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:22.595958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:22.596515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:22.597022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:22.802260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:22.820632 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-206b94db-73f1-4984-bc8c-554b430f24b6 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1301 microversion: 2.1 time: 0.247496 Oct 03 11:05:22.846533 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3327/6334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:22 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1301 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:23.583633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:23.584986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:23.593404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:23.594163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:23.594833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:23.595783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:23.596474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:23.597198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:23.855611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:23.856247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:23.877371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:23.890195 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c89f472c-c591-4bd0-a1c7-81d78bbfa95f tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1498 microversion: 2.1 time: 0.310300 Oct 03 11:05:23.890718 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3008/6335] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:23 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1498 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:23.905658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:23.906309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:23.906783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:23.917172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:23.917778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:23.919397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:24.197771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:24.226618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2f9f3568-2aae-492d-8cb8-10b1e1551674 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1307 microversion: 2.1 time: 0.376976 Oct 03 11:05:24.244295 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3328/6336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:23 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1307 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:24.777830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:24.780337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:24.790688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:24.791706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:24.792334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:24.793413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:24.794437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:24.795176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:24.853295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:05:24.992244 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19fa8ddd-7d58-49cd-ae94-2d6e6e3f086b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 204 len: 0 microversion: 2.1 time: 0.220387 Oct 03 11:05:24.997983 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3009/6337] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:05:24 2022] DELETE /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:05:25.003218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:25.003845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:25.013119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:25.013618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:25.018374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:25.019204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:25.019686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:25.020137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:25.262296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:25.263282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:25.293142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:25.295218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:25.296529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:25.297819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:25.298576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:25.301340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:25.921944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:25.935789 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-171e303d-eba6-4041-855b-3980642b8b3d tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1504 microversion: 2.1 time: 0.935709 Oct 03 11:05:25.953669 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3329/6338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:24 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1504 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:26.968151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:26.968816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:26.982759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:26.983345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:26.983776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:26.984523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:26.985072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:26.985488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:27.248411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:27.267764 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df8118b6-2e75-4c57-aeba-71b8f103d319 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 2.011150 Oct 03 11:05:27.269057 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3010/6339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:25 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:27.747356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c86af986-db00-4a66-a814-e85ec6ebdb8a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:27.758041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:27.767374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86af986-db00-4a66-a814-e85ec6ebdb8a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:27.768593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-50322ab7-d63e-49f3-bc87-6f30190d94d8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1504 microversion: 2.1 time: 0.804737 Oct 03 11:05:27.769471 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3330/6340] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:26 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1504 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:27.783562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86af986-db00-4a66-a814-e85ec6ebdb8a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:27.783562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c86af986-db00-4a66-a814-e85ec6ebdb8a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:27.852328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c86af986-db00-4a66-a814-e85ec6ebdb8a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 11:05:27.948415 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c86af986-db00-4a66-a814-e85ec6ebdb8a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action" status: 202 len: 0 microversion: 2.1 time: 0.206629 Oct 03 11:05:27.959924 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:27.960542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:27.966203 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3011/6341] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:05:27 2022] POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 11:05:27.970206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:27.971422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:27.972092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:27.974885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:27.976154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:27.976818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:28.293482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:28.294132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:28.303208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:28.308660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:28.309478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:28.310424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:28.312854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:28.320001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:28.367433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:28.381779 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-deb0f389-8f89-4ede-bd2c-b43470f7fd92 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 0.426787 Oct 03 11:05:28.382379 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3331/6342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:27 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:28.798312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:28.799010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:28.829556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:28.830888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:28.834007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:28.836721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:28.837415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:28.840276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:28.947121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:28.986211 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0357f248-1fc3-498f-8900-7c94fe3a43b5 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.694068 Oct 03 11:05:29.005253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3012/6343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:28 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:29.011006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7cec6697-62a8-4abf-9425-bea488d3336e req-13e39b84-e0e1-4d36-ac55-f21a2463a20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aab93-8cdd-4aeb-b767-3df97439c21f", "name": "network-vif-deleted", "tag": "bf969bf6-b4cc-4d1d-a324-720cf1eb6825"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:29.027499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7cec6697-62a8-4abf-9425-bea488d3336e req-13e39b84-e0e1-4d36-ac55-f21a2463a20c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:29.029021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7cec6697-62a8-4abf-9425-bea488d3336e req-13e39b84-e0e1-4d36-ac55-f21a2463a20c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:29.030366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7cec6697-62a8-4abf-9425-bea488d3336e req-13e39b84-e0e1-4d36-ac55-f21a2463a20c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:29.079164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7cec6697-62a8-4abf-9425-bea488d3336e req-13e39b84-e0e1-4d36-ac55-f21a2463a20c service nova] Creating event network-vif-deleted:bf969bf6-b4cc-4d1d-a324-720cf1eb6825 for instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f on n-h2-858383-3 Oct 03 11:05:29.100809 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7cec6697-62a8-4abf-9425-bea488d3336e req-13e39b84-e0e1-4d36-ac55-f21a2463a20c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087258 Oct 03 11:05:29.102864 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3013/6344] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:29.411356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:29.413444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:29.427825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:29.432111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:29.432623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:29.433295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:29.433760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:29.434191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:29.549384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:29.567296 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a11b661-f14c-4f15-9851-b726048c9694 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 200 len: 1299 microversion: 2.1 time: 0.772962 Oct 03 11:05:29.586082 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3332/6345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:28 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 1299 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:30.012123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:30.012732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:30.024395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:30.028614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:30.029105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:30.029860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:30.030319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:30.030758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:30.034243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:30.057943 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d6dee718-5a05-4fb0-9eb4-9a3844046894 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 0.651967 Oct 03 11:05:30.060519 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3014/6346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:29 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:30.350103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:30.360045 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e5a157c-beec-41a7-824c-dcda53516a14 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.351651 Oct 03 11:05:30.360636 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3333/6347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:30 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:30.617523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:30.618068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 4b0aab93-8cdd-4aeb-b767-3df97439c21f] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:30.624391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:30.624919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:30.625370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:30.626086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:30.626553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:30.626981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:30.685658 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] HTTP exception thrown: Instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f could not be found. Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Request method failure captured: Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f HTTP/1.1 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsHavi9-cfLQbBIQd2-NfqDcbtR-AYA_ivrgpC1LVyIkpQdBOfH5FBWti2HKd91yYzQo68P09QCmu7OIdQ3IYp_AM16VDjaB8U0_zpcWw-31x88qLbBAmU7LcG7gIcDMWmBMY5YfW1UkgRo2Wz2AKYnbQyjSLsKvN6M03qrtbnQ9S7Y Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 9cbe977d485a4a74be29cb603aa4a2ae Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-VolumesActionsTest-315360127 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cbe977d485a4a74be29cb603aa4a2ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9cbe977d485a4a74be29cb603aa4a2ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9cbe977d485a4a74be29cb603aa4a2ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cbe977d485a4a74be29cb603aa4a2ae"}]}] Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-VolumesActionsTest-315360127 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 9cbe977d485a4a74be29cb603aa4a2ae Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-VolumesActionsTest-315360127 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-VolumesActionsTest-315360127-project Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: ab494d4d5e1146d28e6d5c687cb67ef2 Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-VolumesActionsTest-315360127-project Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f could not be found. Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '4b0aab93-8cdd-4aeb-b767-3df97439c21f'} Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f could not be found. Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f could not be found. Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:05:30.690325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:05:30.696679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:05:30.696679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:05:30.696679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:05:30.696679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:05:30.696679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:05:30.696679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f could not be found. Oct 03 11:05:30.696679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:05:30.704045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Returning 404 to user: Instance 4b0aab93-8cdd-4aeb-b767-3df97439c21f could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:05:30.706059 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-00755b3f-4b97-4a61-85e4-4d801ff9601b tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f" status: 404 len: 111 microversion: 2.1 time: 0.093055 Oct 03 11:05:30.707002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3015/6348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:30 2022] GET /compute/v2.1/servers/4b0aab93-8cdd-4aeb-b767-3df97439c21f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:05:30.917557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-145994445", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "c165e5ba-293c-42e3-9ff1-0d8b01e00612"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:31.059632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] validate_networks() for [('c165e5ba-293c-42e3-9ff1-0d8b01e00612', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:05:31.093240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:31.093891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:31.102863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:31.116861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:31.123125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:31.125107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:31.126222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:31.127422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:31.129602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:31.174138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=16 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:31.549540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:32.016375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:05:32.017116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:05:32.017515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:05:32.018257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:05:32.018684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:05:32.040735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:32.041553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:32.042282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:32.045197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:32.046418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:32.048629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:32.103689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Getting quotas for project 9cbe977d485a4a74be29cb603aa4a2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:05:32.114765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Getting quotas for user ab494d4d5e1146d28e6d5c687cb67ef2 and project 9cbe977d485a4a74be29cb603aa4a2ae. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:05:32.146130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:05:32.154336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:05:32.340159 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7cad43df-4b24-485d-8a33-0373b56a65ec tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.428099 Oct 03 11:05:32.352483 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3334/6349] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:05:32.374656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:32.376573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:32.399077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:32.400737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:32.402354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:32.403836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:32.406242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:32.408717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:33.088757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:33.094454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:33.099949 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3195e6c4-0968-4b07-b944-62c495126f51 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.745160 Oct 03 11:05:33.111609 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3335/6350] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:32 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:33.126052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-222bd910-0fa7-425a-b5b8-7fc6a0218f81 req-a81b9cc6-478d-42dc-9067-d5b14f1b12a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed8af39-dc06-460d-9903-90f5b68d39ac", "tag": "cd822b9a-b486-4177-ae46-2e743dc868b5"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:33.155484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-222bd910-0fa7-425a-b5b8-7fc6a0218f81 req-a81b9cc6-478d-42dc-9067-d5b14f1b12a1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:33.155909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-222bd910-0fa7-425a-b5b8-7fc6a0218f81 req-a81b9cc6-478d-42dc-9067-d5b14f1b12a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:33.156348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-222bd910-0fa7-425a-b5b8-7fc6a0218f81 req-a81b9cc6-478d-42dc-9067-d5b14f1b12a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:33.209625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-222bd910-0fa7-425a-b5b8-7fc6a0218f81 req-a81b9cc6-478d-42dc-9067-d5b14f1b12a1 service nova] Creating event network-changed:cd822b9a-b486-4177-ae46-2e743dc868b5 for instance 5ed8af39-dc06-460d-9903-90f5b68d39ac on n-h1-858383-3 Oct 03 11:05:33.221682 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-222bd910-0fa7-425a-b5b8-7fc6a0218f81 req-a81b9cc6-478d-42dc-9067-d5b14f1b12a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099046 Oct 03 11:05:33.222372 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3336/6351] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:33.239418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:33.258153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7aab8364-5e83-4464-ae20-29a45efeb91e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:33.259657 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e35e85e-d95d-4d8e-98ca-6986f0670829 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 2.176690 Oct 03 11:05:33.260734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7aab8364-5e83-4464-ae20-29a45efeb91e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:33.278800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3016/6352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:31 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:33.521092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7aab8364-5e83-4464-ae20-29a45efeb91e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:33.535187 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7aab8364-5e83-4464-ae20-29a45efeb91e tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1213 microversion: 2.1 time: 0.306628 Oct 03 11:05:33.536665 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3337/6353] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:33 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1213 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:34.142766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:34.143867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:34.149739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:34.176367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:34.183724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:34.184499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:34.186167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:34.188749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:34.189506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:34.294020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:34.295317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:34.325120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:34.328143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:34.328625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:34.331757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:34.332349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:34.332822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:34.964120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:34.973861 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a579dac-7eb0-46f5-95c9-64e69ae8de90 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 0.687022 Oct 03 11:05:34.979050 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3338/6354] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:34 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:34.988250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:34.991905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:35.006755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:35.010647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:35.011808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:35.015945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:35.017172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:35.018097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:35.018771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:35.032492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:35.054161 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-821317af-e084-4e1f-bc11-6f2862ec91be tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.919784 Oct 03 11:05:35.055087 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3017/6355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:34 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:35.158070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:35.167612 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-18d9eb5f-a1fa-425a-a1a2-6b7766d96fcc tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1271 microversion: 2.1 time: 0.187056 Oct 03 11:05:35.173104 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3339/6356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:34 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:36.006477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:36.007005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:36.029168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:36.029861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:36.030471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:36.031382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:36.032009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:36.032736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:36.089447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:36.090272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:36.117724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:36.122211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:36.122812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:36.123697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:36.124274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:36.124832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:36.444378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:36.448712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:36.456590 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b252e5a-4a25-4261-8b10-6b69e83ab2f5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 0.455589 Oct 03 11:05:36.461098 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3018/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:35 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:36.476474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:36.477349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:36.509266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:36.509817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:36.514441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:36.522629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:36.523161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:36.527990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:36.718944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:36.737754 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-95457639-20ff-469c-b99c-e1a675da4a23 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1271 microversion: 2.1 time: 0.275218 Oct 03 11:05:36.738364 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3019/6358] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:36 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:37.025007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:37.037772 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3a2a950-4249-467a-b6a5-e101cae5133f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.956777 Oct 03 11:05:37.047715 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3340/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:36 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:37.497963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:37.498599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:37.517189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:37.521909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:37.522621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:37.525212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:37.528386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:37.529013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:37.765816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:37.767606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:37.784058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:37.785027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:37.787077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:37.788983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:37.790758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:37.791484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:38.496433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:38.513787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-360373b0-0612-49c7-847b-b7abdbe01966 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 0.755347 Oct 03 11:05:38.533661 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3341/6360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:37 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:38.558248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:38.559487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:38.575293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:38.578263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:38.578966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:38.581257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:38.585616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:38.587316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:39.154892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:39.172344 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aef99cdf-2f85-47b0-8de9-a2ddecbc65ce tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 1.690323 Oct 03 11:05:39.173070 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3020/6361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:37 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:39.498972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:39.522771 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61c3610f-5a0f-4294-9d63-65efe12f7d1f tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.979383 Oct 03 11:05:39.523885 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3342/6362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:38 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:39.542379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:39.543283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:39.561666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:39.562412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:39.563184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:39.564113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:39.564813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:39.565673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:40.197911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:40.198835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:40.214538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:40.215306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:40.215941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:40.219236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:40.220139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:40.220336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:40.748725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:40.758835 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2c311b92-0de9-4dbc-951f-23c1d7032daf tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 1.221047 Oct 03 11:05:40.777322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3021/6363] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:39 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:40.794904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:40.795858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:40.809024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:40.809844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:40.813182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:40.814532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:40.815574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:40.816336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:41.245878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:41.270378 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-600415dc-e103-48aa-a21b-b0fbbe6d4f1e tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.491652 Oct 03 11:05:41.274484 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3022/6364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:40 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:41.343316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:41.360462 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-20ea7881-f1ad-4783-9210-dcc891a134ae tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 1.167460 Oct 03 11:05:41.362986 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3343/6365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:40 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:41.718428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b83850e8-c652-4a83-b1a8-b9b3a5b98c0b req-2a8bff61-e2ce-4c5b-8991-12767c143c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6420a5c4-bd61-4bc3-9fce-92f9e056fc6b", "tag": "023b079f-9763-4e69-926f-2036818f7bea"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:41.749057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b83850e8-c652-4a83-b1a8-b9b3a5b98c0b req-2a8bff61-e2ce-4c5b-8991-12767c143c67 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:41.750217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b83850e8-c652-4a83-b1a8-b9b3a5b98c0b req-2a8bff61-e2ce-4c5b-8991-12767c143c67 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:41.752245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b83850e8-c652-4a83-b1a8-b9b3a5b98c0b req-2a8bff61-e2ce-4c5b-8991-12767c143c67 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:41.795623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:41.797142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:41.811288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:41.816142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:41.826494 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b83850e8-c652-4a83-b1a8-b9b3a5b98c0b req-2a8bff61-e2ce-4c5b-8991-12767c143c67 service nova] Creating event network-changed:023b079f-9763-4e69-926f-2036818f7bea for instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b on n-h2-858383-3 Oct 03 11:05:41.827233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:41.828315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:41.831170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:41.833232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:41.849659 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b83850e8-c652-4a83-b1a8-b9b3a5b98c0b req-2a8bff61-e2ce-4c5b-8991-12767c143c67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133377 Oct 03 11:05:41.858549 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3023/6366] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:05:41.875962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1257d09c-9b96-4246-8c38-dfd186cb81b4 req-6d3ff444-67fe-4bfa-8966-52baba0dda8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed8af39-dc06-460d-9903-90f5b68d39ac", "name": "network-vif-plugged", "status": "completed", "tag": "cd822b9a-b486-4177-ae46-2e743dc868b5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:41.907083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1257d09c-9b96-4246-8c38-dfd186cb81b4 req-6d3ff444-67fe-4bfa-8966-52baba0dda8e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:41.911127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1257d09c-9b96-4246-8c38-dfd186cb81b4 req-6d3ff444-67fe-4bfa-8966-52baba0dda8e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:41.912304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1257d09c-9b96-4246-8c38-dfd186cb81b4 req-6d3ff444-67fe-4bfa-8966-52baba0dda8e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:41.954543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1257d09c-9b96-4246-8c38-dfd186cb81b4 req-6d3ff444-67fe-4bfa-8966-52baba0dda8e service nova] Creating event network-vif-plugged:cd822b9a-b486-4177-ae46-2e743dc868b5 for instance 5ed8af39-dc06-460d-9903-90f5b68d39ac on n-h1-858383-3 Oct 03 11:05:41.960457 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1257d09c-9b96-4246-8c38-dfd186cb81b4 req-6d3ff444-67fe-4bfa-8966-52baba0dda8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099421 Oct 03 11:05:41.961983 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3024/6367] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:42.065992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:42.298699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:42.299528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:42.313206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:42.313848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:42.315685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:42.320694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:42.321572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:42.322464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:42.715998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:42.739826 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ef88567e-6ea4-4dbb-8dde-85c68f04b87c tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 0.947270 Oct 03 11:05:42.743437 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3344/6368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:41 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:42.762046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:42.765056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:42.779967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:42.782761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:42.788264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:42.789223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:42.789716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:42.790347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:42.807891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:42.839040 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8ea7845-a41f-4b27-9d80-7eb37a63b555 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.544863 Oct 03 11:05:42.839647 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3025/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:42 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:43.319240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:43.334923 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5c8cb168-5073-48f3-8315-70f05c8a0472 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1723 microversion: 2.1 time: 0.587248 Oct 03 11:05:43.337770 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3345/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:42 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1723 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:43.769642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:43.771062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:43.797905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:43.802178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:43.806146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:43.807724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:43.809990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:43.814256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:43.870029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:43.882884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:43.885564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:43.913094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:43.913612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:43.914055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:43.914772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:43.915231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:43.918989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:44.529936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:44.541184 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba5efa5c-1dce-420a-be26-02fa75659040 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 0.779409 Oct 03 11:05:44.545294 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3026/6371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:43 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:44.552789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:44.553667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:44.590739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:44.591687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:44.592326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:44.594188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:44.594844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:44.595472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:44.729966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:44.743037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0b6552c-623f-4498-beab-8250aac3b5aa tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1375 microversion: 2.1 time: 0.880507 Oct 03 11:05:44.744444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3346/6372] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:43 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1375 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:44.852246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:44.882521 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3df468a2-8202-4731-83fe-78e4305d3ede tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1700 microversion: 2.1 time: 0.328769 Oct 03 11:05:44.885517 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3027/6373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:44 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1700 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:44.915403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c505f63f-8625-4025-a06c-3ef90d1a855d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:44.922937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c505f63f-8625-4025-a06c-3ef90d1a855d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:44.925087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c505f63f-8625-4025-a06c-3ef90d1a855d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:44.928022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c505f63f-8625-4025-a06c-3ef90d1a855d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:44.979265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c505f63f-8625-4025-a06c-3ef90d1a855d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Going to try to start instance {{(pid=122269) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 11:05:45.093203 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c505f63f-8625-4025-a06c-3ef90d1a855d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action" status: 202 len: 0 microversion: 2.1 time: 0.184433 Oct 03 11:05:45.095677 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3347/6374] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:05:44 2022] POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:05:45.117327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:45.117949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:45.138388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:45.138897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:45.140436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:45.141660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:45.142338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:45.143842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:45.567308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:45.568184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:45.585575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:45.589063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:45.589897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:45.590909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:45.601340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:45.602174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:46.042542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:46.066791 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ef6f68a-8d90-4b71-af30-6cbb9a3cf894 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 0.501675 Oct 03 11:05:46.082331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:46.083937 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3348/6375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:45 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:46.096346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:46.097388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:46.108632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dce7cac-2885-4fa9-9933-d042be6d5eed tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1709 microversion: 2.1 time: 1.009614 Oct 03 11:05:46.109614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3028/6376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:45 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1709 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:46.117445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:46.118508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:46.119779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:46.121019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:46.121976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:46.122683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:46.713549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:46.729445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f132cae-c1bb-4222-b7a1-f81a06eb9455 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1548 microversion: 2.1 time: 0.635867 Oct 03 11:05:46.730682 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3349/6377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:46 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1548 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:46.753803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:46.754876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:46.770886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:46.773076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:46.774489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:46.775963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:46.776924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:46.779039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:47.095257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:47.095836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:47.112202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:47.112720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:47.113205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:47.113931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:47.114413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:47.114846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:47.382311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:47.393254 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1dc07dee-de0a-487e-b02b-d01c6cf8137b tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1548 microversion: 2.1 time: 0.644227 Oct 03 11:05:47.394710 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3029/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:46 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1548 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:47.404451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:47.405595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:47.417373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:47.418021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:47.418564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:47.419681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:47.420508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:47.422039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:47.782118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:47.792784 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-906dc8ac-a43f-4086-bbd3-44a981d2d087 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 0.702116 Oct 03 11:05:47.793675 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3350/6379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:47 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:47.921717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:47.936448 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65bc6acb-8dad-4c85-aa62-1ccf503d81f8 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1709 microversion: 2.1 time: 0.537919 Oct 03 11:05:47.957636 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3030/6380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:47 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1709 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:48.576241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-035a9274-0dda-49a9-a35e-9d2b0c3cec52 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Action: 'create', calling method: .version_select at 0x7f074dd54ee0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1876529962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYPwxYQX2m4xeTYahRRtqUxu0U4j069VzVfsT7A8H6Aiqp43+Udo+4zzYS3RZAkATTlQh7NB3EjON9VY7WLKAgSDAqS2Hnu5Uo2nXg/OVqpDx2FRiC6YMaWW/38d4Bwng=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:48.611730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-035a9274-0dda-49a9-a35e-9d2b0c3cec52 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Getting quotas for project 52fb070ed8bb4589bb030224219f815d. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:05:48.627425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-035a9274-0dda-49a9-a35e-9d2b0c3cec52 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Getting quotas for user 7a2b74560e4f4179a73a50364de06e3d and project 52fb070ed8bb4589bb030224219f815d. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:05:48.677430 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-035a9274-0dda-49a9-a35e-9d2b0c3cec52 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.332847 Oct 03 11:05:48.679418 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3351/6381] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:05:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:48.820800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:48.821438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:48.835482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:48.840308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:48.841853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:48.848126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:48.852406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:48.853084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:48.967495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:48.968127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:48.984344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:48.984916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:48.985503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:48.986077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:48.986670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:48.986953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:49.431060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:49.444715 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b427ea73-5f07-4553-98e4-e54a24afd41d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1713 microversion: 2.1 time: 0.482748 Oct 03 11:05:49.456793 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3352/6382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:48 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1713 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:49.462012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a84b6b76-3caa-4965-98cf-c8a2614fa775 req-4f308d5b-33c9-4691-b728-1bcd23e56b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6420a5c4-bd61-4bc3-9fce-92f9e056fc6b", "name": "network-vif-plugged", "status": "completed", "tag": "023b079f-9763-4e69-926f-2036818f7bea"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:49.484185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a84b6b76-3caa-4965-98cf-c8a2614fa775 req-4f308d5b-33c9-4691-b728-1bcd23e56b9a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:49.484665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a84b6b76-3caa-4965-98cf-c8a2614fa775 req-4f308d5b-33c9-4691-b728-1bcd23e56b9a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:49.485131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a84b6b76-3caa-4965-98cf-c8a2614fa775 req-4f308d5b-33c9-4691-b728-1bcd23e56b9a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:49.501710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a84b6b76-3caa-4965-98cf-c8a2614fa775 req-4f308d5b-33c9-4691-b728-1bcd23e56b9a service nova] Creating event network-vif-plugged:023b079f-9763-4e69-926f-2036818f7bea for instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b on n-h2-858383-3 Oct 03 11:05:49.508928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a84b6b76-3caa-4965-98cf-c8a2614fa775 req-4f308d5b-33c9-4691-b728-1bcd23e56b9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061109 Oct 03 11:05:49.511372 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3353/6383] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:49.622910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:49.632034 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11ce2b8b-55cf-425b-8a7c-3e3269696cda tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 0.816518 Oct 03 11:05:49.634726 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3031/6384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:48 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:50.659258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:50.659969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:50.684978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:50.685472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:50.689516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:50.691085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:50.691610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:50.692069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:51.313277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:51.335746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:05:51.338704 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40a6f75c-2c50-4808-b929-3563ac335d41 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1313 microversion: 2.1 time: 0.683409 Oct 03 11:05:51.339303 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3354/6385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:50 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:52.364468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:52.369119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:52.375067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1204598241", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1876529962", "security_groups": [{"name": "tempest-secgroup-smoke-563411977"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "34569078-83a1-43cd-842e-1eba2ecc363b"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:52.394979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:52.395494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:52.396605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:52.397543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:52.398234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:52.398842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:52.631745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] validate_networks() for [('34569078-83a1-43cd-842e-1eba2ecc363b', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:05:53.097039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:53.124433 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93e6523b-9621-48d0-ac15-078c27362eea tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1497 microversion: 2.1 time: 0.764977 Oct 03 11:05:53.141363 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3032/6386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:52 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1497 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:53.473538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Getting quotas for project 52fb070ed8bb4589bb030224219f815d. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:05:53.481604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Getting quotas for user 7a2b74560e4f4179a73a50364de06e3d and project 52fb070ed8bb4589bb030224219f815d. Resources: dict_keys(['metadata_items']) {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:05:53.499866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:05:53.500999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:05:53.501820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:05:53.502401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:05:53.502918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:05:53.514259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:53.515038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:53.515698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:53.516706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:53.517293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:53.518030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:53.550742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Getting quotas for project 52fb070ed8bb4589bb030224219f815d. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:05:53.559713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Getting quotas for user 7a2b74560e4f4179a73a50364de06e3d and project 52fb070ed8bb4589bb030224219f815d. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:05:53.579127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:05:53.587332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:05:53.692740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-135f57c9-63b1-4523-9a83-60e2707e018e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.317142 Oct 03 11:05:53.700035 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3355/6387] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:05:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:05:53.712643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2aa82c2f-e9d6-4537-9704-6d1449524dc2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:53.714163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2aa82c2f-e9d6-4537-9704-6d1449524dc2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:53.952145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:53.954693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:53.982316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:53.984631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:53.986477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:53.989093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:53.991437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:53.996711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:54.052164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:05:54.238955 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0fc71b65-4204-4d0a-b275-e719273600c8 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 204 len: 0 microversion: 2.1 time: 0.300106 Oct 03 11:05:54.244931 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3356/6388] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:05:53 2022] DELETE /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:05:54.254084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:54.256438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:54.265994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:54.266798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:54.267498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:54.268458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:54.269189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:54.269858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:54.335857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2aa82c2f-e9d6-4537-9704-6d1449524dc2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:54.343677 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2aa82c2f-e9d6-4537-9704-6d1449524dc2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1303 microversion: 2.1 time: 0.639275 Oct 03 11:05:54.367976 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3033/6389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:53 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1303 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:54.549622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:54.565001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd9fa24b-fde2-4984-a92d-8129330b7613 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1503 microversion: 2.1 time: 0.316407 Oct 03 11:05:54.566200 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3357/6390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:54 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:54.735070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-09567b46-bc0c-427c-8006-44ef521ca179 req-d19445ea-0091-41bb-9d01-474923d993bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed8af39-dc06-460d-9903-90f5b68d39ac", "tag": "cd822b9a-b486-4177-ae46-2e743dc868b5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:54.758979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-09567b46-bc0c-427c-8006-44ef521ca179 req-d19445ea-0091-41bb-9d01-474923d993bc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:54.761116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-09567b46-bc0c-427c-8006-44ef521ca179 req-d19445ea-0091-41bb-9d01-474923d993bc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:54.761575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-09567b46-bc0c-427c-8006-44ef521ca179 req-d19445ea-0091-41bb-9d01-474923d993bc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:54.789051 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-09567b46-bc0c-427c-8006-44ef521ca179 req-d19445ea-0091-41bb-9d01-474923d993bc service nova] Creating event network-changed:cd822b9a-b486-4177-ae46-2e743dc868b5 for instance 5ed8af39-dc06-460d-9903-90f5b68d39ac on n-h1-858383-3 Oct 03 11:05:54.803515 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-09567b46-bc0c-427c-8006-44ef521ca179 req-d19445ea-0091-41bb-9d01-474923d993bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068395 Oct 03 11:05:54.805059 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3034/6391] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:55.379730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:55.382647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:55.411905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:55.413884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:55.415164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:55.417905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:55.418920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:55.423256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:55.595197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:55.596089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:55.626566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:55.627498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:55.628166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:55.629941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:55.633503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:55.637745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:55.774821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:55.789705 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5689eb4b-3ad7-4c57-a5af-fcbdc61c884c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1299 microversion: 2.1 time: 0.413253 Oct 03 11:05:55.790792 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3358/6392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:55 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:56.206208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:56.219179 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-82cfe2fd-9d3b-41ef-8906-791b1febe2b4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1503 microversion: 2.1 time: 0.633267 Oct 03 11:05:56.226170 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3035/6393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:55 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1503 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:56.817899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:56.820634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:56.840744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:56.846013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:56.846970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:56.849030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:56.853018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:56.854984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:57.054256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:57.067768 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6df4db1d-7584-4066-8e1e-8a900d7ff24e tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1361 microversion: 2.1 time: 0.253769 Oct 03 11:05:57.072968 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3359/6394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:56 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:57.184564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-64dfe1ce-41e3-4aa0-8fbe-e8e7c333f63e req-3978546c-a6f0-472e-97af-c6e1e831cd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6420a5c4-bd61-4bc3-9fce-92f9e056fc6b", "name": "network-vif-deleted", "tag": "023b079f-9763-4e69-926f-2036818f7bea"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:05:57.243784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-64dfe1ce-41e3-4aa0-8fbe-e8e7c333f63e req-3978546c-a6f0-472e-97af-c6e1e831cd93 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:57.244444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-64dfe1ce-41e3-4aa0-8fbe-e8e7c333f63e req-3978546c-a6f0-472e-97af-c6e1e831cd93 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:57.253173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:57.253712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:57.263818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-64dfe1ce-41e3-4aa0-8fbe-e8e7c333f63e req-3978546c-a6f0-472e-97af-c6e1e831cd93 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:57.267460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:57.268214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:57.269048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:57.269939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:57.270567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:57.273283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:57.288312 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-64dfe1ce-41e3-4aa0-8fbe-e8e7c333f63e req-3978546c-a6f0-472e-97af-c6e1e831cd93 service nova] Creating event network-vif-deleted:023b079f-9763-4e69-926f-2036818f7bea for instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b on n-h2-858383-3 Oct 03 11:05:57.321372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-64dfe1ce-41e3-4aa0-8fbe-e8e7c333f63e req-3978546c-a6f0-472e-97af-c6e1e831cd93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141088 Oct 03 11:05:57.323889 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3036/6395] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:05:57.487994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab494d4d5e1146d28e6d5c687cb67ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbe977d485a4a74be29cb603aa4a2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:57.504543 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1e8fbad-bb22-48c9-83ee-92c532095ea4 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 200 len: 1298 microversion: 2.1 time: 0.250771 Oct 03 11:05:57.519348 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3360/6396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:57 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:05:58.096054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:58.096891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:58.120830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:58.123002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:58.123480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:58.124250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:58.124725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:58.125189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:58.270482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:58.282003 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1326ff12-d2b2-45f0-8aed-62e8f4d032f3 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1361 microversion: 2.1 time: 0.191768 Oct 03 11:05:58.284760 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3037/6397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:58 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:05:58.553590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:58.554408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] [instance: 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:58.577193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:58.577772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:58.578362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:58.579201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:58.579732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:58.580170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:58.622177 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] HTTP exception thrown: Instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b could not be found. Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Request method failure captured: Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b HTTP/1.1 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsHavi9-cfLQbBIQd2-NfqDcbtR-AYA_ivrgpC1LVyIkpQdBOfH5FBWti2HKd91yYzQo68P09QCmu7OIdQ3IYp_AM16VDjaB8U0_zpcWw-31x88qLbBAmU7LcG7gIcDMWmBMY5YfW1UkgRo2Wz2AKYnbQyjSLsKvN6M03qrtbnQ9S7Y Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 9cbe977d485a4a74be29cb603aa4a2ae Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesActionsTest-315360127 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cbe977d485a4a74be29cb603aa4a2ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9cbe977d485a4a74be29cb603aa4a2ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9cbe977d485a4a74be29cb603aa4a2ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9cbe977d485a4a74be29cb603aa4a2ae"}]}] Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesActionsTest-315360127 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 9cbe977d485a4a74be29cb603aa4a2ae Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesActionsTest-315360127 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesActionsTest-315360127-project Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: ab494d4d5e1146d28e6d5c687cb67ef2 Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesActionsTest-315360127-project Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b could not be found. Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '6420a5c4-bd61-4bc3-9fce-92f9e056fc6b'} Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b could not be found. Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b could not be found. Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:05:58.629382 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:05:58.636505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:05:58.636505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:05:58.636505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:05:58.636505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:05:58.636505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:05:58.636505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b could not be found. Oct 03 11:05:58.636505 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:05:58.640608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] Returning 404 to user: Instance 6420a5c4-bd61-4bc3-9fce-92f9e056fc6b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:05:58.643966 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f379316e-3218-4635-86c3-b529dcd15239 tempest-VolumesActionsTest-315360127 tempest-VolumesActionsTest-315360127-project] 10.222.0.27 "GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b" status: 404 len: 111 microversion: 2.1 time: 0.115838 Oct 03 11:05:58.647414 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3361/6398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:58 2022] GET /compute/v2.1/servers/6420a5c4-bd61-4bc3-9fce-92f9e056fc6b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:05:59.310958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:05:59.314997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:05:59.332194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:59.334676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:59.337890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:59.338885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:05:59.339514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:05:59.342250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:05:59.667642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:05:59.681024 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c6cd1e9f-9299-464a-8fbb-66cbd4f09413 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1361 microversion: 2.1 time: 0.376575 Oct 03 11:05:59.682390 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3038/6399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:05:59 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:00.713612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:00.714710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:00.739853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:00.740424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:00.740929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:00.741678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:00.746514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:00.747133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:01.261576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:01.291514 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bb191fa-e0e8-4bd8-ada5-77f69d63d054 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.580778 Oct 03 11:06:01.292554 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3362/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:00 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:02.332555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:02.336484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:02.359205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:02.366104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:02.367592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:02.368666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:02.371054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:02.372047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:02.407896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:02.926449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:02.944900 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9beb9f4f-bb69-4216-80c1-80ccdbde93f4 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.628261 Oct 03 11:06:02.947370 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3039/6401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:02 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:03.205786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-cd3053ec-62ee-412d-81fe-398f2080b102 req-789b9a27-9c3e-4ca0-9a75-047628964c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f47816-4731-4cd8-8d3a-24f2b93f0adc", "tag": "9cbcbe87-0a56-47d6-999b-0309db1b8476"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:06:03.264448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cd3053ec-62ee-412d-81fe-398f2080b102 req-789b9a27-9c3e-4ca0-9a75-047628964c5c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:03.268264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cd3053ec-62ee-412d-81fe-398f2080b102 req-789b9a27-9c3e-4ca0-9a75-047628964c5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:03.270070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cd3053ec-62ee-412d-81fe-398f2080b102 req-789b9a27-9c3e-4ca0-9a75-047628964c5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:03.295762 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-cd3053ec-62ee-412d-81fe-398f2080b102 req-789b9a27-9c3e-4ca0-9a75-047628964c5c service nova] Creating event network-changed:9cbcbe87-0a56-47d6-999b-0309db1b8476 for instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc on n-h2-858383-3 Oct 03 11:06:03.312215 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-cd3053ec-62ee-412d-81fe-398f2080b102 req-789b9a27-9c3e-4ca0-9a75-047628964c5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114042 Oct 03 11:06:03.314938 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3363/6402] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:06:03.971392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:03.972182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:03.993265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:03.993847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:03.994823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:03.995992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:03.996787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:03.997626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:04.341189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:04.653345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:04.695549 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d2daca9-1836-4a44-b1ff-7a5047cab044 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.729856 Oct 03 11:06:04.702168 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3040/6403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:03 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:05.727155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:05.727773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:05.729847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:05.731394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:05.737566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:05.760628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:05.762746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:05.763443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:05.765246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:05.765990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:05.766642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:06.286177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:06.325484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f274f4e2-cb05-4b48-b1b8-ab3ad6a7477c tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.586137 Oct 03 11:06:06.327828 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3364/6404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:05 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:07.354900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:07.356297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:07.359364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=50 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:07.378125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:07.382557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:07.387155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:07.391072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:07.394265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:07.398404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:07.775647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:07.786689 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7ad5bf8e-84ec-4b90-b687-6340e3a004f2 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.436060 Oct 03 11:06:07.792050 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3041/6405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:07 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:08.814462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:08.815085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:08.840530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:08.841158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:08.841544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:08.842509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:08.843157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:08.844423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:09.270297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:09.285786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1c8db0cd-8335-42fc-b166-3838e7e52542 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.475099 Oct 03 11:06:09.286756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3365/6406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:08 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:10.311401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:10.312900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:10.325998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:10.330105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:10.331234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:10.333677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:10.335011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:10.337839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:10.688000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-35b1c940-853b-4ddf-9485-39f5c8d1df26 req-bba08770-768b-4ca9-9464-2fd071d056b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f47816-4731-4cd8-8d3a-24f2b93f0adc", "name": "network-vif-plugged", "status": "completed", "tag": "9cbcbe87-0a56-47d6-999b-0309db1b8476"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:06:10.725298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-35b1c940-853b-4ddf-9485-39f5c8d1df26 req-bba08770-768b-4ca9-9464-2fd071d056b1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:10.725933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-35b1c940-853b-4ddf-9485-39f5c8d1df26 req-bba08770-768b-4ca9-9464-2fd071d056b1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:10.727772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-35b1c940-853b-4ddf-9485-39f5c8d1df26 req-bba08770-768b-4ca9-9464-2fd071d056b1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:10.788537 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-35b1c940-853b-4ddf-9485-39f5c8d1df26 req-bba08770-768b-4ca9-9464-2fd071d056b1 service nova] Creating event network-vif-plugged:9cbcbe87-0a56-47d6-999b-0309db1b8476 for instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc on n-h2-858383-3 Oct 03 11:06:10.808211 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-35b1c940-853b-4ddf-9485-39f5c8d1df26 req-bba08770-768b-4ca9-9464-2fd071d056b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123773 Oct 03 11:06:10.812355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:10.817781 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3366/6407] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:06:10.836213 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e4c0b62-f1d4-4ca6-bde6-d4d7ad10c782 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.529557 Oct 03 11:06:10.839163 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3042/6408] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:10 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:11.866598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:11.867836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:11.882237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:11.889335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:11.891129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:11.892153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:11.893981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:11.894882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:12.150787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:12.163112 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3842d22e-904d-44aa-91cf-cbe513ee4ffc tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1428 microversion: 2.1 time: 0.300203 Oct 03 11:06:12.163855 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3367/6409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:11 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1428 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:13.187635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:13.188980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:13.200202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:13.202296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:13.205157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:13.206168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:13.212666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:13.213474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:14.209444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:14.220605 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-087fba0c-66f1-4fe2-81f0-3e96441675f8 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1608 microversion: 2.1 time: 1.036863 Oct 03 11:06:14.221918 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3043/6410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:13 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1608 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:14.247250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:14.248068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:14.262595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:14.263410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:14.264208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:14.265192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:14.268442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:14.271145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:14.561261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:14.572049 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ada161cb-c650-45fd-87bc-871d1544ba78 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1608 microversion: 2.1 time: 0.328517 Oct 03 11:06:14.572580 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3368/6411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:14 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1608 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:14.599192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:14.600707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:14.621971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:14.627088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:14.631178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:14.632070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:14.632700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:14.633809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:15.143081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:15.154326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fc9591b6-ecdf-46eb-bfbe-8a77459255e9 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1608 microversion: 2.1 time: 0.560833 Oct 03 11:06:15.155716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3044/6412] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:14 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1608 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:21.537693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b1622b55-fa01-4c8e-9575-2f92a6055ae3 req-94700bc4-19cf-439e-b339-06917fe53d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f47816-4731-4cd8-8d3a-24f2b93f0adc", "tag": "9cbcbe87-0a56-47d6-999b-0309db1b8476"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:06:21.566316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b1622b55-fa01-4c8e-9575-2f92a6055ae3 req-94700bc4-19cf-439e-b339-06917fe53d38 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:21.567068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b1622b55-fa01-4c8e-9575-2f92a6055ae3 req-94700bc4-19cf-439e-b339-06917fe53d38 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:21.567519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b1622b55-fa01-4c8e-9575-2f92a6055ae3 req-94700bc4-19cf-439e-b339-06917fe53d38 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:21.608085 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b1622b55-fa01-4c8e-9575-2f92a6055ae3 req-94700bc4-19cf-439e-b339-06917fe53d38 service nova] Creating event network-changed:9cbcbe87-0a56-47d6-999b-0309db1b8476 for instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc on n-h2-858383-3 Oct 03 11:06:21.626815 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b1622b55-fa01-4c8e-9575-2f92a6055ae3 req-94700bc4-19cf-439e-b339-06917fe53d38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093276 Oct 03 11:06:21.628111 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3369/6413] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:06:22.555373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:06:22.557753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:22.583108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:22.589219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:22.595922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:22.598333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:22.600235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:22.600980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:22.707705 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1eb8a3d9-1c8e-4886-bee7-a50269c01a50 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac/action" status: 200 len: 24567 microversion: 2.1 time: 0.743955 Oct 03 11:06:22.716475 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3045/6414] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:06:21 2022] POST /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac/action => generated 24567 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:06:44.800027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:44.802044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:44.809564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=11 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:44.816266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:44.847316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:44.854526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:44.858949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:44.869931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:44.875709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:44.876319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:45.032289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lazy-loading 'services' on Instance uuid 068e551a-dff3-4556-8b68-70485a0ff892 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:06:45.206103 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5cf8005e-e94c-421e-81f2-a56b3b44e699 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-volume_attachments/21bb5842-11e9-4171-9933-4f4b2f0c429b" status: 202 len: 0 microversion: 2.1 time: 0.411480 Oct 03 11:06:45.207588 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3370/6415] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:06:44 2022] DELETE /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-volume_attachments/21bb5842-11e9-4171-9933-4f4b2f0c429b => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:06:50.822840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:50.824201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:50.837619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=9 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:50.838534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=38 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:50.840526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:50.844175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:50.849017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:50.850722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:50.852087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:50.852737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:50.934799 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5cffd6c4-b1f6-46ee-b4e3-f46191b2676b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.116387 Oct 03 11:06:50.936434 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3046/6416] 10.222.0.27 () {58 vars in 1293 bytes} [Mon Oct 3 11:06:50 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc/os-server-password => generated 116 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:06:55.708391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:55.709199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:06:55.728652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9eafa42f-c612-45af-9a1e-2b586e343897 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:06:55.772857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eafa42f-c612-45af-9a1e-2b586e343897 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:55.773505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eafa42f-c612-45af-9a1e-2b586e343897 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:55.785577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9eafa42f-c612-45af-9a1e-2b586e343897 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:55.905787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9eafa42f-c612-45af-9a1e-2b586e343897 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Going to try to stop instance {{(pid=122269) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 11:06:56.050820 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9eafa42f-c612-45af-9a1e-2b586e343897 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action" status: 202 len: 0 microversion: 2.1 time: 0.344439 Oct 03 11:06:56.052231 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3371/6417] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:06:55 2022] POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:06:56.061384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:56.062794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:56.072339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:56.073512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:56.074329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:56.075508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:56.076409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:56.077335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:56.519277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:56.542352 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc0d833b-4a5a-493f-a471-eac3058002cc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1677 microversion: 2.1 time: 0.483494 Oct 03 11:06:56.566027 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3047/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:56 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1677 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:57.571857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:57.572680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:57.589172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:57.589678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:57.590118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:57.590828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:57.598593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:57.599217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:58.335601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:58.360170 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0e284b5-3bf2-44d7-9c89-972ef44bc578 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1677 microversion: 2.1 time: 0.790259 Oct 03 11:06:58.360738 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3372/6419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:57 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1677 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:06:59.384210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:06:59.384871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:06:59.400957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:59.401350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:59.402367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:59.403267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:06:59.404035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:06:59.404667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:06:59.694304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:06:59.702296 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc4b681e-df5d-47a9-a493-ceb6ebc775b0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1677 microversion: 2.1 time: 0.322397 Oct 03 11:06:59.707875 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3048/6420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:06:59 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1677 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:00.732267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:00.733036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:00.746772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:00.747497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:00.748123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:00.749549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:00.750945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:00.759374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:01.617809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:01.626642 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1cb95b0a-bc90-4033-81e9-2c12a21aa910 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1677 microversion: 2.1 time: 0.898681 Oct 03 11:07:01.628662 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3373/6421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:00 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1677 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:01.767064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:07:01.770054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:01.783323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:01.784116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:01.784728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:01.789645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:01.790359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:01.801570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:01.897044 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7ed98764-4edb-4039-9beb-6b0a2e23ea3a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "POST /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac/action" status: 200 len: 32633 microversion: 2.1 time: 0.133709 Oct 03 11:07:01.898816 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3049/6422] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:07:01 2022] POST /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac/action => generated 32633 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:07:02.651746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:02.653246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:02.665359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:02.669896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:02.670537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:02.671821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:02.674972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:02.675617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:03.309942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:03.334587 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68cf4769-8cf5-4338-bf55-4544b2389c7b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1677 microversion: 2.1 time: 0.687648 Oct 03 11:07:03.358935 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3374/6423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:02 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1677 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:04.373545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:04.374482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:04.388159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:04.388852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:04.393357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:04.394281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:04.394900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:04.395519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:04.796824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:04.806735 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d04b60c8-4c88-46cd-90c1-88669be1e0ff tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1677 microversion: 2.1 time: 0.438988 Oct 03 11:07:04.839557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:04.841445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:04.847520 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3050/6424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:04 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1677 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:04.851960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:04.856297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f6f24494-9103-46d3-9af7-770352471902 req-17d727dc-593d-485f-b86a-2f14dc8b05ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed8af39-dc06-460d-9903-90f5b68d39ac", "tag": "cd822b9a-b486-4177-ae46-2e743dc868b5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:07:04.857227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:04.857966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:04.858960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:04.866115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:04.867552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:04.880575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f6f24494-9103-46d3-9af7-770352471902 req-17d727dc-593d-485f-b86a-2f14dc8b05ab service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:04.889278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f6f24494-9103-46d3-9af7-770352471902 req-17d727dc-593d-485f-b86a-2f14dc8b05ab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:04.890002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f6f24494-9103-46d3-9af7-770352471902 req-17d727dc-593d-485f-b86a-2f14dc8b05ab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:04.913583 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f6f24494-9103-46d3-9af7-770352471902 req-17d727dc-593d-485f-b86a-2f14dc8b05ab service nova] Creating event network-changed:cd822b9a-b486-4177-ae46-2e743dc868b5 for instance 5ed8af39-dc06-460d-9903-90f5b68d39ac on n-h1-858383-3 Oct 03 11:07:04.921792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:07:04.929201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f6f24494-9103-46d3-9af7-770352471902 req-17d727dc-593d-485f-b86a-2f14dc8b05ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079878 Oct 03 11:07:04.930247 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3051/6425] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:07:05.086419 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2d67e78f-08fc-47ca-9330-e20c5187cfb7 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 204 len: 0 microversion: 2.1 time: 0.253964 Oct 03 11:07:05.090377 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3375/6426] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:07:04 2022] DELETE /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:07:05.096836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:05.098060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:05.105093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:05.105939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:05.109105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:05.110957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:05.111710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:05.112664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:05.709296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:05.718492 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d77e8fd-6a36-4b87-8328-a9c0039cb509 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1673 microversion: 2.1 time: 0.626353 Oct 03 11:07:05.724355 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3052/6427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:05 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1673 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:05.840162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:05.841484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:05.851607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:05.857001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:05.861409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:05.863116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:05.863604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:05.864057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:06.161537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:06.176161 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-516989c1-0c1f-4b07-98aa-2181a6273689 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1677 microversion: 2.1 time: 0.338127 Oct 03 11:07:06.182575 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3376/6428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:05 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1677 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:06.748883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:06.750251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:06.758457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:06.759221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:06.759686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:06.760991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:06.762119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:06.763057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:07.213119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:07.213989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:07.226572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:07.232368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:07.232950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:07.233730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:07.234206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:07.234638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:07.531365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:07.610148 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9deec50a-067b-4e5f-a4f5-1ef681b2e997 tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1673 microversion: 2.1 time: 0.862888 Oct 03 11:07:07.624838 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3053/6429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:06 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1673 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:07:07.682068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:07.715076 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b2e37277-ef82-4b32-be72-59580220da2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1654 microversion: 2.1 time: 0.504190 Oct 03 11:07:07.730082 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3377/6430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:07 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1654 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:07.753091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58734845-7511-4670-b450-7a39e68490e0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:07:07.777509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58734845-7511-4670-b450-7a39e68490e0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:07.778207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58734845-7511-4670-b450-7a39e68490e0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:07.778604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58734845-7511-4670-b450-7a39e68490e0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:07.885281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-58734845-7511-4670-b450-7a39e68490e0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Going to try to start instance {{(pid=122270) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 11:07:07.989792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58734845-7511-4670-b450-7a39e68490e0 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action" status: 202 len: 0 microversion: 2.1 time: 0.243682 Oct 03 11:07:08.007873 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3054/6431] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:07:07 2022] POST /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:07:08.015373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:08.016304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:08.029482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:08.032136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:08.035711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:08.039283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:08.041486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:08.041961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:08.639662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:08.640371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:08.651054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:08.651556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:08.664046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:08.665316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:08.665813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:08.666256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:08.878976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:08.891668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4852b810-ccdb-4ed6-b3bf-d73ff8c02cad tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1605 microversion: 2.1 time: 0.256214 Oct 03 11:07:08.894746 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3055/6432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:08 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1605 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:07:09.282301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:09.302256 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-321aaba5-2922-46f4-8e84-f8fbf660a700 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1663 microversion: 2.1 time: 1.290256 Oct 03 11:07:09.323521 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3378/6433] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:08 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1663 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:07:09.526999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-e9d3a453-c66c-4c4c-afa1-b4732c42308c req-ce56213c-2d96-413d-9e9f-cab852853e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed8af39-dc06-460d-9903-90f5b68d39ac", "name": "network-vif-deleted", "tag": "cd822b9a-b486-4177-ae46-2e743dc868b5"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:07:09.554494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e9d3a453-c66c-4c4c-afa1-b4732c42308c req-ce56213c-2d96-413d-9e9f-cab852853e00 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:09.554976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e9d3a453-c66c-4c4c-afa1-b4732c42308c req-ce56213c-2d96-413d-9e9f-cab852853e00 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:09.555411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-e9d3a453-c66c-4c4c-afa1-b4732c42308c req-ce56213c-2d96-413d-9e9f-cab852853e00 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:09.596650 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-e9d3a453-c66c-4c4c-afa1-b4732c42308c req-ce56213c-2d96-413d-9e9f-cab852853e00 service nova] Creating event network-vif-deleted:cd822b9a-b486-4177-ae46-2e743dc868b5 for instance 5ed8af39-dc06-460d-9903-90f5b68d39ac on n-h1-858383-3 Oct 03 11:07:09.620382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-e9d3a453-c66c-4c4c-afa1-b4732c42308c req-ce56213c-2d96-413d-9e9f-cab852853e00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.565824 Oct 03 11:07:09.621644 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3056/6434] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:07:09.925011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:09.926458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:09.957861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:09.959031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:09.960584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:09.963834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:09.965516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:09.967086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:10.073146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:10.073941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:10.074568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:10.075237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lazy-loading 'fault' on Instance uuid 5ed8af39-dc06-460d-9903-90f5b68d39ac {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:07:10.183905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49f0fdcb5ec457c8ef571a791fb0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd466d7c7cd6f4fcba0488c51907d3037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:10.200255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-01164bd8-88bf-429d-934a-b8e8806f55bc tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 200 len: 1339 microversion: 2.1 time: 0.284548 Oct 03 11:07:10.203373 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3379/6435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:09 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:10.331132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:10.331749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:10.346218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:10.346722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:10.347178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:10.354259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:10.357507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:10.358971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:11.235607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:11.236404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] [instance: 5ed8af39-dc06-460d-9903-90f5b68d39ac] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:11.255823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:11.257040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:11.261341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:11.291372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:11.292105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:11.293423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:11.322889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] HTTP exception thrown: Instance 5ed8af39-dc06-460d-9903-90f5b68d39ac could not be found. Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Request method failure captured: Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac HTTP/1.1 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsDxbze3z120ev90jDxHDMtkUFD-yG7bzkRuXWwkM2108Godz02e3GXIoWfj00pCg-koPFBNM8z3j8Ca9jQViUqFR7iiCQ-fi5qzaG7jLH19AiK7qwIEiUXEFEAKuXx9bwqKep7S_CwYT1KZKsKu9YRSACdJ1NJPqCgeKrVDmpSui0M Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: d466d7c7cd6f4fcba0488c51907d3037 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d466d7c7cd6f4fcba0488c51907d3037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d466d7c7cd6f4fcba0488c51907d3037"}]}] Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: d466d7c7cd6f4fcba0488c51907d3037 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestNetworkBasicOps-1356814400 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestNetworkBasicOps-1356814400-project Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a49f0fdcb5ec457c8ef571a791fb0e12 Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestNetworkBasicOps-1356814400-project Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 5ed8af39-dc06-460d-9903-90f5b68d39ac could not be found. Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '5ed8af39-dc06-460d-9903-90f5b68d39ac'} Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ed8af39-dc06-460d-9903-90f5b68d39ac could not be found. Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ed8af39-dc06-460d-9903-90f5b68d39ac could not be found. Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:07:11.325732 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:07:11.332465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:07:11.332465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:07:11.332465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:07:11.332465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:07:11.332465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:07:11.332465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ed8af39-dc06-460d-9903-90f5b68d39ac could not be found. Oct 03 11:07:11.332465 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:07:11.342851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Returning 404 to user: Instance 5ed8af39-dc06-460d-9903-90f5b68d39ac could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:07:11.352496 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8f1373df-e9f6-4645-a44c-59ac771fdefd tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac" status: 404 len: 111 microversion: 2.1 time: 0.122594 Oct 03 11:07:11.357947 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3380/6436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:11 2022] GET /compute/v2.1/servers/5ed8af39-dc06-460d-9903-90f5b68d39ac => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:07:11.895731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:11.906349 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5c29479b-1416-4111-89d0-f2a1d4e3ec1f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1663 microversion: 2.1 time: 1.581565 Oct 03 11:07:11.920809 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3057/6437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:10 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1663 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:12.725279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4ae84f90-03a3-4827-b212-146276dcdf5a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] Calling method '.version_select at 0x7f074dd68f70>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:12.787418 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4ae84f90-03a3-4827-b212-146276dcdf5a tempest-TestNetworkBasicOps-1356814400 tempest-TestNetworkBasicOps-1356814400-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1028524134" status: 202 len: 0 microversion: 2.1 time: 0.066631 Oct 03 11:07:12.788078 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3381/6438] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 3 11:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1028524134 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:07:12.936328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:12.937581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:12.947017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:12.947836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:12.949325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:12.950246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:12.950896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:12.951511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:13.729736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:07:13.748628 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da1eb2ad-f0f8-4520-93a0-0ec4b43db81b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1667 microversion: 2.1 time: 0.816171 Oct 03 11:07:13.767395 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3058/6439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:12 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1667 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:49.968641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:07:49.969417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:07:50.162837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:50.165388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:50.166298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:50.166940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:50.167950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:50.168660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:50.169308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:50.203416 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a110a18-2d50-499b-a057-372b4f876357 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.237353 Oct 03 11:07:50.204603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3382/6440] 10.222.0.27 () {58 vars in 1185 bytes} [Mon Oct 3 11:07:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:07:50.333820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2112080027", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-3", "networks": [{"uuid": "b2c58b67-4af8-4954-9c28-6299740d6394"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:07:50.353923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=26 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:07:50.355543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:07:50.437099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] validate_networks() for [('b2c58b67-4af8-4954-9c28-6299740d6394', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:07:51.942804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:07:51.944004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:07:51.944685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:07:51.945273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:07:51.945700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:07:51.976611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:51.976611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:51.976611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:51.976611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:51.976611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:51.976611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:52.013890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Getting quotas for project 0a766b3196a542839404ea23c60edf5b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:07:52.020938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Getting quotas for user 6cbb3f871eda444cbd60f938bab3960c and project 0a766b3196a542839404ea23c60edf5b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:07:52.040423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:07:52.044654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:07:52.117969 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96741617-14ff-437b-b16c-7a6e83b0f048 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789662 Oct 03 11:07:52.122762 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3059/6441] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:07:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:07:52.134566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd47e155-90ba-416f-9cd5-241e5c19cdd4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:52.136441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fd47e155-90ba-416f-9cd5-241e5c19cdd4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:52.245906 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd47e155-90ba-416f-9cd5-241e5c19cdd4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1329 microversion: 2.1 time: 0.116336 Oct 03 11:07:52.246933 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3383/6442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:52 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:53.278508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:53.279622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:53.348321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:53.354638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:53.357322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:53.358277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:53.361844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:53.362626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:53.678537 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-82c13b1b-9dd8-4466-b963-acedd6cd5579 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1338 microversion: 2.1 time: 0.411614 Oct 03 11:07:53.679142 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3060/6443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:53 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1338 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:54.703541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:54.704176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:54.737498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:54.738830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:54.741489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:54.745082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:54.745758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:54.746391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:54.918426 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-41ede5d3-2384-4b45-a743-a6efea42fedf tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1422 microversion: 2.1 time: 0.219119 Oct 03 11:07:54.923264 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3384/6444] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:54 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1422 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:55.949678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:55.950962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:55.965394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:55.968199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:55.970383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:55.971807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:55.972465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:55.973134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:56.700257 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-169bdd8e-0f10-457b-9c74-978ae604b9f2 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1464 microversion: 2.1 time: 0.755315 Oct 03 11:07:56.700863 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3061/6445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:55 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1464 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:57.451598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-875a286a-e19e-44db-b92b-2ff92dd10920 req-d52d4424-4cf7-4434-914a-65c18a4dd14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d9d2f2-627b-4041-be8d-af012ed3ff97", "tag": "cfb092b1-a720-43f0-b675-896e24b60f4d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:07:57.486434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-875a286a-e19e-44db-b92b-2ff92dd10920 req-d52d4424-4cf7-4434-914a-65c18a4dd14f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:57.487302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-875a286a-e19e-44db-b92b-2ff92dd10920 req-d52d4424-4cf7-4434-914a-65c18a4dd14f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:57.488105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-875a286a-e19e-44db-b92b-2ff92dd10920 req-d52d4424-4cf7-4434-914a-65c18a4dd14f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:57.545130 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-875a286a-e19e-44db-b92b-2ff92dd10920 req-d52d4424-4cf7-4434-914a-65c18a4dd14f service nova] Creating event network-changed:cfb092b1-a720-43f0-b675-896e24b60f4d for instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 on n-h2-858383-3 Oct 03 11:07:57.557799 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-875a286a-e19e-44db-b92b-2ff92dd10920 req-d52d4424-4cf7-4434-914a-65c18a4dd14f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113908 Oct 03 11:07:57.559275 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3385/6446] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:07:57.724692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:57.726230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:57.734994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:57.735928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:57.736526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:57.739806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:57.740519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:57.741157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:58.161775 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-034cabd0-89ca-4483-ba39-3eb5fb5812c0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1464 microversion: 2.1 time: 0.435940 Oct 03 11:07:58.165898 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3062/6447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:57 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1464 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:07:59.189622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:07:59.191026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:07:59.201150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:59.201918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:59.202590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:59.203581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:07:59.204257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:07:59.205035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:07:59.377060 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce3d9bfe-2af6-4722-829d-49b58107be5b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1464 microversion: 2.1 time: 0.191103 Oct 03 11:07:59.377855 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3386/6448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:07:59 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:00.401260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:00.401925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:00.421516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:00.422725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:00.423173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:00.424200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:00.424831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:00.425594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:01.034373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c60a142c-36b8-4012-8843-a47f07259a3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1464 microversion: 2.1 time: 0.635720 Oct 03 11:08:01.036473 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3063/6449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:00 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1464 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:02.061812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:02.062431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:02.064646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:02.077720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:02.079145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:02.079791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:02.080705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:02.081773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:02.082389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:02.241637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:02.367565 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f7fdf320-9986-46f9-9aa4-c01e3b5133ed tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1464 microversion: 2.1 time: 0.309590 Oct 03 11:08:02.369458 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3387/6450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:02 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:03.142155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:03.143453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:03.269239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-edb3b642-f30c-454d-a3e0-8927cf3c9636 req-4d12afc4-1a5c-451f-b0c9-d40497771605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d9d2f2-627b-4041-be8d-af012ed3ff97", "name": "network-vif-plugged", "status": "completed", "tag": "cfb092b1-a720-43f0-b675-896e24b60f4d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:03.283889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-edb3b642-f30c-454d-a3e0-8927cf3c9636 req-4d12afc4-1a5c-451f-b0c9-d40497771605 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:03.284858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-edb3b642-f30c-454d-a3e0-8927cf3c9636 req-4d12afc4-1a5c-451f-b0c9-d40497771605 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:03.285385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-edb3b642-f30c-454d-a3e0-8927cf3c9636 req-4d12afc4-1a5c-451f-b0c9-d40497771605 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:03.305456 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-edb3b642-f30c-454d-a3e0-8927cf3c9636 req-4d12afc4-1a5c-451f-b0c9-d40497771605 service nova] Creating event network-vif-plugged:cfb092b1-a720-43f0-b675-896e24b60f4d for instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 on n-h2-858383-3 Oct 03 11:08:03.320168 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-edb3b642-f30c-454d-a3e0-8927cf3c9636 req-4d12afc4-1a5c-451f-b0c9-d40497771605 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184813 Oct 03 11:08:03.321844 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3064/6451] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:03.412058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:03.413871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:03.425170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:03.425795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:03.426848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:03.428398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:03.433869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:03.435180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:03.723483 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9e2dd86a-b63e-4153-8e61-2f35a4bdb111 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1464 microversion: 2.1 time: 0.317839 Oct 03 11:08:03.725186 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3388/6452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:03 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:04.817925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:05.162871 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a93cae58-bc4c-43ef-ad49-c19c8a71a268 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1464 microversion: 2.1 time: 0.417675 Oct 03 11:08:05.166973 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3065/6453] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:04 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1464 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:06.207317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:06.211656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:06.238738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:06.241405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:06.241879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:06.243328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:06.243832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:06.244271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:06.480109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61d3873e-1b38-46b6-abae-406561809e21 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1649 microversion: 2.1 time: 0.292766 Oct 03 11:08:06.497510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3389/6454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:06 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1649 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:06.516621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:06.517267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:06.533595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:06.534330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:06.534919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:06.535786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:06.536392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:06.537025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:06.919422 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-15c5aacc-f73d-4e25-bf10-bd9c96738054 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1649 microversion: 2.1 time: 0.406618 Oct 03 11:08:06.951067 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3066/6455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:06 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1649 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:06.966836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:06.968858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:06.983119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:06.983622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:06.984078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:06.984820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:06.985744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:06.986348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:07.613221 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5323b312-1b4d-40cf-b22e-7514870785e4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1649 microversion: 2.1 time: 0.653517 Oct 03 11:08:07.615154 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3390/6456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:06 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1649 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:07.765107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2009184900", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-3", "networks": [{"uuid": "b2c58b67-4af8-4954-9c28-6299740d6394"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:07.858576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] validate_networks() for [('b2c58b67-4af8-4954-9c28-6299740d6394', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:08:09.275428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:09.280435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:09.306716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.324648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:09.329930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:09.340011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.342483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:09.344630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:09.370790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:08:09.371325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:08:09.372254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:08:09.372695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:08:09.374181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:08:09.425483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.427648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:09.429536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:09.434265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.436847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:09.437935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:09.469812 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-808b88be-b437-48cc-b841-18966614f778 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.206038 Oct 03 11:08:09.471216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3391/6457] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:08:09 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 11:08:09.479087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Getting quotas for project 0a766b3196a542839404ea23c60edf5b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:08:09.486391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Getting quotas for user 6cbb3f871eda444cbd60f938bab3960c and project 0a766b3196a542839404ea23c60edf5b. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:08:09.503652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:08:09.506619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:08:09.565841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:09.586356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:09.598155 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f0b702d-4cb3-453d-b71d-2044d971708b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.837371 Oct 03 11:08:09.602291 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3067/6458] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 11:08:09.608353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.608961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:09.609598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:09.610163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.611140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:09.611543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:09.614835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ae3e0c1-c895-4f5c-8d3e-9723ff95d779 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:09.618775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ae3e0c1-c895-4f5c-8d3e-9723ff95d779 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:09.716012 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ae3e0c1-c895-4f5c-8d3e-9723ff95d779 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1329 microversion: 2.1 time: 0.104727 Oct 03 11:08:09.717038 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3068/6459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:09 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:09.759540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:08:09.966610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8c36e01a-a99a-45ec-94bd-cde018d2a2bc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 204 len: 0 microversion: 2.1 time: 0.408713 Oct 03 11:08:09.967746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3392/6460] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:08:09 2022] DELETE /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:08:09.977398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:09.978118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:09.992916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.994253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:09.997865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:09.998632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:09.999418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:10.000015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:10.279433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:10.299457 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eee802d4-e21d-4195-a85e-ae97bbe4da1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1673 microversion: 2.1 time: 0.327154 Oct 03 11:08:10.305501 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3069/6461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:09 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1673 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:10.748759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:10.749622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:10.756969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:10.757691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:10.758318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:10.759210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:10.759676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:10.760275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:10.892366 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c214204-b164-4d18-85a2-6a9ba6dc1060 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1346 microversion: 2.1 time: 0.148266 Oct 03 11:08:10.908820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3393/6462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:10 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:11.330597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:11.331216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:11.345229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:11.346421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:11.347029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:11.349239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:11.353172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:11.355950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:11.785387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:11.794204 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-07ca8665-7f56-4ad9-8239-dd4096751785 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1673 microversion: 2.1 time: 0.467937 Oct 03 11:08:11.801377 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3070/6463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:11 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1673 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:11.918060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:11.919575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:11.934584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:11.961377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:11.965535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:11.972964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:11.976404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:11.977016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:12.097807 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b59dc5f7-9f2c-4a2b-b7d8-eb13805abb37 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1338 microversion: 2.1 time: 0.183499 Oct 03 11:08:12.099024 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3394/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:11 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1338 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:12.825833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:12.827295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:12.844902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:12.845945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:12.847143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:12.849379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:12.851798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:12.853115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:13.123329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:13.124855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:13.153285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:13.155141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:13.155915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:13.157537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:13.158919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:13.159558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:13.365240 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22dbb90d-4127-43e1-9748-8aa650a7ff4c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1422 microversion: 2.1 time: 0.239281 Oct 03 11:08:13.366498 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3395/6465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:13 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1422 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:14.018179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:14.049661 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f216886-3687-44cd-a54f-7ab5bf008b6a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1673 microversion: 2.1 time: 1.225360 Oct 03 11:08:14.074724 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3071/6466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:12 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1673 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:14.391822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:14.393123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:14.408202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:14.414330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:14.415135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:14.416327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:14.421945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:14.423301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:14.584976 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d9b729a-cdd6-46b8-be5d-000d30b303fb tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1422 microversion: 2.1 time: 0.197056 Oct 03 11:08:14.589670 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3396/6467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:14 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1422 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:15.099062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:15.101548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:15.132936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:15.135430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:15.136302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:15.137447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:15.138286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:15.138872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:15.431589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:15.452582 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e013fd3e-8906-470f-ae47-b2f468c749c4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1606 microversion: 2.1 time: 0.355700 Oct 03 11:08:15.457567 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3072/6468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:15 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1606 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:15.618062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:15.618808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:15.634586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:15.635098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:15.635549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:15.636265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:15.639218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:15.639861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:16.189989 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a4faf7f-692c-427d-965b-fc8a25f5a96c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.575551 Oct 03 11:08:16.194310 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3397/6469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:15 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:16.210237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-59d512d5-cfa9-4761-b232-dd0925743640 req-b309d77e-5ae6-4a70-931f-00e3c7a96ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068e551a-dff3-4556-8b68-70485a0ff892", "name": "network-vif-deleted", "tag": "6f129fce-3650-4d44-9dcd-244ba2d16de6"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:16.242171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-59d512d5-cfa9-4761-b232-dd0925743640 req-b309d77e-5ae6-4a70-931f-00e3c7a96ce0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:16.242717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-59d512d5-cfa9-4761-b232-dd0925743640 req-b309d77e-5ae6-4a70-931f-00e3c7a96ce0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:16.243169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-59d512d5-cfa9-4761-b232-dd0925743640 req-b309d77e-5ae6-4a70-931f-00e3c7a96ce0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:16.278681 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-59d512d5-cfa9-4761-b232-dd0925743640 req-b309d77e-5ae6-4a70-931f-00e3c7a96ce0 service nova] Creating event network-vif-deleted:6f129fce-3650-4d44-9dcd-244ba2d16de6 for instance 068e551a-dff3-4556-8b68-70485a0ff892 on n-h1-858383-3 Oct 03 11:08:16.294936 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-59d512d5-cfa9-4761-b232-dd0925743640 req-b309d77e-5ae6-4a70-931f-00e3c7a96ce0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089555 Oct 03 11:08:16.295685 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3073/6470] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:16.485895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:16.486730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:16.501216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:16.501725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:16.502172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:16.505223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:16.505617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:16.506613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:16.597653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:16.598528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:16.599141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:16.600005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lazy-loading 'fault' on Instance uuid 068e551a-dff3-4556-8b68-70485a0ff892 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:08:16.763269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:16.774956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:16.786818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b97516f4-bf89-4a72-80f5-e500ca9a2658 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 200 len: 1327 microversion: 2.1 time: 0.308413 Oct 03 11:08:16.809921 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3398/6471] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:16 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 1327 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:17.222964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:17.223686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:17.254283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:17.254964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:17.256389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:17.259779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:17.261995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:17.262409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:17.725735 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-be0ae78e-8d70-4f33-a7ba-9c608ef9f50e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.508117 Oct 03 11:08:17.726573 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3074/6472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:17 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:17.841640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:17.842350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:17.869628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:17.871613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:17.872354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:17.873364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:17.874084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:17.874766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:17.897412 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] HTTP exception thrown: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Request method failure captured: Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 HTTP/1.1 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsF9R6HBGXoOFSjz_CqSESd6gOqqpWbMoiVeWAHhoLQq8a0lsbhLxOCGQAKOXAnX9yUPBnfyYu1Vd-2xmeN6dYljl44m4TyVEnyJdtjDyyQOtjeF6cJ_N9nrjPLJbVmeW2BVc8968EQ4ibgNjXRds5BnT6YNKHrtUx9THrL5rmo2GNI Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: fc63853293434222952d42b069d89171 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc63853293434222952d42b069d89171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc63853293434222952d42b069d89171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}] Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: fc63853293434222952d42b069d89171 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: becae64c9329457c9c58aec414f89934 Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '068e551a-dff3-4556-8b68-70485a0ff892'} Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:08:17.899191 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Returning 404 to user: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:08:17.903061 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48ba9eb6-38cf-4dae-91c4-8a02fe95ec7e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 404 len: 111 microversion: 2.1 time: 0.064253 Oct 03 11:08:17.904409 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3399/6473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:17 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:08:17.912358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-199ad890-16cf-4a92-a819-5416240d3668 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '.version_select at 0x7f074e2631f0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:17.941900 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-199ad890-16cf-4a92-a819-5416240d3668 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698901041" status: 202 len: 0 microversion: 2.1 time: 0.033518 Oct 03 11:08:17.943280 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3075/6474] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 11:08:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698901041 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:08:18.517817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b77b482e-6060-4d1a-b1f7-98b42ba63a82 req-6460388a-8d3c-42a6-b442-a79c05949e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf37c614-c606-4b10-acc7-7b8996437426", "tag": "e918ca6f-5962-463b-a471-c4cf6a48a491"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:18.543830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b77b482e-6060-4d1a-b1f7-98b42ba63a82 req-6460388a-8d3c-42a6-b442-a79c05949e46 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:18.544663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b77b482e-6060-4d1a-b1f7-98b42ba63a82 req-6460388a-8d3c-42a6-b442-a79c05949e46 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:18.546763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b77b482e-6060-4d1a-b1f7-98b42ba63a82 req-6460388a-8d3c-42a6-b442-a79c05949e46 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:18.619148 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b77b482e-6060-4d1a-b1f7-98b42ba63a82 req-6460388a-8d3c-42a6-b442-a79c05949e46 service nova] Creating event network-changed:e918ca6f-5962-463b-a471-c4cf6a48a491 for instance bf37c614-c606-4b10-acc7-7b8996437426 on n-h1-858383-3 Oct 03 11:08:18.638275 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b77b482e-6060-4d1a-b1f7-98b42ba63a82 req-6460388a-8d3c-42a6-b442-a79c05949e46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124132 Oct 03 11:08:18.642149 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3400/6475] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:18.749391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:18.750052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:18.768595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:18.769919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:18.770580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:18.771770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:18.772440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:18.773066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:19.361411 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c02c29c-74d5-4a7e-8a4c-6c1e61cd6b70 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.616848 Oct 03 11:08:19.373949 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3076/6476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:18 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:19.423700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3edd657c-af00-4e88-81bc-30defc034201 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'create', calling method: .version_select at 0x7f074de0b3a0>, body: {"keypair": {"name": "tempest-keypair-1548911034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAG+UWLDDvBrXQsXfAvXROu5yEdbntkD1Er/Vgk6wWo0iYakQsHNDeUPLGFzROBg/Pkc/eKdxSP7Ank5kOHSfHShSXoxurAIcNcTrjACRJpPg7SsGmkaCB5z39kF4GlSeg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:19.493980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3edd657c-af00-4e88-81bc-30defc034201 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for project fc63853293434222952d42b069d89171. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:08:19.507843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3edd657c-af00-4e88-81bc-30defc034201 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for user becae64c9329457c9c58aec414f89934 and project fc63853293434222952d42b069d89171. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:08:19.574144 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3edd657c-af00-4e88-81bc-30defc034201 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155858 Oct 03 11:08:19.576077 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3401/6477] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:08:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:08:20.386389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:20.388106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:20.391398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:20.394631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:20.398714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:20.416097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:20.417279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:20.419318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:20.420177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:20.423904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:20.425108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:20.486925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=81 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:20.843677 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20c1b92c-1217-4d05-bd90-24b199c69517 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.461401 Oct 03 11:08:20.862410 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3077/6478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:20 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:21.877648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:21.880292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:21.891961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:21.893960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:21.894699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:21.895636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:21.897246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:21.897992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:21.898872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:22.270620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7bbac4bc-8eff-4c82-8551-dde09313330e tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.402085 Oct 03 11:08:22.280811 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3402/6479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:21 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:23.288143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1666255576", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "944a6f9a-9923-408c-9fb0-c7b7b6c4d728"}], "security_groups": [{"name": "tempest-securitygroup--1369862053"}], "key_name": "tempest-keypair-1548911034", "user_data": "}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:23.298068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:23.298697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:23.323482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:23.324148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:23.331892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:23.332680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:23.333195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:23.333636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:23.607316 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-61abad9e-6d92-4b7a-85ae-88a1dad422ab tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.313995 Oct 03 11:08:23.607920 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3403/6480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:23 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:24.079631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] validate_networks() for [('944a6f9a-9923-408c-9fb0-c7b7b6c4d728', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:08:24.634509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:24.635728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:24.647783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:24.648291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:24.648739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:24.649495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:24.649956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:24.654249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:25.024053 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c7bf054-6dd8-43dc-ad68-18231aaed4f9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.393561 Oct 03 11:08:25.027557 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3404/6481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:24 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:25.060344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:08:25.061402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:08:25.062121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:08:25.063002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:08:25.063678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:08:25.076442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:25.077194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:25.077940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:25.078917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:25.079643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:25.080371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:25.127357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for project fc63853293434222952d42b069d89171. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:08:25.158643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Getting quotas for user becae64c9329457c9c58aec414f89934 and project fc63853293434222952d42b069d89171. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:08:25.200939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:08:25.216689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:08:25.408470 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1730a97a-e739-4877-a89a-f9d5f029db7a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.125316 Oct 03 11:08:25.417972 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3078/6482] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:08:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:08:25.427592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31ddbb9f-6ec1-43ac-a5ad-e2ba62dd4278 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:25.428534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-31ddbb9f-6ec1-43ac-a5ad-e2ba62dd4278 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:25.556133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-31ddbb9f-6ec1-43ac-a5ad-e2ba62dd4278 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:25.563816 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-31ddbb9f-6ec1-43ac-a5ad-e2ba62dd4278 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1238 microversion: 2.1 time: 0.140671 Oct 03 11:08:25.580886 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3405/6483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:25 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1238 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:26.056781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:26.057561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:26.068201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:26.079265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:26.079928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:26.080872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:26.083618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:26.084293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:26.683953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f6c46b5-3704-42a7-a8fc-729a1caad973 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.632909 Oct 03 11:08:26.688041 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3079/6484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:26 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:27.032974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:27.034594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:27.046220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:27.046335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:27.046889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:27.047755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:27.048217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:27.048646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:27.179643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:27.191757 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c6b96d66-5722-45a2-b6ac-88ea7b8bc961 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1290 microversion: 2.1 time: 0.599113 Oct 03 11:08:27.192359 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3406/6485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:26 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1290 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:27.717446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:27.718584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:27.729056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:27.729573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:27.730038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:27.730803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:27.731263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:27.731693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:28.057443 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d4c59f0-87ba-4e2c-adfc-cc86faeedfa6 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.345150 Oct 03 11:08:28.059291 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3080/6486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:27 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:28.221091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:28.224400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:28.239098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:28.239888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:28.240622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:28.243475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:28.244542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:28.245232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:28.412672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:28.424787 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-459371d0-8404-415a-8938-893700e1d98f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1296 microversion: 2.1 time: 0.209338 Oct 03 11:08:28.426131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3407/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:28 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1296 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:29.084640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:29.085990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:29.101610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:29.102124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:29.102589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:29.103320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:29.103781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:29.104208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:29.466586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:29.467208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:29.491696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:29.492242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:29.492815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:29.493567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:29.494327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:29.494827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:29.765145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:29.784433 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-869c4ab4-cf97-4756-85d1-6cd3473412a9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.321203 Oct 03 11:08:29.785198 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9872f6a7-16a6-4d9a-950f-3cd66e54086f tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.705729 Oct 03 11:08:29.788098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3408/6488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:29 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:29.826105 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3081/6489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:29 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:29.994247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d8f2c33d-6783-4fe4-ad2d-3987d12663ea req-4b603592-1461-453f-95d0-fe8464f8a74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf37c614-c606-4b10-acc7-7b8996437426", "name": "network-vif-plugged", "status": "completed", "tag": "e918ca6f-5962-463b-a471-c4cf6a48a491"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:30.010807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8f2c33d-6783-4fe4-ad2d-3987d12663ea req-4b603592-1461-453f-95d0-fe8464f8a74b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:30.011939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8f2c33d-6783-4fe4-ad2d-3987d12663ea req-4b603592-1461-453f-95d0-fe8464f8a74b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:30.012661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d8f2c33d-6783-4fe4-ad2d-3987d12663ea req-4b603592-1461-453f-95d0-fe8464f8a74b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:30.027593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d8f2c33d-6783-4fe4-ad2d-3987d12663ea req-4b603592-1461-453f-95d0-fe8464f8a74b service nova] Creating event network-vif-plugged:e918ca6f-5962-463b-a471-c4cf6a48a491 for instance bf37c614-c606-4b10-acc7-7b8996437426 on n-h1-858383-3 Oct 03 11:08:30.034520 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d8f2c33d-6783-4fe4-ad2d-3987d12663ea req-4b603592-1461-453f-95d0-fe8464f8a74b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046777 Oct 03 11:08:30.035646 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3409/6490] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:30.812231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:30.812912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:30.819576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:30.828168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:30.830311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:30.831257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:30.841815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:30.842715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:30.849223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:30.850226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:30.874788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:30.877244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:30.878080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:30.881929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:30.885403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:30.885884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:31.293186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:31.306277 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a57124c-b5ca-4ad6-bc1a-ee3efdaf546d tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.496487 Oct 03 11:08:31.323058 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3082/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:30 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:31.431256 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5cdbc481-02ac-4d16-8604-395683d130e9 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1464 microversion: 2.1 time: 0.594168 Oct 03 11:08:31.431911 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3410/6492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:30 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1464 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:31.598120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c0e197a4-db1e-4c20-ae4b-396bcec3da9f req-c9ca4e30-8dd9-450d-aed9-3ed350a3fd4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f6ce09-57e8-480e-938f-cbf8cf94d914", "tag": "3c6fd916-3d49-41ec-a7ea-51f305593dbe"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:31.624189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c0e197a4-db1e-4c20-ae4b-396bcec3da9f req-c9ca4e30-8dd9-450d-aed9-3ed350a3fd4c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:31.631972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c0e197a4-db1e-4c20-ae4b-396bcec3da9f req-c9ca4e30-8dd9-450d-aed9-3ed350a3fd4c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:31.641055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c0e197a4-db1e-4c20-ae4b-396bcec3da9f req-c9ca4e30-8dd9-450d-aed9-3ed350a3fd4c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:31.668241 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c0e197a4-db1e-4c20-ae4b-396bcec3da9f req-c9ca4e30-8dd9-450d-aed9-3ed350a3fd4c service nova] Creating event network-changed:3c6fd916-3d49-41ec-a7ea-51f305593dbe for instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 on n-h1-858383-3 Oct 03 11:08:31.683265 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c0e197a4-db1e-4c20-ae4b-396bcec3da9f req-c9ca4e30-8dd9-450d-aed9-3ed350a3fd4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084307 Oct 03 11:08:31.684292 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3083/6493] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:32.330766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:32.331312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:32.346170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:32.347491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:32.351812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:32.356142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:32.357426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:32.358159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:32.459382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:32.461030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:32.499624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:32.500279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:32.500929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:32.501808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:32.502422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:32.503052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:32.662516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:32.671447 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf85d9e7-cd1f-4b36-b030-bd8833dab119 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.344985 Oct 03 11:08:32.674517 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3411/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:32 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:32.910535 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e225c079-c6c3-427e-b55b-a25764c9292d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1650 microversion: 2.1 time: 0.456597 Oct 03 11:08:32.911355 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3084/6495] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:32 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1650 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:32.935018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:32.935881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:32.952405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:32.953109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:32.953717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:32.954609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:32.955010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:32.955780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.194691 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2bba0c17-425c-4e9b-93de-35f6c5586f38 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1650 microversion: 2.1 time: 0.263183 Oct 03 11:08:33.195983 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3412/6496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:32 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1650 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:33.217355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:33.218000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:33.224322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.225584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.226047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.226782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.227246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.227682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.387024 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1550b2e7-8082-4560-9171-d590dfedab3a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1650 microversion: 2.1 time: 0.172714 Oct 03 11:08:33.390938 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3085/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:33 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1650 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:33.418234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:33.420169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:33.428975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.429566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.430140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.431129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.431659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.432291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.460994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:08:33.553303 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ffe73593-1b49-4dc0-a7f3-08282690e6fa tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 204 len: 0 microversion: 2.1 time: 0.141089 Oct 03 11:08:33.554376 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3413/6498] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:08:33 2022] DELETE /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:08:33.563700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:33.564542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:33.577978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.578803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.579824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.580801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.581532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.586117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.705574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:33.707015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:33.723368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.724466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.730646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.731954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:33.736653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:33.737453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:33.754479 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40c33b0c-9822-4228-8106-854c8c8d854b tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1656 microversion: 2.1 time: 0.195332 Oct 03 11:08:33.756815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3086/6499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:33 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1656 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:33.903312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3e167b1-9d50-420d-b21f-ff20e9f26c64 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Action: 'create', calling method: .version_select at 0x7f074fa34430>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-39182680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK02WTDx8WaGt2jJsH2/pMoFk6CoJpEBu6wJ6iybGZe0io48Z3pESf236t8IJriitLnjSwww1P58aYQb5xTMoeSgz//aP64kWhiyjYqWaHe0EB0VQWz7SEMfRZlQPDtVg=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:33.932826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e3e167b1-9d50-420d-b21f-ff20e9f26c64 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Getting quotas for project 8555561fbccf4b4c83f47579eaaebd08. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:08:33.941917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e3e167b1-9d50-420d-b21f-ff20e9f26c64 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Getting quotas for user d74e2b5a5a7341aa91fbaa2dca7b687b and project 8555561fbccf4b4c83f47579eaaebd08. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:08:33.984830 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3e167b1-9d50-420d-b21f-ff20e9f26c64 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.085779 Oct 03 11:08:33.986633 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3087/6500] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:08:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:08:34.092645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:34.109698 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c9822c13-a911-468e-8700-3bb044cf3b2b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.410907 Oct 03 11:08:34.112603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3414/6501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:33 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:34.784643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:34.785291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:34.796881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:34.799918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:34.802366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:34.807706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:34.819654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:34.822053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:35.096382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:35.139299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:35.142291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:35.155318 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6bf8777e-4ad1-49d6-8288-38ae2c524497 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1656 microversion: 2.1 time: 0.374076 Oct 03 11:08:35.156466 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3088/6502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:34 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1656 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:35.166925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:35.168333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:35.170245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:35.173355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:35.175300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:35.176601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:35.516354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:35.525545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e99dbabd-1550-41e6-89a9-48ec2e718fee tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.390895 Oct 03 11:08:35.539483 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3415/6503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:35 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:35.979273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-265221511", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8a96b7d1-d5d9-436e-bb0d-f3f40fb0c0ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-39182680", "security_groups": [{"name": "tempest-secgroup-smoke-802680913"}], "networks": [{"uuid": "40314d9a-10c8-4aa6-84d0-731656fcd890"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:36.180649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:36.181287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:36.184248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:36.197790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:36.199503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:36.203971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:36.204991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:36.205652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:36.206270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:36.327316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] validate_networks() for [('40314d9a-10c8-4aa6-84d0-731656fcd890', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:08:36.470469 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe159e64-58c2-4f8c-a17d-10214595147a tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1656 microversion: 2.1 time: 0.294104 Oct 03 11:08:36.477037 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3416/6504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:36 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1656 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:36.564392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:36.565105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:36.575545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:36.579150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:36.579865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:36.580824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:36.581476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:36.582319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:36.768556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:36.773888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:36.780698 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02b5d99d-f97f-41cf-ae39-1bd2b792f226 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.220529 Oct 03 11:08:36.797730 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3417/6505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:36 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:37.503774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:37.504491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:37.521799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:37.522166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:37.522617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:37.523350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:37.523810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:37.524236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:37.828554 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b6a02fe-6a0e-47a1-b664-a40b40af69f4 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1656 microversion: 2.1 time: 0.327220 Oct 03 11:08:37.833999 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3418/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:37 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1656 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:37.842792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:37.844235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:37.856212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:37.857687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:37.859131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:37.860187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:37.861198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:37.862783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:38.149321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:38.170368 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8eaf9b63-7267-4b76-b8eb-4ab66e3ed7e4 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.330238 Oct 03 11:08:38.171446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3419/6507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:37 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:38.667075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:08:38.669151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:08:38.669835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:08:38.670515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:08:38.671167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:08:38.684736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:38.685569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:38.686530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:38.689368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:38.689964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:38.690510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:38.711440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Getting quotas for project 8555561fbccf4b4c83f47579eaaebd08. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:08:38.721558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Getting quotas for user d74e2b5a5a7341aa91fbaa2dca7b687b and project 8555561fbccf4b4c83f47579eaaebd08. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:08:38.794537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:08:38.797437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a96b7d1-d5d9-436e-bb0d-f3f40fb0c0ae',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:08:38.859352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:38.860223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:38.874499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:38.874735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:38.877068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:38.878310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:38.881636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:38.884610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:38.999023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc95a10b-d0f6-4684-a3e8-534feba0a474 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.024587 Oct 03 11:08:39.000576 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3089/6508] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:08:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 3027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:08:39.022773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a653b46e-3f26-4bf3-80e1-1fa48ec78430 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:39.030045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a653b46e-3f26-4bf3-80e1-1fa48ec78430 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:39.161492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e965c711-755b-44cd-bf6b-573ad8f73b02 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 200 len: 1614 microversion: 2.1 time: 0.305970 Oct 03 11:08:39.169614 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3420/6509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:38 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 1614 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:39.174455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-32d25a69-21e3-4036-9508-17403b733ba9 req-4835682a-fa01-4b61-a5d6-fb2131a31be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf37c614-c606-4b10-acc7-7b8996437426", "name": "network-vif-deleted", "tag": "e918ca6f-5962-463b-a471-c4cf6a48a491"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:39.190655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a653b46e-3f26-4bf3-80e1-1fa48ec78430 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:39.207492 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a653b46e-3f26-4bf3-80e1-1fa48ec78430 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1096 microversion: 2.1 time: 0.198560 Oct 03 11:08:39.210848 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3090/6510] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:39 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1096 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:39.220302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:39.233651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-32d25a69-21e3-4036-9508-17403b733ba9 req-4835682a-fa01-4b61-a5d6-fb2131a31be9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:39.234168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-32d25a69-21e3-4036-9508-17403b733ba9 req-4835682a-fa01-4b61-a5d6-fb2131a31be9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:39.234619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-32d25a69-21e3-4036-9508-17403b733ba9 req-4835682a-fa01-4b61-a5d6-fb2131a31be9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:39.239623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:39.252885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:39.253389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:39.261734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:39.278382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:39.281248 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-32d25a69-21e3-4036-9508-17403b733ba9 req-4835682a-fa01-4b61-a5d6-fb2131a31be9 service nova] Creating event network-vif-deleted:e918ca6f-5962-463b-a471-c4cf6a48a491 for instance bf37c614-c606-4b10-acc7-7b8996437426 on n-h1-858383-3 Oct 03 11:08:39.281982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:39.284057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:39.303977 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-32d25a69-21e3-4036-9508-17403b733ba9 req-4835682a-fa01-4b61-a5d6-fb2131a31be9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132530 Oct 03 11:08:39.310489 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3421/6511] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:40.072240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:40.090011 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9c958b5-829c-4b41-b18a-15f4da237735 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.874945 Oct 03 11:08:40.104798 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3091/6512] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:39 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:40.175383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-269141b9-6f16-4c2f-9bf6-c9ef448f92fa req-18ba5fe0-2791-4f22-8732-f14bab1b797f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f6ce09-57e8-480e-938f-cbf8cf94d914", "name": "network-vif-plugged", "status": "completed", "tag": "3c6fd916-3d49-41ec-a7ea-51f305593dbe"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:40.197356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:40.198031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: bf37c614-c606-4b10-acc7-7b8996437426] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:40.210747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-269141b9-6f16-4c2f-9bf6-c9ef448f92fa req-18ba5fe0-2791-4f22-8732-f14bab1b797f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.211244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-269141b9-6f16-4c2f-9bf6-c9ef448f92fa req-18ba5fe0-2791-4f22-8732-f14bab1b797f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.211579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.212147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.215182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.215975 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.216469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.217039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-269141b9-6f16-4c2f-9bf6-c9ef448f92fa req-18ba5fe0-2791-4f22-8732-f14bab1b797f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.226057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.256788 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-269141b9-6f16-4c2f-9bf6-c9ef448f92fa req-18ba5fe0-2791-4f22-8732-f14bab1b797f service nova] Creating event network-vif-plugged:3c6fd916-3d49-41ec-a7ea-51f305593dbe for instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 on n-h1-858383-3 Oct 03 11:08:40.285508 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-269141b9-6f16-4c2f-9bf6-c9ef448f92fa req-18ba5fe0-2791-4f22-8732-f14bab1b797f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114368 Oct 03 11:08:40.286138 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3422/6513] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:40.288381 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] HTTP exception thrown: Instance bf37c614-c606-4b10-acc7-7b8996437426 could not be found. Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Request method failure captured: Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 HTTP/1.1 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsKFxAB9_V19dzQhnbkMD6iBtHp07y8b0HKd-R5caF2RnH2PHPNw9fN7prfHBImAxI5ri8hiWT1ufkq6Pm_AObQPHuSuFqmp2gdpX6aqqCdFK0mmW4QVF_Eo8xxFUqR2pAs-c4jFA2g1g_n6NaXyO4sf88sjkUaC1g97GaGVgPLLEj4 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a766b3196a542839404ea23c60edf5b Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestServerMultinode-77652313 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a766b3196a542839404ea23c60edf5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a766b3196a542839404ea23c60edf5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a766b3196a542839404ea23c60edf5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a766b3196a542839404ea23c60edf5b"}]}] Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestServerMultinode-77652313 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a766b3196a542839404ea23c60edf5b Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestServerMultinode-77652313 Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestServerMultinode-77652313-project-admin Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 6cbb3f871eda444cbd60f938bab3960c Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestServerMultinode-77652313-project-admin Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance bf37c614-c606-4b10-acc7-7b8996437426 could not be found. Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'bf37c614-c606-4b10-acc7-7b8996437426'} Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf37c614-c606-4b10-acc7-7b8996437426 could not be found. Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf37c614-c606-4b10-acc7-7b8996437426 could not be found. Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:08:40.290225 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf37c614-c606-4b10-acc7-7b8996437426 could not be found. Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Returning 404 to user: Instance bf37c614-c606-4b10-acc7-7b8996437426 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:08:40.293842 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b47d91f-38df-48e8-8985-074f56745b28 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426" status: 404 len: 111 microversion: 2.1 time: 0.098971 Oct 03 11:08:40.301155 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3092/6514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:40 2022] GET /compute/v2.1/servers/bf37c614-c606-4b10-acc7-7b8996437426 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:08:40.322124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:40.326620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:40.333176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:40.336135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:40.351145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.353501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.356120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.358244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.359141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.361501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.362642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.365484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.366951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.367791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.368715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.369389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.443337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:08:40.486621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:40.496316 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-528dd53b-09b0-422b-9645-a83b0065c907 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1138 microversion: 2.1 time: 0.198436 Oct 03 11:08:40.497874 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3423/6515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:40 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1138 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:40.621994 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-695b5251-c09c-4892-b6d7-184ffff4e80c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 204 len: 0 microversion: 2.1 time: 0.319144 Oct 03 11:08:40.622558 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3093/6516] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:08:40 2022] DELETE /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:08:40.634744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:40.635447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:40.646690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.647844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.648490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.649382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:40.650028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:40.651629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:40.843504 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fafbd64b-4cb3-4058-9915-9203547047a0 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1655 microversion: 2.1 time: 0.215640 Oct 03 11:08:40.845910 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3424/6517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:40 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1655 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:41.120788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:41.122090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:41.130100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:41.130676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:41.131124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:41.131932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:41.132465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:41.132991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:41.295913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:41.306847 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f1105a93-1c61-48bb-b84f-cba76b36539a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1364 microversion: 2.1 time: 0.192529 Oct 03 11:08:41.307598 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3094/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:41 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:41.523660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:41.524292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:41.531499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:41.532007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:41.532454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:41.533239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:41.533693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:41.534300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:41.641731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:41.651586 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da606490-e491-482a-95cf-7c0354c87164 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1194 microversion: 2.1 time: 0.133539 Oct 03 11:08:41.652390 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3425/6519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:41 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1194 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:41.868258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:41.868890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:41.875888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:41.876367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:41.882175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:41.883031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:41.883501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:41.883922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:42.330945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:42.331656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:42.338366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:42.339307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:42.352643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:42.353820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:42.354519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:42.355163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:42.365912 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-03075bd7-666f-48a5-9c30-e397d9b44f00 tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1655 microversion: 2.1 time: 0.500994 Oct 03 11:08:42.375792 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3095/6520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:41 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1655 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:42.543424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:42.554876 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd1fd5ea-594e-474b-854f-646328e2359e tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1551 microversion: 2.1 time: 0.228026 Oct 03 11:08:42.562087 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3426/6521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:42 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1551 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:42.581041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:42.581733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:42.596999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:42.597736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:42.598332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:42.599208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:42.604135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:42.604918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:42.675824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:42.677406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:42.685500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:42.686203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:42.687126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:42.688066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:42.688712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:42.689327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:42.788066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:42.810630 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-365e79a5-b95a-49f7-bd72-42b1af377987 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1212 microversion: 2.1 time: 0.138476 Oct 03 11:08:42.811875 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3427/6522] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:42 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1212 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:08:43.010708 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d1fe2e52-4af8-4fdb-a7e1-be24c4577ec2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.436083 Oct 03 11:08:43.012059 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3096/6523] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 11:08:42 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-interface => generated 285 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:43.136372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-01e794f1-0916-4548-b050-28f45b2504aa req-ee7e572a-9608-41f4-85fe-c4f277841fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d9d2f2-627b-4041-be8d-af012ed3ff97", "name": "network-vif-deleted", "tag": "cfb092b1-a720-43f0-b675-896e24b60f4d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:43.157335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01e794f1-0916-4548-b050-28f45b2504aa req-ee7e572a-9608-41f4-85fe-c4f277841fb2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:43.157825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01e794f1-0916-4548-b050-28f45b2504aa req-ee7e572a-9608-41f4-85fe-c4f277841fb2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:43.158302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-01e794f1-0916-4548-b050-28f45b2504aa req-ee7e572a-9608-41f4-85fe-c4f277841fb2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:43.174307 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-01e794f1-0916-4548-b050-28f45b2504aa req-ee7e572a-9608-41f4-85fe-c4f277841fb2 service nova] Creating event network-vif-deleted:cfb092b1-a720-43f0-b675-896e24b60f4d for instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 on n-h2-858383-3 Oct 03 11:08:43.179515 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-01e794f1-0916-4548-b050-28f45b2504aa req-ee7e572a-9608-41f4-85fe-c4f277841fb2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048578 Oct 03 11:08:43.180435 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3428/6524] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:43.399869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:43.400479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:43.410207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:43.413835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:43.414293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:43.415040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:43.417461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:43.420290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:43.472246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:43.486485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:43.489419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:43.493410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:43.494365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lazy-loading 'fault' on Instance uuid a7d9d2f2-627b-4041-be8d-af012ed3ff97 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:08:43.628437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47813e00-3731-47b7-a4db-c13698cfaa0c tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 200 len: 1454 microversion: 2.1 time: 0.233487 Oct 03 11:08:43.630313 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3097/6525] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:43 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:43.838756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:43.840052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:43.847424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:43.848164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:43.849032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:43.850026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:43.850669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:43.851257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:44.449760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:44.462084 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-213bc088-e91f-488a-9638-7c4249a003f7 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1279 microversion: 2.1 time: 0.629329 Oct 03 11:08:44.478828 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3429/6526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:43 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1279 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:44.653568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:44.654783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] [instance: a7d9d2f2-627b-4041-be8d-af012ed3ff97] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:44.666793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:44.667336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:44.667791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:44.668525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:44.669023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:44.669458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:44.704983 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] HTTP exception thrown: Instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 could not be found. Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Request method failure captured: Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 HTTP/1.1 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsKFxAB9_V19dzQhnbkMD6iBtHp07y8b0HKd-R5caF2RnH2PHPNw9fN7prfHBImAxI5ri8hiWT1ufkq6Pm_AObQPHuSuFqmp2gdpX6aqqCdFK0mmW4QVF_Eo8xxFUqR2pAs-c4jFA2g1g_n6NaXyO4sf88sjkUaC1g97GaGVgPLLEj4 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0a766b3196a542839404ea23c60edf5b Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestServerMultinode-77652313 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a766b3196a542839404ea23c60edf5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0a766b3196a542839404ea23c60edf5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0a766b3196a542839404ea23c60edf5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0a766b3196a542839404ea23c60edf5b"}]}] Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestServerMultinode-77652313 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0a766b3196a542839404ea23c60edf5b Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestServerMultinode-77652313 Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestServerMultinode-77652313-project-admin Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 6cbb3f871eda444cbd60f938bab3960c Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestServerMultinode-77652313-project-admin Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 could not be found. Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'a7d9d2f2-627b-4041-be8d-af012ed3ff97'} Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 could not be found. Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 could not be found. Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:08:44.711706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 could not be found. Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:08:44.715966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] Returning 404 to user: Instance a7d9d2f2-627b-4041-be8d-af012ed3ff97 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:08:44.718041 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dce4ebe4-9f72-49da-ae42-f3c9ec51eb8d tempest-TestServerMultinode-77652313 tempest-TestServerMultinode-77652313-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97" status: 404 len: 111 microversion: 2.1 time: 0.065282 Oct 03 11:08:44.722385 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3098/6527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:44 2022] GET /compute/v2.1/servers/a7d9d2f2-627b-4041-be8d-af012ed3ff97 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:08:45.317548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f690f7cd-fd7d-470f-b18b-4a42289a33a9 req-e44d5767-a083-4120-88e1-19107486e0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f6ce09-57e8-480e-938f-cbf8cf94d914", "tag": "3c6fd916-3d49-41ec-a7ea-51f305593dbe"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:45.330359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f690f7cd-fd7d-470f-b18b-4a42289a33a9 req-e44d5767-a083-4120-88e1-19107486e0b9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:45.331121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f690f7cd-fd7d-470f-b18b-4a42289a33a9 req-e44d5767-a083-4120-88e1-19107486e0b9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:45.331716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f690f7cd-fd7d-470f-b18b-4a42289a33a9 req-e44d5767-a083-4120-88e1-19107486e0b9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:45.346449 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f690f7cd-fd7d-470f-b18b-4a42289a33a9 req-e44d5767-a083-4120-88e1-19107486e0b9 service nova] Creating event network-changed:3c6fd916-3d49-41ec-a7ea-51f305593dbe for instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 on n-h1-858383-3 Oct 03 11:08:45.352971 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f690f7cd-fd7d-470f-b18b-4a42289a33a9 req-e44d5767-a083-4120-88e1-19107486e0b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304415 Oct 03 11:08:45.353848 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3430/6528] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:45.488593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:45.489739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:45.499725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:45.503165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:45.503822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:45.504728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:45.505620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:45.507730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:46.250418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:46.262684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e49babef-72f6-42f6-9b21-f1bd6e700080 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1279 microversion: 2.1 time: 0.778452 Oct 03 11:08:46.266344 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3099/6529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:45 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1279 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:47.294958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:47.295740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:47.324953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:47.327696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:47.330457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:47.331469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:47.333946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:47.335227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:47.608915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:47.620302 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c0bfdb5e-5365-49f1-8338-c19543fd016d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1279 microversion: 2.1 time: 0.330366 Oct 03 11:08:47.630831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3431/6530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:47 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1279 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:48.517275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-46bf5ad2-ab6b-4f63-ab08-49cca02a99e4 req-15d70a82-5386-4b6c-9e0e-602019f6154e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d73f68-1c8c-4498-83b9-c938fac06bcd", "tag": "10220f89-fb93-42da-b590-ed908cc9a765"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:08:48.528092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-46bf5ad2-ab6b-4f63-ab08-49cca02a99e4 req-15d70a82-5386-4b6c-9e0e-602019f6154e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:48.528927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-46bf5ad2-ab6b-4f63-ab08-49cca02a99e4 req-15d70a82-5386-4b6c-9e0e-602019f6154e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:48.529522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-46bf5ad2-ab6b-4f63-ab08-49cca02a99e4 req-15d70a82-5386-4b6c-9e0e-602019f6154e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:48.541956 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-46bf5ad2-ab6b-4f63-ab08-49cca02a99e4 req-15d70a82-5386-4b6c-9e0e-602019f6154e service nova] Creating event network-changed:10220f89-fb93-42da-b590-ed908cc9a765 for instance 58d73f68-1c8c-4498-83b9-c938fac06bcd on n-h1-858383-3 Oct 03 11:08:48.547123 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-46bf5ad2-ab6b-4f63-ab08-49cca02a99e4 req-15d70a82-5386-4b6c-9e0e-602019f6154e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033438 Oct 03 11:08:48.548323 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3100/6531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:08:48.648258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:48.649563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:48.685889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:48.686686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:48.687390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:48.688224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:48.688751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:48.689264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:48.848489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:48.860016 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8e884cea-7bd4-4ea4-bee6-9c908ff52aba tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1279 microversion: 2.1 time: 0.217145 Oct 03 11:08:48.861064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3432/6532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:48 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:49.880897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:49.881687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=18 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:49.886789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:49.887668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:49.889509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:49.904286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:49.905049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:49.906170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:49.906899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:49.907366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:49.907796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:50.219704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:50.255736 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e2ec98d7-ed8b-428a-8db1-d88c70c770c0 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.375819 Oct 03 11:08:50.276592 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3101/6533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:49 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:51.294251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:51.296590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:51.323300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:51.325521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:51.328681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:51.336520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:51.336520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:51.339767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:51.685545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:51.696894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-31a0ee1a-1756-40dc-84fc-925fccf37f3f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.416802 Oct 03 11:08:51.697521 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3433/6534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:51 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:52.726754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:52.728363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:52.741701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:52.742579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:52.743336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:52.744572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:52.745543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:52.747165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:53.153960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:53.165523 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3661b2ca-6b98-419b-8b4d-9e548e9e6352 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.444824 Oct 03 11:08:53.180803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3102/6535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:52 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:54.200135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:54.201027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:54.205345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:08:54.209975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:54.210567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:54.211516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:54.212314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:54.212959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:54.213451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:54.521578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:54.538420 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-86639794-673d-4e8a-bba7-43f66b389625 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.342208 Oct 03 11:08:54.539676 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3434/6536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:54 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:55.565168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:55.566406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:55.599499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:55.600324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:55.600973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:55.601873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:55.602496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:55.603085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:55.765822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:55.774968 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f40ea3ea-72bc-4e1e-90a8-3cdfbc8db879 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.215837 Oct 03 11:08:55.775711 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3103/6537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:55 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:56.805260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:56.806802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:56.829512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:56.830360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:56.831094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:56.832341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:56.833070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:56.834896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:57.132030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:57.167755 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-179607bc-a006-4a50-9961-d9af817d0390 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.366696 Oct 03 11:08:57.197426 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3435/6538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:56 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:58.192689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:58.194943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:58.208205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:58.208956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:58.209673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:58.210399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:58.215328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:58.219952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:58.499862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:58.508402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e0f6eba-8fdd-4bae-9a59-bcf15103b3d4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.320920 Oct 03 11:08:58.509411 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3104/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:58 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:08:59.531883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:08:59.533401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:08:59.543738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:59.544754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:59.545375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:59.546259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:08:59.547033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:08:59.548584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:08:59.919048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:08:59.927715 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e466c0d4-a3b2-47e3-a1e6-9cd3f79c1e1d tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.400547 Oct 03 11:08:59.929633 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3436/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:08:59 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:00.961489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:00.962801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:00.979130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:00.979637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:00.980089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:00.983752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:00.984335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:00.985140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:01.421235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:01.432215 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bd3fb31c-7729-45f1-a8fc-f524b4f9d325 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.483017 Oct 03 11:09:01.438228 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3105/6541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:00 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:01.971429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b3763bdd-333c-4978-ad08-b8495ea76504 req-5acffd70-91a7-43cd-af74-f8b8759060f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d73f68-1c8c-4498-83b9-c938fac06bcd", "name": "network-vif-plugged", "status": "completed", "tag": "10220f89-fb93-42da-b590-ed908cc9a765"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:09:01.995305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b3763bdd-333c-4978-ad08-b8495ea76504 req-5acffd70-91a7-43cd-af74-f8b8759060f6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:01.995798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b3763bdd-333c-4978-ad08-b8495ea76504 req-5acffd70-91a7-43cd-af74-f8b8759060f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:01.996243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b3763bdd-333c-4978-ad08-b8495ea76504 req-5acffd70-91a7-43cd-af74-f8b8759060f6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:02.027789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:09:02.036088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b3763bdd-333c-4978-ad08-b8495ea76504 req-5acffd70-91a7-43cd-af74-f8b8759060f6 service nova] Creating event network-vif-plugged:10220f89-fb93-42da-b590-ed908cc9a765 for instance 58d73f68-1c8c-4498-83b9-c938fac06bcd on n-h1-858383-3 Oct 03 11:09:02.051016 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b3763bdd-333c-4978-ad08-b8495ea76504 req-5acffd70-91a7-43cd-af74-f8b8759060f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084118 Oct 03 11:09:02.054619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3437/6542] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:09:02.463969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:02.464813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:02.472339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:02.472741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:02.473454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:02.474358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:02.475541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:02.476303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:02.988106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:02.995604 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a04cb905-a615-4aea-a2b8-5a1d15b62fac tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1267 microversion: 2.1 time: 0.536191 Oct 03 11:09:03.007898 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3106/6543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:02 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1267 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:04.024953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:04.025762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:04.034477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:04.034967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:04.035575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:04.036492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:04.037164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:04.038465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:04.231222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:04.239199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a20d724e-4169-4e76-b67b-efd20cfc770f tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1455 microversion: 2.1 time: 0.221174 Oct 03 11:09:04.240006 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3438/6544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:04 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1455 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:04.263146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:04.263837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:04.270900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:04.271475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:04.272544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:04.273341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:04.273872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:04.274377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:04.444437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:04.452712 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75fe0153-5e2c-4b9b-a8ff-e6ffc1b40557 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1455 microversion: 2.1 time: 0.194824 Oct 03 11:09:04.453322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3107/6545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:04 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1455 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:07.038363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0057ae26-cb53-42d2-96b9-64e8efa64909 req-f6e2ce12-58b4-43ab-ae5c-28d98a0043b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d73f68-1c8c-4498-83b9-c938fac06bcd", "tag": "10220f89-fb93-42da-b590-ed908cc9a765"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:09:07.057557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0057ae26-cb53-42d2-96b9-64e8efa64909 req-f6e2ce12-58b4-43ab-ae5c-28d98a0043b9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:07.060198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0057ae26-cb53-42d2-96b9-64e8efa64909 req-f6e2ce12-58b4-43ab-ae5c-28d98a0043b9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:07.061035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0057ae26-cb53-42d2-96b9-64e8efa64909 req-f6e2ce12-58b4-43ab-ae5c-28d98a0043b9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:07.090212 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0057ae26-cb53-42d2-96b9-64e8efa64909 req-f6e2ce12-58b4-43ab-ae5c-28d98a0043b9 service nova] Creating event network-changed:10220f89-fb93-42da-b590-ed908cc9a765 for instance 58d73f68-1c8c-4498-83b9-c938fac06bcd on n-h1-858383-3 Oct 03 11:09:07.104157 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0057ae26-cb53-42d2-96b9-64e8efa64909 req-f6e2ce12-58b4-43ab-ae5c-28d98a0043b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067601 Oct 03 11:09:07.105490 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3439/6546] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:09:09.161805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b575c359-7015-4722-814b-df5d864a5efe req-a1f0c24a-be23-4dca-9acc-760ff9bb0b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d73f68-1c8c-4498-83b9-c938fac06bcd", "tag": "10220f89-fb93-42da-b590-ed908cc9a765"}, {"name": "network-changed", "server_uuid": "58d73f68-1c8c-4498-83b9-c938fac06bcd", "tag": "10220f89-fb93-42da-b590-ed908cc9a765"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:09:09.176902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b575c359-7015-4722-814b-df5d864a5efe req-a1f0c24a-be23-4dca-9acc-760ff9bb0b72 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:09.178363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b575c359-7015-4722-814b-df5d864a5efe req-a1f0c24a-be23-4dca-9acc-760ff9bb0b72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:09.179066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b575c359-7015-4722-814b-df5d864a5efe req-a1f0c24a-be23-4dca-9acc-760ff9bb0b72 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:09.194022 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b575c359-7015-4722-814b-df5d864a5efe req-a1f0c24a-be23-4dca-9acc-760ff9bb0b72 service nova] Creating event network-changed:10220f89-fb93-42da-b590-ed908cc9a765 for instance 58d73f68-1c8c-4498-83b9-c938fac06bcd on n-h1-858383-3 Oct 03 11:09:09.194816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b575c359-7015-4722-814b-df5d864a5efe req-a1f0c24a-be23-4dca-9acc-760ff9bb0b72 service nova] Creating event network-changed:10220f89-fb93-42da-b590-ed908cc9a765 for instance 58d73f68-1c8c-4498-83b9-c938fac06bcd on n-h1-858383-3 Oct 03 11:09:09.202237 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b575c359-7015-4722-814b-df5d864a5efe req-a1f0c24a-be23-4dca-9acc-760ff9bb0b72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044919 Oct 03 11:09:09.203540 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3108/6547] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:09:43.359629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:43.362225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:43.366042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=11 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:09:43.366709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:09:43.367671 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:09:43.367888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bdc0d53a-5731-4c15-98ae-01cbcc5c2f8e req-714d25e0-3ff1-48a5-a071-42f5577eae0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d73f68-1c8c-4498-83b9-c938fac06bcd", "tag": "10220f89-fb93-42da-b590-ed908cc9a765"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:09:43.368888 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:09:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd (ip 10.222.0.27) !!! Oct 03 11:09:43.375554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:43.375554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:43.376095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:43.378256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:43.378256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:43.378256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:43.389044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=15 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:09:43.390636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=61 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:09:43.400854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bdc0d53a-5731-4c15-98ae-01cbcc5c2f8e req-714d25e0-3ff1-48a5-a071-42f5577eae0d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:43.401692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bdc0d53a-5731-4c15-98ae-01cbcc5c2f8e req-714d25e0-3ff1-48a5-a071-42f5577eae0d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:43.402410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bdc0d53a-5731-4c15-98ae-01cbcc5c2f8e req-714d25e0-3ff1-48a5-a071-42f5577eae0d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:43.416177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:09:43.421896 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bdc0d53a-5731-4c15-98ae-01cbcc5c2f8e req-714d25e0-3ff1-48a5-a071-42f5577eae0d service nova] Creating event network-changed:10220f89-fb93-42da-b590-ed908cc9a765 for instance 58d73f68-1c8c-4498-83b9-c938fac06bcd on n-h1-858383-3 Oct 03 11:09:43.431393 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bdc0d53a-5731-4c15-98ae-01cbcc5c2f8e req-714d25e0-3ff1-48a5-a071-42f5577eae0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070326 Oct 03 11:09:43.436659 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3109/6548] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:09:43.541654 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c417101b-a404-472b-830a-998176db8d79 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 204 len: 0 microversion: 2.1 time: 0.188657 Oct 03 11:09:43.547108 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3440/6549] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:09:43 2022] DELETE /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:09:43.553710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:43.554611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:43.570918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:43.574961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:43.575502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:43.576368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:43.578079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:43.578867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:43.771270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:43.780578 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-18dc4775-5ae6-4b55-8d12-638335bf9981 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1580 microversion: 2.1 time: 0.231964 Oct 03 11:09:43.781985 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3110/6550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:43 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1580 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:09:44.811515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:44.813047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:44.838376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:44.838884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:44.839437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:44.842480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:44.842992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:44.843442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:45.036856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:45.046001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62941fb6-5c28-46ef-991e-7ce4da03b9a4 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1580 microversion: 2.1 time: 0.238892 Oct 03 11:09:45.046578 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3441/6551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:44 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1580 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:09:46.036470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-601c187d-1750-482d-9f4a-4b5d79761423 req-ffb04428-aecc-44f0-b8f9-08ae70c628d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d73f68-1c8c-4498-83b9-c938fac06bcd", "name": "network-vif-deleted", "tag": "10220f89-fb93-42da-b590-ed908cc9a765"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:09:46.065141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-601c187d-1750-482d-9f4a-4b5d79761423 req-ffb04428-aecc-44f0-b8f9-08ae70c628d3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:46.065141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-601c187d-1750-482d-9f4a-4b5d79761423 req-ffb04428-aecc-44f0-b8f9-08ae70c628d3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:46.065141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-601c187d-1750-482d-9f4a-4b5d79761423 req-ffb04428-aecc-44f0-b8f9-08ae70c628d3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:46.075948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:46.077426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:46.099369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:46.103294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:46.104167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:46.107417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:46.110293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:46.112144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:46.116381 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-601c187d-1750-482d-9f4a-4b5d79761423 req-ffb04428-aecc-44f0-b8f9-08ae70c628d3 service nova] Creating event network-vif-deleted:10220f89-fb93-42da-b590-ed908cc9a765 for instance 58d73f68-1c8c-4498-83b9-c938fac06bcd on n-h1-858383-3 Oct 03 11:09:46.129825 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-601c187d-1750-482d-9f4a-4b5d79761423 req-ffb04428-aecc-44f0-b8f9-08ae70c628d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096817 Oct 03 11:09:46.130981 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3111/6552] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:09:46.196557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:46.204957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-83013eb0-b8d1-4f5b-8128-a8c79362bcce tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1227 microversion: 2.1 time: 0.134123 Oct 03 11:09:46.205897 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3442/6553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:46 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1227 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:47.228628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:47.230023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:47.240799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:47.241846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:47.242335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:47.243070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:47.243544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:47.244034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:47.339657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:47.354649 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df34dced-c657-4e59-858e-ceaa47bd9889 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1227 microversion: 2.1 time: 0.130647 Oct 03 11:09:47.356275 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3112/6554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:47 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1227 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:48.378768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:48.380319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:48.388061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:48.388922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:48.389783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:48.390791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:48.391492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:48.392621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:48.465390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:48.481596 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-84fdcff2-7320-4a0a-afd2-9958714bb6c9 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1227 microversion: 2.1 time: 0.106461 Oct 03 11:09:48.483081 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3443/6555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:48 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1227 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:49.505103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:49.506332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:49.516171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:49.516920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:49.517530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:49.518412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:49.519024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:49.519604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:49.618470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:49.628331 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2bee1de4-816a-4119-a97d-c60118968a33 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1227 microversion: 2.1 time: 0.126836 Oct 03 11:09:49.629614 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3113/6556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:49 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1227 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:50.378329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:50.378884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:50.393364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:50.393852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:50.394476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:50.395341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:50.395947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:50.396526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:50.426334 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a9bffa3-6d49-4481-8a41-ba60fcbacd6f tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/ips" status: 200 len: 147 microversion: 2.1 time: 0.051876 Oct 03 11:09:50.427109 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3444/6557] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Oct 3 11:09:50 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/ips => generated 147 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:09:50.651378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:50.652514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:50.668366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:50.669065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:50.670228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:50.672112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:50.673962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:50.674997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:50.827409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74e2b5a5a7341aa91fbaa2dca7b687b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8555561fbccf4b4c83f47579eaaebd08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:09:50.837772 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-66614cae-ae5e-4f0e-bf9b-799038bdbf62 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 200 len: 1227 microversion: 2.1 time: 0.190311 Oct 03 11:09:50.840804 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3114/6558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:50 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 1227 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:09:51.869866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:51.870563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] [instance: 58d73f68-1c8c-4498-83b9-c938fac06bcd] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:51.882123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:51.883025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:51.883698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:51.884867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:51.885954 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:51.886616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:51.904718 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] HTTP exception thrown: Instance 58d73f68-1c8c-4498-83b9-c938fac06bcd could not be found. Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Request method failure captured: Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd HTTP/1.1 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsHkGv4rMCIxD9zbnH3C9_Ej1-S4m7UtPE8uPjTbBx7UPlvEUuxy4wHyreUgtwTi_9Bcnd7XwLhhCv2ARhnaZh1feGpQdv-_GgsiHN47yKysN3vSWzuweY5WLFiAKs85rOLPLL7r6CI8gyyORhWeD75U1DjuEeSgTroJksgoIfnzFEE Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 8555561fbccf4b4c83f47579eaaebd08 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBackupRestore-2079793031 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8555561fbccf4b4c83f47579eaaebd08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8555561fbccf4b4c83f47579eaaebd08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8555561fbccf4b4c83f47579eaaebd08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8555561fbccf4b4c83f47579eaaebd08"}]}] Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBackupRestore-2079793031 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 8555561fbccf4b4c83f47579eaaebd08 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2079793031 Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBackupRestore-2079793031-project Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: d74e2b5a5a7341aa91fbaa2dca7b687b Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBackupRestore-2079793031-project Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 58d73f68-1c8c-4498-83b9-c938fac06bcd could not be found. Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '58d73f68-1c8c-4498-83b9-c938fac06bcd'} Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d73f68-1c8c-4498-83b9-c938fac06bcd could not be found. Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d73f68-1c8c-4498-83b9-c938fac06bcd could not be found. Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:09:51.912437 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d73f68-1c8c-4498-83b9-c938fac06bcd could not be found. Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Returning 404 to user: Instance 58d73f68-1c8c-4498-83b9-c938fac06bcd could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7829b985-a942-41e0-b993-ef829cb1d35a tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd" status: 404 len: 111 microversion: 2.1 time: 0.057159 Oct 03 11:09:51.916360 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3445/6559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:09:51 2022] GET /compute/v2.1/servers/58d73f68-1c8c-4498-83b9-c938fac06bcd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:09:52.186518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5010063b-d674-4441-bab8-0668d0b6d288"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:09:52.189227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:09:52.203504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:52.203970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:52.205399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:52.206510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:09:52.208611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:09:52.209146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:09:52.250760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-235b4f36-4acc-4b8b-823f-032be3317e56 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] Calling method '.version_select at 0x7f074de0b160>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:09:52.286461 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-235b4f36-4acc-4b8b-823f-032be3317e56 tempest-TestVolumeBackupRestore-2079793031 tempest-TestVolumeBackupRestore-2079793031-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-39182680" status: 202 len: 0 microversion: 2.1 time: 0.040056 Oct 03 11:09:52.287849 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3446/6560] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Oct 3 11:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-39182680 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:09:52.893023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-754894be-9b11-4ba5-b506-55f0d361b82b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700014 Oct 03 11:09:52.902647 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3115/6561] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:09:52 2022] POST /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:09.046054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:09.049155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:09.054074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:09.056066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:09.078832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:09.079622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:09.080234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:09.081151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:09.081775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:09.082370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:09.122744 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4df4908c-d1fc-4e13-9449-9a6562a4758b tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080448 Oct 03 11:10:09.123931 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3447/6562] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:10:09 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:09.132726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:09.133801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:09.138362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:09.139138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:09.147245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:09.148138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:09.148750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:09.149938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:09.150566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:09.151195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:09.201673 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-302739b0-53bb-4b34-82ae-37d8dee8ef68 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/5010063b-d674-4441-bab8-0668d0b6d288" status: 200 len: 194 microversion: 2.1 time: 0.070785 Oct 03 11:10:09.202768 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3116/6563] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 3 11:10:09 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/5010063b-d674-4441-bab8-0668d0b6d288 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:11.847757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2ea5c6e-72cd-4b20-acd3-ed213ae3de02"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:10:11.854331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:11.867017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:11.880852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:11.881951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:11.883751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:11.884542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:11.885496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:12.305112 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57508fb7-1be6-4320-bb03-69925430fadb tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "POST /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468643 Oct 03 11:10:12.305831 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3448/6564] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:10:11 2022] POST /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:24.775318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:24.778303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:24.781279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:24.782643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:24.788495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:24.789211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:24.789842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:24.790718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:24.791342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:24.791989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:24.831785 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8f1d8166-76a3-44d6-84cc-ae6fde42bf09 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061031 Oct 03 11:10:24.832376 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3117/6565] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:10:24 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:24.979221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:24.979817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:24.986815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:24.987508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:24.989462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:24.990175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:24.991923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:24.993008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:24.993636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:24.994233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:25.038934 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7074084b-e3ca-4404-8ffa-a624ac1edc93 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/5010063b-d674-4441-bab8-0668d0b6d288" status: 200 len: 194 microversion: 2.1 time: 0.064331 Oct 03 11:10:25.039920 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3449/6566] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 3 11:10:24 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/5010063b-d674-4441-bab8-0668d0b6d288 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:25.054403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:25.055170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:25.063768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:25.065242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:25.066079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:25.067396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:25.068191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:25.069352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:25.183989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lazy-loading 'services' on Instance uuid f3f6ce09-57e8-480e-938f-cbf8cf94d914 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:10:25.294543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d22a2e54-72c4-40f1-9348-2f0621bde5fa tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/5010063b-d674-4441-bab8-0668d0b6d288" status: 202 len: 0 microversion: 2.1 time: 0.244422 Oct 03 11:10:25.295761 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3118/6567] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:10:25 2022] DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/5010063b-d674-4441-bab8-0668d0b6d288 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:10:30.864801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:30.868052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:30.875723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:30.876511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:30.877187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:30.878121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:30.879021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:30.879618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:30.915506 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d2cfd6c-aaca-4c15-affa-5df99d26c42a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/d2ea5c6e-72cd-4b20-acd3-ed213ae3de02" status: 200 len: 194 microversion: 2.1 time: 0.055315 Oct 03 11:10:30.930595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:30.931904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:30.934043 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3450/6568] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Oct 3 11:10:30 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/d2ea5c6e-72cd-4b20-acd3-ed213ae3de02 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:30.939676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:30.941842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:30.942508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:30.944336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:30.945046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:30.945713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:31.060907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lazy-loading 'services' on Instance uuid f3f6ce09-57e8-480e-938f-cbf8cf94d914 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:10:31.157719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72980c9b-10bf-4d95-92fe-ff0459e076d2 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/d2ea5c6e-72cd-4b20-acd3-ed213ae3de02" status: 202 len: 0 microversion: 2.1 time: 0.232502 Oct 03 11:10:31.158386 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3119/6569] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:10:30 2022] DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments/d2ea5c6e-72cd-4b20-acd3-ed213ae3de02 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:10:36.683411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:36.685692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:36.692671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:36.693192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:36.693634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:36.694891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:36.695350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:36.695774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:36.726394 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ffb6b66a-ee2b-4747-a7ac-b46c2d7d6087 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046956 Oct 03 11:10:36.726969 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3451/6570] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:10:36 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 11:10:36.848471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:36.850938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:36.857505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:36.857992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:36.858437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:36.859133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:36.859622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:36.860052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:36.890566 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eff05e24-5bf0-457c-89a2-8af4bab4520c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048486 Oct 03 11:10:36.891146 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3120/6571] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:10:36 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 11:10:36.955233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:36.955838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:36.963133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:36.963727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:36.964345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:36.965156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:36.965681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:36.966188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:36.992900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:10:37.074562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e8c6b7f-976e-42d4-9461-a630de5a3926 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 204 len: 0 microversion: 2.1 time: 0.123036 Oct 03 11:10:37.078894 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3452/6572] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:10:36 2022] DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:10:37.086708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:37.087613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:37.103117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:37.103635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:37.104086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:37.104836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:37.105301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:37.105745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:37.457788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:10:37.466385 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-339d3749-5d08-49aa-88bb-ba9a7fe5ff25 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1676 microversion: 2.1 time: 0.385958 Oct 03 11:10:37.467296 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3121/6573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:37 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1676 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:10:38.491301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:38.492009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:38.499147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:38.499633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:38.500075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:38.500866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:38.502002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:38.502002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:38.721451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:10:38.729560 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5cbf3555-924f-4f42-9bc0-ae0bc980653c tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1676 microversion: 2.1 time: 0.243026 Oct 03 11:10:38.730146 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3453/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:38 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:10:39.753922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:39.754539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:39.762122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:39.762949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:39.763474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:39.764086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:39.764717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:39.765501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:39.883521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'becae64c9329457c9c58aec414f89934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc63853293434222952d42b069d89171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:10:39.894381 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b0f9e1a-d13a-48ea-8e5b-adef1d09a0e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 200 len: 1608 microversion: 2.1 time: 0.144631 Oct 03 11:10:39.895067 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3122/6575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:39 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 1608 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:10:40.132624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ca8f1442-334a-4f85-9179-a35b7916c15b req-2b7b614e-5044-4447-85af-c6127dd173c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f6ce09-57e8-480e-938f-cbf8cf94d914", "name": "network-vif-deleted", "tag": "3c6fd916-3d49-41ec-a7ea-51f305593dbe"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:10:40.144495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ca8f1442-334a-4f85-9179-a35b7916c15b req-2b7b614e-5044-4447-85af-c6127dd173c9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:40.145118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ca8f1442-334a-4f85-9179-a35b7916c15b req-2b7b614e-5044-4447-85af-c6127dd173c9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:40.145662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ca8f1442-334a-4f85-9179-a35b7916c15b req-2b7b614e-5044-4447-85af-c6127dd173c9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:40.163693 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ca8f1442-334a-4f85-9179-a35b7916c15b req-2b7b614e-5044-4447-85af-c6127dd173c9 service nova] Creating event network-vif-deleted:3c6fd916-3d49-41ec-a7ea-51f305593dbe for instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 on n-h1-858383-3 Oct 03 11:10:40.169093 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ca8f1442-334a-4f85-9179-a35b7916c15b req-2b7b614e-5044-4447-85af-c6127dd173c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040095 Oct 03 11:10:40.178087 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3454/6576] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:40.917896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:40.918527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:40.925921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:40.926420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:40.926868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:40.927588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:40.928052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:40.929046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:40.952568 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] HTTP exception thrown: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Request method failure captured: Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 HTTP/1.1 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsF9R6HBGXoOFSjz_CqSESd6gOqqpWbMoiVeWAHhoLQq8a0lsbhLxOCGQAKOXAnX9yUPBnfyYu1Vd-2xmeN6dYljl44m4TyVEnyJdtjDyyQOtjeF6cJ_N9nrjPLJbVmeW2BVc8968EQ4ibgNjXRds5BnT6YNKHrtUx9THrL5rmo2GNI Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc63853293434222952d42b069d89171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc63853293434222952d42b069d89171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}] Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: becae64c9329457c9c58aec414f89934 Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f3f6ce09-57e8-480e-938f-cbf8cf94d914'} Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:40.954373 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Returning 404 to user: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78809e61-176d-4a8c-8fde-98df1ab32a34 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 404 len: 111 microversion: 2.1 time: 0.042076 Oct 03 11:10:40.958706 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3123/6577] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:40 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:10:40.965844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-76197471-c4ef-4d63-8d45-834a9782f9e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '.version_select at 0x7f074dd1b3a0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:40.988052 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-76197471-c4ef-4d63-8d45-834a9782f9e5 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548911034" status: 202 len: 0 microversion: 2.1 time: 0.025923 Oct 03 11:10:40.988408 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3455/6578] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 11:10:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548911034 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:10:49.421055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:49.421580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:49.429891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:49.430728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:49.431261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:49.432039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:49.432567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:49.433235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:49.448264 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] HTTP exception thrown: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Request method failure captured: Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 HTTP/1.1 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsF9R6HBGXoOFSjz_CqSESd6gOqqpWbMoiVeWAHhoLQq8a0lsbhLxOCGQAKOXAnX9yUPBnfyYu1Vd-2xmeN6dYljl44m4TyVEnyJdtjDyyQOtjeF6cJ_N9nrjPLJbVmeW2BVc8968EQ4ibgNjXRds5BnT6YNKHrtUx9THrL5rmo2GNI Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc63853293434222952d42b069d89171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc63853293434222952d42b069d89171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}] Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: becae64c9329457c9c58aec414f89934 Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f3f6ce09-57e8-480e-938f-cbf8cf94d914'} Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:49.450002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Returning 404 to user: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa36c408-c22c-4f99-960a-dd68da724dbc tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 404 len: 111 microversion: 2.1 time: 0.035233 Oct 03 11:10:49.457715 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3124/6579] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:10:49 2022] DELETE /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:10:49.461357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:49.462216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: f3f6ce09-57e8-480e-938f-cbf8cf94d914] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:49.470750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:49.471254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:49.471999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:49.472717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:49.473214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:49.473645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:49.498949 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] HTTP exception thrown: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Request method failure captured: Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 HTTP/1.1 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsF9R6HBGXoOFSjz_CqSESd6gOqqpWbMoiVeWAHhoLQq8a0lsbhLxOCGQAKOXAnX9yUPBnfyYu1Vd-2xmeN6dYljl44m4TyVEnyJdtjDyyQOtjeF6cJ_N9nrjPLJbVmeW2BVc8968EQ4ibgNjXRds5BnT6YNKHrtUx9THrL5rmo2GNI Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc63853293434222952d42b069d89171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc63853293434222952d42b069d89171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}] Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: becae64c9329457c9c58aec414f89934 Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f3f6ce09-57e8-480e-938f-cbf8cf94d914'} Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:49.500653 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Returning 404 to user: Instance f3f6ce09-57e8-480e-938f-cbf8cf94d914 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b6ca8bd-4f0a-41e4-9a91-095ddb8d0f1a tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914" status: 404 len: 111 microversion: 2.1 time: 0.045215 Oct 03 11:10:49.507219 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3456/6580] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:49 2022] GET /compute/v2.1/servers/f3f6ce09-57e8-480e-938f-cbf8cf94d914 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:10:54.540268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:54.540906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:54.549450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:54.550200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:54.550888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:54.551713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:54.552517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:54.553233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:54.592155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:10:54.680630 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0ba561bf-ef33-4568-99db-bfc1d0f27d7b tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 204 len: 0 microversion: 2.1 time: 0.297588 Oct 03 11:10:54.682056 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3125/6581] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:10:54 2022] DELETE /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:10:54.692227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:54.693281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:54.701247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:54.701739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:54.702281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:54.702984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:54.703465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:54.703891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:54.850294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:10:54.859271 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d1cc05d-dbc5-41de-aea6-b2c24355af27 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1732 microversion: 2.1 time: 0.172324 Oct 03 11:10:54.859842 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3457/6582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:54 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:10:54.940220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:54.940851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:54.942938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:54.948634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:54.949219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:54.949683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:54.950716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:54.951182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:54.951638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:54.955379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:54.970417 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] HTTP exception thrown: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Request method failure captured: Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 HTTP/1.1 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsF9R6HBGXoOFSjz_CqSESd6gOqqpWbMoiVeWAHhoLQq8a0lsbhLxOCGQAKOXAnX9yUPBnfyYu1Vd-2xmeN6dYljl44m4TyVEnyJdtjDyyQOtjeF6cJ_N9nrjPLJbVmeW2BVc8968EQ4ibgNjXRds5BnT6YNKHrtUx9THrL5rmo2GNI Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc63853293434222952d42b069d89171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc63853293434222952d42b069d89171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}] Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: becae64c9329457c9c58aec414f89934 Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '068e551a-dff3-4556-8b68-70485a0ff892'} Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:54.972115 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Returning 404 to user: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c8e9b7d7-d136-4801-8bd1-a165864a8f97 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "DELETE /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 404 len: 111 microversion: 2.1 time: 0.037992 Oct 03 11:10:54.980574 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3126/6583] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:10:54 2022] DELETE /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:10:54.983033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:54.983746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] [instance: 068e551a-dff3-4556-8b68-70485a0ff892] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:54.997962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:54.998461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:54.998907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:54.999616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:55.000074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:55.000511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:55.015436 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] HTTP exception thrown: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Request method failure captured: Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 HTTP/1.1 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsF9R6HBGXoOFSjz_CqSESd6gOqqpWbMoiVeWAHhoLQq8a0lsbhLxOCGQAKOXAnX9yUPBnfyYu1Vd-2xmeN6dYljl44m4TyVEnyJdtjDyyQOtjeF6cJ_N9nrjPLJbVmeW2BVc8968EQ4ibgNjXRds5BnT6YNKHrtUx9THrL5rmo2GNI Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc63853293434222952d42b069d89171"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc63853293434222952d42b069d89171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc63853293434222952d42b069d89171"}]}] Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: fc63853293434222952d42b069d89171 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625040149 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: becae64c9329457c9c58aec414f89934 Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-AttachVolumeTestJSON-1625040149-project Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '068e551a-dff3-4556-8b68-70485a0ff892'} Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:55.017069 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] Returning 404 to user: Instance 068e551a-dff3-4556-8b68-70485a0ff892 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4956a5c6-c33c-435d-a9bf-52e97d514cf9 tempest-AttachVolumeTestJSON-1625040149 tempest-AttachVolumeTestJSON-1625040149-project] 10.222.0.27 "GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892" status: 404 len: 111 microversion: 2.1 time: 0.039586 Oct 03 11:10:55.023876 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3458/6584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:54 2022] GET /compute/v2.1/servers/068e551a-dff3-4556-8b68-70485a0ff892 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:10:55.882799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:55.883489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:55.893884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:55.894946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:55.895663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:55.896930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:55.897578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:55.898719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:56.199232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:10:56.207750 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fef8f3de-49d9-4201-8eeb-e61361a46a82 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1732 microversion: 2.1 time: 0.329075 Oct 03 11:10:56.208488 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3127/6585] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:55 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1732 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:10:57.233959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:57.235070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:57.237633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:57.243813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:57.244544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:57.245561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:57.246448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:57.247094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:57.247690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:57.251772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:10:57.327825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b74560e4f4179a73a50364de06e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb070ed8bb4589bb030224219f815d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:10:57.339182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38b7609e-81c4-480f-8b7f-3d73e7ac36d0 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 200 len: 1665 microversion: 2.1 time: 0.109743 Oct 03 11:10:57.353569 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3459/6586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:57 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 1665 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:10:57.605135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bf6cdb8f-4cad-4a66-a246-0c91e4d52257 req-39fa140a-ff4e-4b8c-aac3-33bd7f7507a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f47816-4731-4cd8-8d3a-24f2b93f0adc", "name": "network-vif-deleted", "tag": "9cbcbe87-0a56-47d6-999b-0309db1b8476"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:10:57.632160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bf6cdb8f-4cad-4a66-a246-0c91e4d52257 req-39fa140a-ff4e-4b8c-aac3-33bd7f7507a7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:57.632811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bf6cdb8f-4cad-4a66-a246-0c91e4d52257 req-39fa140a-ff4e-4b8c-aac3-33bd7f7507a7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:57.633260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bf6cdb8f-4cad-4a66-a246-0c91e4d52257 req-39fa140a-ff4e-4b8c-aac3-33bd7f7507a7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:57.655834 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bf6cdb8f-4cad-4a66-a246-0c91e4d52257 req-39fa140a-ff4e-4b8c-aac3-33bd7f7507a7 service nova] Creating event network-vif-deleted:9cbcbe87-0a56-47d6-999b-0309db1b8476 for instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc on n-h2-858383-3 Oct 03 11:10:57.667205 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bf6cdb8f-4cad-4a66-a246-0c91e4d52257 req-39fa140a-ff4e-4b8c-aac3-33bd7f7507a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062916 Oct 03 11:10:57.669495 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3128/6587] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:10:58.374001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:58.376086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:58.398791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:58.399306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:58.399751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:58.400470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:58.404505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:58.405383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:58.424725 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] HTTP exception thrown: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Request method failure captured: Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc HTTP/1.1 Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsH5Rz5hIVEG6kwo4thpHtZJx6q-Db64DOWRAmIsF9-IJegKKYYoEqCOqmJYq3Px6Homy-ZzTT2uGoe2yyqnU_FInxdv9wstECLKQFtgTjD0Ys8vukfWpPw37tEdS8r_M11h1XOOlQHHtrliGKIBliB4HGWbBR3-n_HZZydk1SwUS0U Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 52fb070ed8bb4589bb030224219f815d Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestServerBasicOps-485551534 Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52fb070ed8bb4589bb030224219f815d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52fb070ed8bb4589bb030224219f815d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52fb070ed8bb4589bb030224219f815d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52fb070ed8bb4589bb030224219f815d"}]}] Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestServerBasicOps-485551534 Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 52fb070ed8bb4589bb030224219f815d Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestServerBasicOps-485551534 Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestServerBasicOps-485551534-project Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7a2b74560e4f4179a73a50364de06e3d Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestServerBasicOps-485551534-project Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'b3f47816-4731-4cd8-8d3a-24f2b93f0adc'} Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:58.427390 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Returning 404 to user: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:58.435187 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-528ed07e-65de-49ff-b284-c6ea625f9239 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 404 len: 111 microversion: 2.1 time: 0.069100 Oct 03 11:10:58.439309 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3460/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:58 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:10:59.098894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:59.105558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:59.120485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:59.121169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:59.121681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:59.122409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:59.122865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:59.123484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:59.145122 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] HTTP exception thrown: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Request method failure captured: Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc HTTP/1.1 Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsH5Rz5hIVEG6kwo4thpHtZJx6q-Db64DOWRAmIsF9-IJegKKYYoEqCOqmJYq3Px6Homy-ZzTT2uGoe2yyqnU_FInxdv9wstECLKQFtgTjD0Ys8vukfWpPw37tEdS8r_M11h1XOOlQHHtrliGKIBliB4HGWbBR3-n_HZZydk1SwUS0U Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 52fb070ed8bb4589bb030224219f815d Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestServerBasicOps-485551534 Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52fb070ed8bb4589bb030224219f815d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52fb070ed8bb4589bb030224219f815d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52fb070ed8bb4589bb030224219f815d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52fb070ed8bb4589bb030224219f815d"}]}] Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestServerBasicOps-485551534 Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 52fb070ed8bb4589bb030224219f815d Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestServerBasicOps-485551534 Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestServerBasicOps-485551534-project Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 7a2b74560e4f4179a73a50364de06e3d Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestServerBasicOps-485551534-project Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b3f47816-4731-4cd8-8d3a-24f2b93f0adc'} Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:59.147173 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.151812 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.153964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Returning 404 to user: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:59.155090 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-238b5a59-dc9d-4ae8-8c3d-99156173e203 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 404 len: 111 microversion: 2.1 time: 0.063176 Oct 03 11:10:59.155674 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3129/6589] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:10:59 2022] DELETE /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:10:59.163941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:59.165107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] [instance: b3f47816-4731-4cd8-8d3a-24f2b93f0adc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:10:59.171229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:59.171726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:59.172165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:59.172931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:10:59.173390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:10:59.173818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:10:59.193172 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] HTTP exception thrown: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Request method failure captured: Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc HTTP/1.1 Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsH5Rz5hIVEG6kwo4thpHtZJx6q-Db64DOWRAmIsF9-IJegKKYYoEqCOqmJYq3Px6Homy-ZzTT2uGoe2yyqnU_FInxdv9wstECLKQFtgTjD0Ys8vukfWpPw37tEdS8r_M11h1XOOlQHHtrliGKIBliB4HGWbBR3-n_HZZydk1SwUS0U Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 52fb070ed8bb4589bb030224219f815d Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestServerBasicOps-485551534 Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52fb070ed8bb4589bb030224219f815d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52fb070ed8bb4589bb030224219f815d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52fb070ed8bb4589bb030224219f815d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52fb070ed8bb4589bb030224219f815d"}]}] Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestServerBasicOps-485551534 Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 52fb070ed8bb4589bb030224219f815d Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestServerBasicOps-485551534 Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestServerBasicOps-485551534-project Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 7a2b74560e4f4179a73a50364de06e3d Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestServerBasicOps-485551534-project Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'b3f47816-4731-4cd8-8d3a-24f2b93f0adc'} Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:10:59.200728 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.205454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:10:59.205454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:10:59.205454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:10:59.205454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:10:59.205454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:10:59.205454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. Oct 03 11:10:59.205454 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:10:59.206872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Returning 404 to user: Instance b3f47816-4731-4cd8-8d3a-24f2b93f0adc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:10:59.213061 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17ed0881-2d46-4bff-9ccd-ecffbab945bb tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc" status: 404 len: 111 microversion: 2.1 time: 0.047891 Oct 03 11:10:59.213061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3461/6590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:10:59 2022] GET /compute/v2.1/servers/b3f47816-4731-4cd8-8d3a-24f2b93f0adc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:10:59.443008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99efad3c-2e41-426b-b33c-df207f2d28d6 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] Calling method '.version_select at 0x7f074f07a700>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:10:59.489324 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99efad3c-2e41-426b-b33c-df207f2d28d6 tempest-TestServerBasicOps-485551534 tempest-TestServerBasicOps-485551534-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1876529962" status: 202 len: 0 microversion: 2.1 time: 0.051281 Oct 03 11:10:59.507741 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3130/6591] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 3 11:10:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1876529962 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:12:24.736946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=5 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:12:24.739168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=9 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:12:24.748823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-494968167", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:12:24.814799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:12:25.187750 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 11:12:25.346097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:12:25.346529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:12:25.349277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:12:25.349709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:12:25.350161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:12:25.363089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:25.363851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:25.365030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:25.365963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:25.366579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:25.367730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:25.387918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Getting quotas for project adabe5a82f6947fc871ad55ecc811637. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:12:25.393571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Getting quotas for user 357959515f6d4a99818e0d8a69eabcd1 and project adabe5a82f6947fc871ad55ecc811637. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:12:25.409100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:12:25.411469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:12:25.467973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-015284dc-8451-4d89-b414-cc808075cc98 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733832 Oct 03 11:12:25.469259 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3462/6592] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:12:25.481380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=11 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:12:25.482928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:12:25.495596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b2a3d06-a9af-4ca1-bea1-6bf50e1cb055 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:25.496912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b2a3d06-a9af-4ca1-bea1-6bf50e1cb055 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:25.588354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b2a3d06-a9af-4ca1-bea1-6bf50e1cb055 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:25.598084 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b2a3d06-a9af-4ca1-bea1-6bf50e1cb055 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1213 microversion: 2.1 time: 0.120243 Oct 03 11:12:25.613065 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3131/6593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:25 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:26.628913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:26.629688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:26.658216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:26.664801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:26.665559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:26.666423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:26.674617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:26.675241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:26.680487 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 37848. Oct 03 11:12:26.780061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:26.793603 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-089934dc-4b58-4653-b6af-c4e6cee7011a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1273 microversion: 2.1 time: 0.170146 Oct 03 11:12:26.795238 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3463/6594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:26 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:27.819571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:27.821598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:27.830662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:27.837341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:27.838037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:27.839037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:27.839746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:27.840407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:28.115431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:28.125859 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5ee2f213-8afa-46f8-8914-30a8118d63ce tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.309646 Oct 03 11:12:28.127131 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3132/6595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:27 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:29.112645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ac08f573-0b04-4d72-ad09-da0619ff5e75 req-8b68f981-3aec-47ec-b474-f70e6f857e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd0433a-59af-44bd-829e-bf7d7ab5e967", "tag": "0fe133a9-e38c-467a-8da3-304041d1ba00"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:12:29.123199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac08f573-0b04-4d72-ad09-da0619ff5e75 req-8b68f981-3aec-47ec-b474-f70e6f857e79 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:29.123679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac08f573-0b04-4d72-ad09-da0619ff5e75 req-8b68f981-3aec-47ec-b474-f70e6f857e79 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:29.124302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ac08f573-0b04-4d72-ad09-da0619ff5e75 req-8b68f981-3aec-47ec-b474-f70e6f857e79 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:29.143152 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ac08f573-0b04-4d72-ad09-da0619ff5e75 req-8b68f981-3aec-47ec-b474-f70e6f857e79 service nova] Creating event network-changed:0fe133a9-e38c-467a-8da3-304041d1ba00 for instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 on n-h2-858383-3 Oct 03 11:12:29.153385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:29.154636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:29.160015 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ac08f573-0b04-4d72-ad09-da0619ff5e75 req-8b68f981-3aec-47ec-b474-f70e6f857e79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265979 Oct 03 11:12:29.163143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3464/6596] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:12:29.165092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:29.165849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:29.166447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:29.167449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:29.168815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:29.169425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:29.423835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:29.433487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4921b9bb-9b56-4b6c-b987-6cf5409d3521 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.285868 Oct 03 11:12:29.435537 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3133/6597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:29 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:30.459242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:30.460543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:30.474006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:30.474896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:30.475516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:30.477164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:30.477824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:30.478426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:30.863459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:30.876140 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1dbb087-1707-4eb9-b1ea-a9f506094870 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.421657 Oct 03 11:12:30.877489 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3465/6598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:30 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:31.899714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:31.900537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:31.907326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:31.907825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:31.908272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:31.909013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:31.909476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:31.909909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:32.046169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:32.055122 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ce4b155c-e5f1-44c6-8875-ce2853da8d95 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.158923 Oct 03 11:12:32.055712 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3134/6599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:31 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:33.080451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:33.081092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:33.098586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:33.099543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:33.100188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:33.101869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:33.102722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:33.103349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:33.358909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:33.374942 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7e7fda0-6fd7-459f-acb3-f726d6ee1eb3 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.299206 Oct 03 11:12:33.375968 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3466/6600] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:33 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:34.402310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:34.403546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:34.411625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:34.412027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:34.412648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:34.413529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:34.414591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:34.415028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:34.563529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:34.581114 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1744fd3d-2a36-4c22-9069-a1f4aa9abcc0 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.183273 Oct 03 11:12:34.581718 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3135/6601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:34 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:35.606341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:35.606765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:35.609433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:12:35.610108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:12:35.616409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:35.617585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:35.618052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:35.618774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:35.619227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:35.619655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:35.796672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:35.804332 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ab364cf7-8cc8-4996-9b22-ff5fc3d23ced tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.203406 Oct 03 11:12:35.805197 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3467/6602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:35 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:36.004619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c47d64b3-b55a-4b66-9a98-055bea720644 req-054c5e33-11bc-4ecd-a776-aa263042a556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd0433a-59af-44bd-829e-bf7d7ab5e967", "name": "network-vif-plugged", "status": "completed", "tag": "0fe133a9-e38c-467a-8da3-304041d1ba00"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:12:36.014813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:12:36.021226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c47d64b3-b55a-4b66-9a98-055bea720644 req-054c5e33-11bc-4ecd-a776-aa263042a556 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:36.022335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c47d64b3-b55a-4b66-9a98-055bea720644 req-054c5e33-11bc-4ecd-a776-aa263042a556 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:36.023663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c47d64b3-b55a-4b66-9a98-055bea720644 req-054c5e33-11bc-4ecd-a776-aa263042a556 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:36.035786 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c47d64b3-b55a-4b66-9a98-055bea720644 req-054c5e33-11bc-4ecd-a776-aa263042a556 service nova] Creating event network-vif-plugged:0fe133a9-e38c-467a-8da3-304041d1ba00 for instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 on n-h2-858383-3 Oct 03 11:12:36.041864 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c47d64b3-b55a-4b66-9a98-055bea720644 req-054c5e33-11bc-4ecd-a776-aa263042a556 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041201 Oct 03 11:12:36.042679 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3136/6603] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:12:36.833500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:36.834054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:36.842052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:36.842544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:36.842981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:36.844085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:36.844541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:36.844988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:37.003003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:37.014118 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72801575-7d6a-41cf-9a58-42c46436ad51 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1313 microversion: 2.1 time: 0.190071 Oct 03 11:12:37.015106 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3468/6604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:36 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:38.043009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:12:38.044868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:38.051661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:38.052157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:38.052601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:38.053348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:38.053809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:38.054240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:38.213322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:12:38.223611 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-330d1fd2-300f-470f-8c24-ec9125ed8c1a tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1463 microversion: 2.1 time: 0.187624 Oct 03 11:12:38.224347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3137/6605] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:12:38 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1463 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:12:38.247428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5f48a24-c62f-4f70-8b9a-a63aa9e9c2c8", "device": "/dev/sdb"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:12:38.250085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:12:38.257430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:38.258548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:38.259055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:38.259858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:12:38.260421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:12:38.261039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:12:38.519668 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a6bcedc-8240-42c0-a007-1543a297265d tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "POST /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275789 Oct 03 11:12:38.520311 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3469/6606] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:12:38 2022] POST /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:13:44.588146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:13:44.588704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:13:44.591235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=16 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:13:44.592041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=32 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:13:44.599093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:44.599583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:44.600015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:44.600718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:44.601369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:44.601800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:44.717962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lazy-loading 'services' on Instance uuid 2dd0433a-59af-44bd-829e-bf7d7ab5e967 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:13:44.808496 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43e026da-fa6c-4408-afa9-b2fadfa3cfd7 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967/os-volume_attachments/c5f48a24-c62f-4f70-8b9a-a63aa9e9c2c8" status: 202 len: 0 microversion: 2.1 time: 0.240216 Oct 03 11:13:44.810233 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3138/6607] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:13:44 2022] DELETE /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967/os-volume_attachments/c5f48a24-c62f-4f70-8b9a-a63aa9e9c2c8 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 11:13:51.294684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:13:51.295949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:13:51.300190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:13:51.300893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:13:51.308802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:51.309375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:51.309884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:51.310658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:51.311200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:51.311866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:51.344679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:13:51.429222 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e42fe3bd-0b2b-4478-a5df-84ba40dd1aba tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 204 len: 0 microversion: 2.1 time: 0.136484 Oct 03 11:13:51.429819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3470/6608] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:13:51 2022] DELETE /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:13:51.440506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:13:51.441322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:13:51.447913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:51.448485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:51.449392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:51.450167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:51.450704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:51.451230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:51.595317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:13:51.604133 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86c75702-95be-42b4-917e-a0907892de81 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1469 microversion: 2.1 time: 0.169373 Oct 03 11:13:51.604740 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3139/6609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:13:51 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:13:52.629100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:13:52.630607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:13:52.637622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:52.638110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:52.638547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:52.639262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:52.639699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:52.640149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:52.783421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:13:52.791548 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8df4fc4-94c1-4527-b4de-a913045e8803 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1469 microversion: 2.1 time: 0.167675 Oct 03 11:13:52.792241 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3471/6610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:13:52 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:13:53.364693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8644bd44-0a05-4e84-8b67-7052cc1d56e4 req-f51d67a0-1c5e-40e7-b00b-cfc8b617e8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd0433a-59af-44bd-829e-bf7d7ab5e967", "name": "network-vif-deleted", "tag": "0fe133a9-e38c-467a-8da3-304041d1ba00"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:13:53.378414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8644bd44-0a05-4e84-8b67-7052cc1d56e4 req-f51d67a0-1c5e-40e7-b00b-cfc8b617e8fa service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:53.378903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8644bd44-0a05-4e84-8b67-7052cc1d56e4 req-f51d67a0-1c5e-40e7-b00b-cfc8b617e8fa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:53.379340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8644bd44-0a05-4e84-8b67-7052cc1d56e4 req-f51d67a0-1c5e-40e7-b00b-cfc8b617e8fa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:53.391245 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8644bd44-0a05-4e84-8b67-7052cc1d56e4 req-f51d67a0-1c5e-40e7-b00b-cfc8b617e8fa service nova] Creating event network-vif-deleted:0fe133a9-e38c-467a-8da3-304041d1ba00 for instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 on n-h2-858383-3 Oct 03 11:13:53.397333 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8644bd44-0a05-4e84-8b67-7052cc1d56e4 req-f51d67a0-1c5e-40e7-b00b-cfc8b617e8fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037236 Oct 03 11:13:53.398633 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3140/6611] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:13:53.818048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:13:53.818587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:13:53.827116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:53.827619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:53.828066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:53.829372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:53.830294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:53.830894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:53.867901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:53.868889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:53.869453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:53.869940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lazy-loading 'fault' on Instance uuid 2dd0433a-59af-44bd-829e-bf7d7ab5e967 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:13:53.919162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357959515f6d4a99818e0d8a69eabcd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adabe5a82f6947fc871ad55ecc811637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:13:53.927200 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e476ed5a-8730-48cf-8760-1a12719814c2 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 200 len: 1303 microversion: 2.1 time: 0.115480 Oct 03 11:13:53.927956 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3472/6612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:13:53 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:13:54.952815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:13:54.953527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] [instance: 2dd0433a-59af-44bd-829e-bf7d7ab5e967] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:13:54.960491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:54.961017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:54.961459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:54.962165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:13:54.962645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:13:54.963056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:13:54.977546 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] HTTP exception thrown: Instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 could not be found. Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Request method failure captured: Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 HTTP/1.1 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsOV2EO31ZiMeVf_zTNTFHguyb4Q-K1Gok9VYX5Sa_xV1MJA5-3bQMACD37RPe-uDcnQ4DfXncI_uZO1J5cLqUVilf-GpY5jbz9GYGGWiSXsmjmqAn6RJwMdWEcQRnEqRfYlMIDVikMom9PkY07kEaVzKHLR49UGLpmvriVAcBlGWJw Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: adabe5a82f6947fc871ad55ecc811637 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-VolumesBackupsTest-638054929 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adabe5a82f6947fc871ad55ecc811637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adabe5a82f6947fc871ad55ecc811637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adabe5a82f6947fc871ad55ecc811637"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adabe5a82f6947fc871ad55ecc811637"}]}] Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-VolumesBackupsTest-638054929 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: adabe5a82f6947fc871ad55ecc811637 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-VolumesBackupsTest-638054929 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-VolumesBackupsTest-638054929-project Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 357959515f6d4a99818e0d8a69eabcd1 Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-VolumesBackupsTest-638054929-project Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 could not be found. Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '2dd0433a-59af-44bd-829e-bf7d7ab5e967'} Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 could not be found. Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 could not be found. Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:13:54.979217 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 could not be found. Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] Returning 404 to user: Instance 2dd0433a-59af-44bd-829e-bf7d7ab5e967 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5de8a29-12cc-4430-ae6c-715036cf1402 tempest-VolumesBackupsTest-638054929 tempest-VolumesBackupsTest-638054929-project] 10.222.0.27 "GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967" status: 404 len: 111 microversion: 2.1 time: 0.033433 Oct 03 11:13:54.983652 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3141/6613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:13:54 2022] GET /compute/v2.1/servers/2dd0433a-59af-44bd-829e-bf7d7ab5e967 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:14:28.816030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-899408390", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e94f0843-78b8-4177-8dc7-c99bb146ead7"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:14:28.825088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:28.825760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:28.826877 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:14:28.826877 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 03 11:14:28.883053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] validate_networks() for [('e94f0843-78b8-4177-8dc7-c99bb146ead7', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:14:29.332693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:14:29.333291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:14:29.333805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:14:29.334220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:14:29.334638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:14:29.344683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:29.345203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:29.345644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:29.346377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:29.346832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:29.347273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:29.364294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Getting quotas for project 99137ef58b8841b29ff87c3ec7fdf5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:14:29.369915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Getting quotas for user 9a35acdbabcc43bfafb2443c8c1c2d24 and project 99137ef58b8841b29ff87c3ec7fdf5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:14:29.385247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:14:29.388102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:14:29.441216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2712eb26-f4dc-420c-8a11-bd0184384bc6 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629332 Oct 03 11:14:29.441991 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3473/6614] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:14:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 11:14:29.454550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eebc7ab8-0fc3-4c36-83da-d9c6d4067e24 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:29.455545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eebc7ab8-0fc3-4c36-83da-d9c6d4067e24 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:29.458517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:29.459256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:29.460366 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:14:29.460551 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 (ip 10.222.0.27) !!! Oct 03 11:14:29.461715 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:14:29.461891 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 (ip 10.222.0.27) !!! Oct 03 11:14:29.549433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eebc7ab8-0fc3-4c36-83da-d9c6d4067e24 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:29.556149 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eebc7ab8-0fc3-4c36-83da-d9c6d4067e24 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1218 microversion: 2.1 time: 0.106571 Oct 03 11:14:29.556827 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3142/6615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:29 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:30.580594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:30.580992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:30.589087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:30.589884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:30.590363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:30.591131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:30.591797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:30.592240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:30.663111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:30.672740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6abd9eee-6323-462b-b79e-32c066b22272 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1278 microversion: 2.1 time: 0.096397 Oct 03 11:14:30.674469 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3474/6616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:30 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:31.697558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:31.698238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:31.706703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:31.707196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:31.707811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:31.708700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:31.709193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:31.709622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:31.939140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:31.952275 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3611c312-8bc2-4573-b651-7f54fc86d6dd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1318 microversion: 2.1 time: 0.260097 Oct 03 11:14:31.964826 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3143/6617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:31 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:32.120733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f25c3b50-61ee-4450-87e9-91e4e4f03984 req-b60fa912-a43f-419c-86c8-f60405a37d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c040f925-25f2-4630-a107-02ca873b7097", "tag": "9060d095-c996-4fe9-af03-ce625803d5fe"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:14:32.138934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f25c3b50-61ee-4450-87e9-91e4e4f03984 req-b60fa912-a43f-419c-86c8-f60405a37d25 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:32.139738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f25c3b50-61ee-4450-87e9-91e4e4f03984 req-b60fa912-a43f-419c-86c8-f60405a37d25 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:32.140270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f25c3b50-61ee-4450-87e9-91e4e4f03984 req-b60fa912-a43f-419c-86c8-f60405a37d25 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:32.151822 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f25c3b50-61ee-4450-87e9-91e4e4f03984 req-b60fa912-a43f-419c-86c8-f60405a37d25 service nova] Creating event network-changed:9060d095-c996-4fe9-af03-ce625803d5fe for instance c040f925-25f2-4630-a107-02ca873b7097 on n-h2-858383-3 Oct 03 11:14:32.157602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f25c3b50-61ee-4450-87e9-91e4e4f03984 req-b60fa912-a43f-419c-86c8-f60405a37d25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040613 Oct 03 11:14:32.158282 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3475/6618] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:14:32.975757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:32.976321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:32.983934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:32.984420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:32.984952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:32.985656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:32.986110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:32.986895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:33.129206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:33.138839 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c3e5e12d-17e7-464c-a787-97c12df37c76 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1318 microversion: 2.1 time: 0.167163 Oct 03 11:14:33.139436 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3144/6619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:32 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:34.163497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:34.164342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:34.171194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:34.171703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:34.172136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:34.172840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:34.173286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:34.173706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:34.311479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:34.320342 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f76aba4-ceed-489f-a91b-ec1669f06a3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1318 microversion: 2.1 time: 0.161970 Oct 03 11:14:34.321303 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3476/6620] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:34 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:35.343155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:35.343930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:35.350937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:35.351428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:35.351873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:35.352579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:35.353871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:35.353871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:35.486357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:35.494115 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b20dfa1-fe6c-4db6-a46d-de0e0af6e772 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1318 microversion: 2.1 time: 0.155584 Oct 03 11:14:35.494896 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3145/6621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:35 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:36.516682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:36.517486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:36.525100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:36.525587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:36.526031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:36.526730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:36.527308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:36.527772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:36.682855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:36.691144 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81ef60c3-da77-49cf-b35d-8c629f2af8c7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1318 microversion: 2.1 time: 0.178950 Oct 03 11:14:36.691720 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3477/6622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:36 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:37.713649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:37.714264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:37.721828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:37.722312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:37.722771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:37.723467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:37.723916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:37.724339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:37.855840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:37.863571 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8a6ec794-abc4-4b9d-b07d-1db50b1ea921 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1318 microversion: 2.1 time: 0.153776 Oct 03 11:14:37.864142 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3146/6623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:37 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:38.666613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4413fd02-45fd-4b98-89df-f58288de2c11 req-0ffac397-82ad-425d-bf4f-4ec96a02e80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c040f925-25f2-4630-a107-02ca873b7097", "name": "network-vif-plugged", "status": "completed", "tag": "9060d095-c996-4fe9-af03-ce625803d5fe"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:14:38.678561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4413fd02-45fd-4b98-89df-f58288de2c11 req-0ffac397-82ad-425d-bf4f-4ec96a02e80a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:38.679120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4413fd02-45fd-4b98-89df-f58288de2c11 req-0ffac397-82ad-425d-bf4f-4ec96a02e80a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:38.679671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4413fd02-45fd-4b98-89df-f58288de2c11 req-0ffac397-82ad-425d-bf4f-4ec96a02e80a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:38.691095 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4413fd02-45fd-4b98-89df-f58288de2c11 req-0ffac397-82ad-425d-bf4f-4ec96a02e80a service nova] Creating event network-vif-plugged:9060d095-c996-4fe9-af03-ce625803d5fe for instance c040f925-25f2-4630-a107-02ca873b7097 on n-h2-858383-3 Oct 03 11:14:38.696388 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4413fd02-45fd-4b98-89df-f58288de2c11 req-0ffac397-82ad-425d-bf4f-4ec96a02e80a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186996 Oct 03 11:14:38.697234 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3478/6624] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:14:38.887786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:38.888528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:38.895250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:38.896107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:38.896332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:38.896946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:38.897413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:38.897849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:39.030530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:39.038273 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f30145c7-7f1d-4c2b-84d8-ad80629233a7 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1318 microversion: 2.1 time: 0.155184 Oct 03 11:14:39.039060 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3147/6625] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:38 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:40.062301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:14:40.063006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:40.065059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:40.065731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:40.073622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:40.074119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:40.074561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:40.075283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:40.075739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:40.076173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:40.211956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:14:40.220373 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4dca88a6-acff-4b14-84da-4bc33a2073bf tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1507 microversion: 2.1 time: 0.163197 Oct 03 11:14:40.221028 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3479/6626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:14:40 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:14:56.621977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11f4058f-afb5-4d7e-bfa9-7308b5152a09", "device": "/dev/sdb"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:14:56.624756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:14:56.627904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:56.629720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:56.630766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=30 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:14:56.634805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:56.635318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:56.635757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:56.636481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:14:56.637129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:14:56.637556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:14:56.913500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1b2a5a3a-0d10-42cc-b014-1328f4edfb94 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "POST /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295054 Oct 03 11:14:56.914716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3148/6627] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:14:56 2022] POST /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:15:22.052508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:22.053693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=30 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:22.058753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:22.059477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:22.067526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:22.068398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:22.068982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:22.069798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:22.070328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:22.070829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:22.155846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lazy-loading 'services' on Instance uuid c040f925-25f2-4630-a107-02ca873b7097 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:15:22.228055 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5072da19-7887-495e-92ae-5d448cc9a776 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097/os-volume_attachments/11f4058f-afb5-4d7e-bfa9-7308b5152a09" status: 202 len: 0 microversion: 2.1 time: 0.176435 Oct 03 11:15:22.228944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3480/6628] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:15:22 2022] DELETE /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097/os-volume_attachments/11f4058f-afb5-4d7e-bfa9-7308b5152a09 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:15:28.705902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:28.706493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:28.709270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:28.710045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:28.717399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:28.717887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:28.718357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:28.719059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:28.719608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:28.720032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:28.751755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:15:28.831072 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4e23ff78-6f1b-4f16-af33-e7b64eb42938 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 204 len: 0 microversion: 2.1 time: 0.129154 Oct 03 11:15:28.831766 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3149/6629] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:15:28 2022] DELETE /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:15:28.842922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:28.843748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:28.850138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:28.851326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:28.852054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:28.853277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:28.853743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:28.854203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:29.009933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:29.021856 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02d646c5-2fd3-4f01-a3c6-2bd634dec326 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1513 microversion: 2.1 time: 0.184438 Oct 03 11:15:29.022684 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3481/6630] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:28 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:30.047502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:30.048230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:30.057234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:30.057898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:30.058398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:30.059267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:30.059781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:30.060372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:30.211782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:30.219985 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-95fb90dd-db5b-4a66-8c2b-02e2036f83bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1513 microversion: 2.1 time: 0.176810 Oct 03 11:15:30.220575 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3150/6631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:30 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:30.801902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0cf7dcbf-c38a-4cce-9eea-cb349be43ffc req-1517f89a-22dc-4587-8b14-d8039c3ac4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c040f925-25f2-4630-a107-02ca873b7097", "name": "network-vif-deleted", "tag": "9060d095-c996-4fe9-af03-ce625803d5fe"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:15:30.814273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0cf7dcbf-c38a-4cce-9eea-cb349be43ffc req-1517f89a-22dc-4587-8b14-d8039c3ac4c1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:30.814763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0cf7dcbf-c38a-4cce-9eea-cb349be43ffc req-1517f89a-22dc-4587-8b14-d8039c3ac4c1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:30.815825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0cf7dcbf-c38a-4cce-9eea-cb349be43ffc req-1517f89a-22dc-4587-8b14-d8039c3ac4c1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:30.829769 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0cf7dcbf-c38a-4cce-9eea-cb349be43ffc req-1517f89a-22dc-4587-8b14-d8039c3ac4c1 service nova] Creating event network-vif-deleted:9060d095-c996-4fe9-af03-ce625803d5fe for instance c040f925-25f2-4630-a107-02ca873b7097 on n-h2-858383-3 Oct 03 11:15:30.836482 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0cf7dcbf-c38a-4cce-9eea-cb349be43ffc req-1517f89a-22dc-4587-8b14-d8039c3ac4c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038184 Oct 03 11:15:30.837126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3482/6632] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:15:31.246462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:31.247267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:31.255822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:31.257700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:31.258209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:31.258938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:31.259411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:31.259834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:31.302370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:31.302940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:31.303504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:31.303967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lazy-loading 'fault' on Instance uuid c040f925-25f2-4630-a107-02ca873b7097 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:15:31.363346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:31.372432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d36d12a-ac51-4e5b-8908-d1754561e8bd tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 200 len: 1308 microversion: 2.1 time: 0.132334 Oct 03 11:15:31.373076 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3151/6633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:31 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 1308 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:32.397473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:32.398757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: c040f925-25f2-4630-a107-02ca873b7097] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:32.407926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:32.408422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:32.408892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:32.409604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:32.410056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:32.410481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:32.425473 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] HTTP exception thrown: Instance c040f925-25f2-4630-a107-02ca873b7097 could not be found. Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Request method failure captured: Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 HTTP/1.1 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsPX1ED8nXsF82Z0vRoXl5Hp85-TjrmDZKM8K3PjCTekSQaZ6iXTkISDonUkFfYBCNZy5HLD7x2XB9eGRPBcJBMSH_O5zDj4ZTj-9G2UBi4H0tTZ85vPVghcwuITY_fBmZyUVZa9lgj66MDWEQJBkzw7JFoMoWbjQy8AOAVyBjjCqPY Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 99137ef58b8841b29ff87c3ec7fdf5f6 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211131134 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99137ef58b8841b29ff87c3ec7fdf5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_99137ef58b8841b29ff87c3ec7fdf5f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/99137ef58b8841b29ff87c3ec7fdf5f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99137ef58b8841b29ff87c3ec7fdf5f6"}]}] Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211131134 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 99137ef58b8841b29ff87c3ec7fdf5f6 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211131134 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesSnapshotTestJSON-1211131134-project Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9a35acdbabcc43bfafb2443c8c1c2d24 Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211131134-project Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c040f925-25f2-4630-a107-02ca873b7097 could not be found. Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c040f925-25f2-4630-a107-02ca873b7097'} Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c040f925-25f2-4630-a107-02ca873b7097 could not be found. Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c040f925-25f2-4630-a107-02ca873b7097 could not be found. Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:15:32.427175 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c040f925-25f2-4630-a107-02ca873b7097 could not be found. Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Returning 404 to user: Instance c040f925-25f2-4630-a107-02ca873b7097 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99c9a48a-9013-4413-8910-54636f5e85cb tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097" status: 404 len: 111 microversion: 2.1 time: 0.035844 Oct 03 11:15:32.432879 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3483/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:32 2022] GET /compute/v2.1/servers/c040f925-25f2-4630-a107-02ca873b7097 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:15:39.241013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-866575241", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "e94f0843-78b8-4177-8dc7-c99bb146ead7"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:15:39.468092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] validate_networks() for [('e94f0843-78b8-4177-8dc7-c99bb146ead7', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:15:39.907446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:15:39.907877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:15:39.908351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:15:39.908785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:15:39.909212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:15:39.918832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:39.919317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:39.919754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:39.920484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:39.920982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:39.921412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:39.938591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Getting quotas for project 99137ef58b8841b29ff87c3ec7fdf5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:15:39.944339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Getting quotas for user 9a35acdbabcc43bfafb2443c8c1c2d24 and project 99137ef58b8841b29ff87c3ec7fdf5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:15:39.958625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:15:39.961339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:15:40.014106 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-364a1a82-7432-4d16-b022-58baa8bf672e tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777063 Oct 03 11:15:40.014931 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3152/6635] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:15:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:15:40.025767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f60111b-0316-4826-b882-7852fc362d0b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:40.026383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f60111b-0316-4826-b882-7852fc362d0b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:40.161306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f60111b-0316-4826-b882-7852fc362d0b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:40.173927 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f60111b-0316-4826-b882-7852fc362d0b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1218 microversion: 2.1 time: 0.151772 Oct 03 11:15:40.189787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3484/6636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:40 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:41.197282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:41.198849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:41.206235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:41.207079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:41.207763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:41.209129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:41.209825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:41.210502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:41.295420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:41.307174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68c218bf-44e3-4fd7-be20-73a6417ea95a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1278 microversion: 2.1 time: 0.114598 Oct 03 11:15:41.307886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3153/6637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:41 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:42.334913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:42.336199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:42.343087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:42.344189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:42.344804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:42.345679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:42.346141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:42.346569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:42.512109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:42.520171 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-551b27c1-e45e-4785-b215-3cb98498a62a tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.192261 Oct 03 11:15:42.533167 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3485/6638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:42 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:42.871207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-228e871f-dff3-4169-81ea-e9bcb5029a12 req-6ffa7840-fe70-47fc-b968-869d74528122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae57bc6c-0e36-4fab-802c-53451a5dc224", "tag": "a1b40ac1-27b3-4973-807f-55eb5570c5ef"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:15:42.887591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-228e871f-dff3-4169-81ea-e9bcb5029a12 req-6ffa7840-fe70-47fc-b968-869d74528122 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:42.887987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-228e871f-dff3-4169-81ea-e9bcb5029a12 req-6ffa7840-fe70-47fc-b968-869d74528122 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:42.889169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-228e871f-dff3-4169-81ea-e9bcb5029a12 req-6ffa7840-fe70-47fc-b968-869d74528122 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:42.902021 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-228e871f-dff3-4169-81ea-e9bcb5029a12 req-6ffa7840-fe70-47fc-b968-869d74528122 service nova] Creating event network-changed:a1b40ac1-27b3-4973-807f-55eb5570c5ef for instance ae57bc6c-0e36-4fab-802c-53451a5dc224 on n-h1-858383-3 Oct 03 11:15:42.907857 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-228e871f-dff3-4169-81ea-e9bcb5029a12 req-6ffa7840-fe70-47fc-b968-869d74528122 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047653 Oct 03 11:15:42.909798 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3154/6639] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:15:43.543921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:43.544548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:43.551566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:43.552055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:43.552609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:43.553343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:43.553804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:43.554239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:43.693959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:43.701698 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0cb93f7c-0f69-46dd-8c72-9a4c4662ea65 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.161732 Oct 03 11:15:43.702400 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3486/6640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:43 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:44.727847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:44.728466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:44.734623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:44.735107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:44.735568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:44.736377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:44.736700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:44.737176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:44.880048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:44.888609 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9eac3477-4d2e-434e-b0c8-ce32494af016 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.166690 Oct 03 11:15:44.889317 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3155/6641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:44 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:45.912294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:45.914081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:45.920753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:45.921272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:45.921714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:45.922424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:45.923015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:45.923590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:46.063885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:46.075259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3930aca-704e-4108-9279-9b3ee38ed5a1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.167507 Oct 03 11:15:46.076005 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3487/6642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:45 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:47.098690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:47.100101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:47.107324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:47.107813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:47.108260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:47.109005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:47.109489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:47.109925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:47.272885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:47.283388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-98a3cf06-9ea0-40d9-9ff7-75018efe2e8b tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.188659 Oct 03 11:15:47.283977 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3156/6643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:47 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:48.307594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:48.308827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:48.315835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:48.316519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:48.316988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:48.318434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:48.318899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:48.319330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:48.481963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:48.490305 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-47097c62-51d0-4b3d-ae2a-24779fbfc2d1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.186632 Oct 03 11:15:48.491110 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3488/6644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:48 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:49.512622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:49.514032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:49.521838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:49.522430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:49.522944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:49.523727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:49.524354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:49.524885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:49.701175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:49.705800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-754f4de6-6774-4a8f-8710-793dfba30603 req-847b20b6-122f-4521-b23e-63fc2e3d4e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae57bc6c-0e36-4fab-802c-53451a5dc224", "name": "network-vif-plugged", "status": "completed", "tag": "a1b40ac1-27b3-4973-807f-55eb5570c5ef"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:15:49.710261 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db5a7342-7d86-43fd-8e4a-266eaa3f5bad tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.201614 Oct 03 11:15:49.711296 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3157/6645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:49 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:49.733866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-754f4de6-6774-4a8f-8710-793dfba30603 req-847b20b6-122f-4521-b23e-63fc2e3d4e70 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:49.734664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-754f4de6-6774-4a8f-8710-793dfba30603 req-847b20b6-122f-4521-b23e-63fc2e3d4e70 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:49.735109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-754f4de6-6774-4a8f-8710-793dfba30603 req-847b20b6-122f-4521-b23e-63fc2e3d4e70 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:49.748215 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-754f4de6-6774-4a8f-8710-793dfba30603 req-847b20b6-122f-4521-b23e-63fc2e3d4e70 service nova] Creating event network-vif-plugged:a1b40ac1-27b3-4973-807f-55eb5570c5ef for instance ae57bc6c-0e36-4fab-802c-53451a5dc224 on n-h1-858383-3 Oct 03 11:15:49.753337 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-754f4de6-6774-4a8f-8710-793dfba30603 req-847b20b6-122f-4521-b23e-63fc2e3d4e70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051225 Oct 03 11:15:49.754195 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3489/6646] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:15:50.738178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:50.738787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:50.740799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:50.741471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:50.749415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:50.750184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:50.750632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:50.751635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:50.752467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:50.752964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:50.915415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:50.923882 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-37158431-00f3-4e52-8411-ba222dbd8543 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1318 microversion: 2.1 time: 0.189578 Oct 03 11:15:50.924483 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3158/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:50 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:51.945657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:51.951431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:15:51.952171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:51.959861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:51.960351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:51.961956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:51.961956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:51.963243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:51.963683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:52.112815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:15:52.115648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:15:52.122889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-40729bd3-b93b-4646-9670-90c805856587 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1507 microversion: 2.1 time: 0.178205 Oct 03 11:15:52.123566 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3490/6648] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:15:51 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:15:52.145917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b64b7a53-d819-4d71-8d4d-bdce0d705182", "device": "/dev/sdb"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:15:52.149034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:15:52.155884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:52.156315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:52.156755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:52.157468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:15:52.157925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:15:52.158352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:15:52.429203 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b8669c2-653c-4a17-a9fb-3a47e2dcfbc4 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "POST /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287042 Oct 03 11:15:52.430275 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3159/6649] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:15:52 2022] POST /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:16:18.343720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:16:18.344282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:16:18.346208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=24 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:16:18.352753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:18.353271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:18.353710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:18.354406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:18.354857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:18.355327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:18.443026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lazy-loading 'services' on Instance uuid ae57bc6c-0e36-4fab-802c-53451a5dc224 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:16:18.774538 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f8e01a6-fbc3-4aec-aef4-75ae40c7ef9c tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224/os-volume_attachments/b64b7a53-d819-4d71-8d4d-bdce0d705182" status: 202 len: 0 microversion: 2.1 time: 0.435160 Oct 03 11:16:18.775174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3491/6650] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:16:18 2022] DELETE /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224/os-volume_attachments/b64b7a53-d819-4d71-8d4d-bdce0d705182 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:16:24.237610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:16:24.238419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:16:24.243395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:16:24.244042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:16:24.252761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:24.253276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:24.253722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:24.254437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:24.254949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:24.255338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:24.283948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:16:24.371727 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6826df6a-8b8a-4782-b1b6-5529addfce3d tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 204 len: 0 microversion: 2.1 time: 0.136428 Oct 03 11:16:24.372335 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3160/6651] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:16:24 2022] DELETE /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:16:24.381969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:16:24.382668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:16:24.389291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:24.389644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:24.390080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:24.390950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:24.391407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:24.391836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:24.531652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:16:24.540364 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-72b48cf1-8b36-4247-a14b-1b93f328f2b1 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1513 microversion: 2.1 time: 0.163387 Oct 03 11:16:24.540982 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3492/6652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:16:24 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:16:25.569200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:16:25.570772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:16:25.578540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:25.579699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:25.581097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:25.581841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:25.582846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:25.582846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:25.739855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:16:25.749720 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71f31bcf-b28d-40ca-a40d-ab693b2fb8c3 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1513 microversion: 2.1 time: 0.186393 Oct 03 11:16:25.750320 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3161/6653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:16:25 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:16:26.608591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c95dde9d-4973-4b20-8f43-085adcbbbc93 req-728c28ee-8407-4988-aba4-81c0c9b48b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae57bc6c-0e36-4fab-802c-53451a5dc224", "name": "network-vif-deleted", "tag": "a1b40ac1-27b3-4973-807f-55eb5570c5ef"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:16:26.620571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c95dde9d-4973-4b20-8f43-085adcbbbc93 req-728c28ee-8407-4988-aba4-81c0c9b48b82 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:26.621087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c95dde9d-4973-4b20-8f43-085adcbbbc93 req-728c28ee-8407-4988-aba4-81c0c9b48b82 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:26.621519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c95dde9d-4973-4b20-8f43-085adcbbbc93 req-728c28ee-8407-4988-aba4-81c0c9b48b82 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:26.635296 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c95dde9d-4973-4b20-8f43-085adcbbbc93 req-728c28ee-8407-4988-aba4-81c0c9b48b82 service nova] Creating event network-vif-deleted:a1b40ac1-27b3-4973-807f-55eb5570c5ef for instance ae57bc6c-0e36-4fab-802c-53451a5dc224 on n-h1-858383-3 Oct 03 11:16:26.641207 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c95dde9d-4973-4b20-8f43-085adcbbbc93 req-728c28ee-8407-4988-aba4-81c0c9b48b82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036489 Oct 03 11:16:26.641883 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3493/6654] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:16:26.773837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:16:26.774457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:16:26.781577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:26.782454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:26.783673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:26.784393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:26.784888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:26.785317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:26.819131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:26.819643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:26.820132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:26.820629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lazy-loading 'fault' on Instance uuid ae57bc6c-0e36-4fab-802c-53451a5dc224 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:16:26.872716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a35acdbabcc43bfafb2443c8c1c2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99137ef58b8841b29ff87c3ec7fdf5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:16:26.880668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26a480ed-37e0-4927-a7ce-ce2f7bf32a93 tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 200 len: 1308 microversion: 2.1 time: 0.110729 Oct 03 11:16:26.881345 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3162/6655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:16:26 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:16:27.912353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:16:27.913125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] [instance: ae57bc6c-0e36-4fab-802c-53451a5dc224] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:16:27.919525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:27.920023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:27.920468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:27.921206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:16:27.921665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:16:27.922100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:16:27.936761 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] HTTP exception thrown: Instance ae57bc6c-0e36-4fab-802c-53451a5dc224 could not be found. Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Request method failure captured: Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 HTTP/1.1 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsPX1ED8nXsF82Z0vRoXl5Hp85-TjrmDZKM8K3PjCTekSQaZ6iXTkISDonUkFfYBCNZy5HLD7x2XB9eGRPBcJBMSH_O5zDj4ZTj-9G2UBi4H0tTZ85vPVghcwuITY_fBmZyUVZa9lgj66MDWEQJBkzw7JFoMoWbjQy8AOAVyBjjCqPY Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 99137ef58b8841b29ff87c3ec7fdf5f6 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1211131134 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99137ef58b8841b29ff87c3ec7fdf5f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_99137ef58b8841b29ff87c3ec7fdf5f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/99137ef58b8841b29ff87c3ec7fdf5f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/99137ef58b8841b29ff87c3ec7fdf5f6"}]}] Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-VolumesSnapshotTestJSON-1211131134 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 99137ef58b8841b29ff87c3ec7fdf5f6 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1211131134 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-VolumesSnapshotTestJSON-1211131134-project Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 9a35acdbabcc43bfafb2443c8c1c2d24 Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-VolumesSnapshotTestJSON-1211131134-project Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance ae57bc6c-0e36-4fab-802c-53451a5dc224 could not be found. Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'ae57bc6c-0e36-4fab-802c-53451a5dc224'} Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae57bc6c-0e36-4fab-802c-53451a5dc224 could not be found. Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae57bc6c-0e36-4fab-802c-53451a5dc224 could not be found. Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:16:27.938491 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae57bc6c-0e36-4fab-802c-53451a5dc224 could not be found. Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] Returning 404 to user: Instance ae57bc6c-0e36-4fab-802c-53451a5dc224 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a03cc55-b2a6-4496-9b2c-25c1f8a563ab tempest-VolumesSnapshotTestJSON-1211131134 tempest-VolumesSnapshotTestJSON-1211131134-project] 10.222.0.27 "GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224" status: 404 len: 111 microversion: 2.1 time: 0.034066 Oct 03 11:16:27.947088 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3494/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:16:27 2022] GET /compute/v2.1/servers/ae57bc6c-0e36-4fab-802c-53451a5dc224 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:17:30.473467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:30.474330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:30.524542 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 11:17:30.670940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53a61e18-0b79-44a0-9716-d74a47ab2252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: .version_select at 0x7f074fad6160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1170425854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZRKcz02l1UynL4oDoK51KP40NQOx9DRM2uB5PcUvtLRlY8MppPPZFFom08N2K21q7y3gw2uIz8/ZTQBsewAI3iydtU0filxrlQrVoMfn3el9vCtiDfM95L0uMAKHTaNg=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:17:30.687228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-53a61e18-0b79-44a0-9716-d74a47ab2252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:17:30.692903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-53a61e18-0b79-44a0-9716-d74a47ab2252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:17:30.706933 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-53a61e18-0b79-44a0-9716-d74a47ab2252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:17:31.536179 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44130. Oct 03 11:17:31.716463 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [None req-53a61e18-0b79-44a0-9716-d74a47ab2252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44132. Oct 03 11:17:31.736740 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53a61e18-0b79-44a0-9716-d74a47ab2252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.265184 Oct 03 11:17:31.737454 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3163/6657] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:17:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:17:40.019880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:40.021494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:40.026752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2084735948", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "82a3b7bf-69e7-486a-b66a-a9adf65b66c5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1170425854", "security_groups": [{"name": "tempest-secgroup-smoke-2126706191"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:17:40.239688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] validate_networks() for [('82a3b7bf-69e7-486a-b66a-a9adf65b66c5', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:17:40.964273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:17:40.964739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:17:40.965824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:17:40.966274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:17:40.966698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:17:40.990806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:40.991552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:40.992383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:40.993518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:40.994598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:40.995324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:41.021117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:17:41.028299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:17:41.045552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:17:41.053253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:17:41.146311 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [550b53d0-5cd9-45fe-b521-894f231f725e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:17:42.157755 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [550b53d0-5cd9-45fe-b521-894f231f725e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44226. Oct 03 11:17:42.167102 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e219d27d-ae6e-43c6-b4e3-c109c393b99e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.148725 Oct 03 11:17:42.177152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3495/6658] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:17:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:17:42.178875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:42.180169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:42.196992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc92939f-79b8-4416-a1cf-c3bd0a65a33c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:42.201570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc92939f-79b8-4416-a1cf-c3bd0a65a33c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:42.344574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc92939f-79b8-4416-a1cf-c3bd0a65a33c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:42.353605 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc92939f-79b8-4416-a1cf-c3bd0a65a33c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1267 microversion: 2.1 time: 0.175553 Oct 03 11:17:42.355180 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3164/6659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:42 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:43.378044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:43.378667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:43.386704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:43.389415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:43.390493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:43.392021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:43.393179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:43.394294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:43.510818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:43.520354 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd8ad180-dc14-42d1-b838-084990757a1b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1319 microversion: 2.1 time: 0.146286 Oct 03 11:17:43.521621 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3496/6660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:43 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:44.548311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:44.551335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:44.568256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:44.569523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:44.570321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:44.573226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:44.578910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:44.579694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:45.141607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:45.151424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e8c5fd84-6e97-4106-8546-2982b33e8230 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1393 microversion: 2.1 time: 0.609769 Oct 03 11:17:45.164849 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3165/6661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:44 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1393 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:46.179494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:46.180732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:46.194080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:46.204354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:46.207232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:46.208650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:46.212870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:46.213510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:46.444507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-dae3c4c3-b6b7-424b-802b-8ff98c896eff req-af837e09-6813-4931-883f-b10f637e80d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:17:46.460437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dae3c4c3-b6b7-424b-802b-8ff98c896eff req-af837e09-6813-4931-883f-b10f637e80d3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:46.460949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dae3c4c3-b6b7-424b-802b-8ff98c896eff req-af837e09-6813-4931-883f-b10f637e80d3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:46.462957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-dae3c4c3-b6b7-424b-802b-8ff98c896eff req-af837e09-6813-4931-883f-b10f637e80d3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:46.478699 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-dae3c4c3-b6b7-424b-802b-8ff98c896eff req-af837e09-6813-4931-883f-b10f637e80d3 service nova] Creating event network-changed:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h2-858383-3 Oct 03 11:17:46.490781 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-dae3c4c3-b6b7-424b-802b-8ff98c896eff req-af837e09-6813-4931-883f-b10f637e80d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382900 Oct 03 11:17:46.491646 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3497/6662] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:17:46.603149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:46.618712 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7b5cea3-120b-4c2b-80d7-ad96456104d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1393 microversion: 2.1 time: 0.442270 Oct 03 11:17:46.632702 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3166/6663] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:46 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1393 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:47.644076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:47.644814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:47.652074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:47.653268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:47.654029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:47.654991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:47.655661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:47.656364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:47.894027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:47.908566 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-402c2f77-cec1-4c35-8a42-6c49abca581d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1393 microversion: 2.1 time: 0.269568 Oct 03 11:17:47.913897 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3498/6664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:47 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1393 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:48.935604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:48.936415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:48.947234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:48.947658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:48.948101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:48.949413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:48.950139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:48.950520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:49.104345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:49.112811 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7dbd249-ae65-49ae-87fa-ae485a5842e4 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1393 microversion: 2.1 time: 0.183003 Oct 03 11:17:49.113352 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3167/6665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:48 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:50.135995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:50.136633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:50.143739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:50.144222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:50.144658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:50.145376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:50.145830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:50.146252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:50.313872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:50.327923 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d25a6771-5b10-4add-8a7d-f8924da1a213 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1393 microversion: 2.1 time: 0.194885 Oct 03 11:17:50.329485 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3499/6666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:50 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1393 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:17:51.352907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:51.354083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:51.366600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:51.367101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:51.367550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:51.368669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:51.369164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:51.369784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:51.497146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:51.498663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:51.504799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-bbef289d-4776-41df-bcc6-9999f2acbbdc req-f8e36518-36b7-47b9-904b-3505f48f3aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "name": "network-vif-plugged", "status": "completed", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:17:51.516898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bbef289d-4776-41df-bcc6-9999f2acbbdc req-f8e36518-36b7-47b9-904b-3505f48f3aa1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:51.517646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bbef289d-4776-41df-bcc6-9999f2acbbdc req-f8e36518-36b7-47b9-904b-3505f48f3aa1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:51.518369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bbef289d-4776-41df-bcc6-9999f2acbbdc req-f8e36518-36b7-47b9-904b-3505f48f3aa1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:51.531632 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-bbef289d-4776-41df-bcc6-9999f2acbbdc req-f8e36518-36b7-47b9-904b-3505f48f3aa1 service nova] Creating event network-vif-plugged:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h2-858383-3 Oct 03 11:17:51.537560 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-bbef289d-4776-41df-bcc6-9999f2acbbdc req-f8e36518-36b7-47b9-904b-3505f48f3aa1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041093 Oct 03 11:17:51.538161 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3500/6667] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:17:52.027833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:52.036288 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f06c2bd3-3570-4b5e-9de1-91e7aa03767b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1393 microversion: 2.1 time: 0.688548 Oct 03 11:17:52.037429 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3168/6668] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:51 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1393 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:53.067590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:53.070058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:53.079823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:53.080680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:53.081733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:53.084514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:53.085312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:53.086425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:53.325706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:53.336948 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8403bf5d-10f9-4dd0-9987-564138d05c40 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1393 microversion: 2.1 time: 0.277761 Oct 03 11:17:53.349726 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3501/6669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:53 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1393 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:54.361816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:54.369098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:54.371582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:17:54.378279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:54.379107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:54.379812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:54.380759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:54.381506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:54.382423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:54.567873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:54.582142 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-220168ef-7c96-468f-a4c5-726bd7dba25a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1565 microversion: 2.1 time: 0.224090 Oct 03 11:17:54.582735 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3169/6670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:54 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:54.612809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:54.613810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:54.621296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:54.621915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:54.622429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:54.624684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:54.625184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:54.627564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:54.803663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:54.813218 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1fe16dea-27cd-41ca-9d1a-0980b9d90f4b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1565 microversion: 2.1 time: 0.211478 Oct 03 11:17:54.814312 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3502/6671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:54 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:57.788317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:17:57.789320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:17:57.801420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:57.801911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:57.802363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:57.803120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:57.803548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:57.804672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:58.098219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:17:58.109720 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-030436ac-4851-44ba-84b6-4bdf0047d500 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1565 microversion: 2.1 time: 0.325414 Oct 03 11:17:58.129518 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3170/6672] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:17:57 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1565 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:17:58.311595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a5183c72-9b9e-4c27-b980-4e0bca2a8ad6 req-c0d75ab9-fca9-481b-86b7-6e9fcfd87cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:17:58.336639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a5183c72-9b9e-4c27-b980-4e0bca2a8ad6 req-c0d75ab9-fca9-481b-86b7-6e9fcfd87cc8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:17:58.337565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a5183c72-9b9e-4c27-b980-4e0bca2a8ad6 req-c0d75ab9-fca9-481b-86b7-6e9fcfd87cc8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:17:58.338794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a5183c72-9b9e-4c27-b980-4e0bca2a8ad6 req-c0d75ab9-fca9-481b-86b7-6e9fcfd87cc8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:17:58.357840 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:17:58.360406 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:17:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 11:17:58.366955 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a5183c72-9b9e-4c27-b980-4e0bca2a8ad6 req-c0d75ab9-fca9-481b-86b7-6e9fcfd87cc8 service nova] Creating event network-changed:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h2-858383-3 Oct 03 11:17:58.374904 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a5183c72-9b9e-4c27-b980-4e0bca2a8ad6 req-c0d75ab9-fca9-481b-86b7-6e9fcfd87cc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586421 Oct 03 11:17:58.376100 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3503/6673] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:18:03.099976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-470528491", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b799e0ce-1208-47c8-be39-e04bbc3873fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:03.165060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:18:03.571444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:18:03.571905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:18:03.573364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:18:03.574153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:18:03.574958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:18:03.587572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:03.588909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:03.589364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:03.590125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:03.590588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:03.591016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:03.608032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:18:03.613357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:18:03.670634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:18:03.672716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b799e0ce-1208-47c8-be39-e04bbc3873fc',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:18:03.821572 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8fefd991-1995-4ed4-bf3f-be0aae038e52 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725541 Oct 03 11:18:03.822224 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3171/6674] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:18:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:18:03.837457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ebcc144d-68c4-4bf2-8102-4665b3a11e96 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:03.838837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ebcc144d-68c4-4bf2-8102-4665b3a11e96 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:03.908257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ebcc144d-68c4-4bf2-8102-4665b3a11e96 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:03.915528 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ebcc144d-68c4-4bf2-8102-4665b3a11e96 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1056 microversion: 2.1 time: 0.084717 Oct 03 11:18:03.916135 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3504/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:03 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1056 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:04.939851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:04.940522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:04.951243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:04.952292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:04.953305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:04.956052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:04.956631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:04.957544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:05.056924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:05.068482 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-44301cc8-733e-4a7b-a94b-425ca48f22b7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1162 microversion: 2.1 time: 0.133486 Oct 03 11:18:05.069393 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3172/6676] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:04 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1162 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:06.094221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:06.095653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:06.104563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:06.105492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:06.106204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:06.107196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:06.107977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:06.108669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:06.266844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:06.276402 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a7c609b2-4bca-4303-939c-6421f57060c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1214 microversion: 2.1 time: 0.185877 Oct 03 11:18:06.278932 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3505/6677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:06 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:06.647572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b90eca14-80b6-4116-8963-21b60cb74df1 req-46aa6c16-12a5-493d-b346-222a4f7f7cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5b68a8-902a-4112-880a-43af65caf853", "tag": "3220220e-d135-4136-bc5d-8456b53942cb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:06.666209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b90eca14-80b6-4116-8963-21b60cb74df1 req-46aa6c16-12a5-493d-b346-222a4f7f7cd4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:06.666698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b90eca14-80b6-4116-8963-21b60cb74df1 req-46aa6c16-12a5-493d-b346-222a4f7f7cd4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:06.667141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b90eca14-80b6-4116-8963-21b60cb74df1 req-46aa6c16-12a5-493d-b346-222a4f7f7cd4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:06.699174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b90eca14-80b6-4116-8963-21b60cb74df1 req-46aa6c16-12a5-493d-b346-222a4f7f7cd4 service nova] Creating event network-changed:3220220e-d135-4136-bc5d-8456b53942cb for instance 7e5b68a8-902a-4112-880a-43af65caf853 on n-h1-858383-3 Oct 03 11:18:06.707375 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b90eca14-80b6-4116-8963-21b60cb74df1 req-46aa6c16-12a5-493d-b346-222a4f7f7cd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063798 Oct 03 11:18:06.708558 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3173/6678] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:18:07.304514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:07.305164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:07.321675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:07.323221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:07.324031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:07.324978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:07.325613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:07.326251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:07.512216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:07.526228 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7450eb2-afb1-4be4-b3ad-dbffad4d4976 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1214 microversion: 2.1 time: 0.221251 Oct 03 11:18:07.527185 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3506/6679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:07 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:08.552288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:08.553057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:08.560897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:08.561397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:08.561837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:08.562766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:08.563225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:08.563843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:08.721812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:08.731701 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef39f801-d415-4ed4-9156-93333c5da7fd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1214 microversion: 2.1 time: 0.184712 Oct 03 11:18:08.732596 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3174/6680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:08 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:09.755011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:09.755681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:09.763891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:09.764733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:09.765270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:09.766115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:09.766659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:09.767228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:09.920842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:09.930228 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca547eae-cdec-4a38-9bff-95a212249c49 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1214 microversion: 2.1 time: 0.178984 Oct 03 11:18:09.931016 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3507/6681] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:09 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:10.955038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:10.955646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:10.963537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:10.964023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:10.964459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:10.965183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:10.965638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:10.966060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:11.097249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:11.105010 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2739e2f2-e5ae-469c-b3c5-6d5033c18ea7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.154036 Oct 03 11:18:11.105578 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3175/6682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:10 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:12.127810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:12.128454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:12.130891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:12.136065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:12.136555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:12.137033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:12.137734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:12.138204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:12.138638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:12.141967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=57 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:12.269959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:12.278182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d31b0a9-55cf-4468-8ac8-08a8018a86c6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.154477 Oct 03 11:18:12.278800 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3508/6683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:12 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:13.302636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:13.303240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:13.305998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:13.313389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:13.313870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:13.314308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:13.315000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:13.315458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:13.315887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:13.319036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=59 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:13.449000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:13.456995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01fea4b8-c293-4319-9e72-01745bece774 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.158206 Oct 03 11:18:13.457573 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3176/6684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:13 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:14.479420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:14.480227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:14.482759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:14.488153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:14.488643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:14.489117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:14.489822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:14.490277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:14.490706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:14.637263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:14.645412 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-671f548c-20e4-48c8-ac2a-a2643d8344e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.169876 Oct 03 11:18:14.645990 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3509/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:14 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:15.670441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:15.671049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:15.672886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:15.673548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:15.680235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:15.680717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:15.681196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:15.681911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:15.683143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:15.683990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:15.824458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:15.832472 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc7dfb28-89bd-41a1-8a11-8e1593697acc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.165862 Oct 03 11:18:15.833057 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3177/6686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:15 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:16.856209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:16.856749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:16.864227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:16.864713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:16.865174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:16.866028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:16.866480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:16.866908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:17.010799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:17.019216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc0b5b17-59a5-4e76-a357-b7d31eabb336 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.167419 Oct 03 11:18:17.019716 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3510/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:16 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:18.041948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:18.042552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:18.049807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:18.050291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:18.050730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:18.051429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:18.051899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:18.052323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:18.191048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:18.199829 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5998135-5bad-4dfe-b071-64bf07078d09 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.161926 Oct 03 11:18:18.200421 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3178/6688] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:18 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:18.525539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:18.527827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:18.535324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:18.535926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:18.536394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:18.537160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:18.537618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:18.538043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:18.594912 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8f806ce9-6b17-4451-93b6-788a1b11d219 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action" status: 200 len: 24572 microversion: 2.1 time: 0.073444 Oct 03 11:18:18.595599 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3511/6689] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:18:18 2022] POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action => generated 24572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:18:19.225365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:19.225921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:19.232788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:19.233285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:19.233727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:19.234468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:19.234924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:19.235355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:19.367529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:19.375203 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-911402d5-871a-41d6-ac33-3b47a83de778 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.153825 Oct 03 11:18:19.375772 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3179/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:19 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:20.398831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:20.399639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:20.407870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:20.408357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:20.408850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:20.409512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:20.409971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:20.410400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:20.450750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7a521df4-9435-4fb0-b3ac-1e6bcf4a3319 req-8b2452ec-9f88-48ad-ade4-2bb4e108d1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b68a8-902a-4112-880a-43af65caf853", "name": "network-vif-plugged", "status": "completed", "tag": "3220220e-d135-4136-bc5d-8456b53942cb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:20.467953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7a521df4-9435-4fb0-b3ac-1e6bcf4a3319 req-8b2452ec-9f88-48ad-ade4-2bb4e108d1c0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:20.468788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7a521df4-9435-4fb0-b3ac-1e6bcf4a3319 req-8b2452ec-9f88-48ad-ade4-2bb4e108d1c0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:20.469274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7a521df4-9435-4fb0-b3ac-1e6bcf4a3319 req-8b2452ec-9f88-48ad-ade4-2bb4e108d1c0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:20.482585 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7a521df4-9435-4fb0-b3ac-1e6bcf4a3319 req-8b2452ec-9f88-48ad-ade4-2bb4e108d1c0 service nova] Creating event network-vif-plugged:3220220e-d135-4136-bc5d-8456b53942cb for instance 7e5b68a8-902a-4112-880a-43af65caf853 on n-h1-858383-3 Oct 03 11:18:20.489690 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7a521df4-9435-4fb0-b3ac-1e6bcf4a3319 req-8b2452ec-9f88-48ad-ade4-2bb4e108d1c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050448 Oct 03 11:18:20.490925 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3180/6691] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:18:20.558809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:20.566968 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b5228dc-c118-467d-be51-02744f4b692b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.172691 Oct 03 11:18:20.567903 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3512/6692] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:20 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:21.591275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:21.592655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:21.599040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:21.599526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:21.599968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:21.600666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:21.601151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:21.601581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:21.734757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:21.742487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9094f4f0-ff0f-4f7f-834b-7ee573c5132a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1202 microversion: 2.1 time: 0.156287 Oct 03 11:18:21.743061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3181/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:21 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:22.765474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:22.766078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:22.777489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:22.777987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:22.778427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:22.779129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:22.779579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:22.780007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:22.926537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:22.935510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8d6caf71-d08f-400d-9733-e418751acca3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1390 microversion: 2.1 time: 0.173919 Oct 03 11:18:22.936110 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3513/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:22 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:22.957719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:22.958337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:22.965339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:22.966713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:22.966713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:22.966965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:22.967419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:22.967856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:23.105636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:23.114394 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75acff1b-cedd-4b74-909e-81393c9092ca tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1390 microversion: 2.1 time: 0.160617 Oct 03 11:18:23.114999 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3182/6695] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:22 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:23.137256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:23.137899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:23.144382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:23.144986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:23.146531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:23.146531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:23.146531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:23.147017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:23.295506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:23.304003 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0399a2a0-7787-4efa-950c-971fd8be74dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1390 microversion: 2.1 time: 0.170683 Oct 03 11:18:23.304580 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3514/6696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:23 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:23.328229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:23.328757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:23.340008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:23.340589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:23.341073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:23.341808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:23.342269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:23.342755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:23.369956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:18:23.464477 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99481ba1-ff26-4a8e-b15b-8808732a3a56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 204 len: 0 microversion: 2.1 time: 0.141582 Oct 03 11:18:23.465186 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3183/6697] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:18:23 2022] DELETE /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:18:23.473445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:23.474054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:23.481876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:23.483175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:23.483617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:23.485158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:23.485778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:23.486063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:23.620606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:23.629502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a21316c8-047c-417e-862d-bb199c7dc102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1396 microversion: 2.1 time: 0.159518 Oct 03 11:18:23.629502 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3515/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:23 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:24.652567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:24.653300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:24.660753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:24.661273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:24.661713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:24.662409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:24.662866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:24.663300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:24.861127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:24.869095 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f342ac72-e066-444b-a47a-7ffb404ab892 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1396 microversion: 2.1 time: 0.221298 Oct 03 11:18:24.869681 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3184/6699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:24 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1396 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:25.644561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-96c35a09-b2dc-4251-bbc4-a580864e3b62 req-4de190ac-d189-41ec-88f3-b840ffd8676c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b68a8-902a-4112-880a-43af65caf853", "name": "network-vif-deleted", "tag": "3220220e-d135-4136-bc5d-8456b53942cb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:25.659745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-96c35a09-b2dc-4251-bbc4-a580864e3b62 req-4de190ac-d189-41ec-88f3-b840ffd8676c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:25.660353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-96c35a09-b2dc-4251-bbc4-a580864e3b62 req-4de190ac-d189-41ec-88f3-b840ffd8676c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:25.660839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-96c35a09-b2dc-4251-bbc4-a580864e3b62 req-4de190ac-d189-41ec-88f3-b840ffd8676c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:25.674438 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-96c35a09-b2dc-4251-bbc4-a580864e3b62 req-4de190ac-d189-41ec-88f3-b840ffd8676c service nova] Creating event network-vif-deleted:3220220e-d135-4136-bc5d-8456b53942cb for instance 7e5b68a8-902a-4112-880a-43af65caf853 on n-h1-858383-3 Oct 03 11:18:25.681348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-96c35a09-b2dc-4251-bbc4-a580864e3b62 req-4de190ac-d189-41ec-88f3-b840ffd8676c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040007 Oct 03 11:18:25.682297 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3516/6700] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:18:25.891575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:25.892129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:25.899389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:25.899882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:25.900327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:25.901059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:25.901589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:25.902030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:25.968913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:25.977004 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1c21294c-3089-4511-965a-0b92cf497df7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1187 microversion: 2.1 time: 0.089296 Oct 03 11:18:25.978089 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3185/6701] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:25 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:27.000998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:27.001703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:27.009505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:27.010002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:27.010447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:27.011343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:27.011809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:27.012244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:27.077757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:27.085604 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c5a5cc1a-683b-4efd-8c5e-eea2366c8324 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1187 microversion: 2.1 time: 0.089071 Oct 03 11:18:27.086174 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3517/6702] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:26 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:28.107640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:28.108260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:28.115198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:28.115879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:28.116143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:28.116886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:28.117349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:28.117782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:28.179820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:28.188406 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68df7ea9-f5e7-4acc-bf2a-2af8347986e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1187 microversion: 2.1 time: 0.084610 Oct 03 11:18:28.189029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3186/6703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:28 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:29.212361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:29.212932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:29.220043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:29.220552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:29.221031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:29.221809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:29.222267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:29.222695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:29.284367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:29.293204 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53aea435-6d11-41ba-971e-6d8521d469d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 200 len: 1187 microversion: 2.1 time: 0.085492 Oct 03 11:18:29.293788 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3518/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:29 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:29.704873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:29.705479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:29.712902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:29.713385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:29.713818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:29.714508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:29.714959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:29.715382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:29.951672 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41ecfdd8-5e1d-4dff-ba40-b60a4a052b51 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1835 microversion: 2.1 time: 0.250710 Oct 03 11:18:29.952603 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3187/6705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:29 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1835 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:29.975229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:29.975832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:29.981937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:29.982419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:29.982858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:29.983544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:29.983993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:29.984413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.114542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:30.123691 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d8cd717-7ef2-4b81-b2b0-18fe563d990e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1684 microversion: 2.1 time: 0.152210 Oct 03 11:18:30.124206 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3519/6706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:29 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:30.222362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:30.224692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:30.230677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.231172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.231620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.232315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.232791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.233231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.284762 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dbb25695-15e4-4518-b29f-d1caa5c15f98 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action" status: 200 len: 32639 microversion: 2.1 time: 0.066277 Oct 03 11:18:30.288029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3188/6707] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:18:30 2022] POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action => generated 32639 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:18:30.315382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:30.316000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7e5b68a8-902a-4112-880a-43af65caf853] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:30.323014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.323504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.323990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.324669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.325168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.325598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.340160 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 7e5b68a8-902a-4112-880a-43af65caf853 could not be found. Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 HTTP/1.1 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 7e5b68a8-902a-4112-880a-43af65caf853 could not be found. Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '7e5b68a8-902a-4112-880a-43af65caf853'} Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5b68a8-902a-4112-880a-43af65caf853 could not be found. Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5b68a8-902a-4112-880a-43af65caf853 could not be found. Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:18:30.341894 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5b68a8-902a-4112-880a-43af65caf853 could not be found. Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 7e5b68a8-902a-4112-880a-43af65caf853 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7e20c914-9295-457b-84c5-1698b17674c4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853" status: 404 len: 111 microversion: 2.1 time: 0.031886 Oct 03 11:18:30.347678 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3520/6708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:30 2022] GET /compute/v2.1/servers/7e5b68a8-902a-4112-880a-43af65caf853 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:18:30.445571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:30.446426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:30.453901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.454507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.454826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.455535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.456002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.456560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.499796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9bbc6b84dff24e13b74c5f29ccd05b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c76fd7eafd4605ac3b4c55fcc463cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:30.500415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] flavor_id is None. Assuming migration. {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 11:18:30.500922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:18:30.797591 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3bf18faf-7451-4a61-b000-c9d64bc80bd4 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action" status: 202 len: 0 microversion: 2.1 time: 0.356264 Oct 03 11:18:30.798969 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3189/6709] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:18:30 2022] POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:18:30.807188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:30.807857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:30.819791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.819791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.820313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.820960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:30.821422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:30.821854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:30.978379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:30.986522 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-745b2a6d-be85-4be7-bb06-ec9655022b3e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1693 microversion: 2.1 time: 0.183297 Oct 03 11:18:30.988856 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3521/6710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:30 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:32.011214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:32.012142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:32.020214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:32.020865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:32.021404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:32.022149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:32.022663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:32.023030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:32.045877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:32.186208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:32.194586 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c805b83-5ede-4c5d-93cd-781c7884988c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1693 microversion: 2.1 time: 0.188888 Oct 03 11:18:32.195270 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3190/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:32 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:33.219908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:33.220747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:33.230641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:33.231130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:33.231572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:33.232498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:33.232986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:33.233419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:33.380536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:33.391053 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb1d384a-1b29-4e33-a4c6-0f68719440b9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.176214 Oct 03 11:18:33.391756 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3522/6712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:33 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:34.415951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:34.416517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:34.423640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:34.424138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:34.424585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:34.425326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:34.425794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:34.426228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:34.589226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:34.597075 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f9eae46-636a-46d5-83f6-0ddd6957f91b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.185702 Oct 03 11:18:34.597696 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3191/6713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:34 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:35.391059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1247941738", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0afbc05a-1dd8-4561-9aea-62aa21bc4366", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:35.454051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:18:35.622535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:35.623149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:35.630109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:35.630602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:35.631049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:35.631750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:35.632208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:35.632643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:35.771042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:35.779157 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb6352fa-1d5c-4406-a681-fc550a262ac5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.161070 Oct 03 11:18:35.780224 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3192/6714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:35 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:35.834858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:18:35.835286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:18:35.835770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:18:35.836240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:18:35.836661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:18:35.845574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:35.846063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:35.846507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:35.847240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:35.847703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:35.848139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:35.866194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:18:35.872473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:18:35.931690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:18:35.934121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0afbc05a-1dd8-4561-9aea-62aa21bc4366',volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:18:36.068417 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0913b0d3-453e-4f68-a0f9-80c748d80bf3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681191 Oct 03 11:18:36.069101 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3523/6715] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 11:18:36.080543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-758f4ca6-437c-4fe6-90be-f29bab65c194 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:36.081338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-758f4ca6-437c-4fe6-90be-f29bab65c194 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:36.134903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-758f4ca6-437c-4fe6-90be-f29bab65c194 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:36.142205 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-758f4ca6-437c-4fe6-90be-f29bab65c194 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1057 microversion: 2.1 time: 0.065674 Oct 03 11:18:36.142793 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3193/6716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:36 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1057 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:36.805826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:36.806646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:36.813372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:36.813863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:36.814306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:36.815184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:36.815473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:36.815911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:36.958004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:36.966457 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8d9848f4-0269-46ec-96c0-34547fac4060 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.166040 Oct 03 11:18:36.967022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3524/6717] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:36 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:37.166725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:37.167554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:37.176134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:37.176629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:37.177608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:37.178026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:37.178491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:37.178926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:37.281421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:37.289914 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3459efd8-e46a-4d41-aca9-2f683d05a600 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1163 microversion: 2.1 time: 0.127857 Oct 03 11:18:37.290493 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3194/6718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:37 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1163 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:37.990440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:37.991920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:38.001148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:38.002051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:38.002639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:38.003568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:38.004168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:38.004821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:38.314172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:38.315535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:38.323987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:38.324871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:38.325661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:38.326794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:38.327487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:38.328128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:38.523060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:38.532198 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ddedaae9-75a7-469e-ad6a-edf38d654386 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.546231 Oct 03 11:18:38.533542 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3525/6719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:37 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:38.613283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:38.621996 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9235d4f0-7b43-4f74-a65b-d41ce776af0a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1215 microversion: 2.1 time: 0.311890 Oct 03 11:18:38.622573 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3195/6720] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:38 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:38.824065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-afb203c9-d1ed-41b0-907b-a07e982cd82b req-14201db9-7ee7-4d0b-ab13-ccbbc00008a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7610094e-9f47-4ecf-bad6-740b32f9bd31", "tag": "cb16f48b-9d4d-4913-b30e-ae1c8530cc86"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:38.834593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-afb203c9-d1ed-41b0-907b-a07e982cd82b req-14201db9-7ee7-4d0b-ab13-ccbbc00008a1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:38.835371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-afb203c9-d1ed-41b0-907b-a07e982cd82b req-14201db9-7ee7-4d0b-ab13-ccbbc00008a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:38.835992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-afb203c9-d1ed-41b0-907b-a07e982cd82b req-14201db9-7ee7-4d0b-ab13-ccbbc00008a1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:38.850959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-afb203c9-d1ed-41b0-907b-a07e982cd82b req-14201db9-7ee7-4d0b-ab13-ccbbc00008a1 service nova] Creating event network-changed:cb16f48b-9d4d-4913-b30e-ae1c8530cc86 for instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 on n-h1-858383-3 Oct 03 11:18:38.857417 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-afb203c9-d1ed-41b0-907b-a07e982cd82b req-14201db9-7ee7-4d0b-ab13-ccbbc00008a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038533 Oct 03 11:18:38.858521 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3526/6721] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:18:39.556799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:39.557922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:39.564715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:39.565232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:39.565691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:39.566399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:39.566854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:39.567279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:39.646210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:39.647144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:39.655677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:39.656801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:39.656801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:39.657666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:39.658242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:39.658768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:39.799523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:39.808337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:39.810761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:39.815846 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0bbb1440-b793-4f63-ac83-814f6cab45fe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.262875 Oct 03 11:18:39.816587 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3196/6722] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:39 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:39.825619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7aedfa01-8881-4704-bd15-620fb512b7d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1215 microversion: 2.1 time: 0.184410 Oct 03 11:18:39.826876 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3527/6723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:39 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:40.849907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:40.850728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:40.851111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:40.851337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:40.857884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:40.858219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:40.858410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:40.858708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:40.858860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:40.859158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:40.859577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:40.859985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:40.860097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:40.860444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:40.860544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:40.860900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:41.004934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:41.014214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:41.014847 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e2b2b391-18df-4adc-913e-4fa806015754 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1215 microversion: 2.1 time: 0.170161 Oct 03 11:18:41.015522 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3197/6724] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:40 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:41.024928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3fa0a8ab-fc6b-483e-8386-3198e1db6a1f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.177941 Oct 03 11:18:41.025593 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3528/6725] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:40 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:42.038410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:42.039124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:42.047845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:42.048246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:42.048601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:42.048800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:42.048886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:42.049504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:42.049976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:42.050392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:42.057927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:42.058416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:42.058849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:42.059554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:42.060008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:42.060592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:42.204608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:42.208739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:42.218234 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e431d99f-259b-4b3e-b5d5-cce3d5bc7273 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1215 microversion: 2.1 time: 0.183732 Oct 03 11:18:42.219024 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3198/6726] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:42 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:42.220195 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e2495b6f-4a51-4b04-b2ca-f94b4a6f3dd2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.175640 Oct 03 11:18:42.229248 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3529/6727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:42 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:43.241950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:43.243120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:43.245893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:43.246506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:43.249243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:43.250003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:43.250495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:43.250973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:43.251696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:43.252146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:43.252572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:43.255079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:43.255570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:43.256012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:43.256712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:43.257192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:43.257625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:43.387860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:43.395719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0011d1a-b7cc-4029-918a-929646e6cbfc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.157872 Oct 03 11:18:43.396303 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3199/6728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:43 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:43.399297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:43.408448 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-11f7fe3f-0304-4933-a696-fc45ab1641bb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.166987 Oct 03 11:18:43.409056 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3530/6729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:43 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:44.419681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:44.420287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:44.422942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:44.428337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:44.428935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:44.429380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:44.430747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:44.431207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:44.431632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:44.432811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:44.433448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:44.440410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:44.441080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:44.441529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:44.442240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:44.442703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:44.443143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:44.562940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:44.571230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a1481b3-230a-493c-90e9-0d28228d2a16 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.155470 Oct 03 11:18:44.571865 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3200/6730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:44 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:44.578105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:44.585281 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28bbdb77-a117-4f08-89c2-86103c8181cb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1698 microversion: 2.1 time: 0.157703 Oct 03 11:18:44.585973 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3531/6731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:44 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:45.593254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:45.593881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:45.601503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:45.602006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:45.602458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:45.603222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:45.603853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:45.604221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:45.609011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:45.609805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:45.617648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:45.618059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:45.618503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:45.619220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:45.619713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:45.620144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:45.768033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:45.776445 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65d755ef-42ac-4f39-9c8c-cd1c750d826e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1697 microversion: 2.1 time: 0.171418 Oct 03 11:18:45.777666 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3532/6732] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:45 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:45.925112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:45.933911 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-38ce3558-c2db-4e38-a23b-4761e7192e48 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.344690 Oct 03 11:18:45.934586 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3201/6733] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:45 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:45.979204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-04ffc80f-8a95-403f-ab06-4c775880ba88 req-d901069c-ce93-43e0-9e0f-6f6f642af14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "name": "network-vif-unplugged", "status": "completed", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:45.984189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:45.984907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:45.991753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-04ffc80f-8a95-403f-ab06-4c775880ba88 req-d901069c-ce93-43e0-9e0f-6f6f642af14f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:45.992755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-04ffc80f-8a95-403f-ab06-4c775880ba88 req-d901069c-ce93-43e0-9e0f-6f6f642af14f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:45.993248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-04ffc80f-8a95-403f-ab06-4c775880ba88 req-d901069c-ce93-43e0-9e0f-6f6f642af14f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:46.006385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-04ffc80f-8a95-403f-ab06-4c775880ba88 req-d901069c-ce93-43e0-9e0f-6f6f642af14f service nova] Creating event network-vif-unplugged:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h1-858383-3 Oct 03 11:18:46.012566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-04ffc80f-8a95-403f-ab06-4c775880ba88 req-d901069c-ce93-43e0-9e0f-6f6f642af14f service nova] Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:18:46.023932 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-04ffc80f-8a95-403f-ab06-4c775880ba88 req-d901069c-ce93-43e0-9e0f-6f6f642af14f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048407 Oct 03 11:18:46.024676 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3533/6734] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:18:46.796601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:46.802139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:46.802769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:46.809406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:46.809894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:46.810342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:46.811043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:46.811501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:46.811931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:46.958649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:46.959366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:46.966667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:46.967165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:46.967608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:46.968316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:46.968791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:46.969256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:47.067675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:47.076424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3250a57f-14e8-42d1-8c34-aa77d901950d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1697 microversion: 2.1 time: 0.280602 Oct 03 11:18:47.077161 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3202/6735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:46 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1697 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:47.120417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:47.128618 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19b286f0-5a4b-4ce1-b10e-cd67f07f9b6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.175119 Oct 03 11:18:47.129269 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3534/6736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:46 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:48.053306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-dc52bb15-3756-4d80-a623-64643eba0bf6 req-2951a1ee-80cb-45c1-8a1e-a068c22318e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:48.063918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dc52bb15-3756-4d80-a623-64643eba0bf6 req-2951a1ee-80cb-45c1-8a1e-a068c22318e0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:48.064436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dc52bb15-3756-4d80-a623-64643eba0bf6 req-2951a1ee-80cb-45c1-8a1e-a068c22318e0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:48.064935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-dc52bb15-3756-4d80-a623-64643eba0bf6 req-2951a1ee-80cb-45c1-8a1e-a068c22318e0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:48.077200 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-dc52bb15-3756-4d80-a623-64643eba0bf6 req-2951a1ee-80cb-45c1-8a1e-a068c22318e0 service nova] Creating event network-changed:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h1-858383-3 Oct 03 11:18:48.082857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-dc52bb15-3756-4d80-a623-64643eba0bf6 req-2951a1ee-80cb-45c1-8a1e-a068c22318e0 service nova] Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:18:48.094138 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-dc52bb15-3756-4d80-a623-64643eba0bf6 req-2951a1ee-80cb-45c1-8a1e-a068c22318e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044556 Oct 03 11:18:48.094753 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3203/6737] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:18:48.100697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:48.101396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:48.109476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:48.109973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:48.110418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:48.111123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:48.111580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:48.112009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:48.152554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:48.153417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:48.161570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:48.162272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:48.162792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:48.163612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:48.164194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:48.165685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:48.261804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:48.269800 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d8584be9-2b2f-4b21-b440-7f83e487c2df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1695 microversion: 2.1 time: 0.173189 Oct 03 11:18:48.270716 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3535/6738] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:48 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:48.374848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:48.382803 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-377177ce-a2b0-4280-88ef-023667030cf4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.235020 Oct 03 11:18:48.383915 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3204/6739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:48 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:49.294842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:49.295459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:49.302638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:49.303126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:49.303568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:49.304266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:49.304760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:49.305765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:49.405904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:49.406546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:49.413353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:49.413853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:49.414987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:49.415605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:49.416070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:49.416510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:49.455423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:49.467679 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a60882ac-0738-4c80-bef2-d623bf3b9484 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1695 microversion: 2.1 time: 0.176307 Oct 03 11:18:49.468754 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3536/6740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:49 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:49.558810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:49.567054 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e961212c-39ea-4f03-beaa-2ea2be85b7d3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.165006 Oct 03 11:18:49.567662 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3205/6741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:49 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:50.492015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:50.493168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:50.499973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:50.500462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:50.500951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:50.501635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:50.502096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:50.502525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:50.591564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:50.592181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:50.599255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:50.599754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:50.600196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:50.600937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:50.601395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:50.602411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:50.678932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:50.688599 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6b051c5-20f4-492e-b3f7-10fc43249c52 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1695 microversion: 2.1 time: 0.200502 Oct 03 11:18:50.689424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3537/6742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:50 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:50.749003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:50.757078 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4bb9c3f1-49cb-443b-b6bf-a1fef338a7b9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.169446 Oct 03 11:18:50.757661 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3206/6743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:50 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:51.713527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:51.714140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:51.720993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.721478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.721919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:51.722608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.723258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.723713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:51.780443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:51.781073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:51.787899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.788532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.789101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:51.789466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.789909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.790339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:51.866313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:51.880374 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-149a4f87-124e-4276-91bd-25f742d35368 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1692 microversion: 2.1 time: 0.170679 Oct 03 11:18:51.880985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3538/6744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:51 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:51.904328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:51.904899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:51.910897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.911389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.912011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:51.912534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.913022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.913452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:51.921254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:51.929066 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d7932a9d-b7e4-4dc4-95da-315f52d0db46 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.152342 Oct 03 11:18:51.930255 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3207/6745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:51 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:51.972348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-83a88786-60ff-4b67-a861-9bec0e979724 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action" status: 204 len: 0 microversion: 2.1 time: 0.072391 Oct 03 11:18:51.973015 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3539/6746] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:18:51 2022] POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:18:51.981253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:51.981960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:51.988565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.989282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.989649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:51.990739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:51.991345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:51.991880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:52.011575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=100 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:52.249417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:52.259976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5541badf-c899-4aee-8296-b3e9b679c973 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1692 microversion: 2.1 time: 0.282166 Oct 03 11:18:52.260788 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3208/6747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:51 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1692 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:52.880717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8d702f98-f8ee-4c10-9752-53f448ce101c req-762466b3-ae2a-4a1f-b966-6cbab562ad60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "name": "network-vif-plugged", "status": "completed", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:52.897150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d702f98-f8ee-4c10-9752-53f448ce101c req-762466b3-ae2a-4a1f-b966-6cbab562ad60 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:52.897654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d702f98-f8ee-4c10-9752-53f448ce101c req-762466b3-ae2a-4a1f-b966-6cbab562ad60 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:52.899184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d702f98-f8ee-4c10-9752-53f448ce101c req-762466b3-ae2a-4a1f-b966-6cbab562ad60 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:52.914486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8d702f98-f8ee-4c10-9752-53f448ce101c req-762466b3-ae2a-4a1f-b966-6cbab562ad60 service nova] Creating event network-vif-plugged:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h1-858383-3 Oct 03 11:18:52.921417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-8d702f98-f8ee-4c10-9752-53f448ce101c req-762466b3-ae2a-4a1f-b966-6cbab562ad60 service nova] Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:18:52.935920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8d702f98-f8ee-4c10-9752-53f448ce101c req-762466b3-ae2a-4a1f-b966-6cbab562ad60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059805 Oct 03 11:18:52.936844 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3540/6748] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:18:52.952111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:52.952733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:52.959893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:52.960396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:52.961454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:52.962216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:52.962672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:52.963044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:53.095144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:53.103026 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-624cfbeb-09c9-4be4-9c24-a5b1ccb93cbb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.154957 Oct 03 11:18:53.103612 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3209/6749] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:52 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:53.288134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:53.289558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:53.295749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:53.296279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:53.296794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:53.297567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:53.298108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:53.298564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:53.459032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:53.467721 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a30ce1c-d037-4ff5-8eb3-afdaee46b7e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1684 microversion: 2.1 time: 0.184386 Oct 03 11:18:53.468337 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3541/6750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:53 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:18:54.125934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:54.126484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:54.135904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:54.136393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:54.136956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:54.137779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:54.138235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:54.138664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:54.271376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:54.279838 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7b29d685-0d88-486b-a0e3-3e04efdb8460 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.158016 Oct 03 11:18:54.280419 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3210/6751] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:54 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:54.954894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-d0439ad6-f2b6-4662-b2f0-095141194524 req-a12a030a-bcb9-47be-a513-c8796e7939e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7610094e-9f47-4ecf-bad6-740b32f9bd31", "name": "network-vif-plugged", "status": "completed", "tag": "cb16f48b-9d4d-4913-b30e-ae1c8530cc86"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:18:54.965173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d0439ad6-f2b6-4662-b2f0-095141194524 req-a12a030a-bcb9-47be-a513-c8796e7939e5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:54.965651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d0439ad6-f2b6-4662-b2f0-095141194524 req-a12a030a-bcb9-47be-a513-c8796e7939e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:54.966083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-d0439ad6-f2b6-4662-b2f0-095141194524 req-a12a030a-bcb9-47be-a513-c8796e7939e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:54.977290 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-d0439ad6-f2b6-4662-b2f0-095141194524 req-a12a030a-bcb9-47be-a513-c8796e7939e5 service nova] Creating event network-vif-plugged:cb16f48b-9d4d-4913-b30e-ae1c8530cc86 for instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 on n-h1-858383-3 Oct 03 11:18:54.982064 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-d0439ad6-f2b6-4662-b2f0-095141194524 req-a12a030a-bcb9-47be-a513-c8796e7939e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030917 Oct 03 11:18:54.982647 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3542/6752] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:18:55.302390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:55.303118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:55.310736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:55.311230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:55.311675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:55.312381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:55.312872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:55.313309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:55.450691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:55.458550 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2cd19d9-6ad6-45dc-957c-971854b634e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.160122 Oct 03 11:18:55.459116 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3211/6753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:55 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:56.483685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:56.484388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:56.490795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:56.491282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:56.491741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:56.492435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:56.492928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:56.493364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:56.636442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:56.644825 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-169d6643-1b3e-4461-ad62-768364d0ea40 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1203 microversion: 2.1 time: 0.166359 Oct 03 11:18:56.656985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3543/6754] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:56 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:57.670284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:57.671072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:57.678922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:57.679464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:57.679899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:57.680600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:57.681087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:57.681512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:57.820085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:57.828368 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b2fa8743-9b73-4f66-b4fa-1e2afd9512bb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1391 microversion: 2.1 time: 0.162275 Oct 03 11:18:57.828915 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3212/6755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:57 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:57.852070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:57.852855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:57.859641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:57.860114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:57.860558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:57.861296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:57.861751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:57.862182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:57.882850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:18:58.016947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:58.025829 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d56b7332-960a-4221-a158-a99475c9e52c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1391 microversion: 2.1 time: 0.178253 Oct 03 11:18:58.026418 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3544/6756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:57 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:58.051312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:58.051918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:58.058454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:58.058935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:58.059371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:58.060071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:58.060526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:58.060978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:58.201318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:58.209358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fa8c8c2-8e65-40f4-b657-b2b2b8299206 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1391 microversion: 2.1 time: 0.162038 Oct 03 11:18:58.209943 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3213/6757] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:58 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:58.232206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:58.232699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:58.238845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:58.239329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:58.239767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:58.240455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:58.240940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:58.241363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:58.267054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:18:58.350251 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3055b955-0683-4008-986e-02c5b0e9e26f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 204 len: 0 microversion: 2.1 time: 0.121665 Oct 03 11:18:58.353976 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3545/6758] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:18:58 2022] DELETE /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:18:58.359192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:58.359805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:58.366285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:58.367328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:58.367769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:58.368476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:58.368986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:58.369411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:58.499912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:58.508586 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e0b1564-8a6c-4bb9-a855-9569b35fb4fc tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1397 microversion: 2.1 time: 0.153221 Oct 03 11:18:58.509193 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3214/6759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:58 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1397 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:18:59.532303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:18:59.533135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:18:59.539978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:59.540459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:59.540929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:59.541633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:18:59.542084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:18:59.542508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:18:59.698071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:18:59.709219 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f25e6a8d-22c9-40e3-a6ed-bcc06b906449 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1397 microversion: 2.1 time: 0.181291 Oct 03 11:18:59.710933 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3546/6760] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:18:59 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1397 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:00.705090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d54b7b3b-1975-4605-a6bf-f0108e70e93c req-a9ce2bb0-cc2b-4ee0-ab00-a00dbfebd63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7610094e-9f47-4ecf-bad6-740b32f9bd31", "name": "network-vif-deleted", "tag": "cb16f48b-9d4d-4913-b30e-ae1c8530cc86"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:00.736497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:00.737037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d54b7b3b-1975-4605-a6bf-f0108e70e93c req-a9ce2bb0-cc2b-4ee0-ab00-a00dbfebd63a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:00.737299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d54b7b3b-1975-4605-a6bf-f0108e70e93c req-a9ce2bb0-cc2b-4ee0-ab00-a00dbfebd63a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:00.738706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:00.740221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d54b7b3b-1975-4605-a6bf-f0108e70e93c req-a9ce2bb0-cc2b-4ee0-ab00-a00dbfebd63a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:00.748669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:00.749263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:00.749877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:00.750734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:00.752029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:00.752718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:00.785299 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d54b7b3b-1975-4605-a6bf-f0108e70e93c req-a9ce2bb0-cc2b-4ee0-ab00-a00dbfebd63a service nova] Creating event network-vif-deleted:cb16f48b-9d4d-4913-b30e-ae1c8530cc86 for instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 on n-h1-858383-3 Oct 03 11:19:00.793620 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d54b7b3b-1975-4605-a6bf-f0108e70e93c req-a9ce2bb0-cc2b-4ee0-ab00-a00dbfebd63a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093865 Oct 03 11:19:00.798426 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3215/6761] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:19:00.849396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:00.858567 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a546257c-75e5-4d07-8c55-68b501efd375 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1188 microversion: 2.1 time: 0.127931 Oct 03 11:19:00.872794 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3547/6762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:00 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1188 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:19:01.885952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:01.886672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:01.893195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:01.893816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:01.894281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:01.894997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:01.895458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:01.895894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:01.964459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:01.972427 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9fdc33c-3d1b-4fad-8bb6-f54e385b3381 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1188 microversion: 2.1 time: 0.092542 Oct 03 11:19:01.973046 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3216/6763] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:01 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:02.996311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:02.996958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:03.004047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:03.004532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:03.004997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:03.005870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:03.006276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:03.006703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:03.073479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:03.081620 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5152c0ea-32cd-4853-91a5-b6927070d64f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1188 microversion: 2.1 time: 0.089148 Oct 03 11:19:03.082244 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3548/6764] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:02 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:04.105408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:04.106051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:04.113264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:04.113754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:04.114218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:04.114923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:04.115375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:04.115804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:04.183391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:04.192614 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43bac86a-0fbc-487b-bb00-3527107d7556 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1188 microversion: 2.1 time: 0.091099 Oct 03 11:19:04.204791 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3217/6765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:04 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:05.216930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:05.217425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:05.224341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:05.224860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:05.225303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:05.226562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:05.227022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:05.227453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:05.302591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:05.316318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75cd893f-7257-4fb9-9dd2-2a0a6a61f430 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 200 len: 1188 microversion: 2.1 time: 0.103891 Oct 03 11:19:05.317012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3549/6766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:05 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:06.346937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:06.347552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 7610094e-9f47-4ecf-bad6-740b32f9bd31] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:06.354841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:06.355329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:06.355781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:06.356484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:06.356987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:06.357421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:06.371503 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 could not be found. Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 HTTP/1.1 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 could not be found. Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '7610094e-9f47-4ecf-bad6-740b32f9bd31'} Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 could not be found. Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 could not be found. Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:19:06.373207 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 could not be found. Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 7610094e-9f47-4ecf-bad6-740b32f9bd31 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-51b2646e-589d-4da2-92f4-f3ceb4c6b42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31" status: 404 len: 111 microversion: 2.1 time: 0.031795 Oct 03 11:19:06.376845 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3218/6767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:06 2022] GET /compute/v2.1/servers/7610094e-9f47-4ecf-bad6-740b32f9bd31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:19:25.713078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:25.715379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:25.718069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:25.718729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:25.725001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:25.725496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:25.725941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:25.726646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:25.727104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:25.728091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:25.797718 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3b9d2b60-94ac-44f4-a951-5180422837e1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action" status: 200 len: 24572 microversion: 2.1 time: 0.088739 Oct 03 11:19:25.804627 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3550/6768] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:19:25 2022] POST /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47/action => generated 24572 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:19:27.444129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-845392537", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7a8d334d-1e56-4f1d-ad9a-9372bb994911", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:27.459093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=37 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:27.459756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=55 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:27.543159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:19:28.228473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:19:28.228969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:19:28.229448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:19:28.229886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:19:28.230300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:19:28.239408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:28.239934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:28.240375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:28.241143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:28.241603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:28.242121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:28.259105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:19:28.264381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:19:28.277184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:19:28.279249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7a8d334d-1e56-4f1d-ad9a-9372bb994911',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:19:28.355730 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c570e602-9ac1-49cf-ab40-fbeefeb31b42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915399 Oct 03 11:19:28.356577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3219/6769] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:19:28.368029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-85bdfd7b-42b0-44c4-9093-b97759a908bd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:28.368734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-85bdfd7b-42b0-44c4-9093-b97759a908bd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:28.428434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-85bdfd7b-42b0-44c4-9093-b97759a908bd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:28.438734 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-85bdfd7b-42b0-44c4-9093-b97759a908bd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1056 microversion: 2.1 time: 0.074866 Oct 03 11:19:28.439330 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3551/6770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:28 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1056 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:29.463220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:29.464591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:29.473970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:29.474505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:29.475299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:29.476043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:29.476508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:29.477274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:29.561871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:29.582135 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f6e6fcc3-a781-4593-aaab-a6934d736c2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1116 microversion: 2.1 time: 0.124313 Oct 03 11:19:29.582645 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3220/6771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:29 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1116 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:30.606288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:30.607088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:30.614605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:30.615405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:30.615921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:30.616903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:30.617442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:30.617950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:30.795406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:30.804955 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-558db69a-ba17-4722-976a-95d8b62d5608 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.203592 Oct 03 11:19:30.807158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3552/6772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:30 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:30.998838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d19edbc5-105b-4503-a730-e94578b32cf4 req-a729413e-a2b3-4443-89c7-04a1937c958d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0ca5be-8670-4df2-9b6c-926ec5ec6127", "tag": "c3bacbb6-3fe7-4e74-9321-14b0f214c43d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:31.011074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d19edbc5-105b-4503-a730-e94578b32cf4 req-a729413e-a2b3-4443-89c7-04a1937c958d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:31.011865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d19edbc5-105b-4503-a730-e94578b32cf4 req-a729413e-a2b3-4443-89c7-04a1937c958d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:31.012535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d19edbc5-105b-4503-a730-e94578b32cf4 req-a729413e-a2b3-4443-89c7-04a1937c958d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:31.025477 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d19edbc5-105b-4503-a730-e94578b32cf4 req-a729413e-a2b3-4443-89c7-04a1937c958d service nova] Creating event network-changed:c3bacbb6-3fe7-4e74-9321-14b0f214c43d for instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 on n-h2-858383-3 Oct 03 11:19:31.032087 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d19edbc5-105b-4503-a730-e94578b32cf4 req-a729413e-a2b3-4443-89c7-04a1937c958d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038725 Oct 03 11:19:31.032841 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3221/6773] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:19:31.834543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:31.835085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:31.844354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:31.844984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:31.845498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:31.846542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:31.847011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:31.847444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:32.016747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:32.025105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4ab81d3b-5a79-4269-9661-d41cce860957 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.198142 Oct 03 11:19:32.025706 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3553/6774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:31 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:33.052159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:33.054926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:33.064272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:33.064786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:33.065404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:33.066636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:33.067663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:33.068257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:33.258303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:33.270596 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b54a4914-7c21-48b9-8b34-501d0bada2b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.226618 Oct 03 11:19:33.271197 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3222/6775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:33 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:34.297472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:34.298092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:34.313672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:34.316941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:34.317470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:34.318409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:34.318976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:34.319529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:34.522842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:34.533175 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-237447cf-0d5a-4a24-b61f-82a3eacdc8c8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.241347 Oct 03 11:19:34.533763 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3554/6776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:34 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:35.558719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:35.559519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:35.566373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:35.567068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:35.567504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:35.568847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:35.569322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:35.569970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:35.725095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:35.734453 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e81ab002-c61e-49e7-a872-5efe18f74825 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.179896 Oct 03 11:19:35.735286 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3223/6777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:35 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:36.760556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:36.761255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:36.767960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:36.768451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:36.768923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:36.769629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:36.770084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:36.770515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:36.911460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:36.919382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-219f6f9c-f3cf-490b-bc15-913f650450cd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.163176 Oct 03 11:19:36.920247 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3555/6778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:36 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:37.941237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:37.941845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:37.948938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:37.949420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:37.949856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:37.950542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:37.950993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:37.951427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:38.092264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:38.100000 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e257aec8-8686-44ca-82d4-4f6939e53bfa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.162854 Oct 03 11:19:38.100565 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3224/6779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:37 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:39.125058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:39.125596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:39.128740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:39.135195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:39.135696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:39.136145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:39.136915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:39.137380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:39.137813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:39.278823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:39.287765 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc731f61-9366-4d34-8aab-9f9d36b5235c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.166912 Oct 03 11:19:39.288337 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3556/6780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:39 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:40.315923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:40.316450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:40.318384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:40.319173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:40.326790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:40.327274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:40.327707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:40.328402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:40.328885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:40.329313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:40.462580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:40.471152 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-46967ddd-6cf9-4dc9-b994-be220470d707 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.159399 Oct 03 11:19:40.471821 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3225/6781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:40 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:41.494444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:41.495070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:41.502324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:41.502821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:41.503266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:41.503982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:41.504439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:41.504948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:41.650829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:41.658705 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4a8b93f2-12ff-4ae8-b452-de1dc73224c7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.168692 Oct 03 11:19:41.659308 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3557/6782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:41 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:42.011510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:42.012122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:42.019069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:42.019555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:42.019994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:42.020685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:42.021166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:42.021590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:42.164969 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-368931bd-374a-4ff9-997f-10061d77a6e6 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1835 microversion: 2.1 time: 0.156595 Oct 03 11:19:42.165572 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3226/6783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:42 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1835 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:42.683325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:42.684160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:42.691449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:42.692215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:42.692663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:42.693402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:42.693861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:42.694291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:42.911888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:42.929886 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48e92521-4c74-43f5-9b39-ad81f4fb41a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.251341 Oct 03 11:19:42.931503 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3558/6784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:42 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:43.173987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:43.179420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-729e9cd8-d6f2-4d14-a2af-4c4aa9748462 req-d4903810-6dba-4fbf-836e-33ecf0eb610b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:43.180895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:43.188511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:43.189185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:43.190167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:43.191260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:43.192080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:43.192735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:43.194250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-729e9cd8-d6f2-4d14-a2af-4c4aa9748462 req-d4903810-6dba-4fbf-836e-33ecf0eb610b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:43.194730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-729e9cd8-d6f2-4d14-a2af-4c4aa9748462 req-d4903810-6dba-4fbf-836e-33ecf0eb610b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:43.195330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-729e9cd8-d6f2-4d14-a2af-4c4aa9748462 req-d4903810-6dba-4fbf-836e-33ecf0eb610b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:43.208341 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-729e9cd8-d6f2-4d14-a2af-4c4aa9748462 req-d4903810-6dba-4fbf-836e-33ecf0eb610b service nova] Creating event network-changed:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h1-858383-3 Oct 03 11:19:43.214126 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-729e9cd8-d6f2-4d14-a2af-4c4aa9748462 req-d4903810-6dba-4fbf-836e-33ecf0eb610b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038234 Oct 03 11:19:43.215350 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3559/6785] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:19:43.228109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:19:43.321744 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f19dac0-4a49-4817-be64-225779e9b2ec tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 204 len: 0 microversion: 2.1 time: 0.150847 Oct 03 11:19:43.326196 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3227/6786] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:19:43 2022] DELETE /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:19:43.331409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:43.332460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:43.342029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:43.342716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:43.343260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:43.345429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:43.345990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:43.346535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:43.516387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:43.527434 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1823aa7e-57a4-4795-8196-ddd4fc23cc95 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1690 microversion: 2.1 time: 0.199749 Oct 03 11:19:43.528518 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3560/6787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:43 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:43.953828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:43.954410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:43.961006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:43.962103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:43.962585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:43.963357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:43.963811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:43.964358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:44.118458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:44.130159 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3bf9a5c1-eb5b-4696-95f5-79a70f8934c2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1168 microversion: 2.1 time: 0.180338 Oct 03 11:19:44.131099 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3228/6788] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:43 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:19:44.551834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:44.552448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:44.565848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:44.566347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:44.566791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:44.567500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:44.567963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:44.568401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:44.709854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:44.718255 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-824529b6-cdc5-48fa-bf44-98729be90392 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1690 microversion: 2.1 time: 0.170442 Oct 03 11:19:44.718845 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3561/6789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:44 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:19:45.155030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:45.155638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:45.163191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:45.163693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:45.164645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:45.165348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:45.165796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:45.166217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:45.389904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:45.397096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-89f99c18-5e4e-4e75-895c-b66ee2e00d56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.245826 Oct 03 11:19:45.397692 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3229/6790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:45 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:45.718409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8b8328b3-84c0-40b3-aa20-0940211d13ab req-b77dfbd6-1cd7-4c13-9683-2605e5f40f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69dc3200-7ff7-4adb-9312-f24454cb8e47", "name": "network-vif-deleted", "tag": "7885b2a8-3fd4-47b1-95d4-94deb336789c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:45.729007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8b8328b3-84c0-40b3-aa20-0940211d13ab req-b77dfbd6-1cd7-4c13-9683-2605e5f40f17 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:45.729504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8b8328b3-84c0-40b3-aa20-0940211d13ab req-b77dfbd6-1cd7-4c13-9683-2605e5f40f17 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:45.729937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8b8328b3-84c0-40b3-aa20-0940211d13ab req-b77dfbd6-1cd7-4c13-9683-2605e5f40f17 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:45.742769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:45.743406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:45.745105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8b8328b3-84c0-40b3-aa20-0940211d13ab req-b77dfbd6-1cd7-4c13-9683-2605e5f40f17 service nova] Creating event network-vif-deleted:7885b2a8-3fd4-47b1-95d4-94deb336789c for instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 on n-h1-858383-3 Oct 03 11:19:45.749920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:45.750376 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8b8328b3-84c0-40b3-aa20-0940211d13ab req-b77dfbd6-1cd7-4c13-9683-2605e5f40f17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 Oct 03 11:19:45.750623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:45.751460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:45.751641 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3562/6791] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:19:45.751876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:45.752676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:45.753145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:45.825173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:45.834577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4570315c-169c-40a9-9d7c-cabfef53d06f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 200 len: 1352 microversion: 2.1 time: 0.096537 Oct 03 11:19:45.835084 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3230/6792] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:45 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:19:46.420210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:46.420865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:46.427169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:46.427655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:46.428095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:46.428825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:46.429293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:46.429833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:46.560114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:46.567895 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff72a854-6e35-4947-8005-3c2dd8d06102 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.152062 Oct 03 11:19:46.568477 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3563/6793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:46 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:46.859092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:46.859702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 69dc3200-7ff7-4adb-9312-f24454cb8e47] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:46.866604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:46.867679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:46.868043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:46.868738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:46.869217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:46.869644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:46.883535 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] HTTP exception thrown: Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 could not be found. Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Request method failure captured: Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 HTTP/1.1 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTJX3me0ubgizALUMdHyD1Cm6Q07-p4WZHzszlZB8YEt9Nq7i2P1ClQ4xFbzLCdsQ5UL88hVP8HmaVFl6M5wMElRf5imNdRyYZ1IG2kIYmjxRrRhnCxuRQA5Vsoty-UKFenbZfiouTOk3PswpcCO3UBWSmKTL2i_yYd8TWbmOUwN9w Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}] Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 23c88a45a2c143cdab0a44ebf2022171 Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 could not be found. Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '69dc3200-7ff7-4adb-9312-f24454cb8e47'} Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 could not be found. Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 could not be found. Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:46.885198 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 could not be found. Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Returning 404 to user: Instance 69dc3200-7ff7-4adb-9312-f24454cb8e47 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a058b41e-3cc3-4507-9b0c-3ab2e893eb73 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47" status: 404 len: 111 microversion: 2.1 time: 0.031415 Oct 03 11:19:46.889747 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3231/6794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:46 2022] GET /compute/v2.1/servers/69dc3200-7ff7-4adb-9312-f24454cb8e47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:19:47.591062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:47.591821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:47.598850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:47.599339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:47.599782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:47.600481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:47.600977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:47.601408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:47.734382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:47.742588 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d405fe1f-136b-43b4-b5ac-8eaeb7becfdf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.155403 Oct 03 11:19:47.743184 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3564/6795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:47 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:48.766624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:48.767239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:48.776506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:48.777029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:48.777812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:48.778663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:48.779124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:48.779554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:48.982030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:48.991919 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-edd3cfe5-6b3d-4e04-aa55-c93f96b5997f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.229136 Oct 03 11:19:48.993582 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3232/6796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:48 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:50.022769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:50.023450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:50.030914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:50.031260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:50.033625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:50.033625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:50.033625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:50.033625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:50.238151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:50.248060 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2939e4f0-b376-4bfd-87a5-046f74b4a594 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.229206 Oct 03 11:19:50.248680 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3565/6797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:50 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:50.359371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef0e3c8f-bfd6-4fd5-b167-c519443fe58e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '.version_select at 0x7f074f9e1550>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:50.387138 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef0e3c8f-bfd6-4fd5-b167-c519443fe58e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1170425854" status: 202 len: 0 microversion: 2.1 time: 0.031947 Oct 03 11:19:50.387804 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3233/6798] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 3 11:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1170425854 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:19:50.418148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b54ba441-7904-47a9-a2cc-7ffb02e142c7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: .version_select at 0x7f074df67d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1332482285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuZLpzdpZyP7xwzHY+u0WtRwKjuJjy9+axgyyYSlB/75obW9fkXMtZcksihYn3jaR0LJwikqdeCTSLpsuK5eHrZN/2dW32R84ZBTcoZItw8x1i06WaBY+p/sYDr+v0XlQ=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:50.434645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-b54ba441-7904-47a9-a2cc-7ffb02e142c7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:19:50.439869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-b54ba441-7904-47a9-a2cc-7ffb02e142c7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:19:50.470141 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b54ba441-7904-47a9-a2cc-7ffb02e142c7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056521 Oct 03 11:19:50.470965 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3566/6799] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:19:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:19:51.275148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:51.277943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:51.289971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:51.290337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:51.291230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:51.291996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:51.292706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:51.293347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:51.443534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:51.453218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-97e67b7b-96d9-4d51-b9ce-a39ed0b0a55c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.185394 Oct 03 11:19:51.453792 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3234/6800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:51 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:52.477695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:52.478543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:52.486289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:52.487176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:52.487631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:52.488521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:52.489012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:52.489450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:52.646020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:52.655446 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f153e84e-d79e-4c82-b8d0-3b022d71e19f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.182984 Oct 03 11:19:52.656033 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3567/6801] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:52 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:19:53.679601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:53.681138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:53.689181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:53.689851 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:53.690544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:53.691474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:53.691997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:53.692620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:53.936844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:53.948278 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-194cc023-3317-44fe-835d-c24b60af9c7c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.272845 Oct 03 11:19:53.959083 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3235/6802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:53 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:54.778204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7c79f6eb-1e4f-4eb6-8ab3-750d50e1fccc req-c223bf18-3f32-48ef-b7f1-60daddb25b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0ca5be-8670-4df2-9b6c-926ec5ec6127", "name": "network-vif-plugged", "status": "completed", "tag": "c3bacbb6-3fe7-4e74-9321-14b0f214c43d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:54.804153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c79f6eb-1e4f-4eb6-8ab3-750d50e1fccc req-c223bf18-3f32-48ef-b7f1-60daddb25b7f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:54.804643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c79f6eb-1e4f-4eb6-8ab3-750d50e1fccc req-c223bf18-3f32-48ef-b7f1-60daddb25b7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:54.805374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7c79f6eb-1e4f-4eb6-8ab3-750d50e1fccc req-c223bf18-3f32-48ef-b7f1-60daddb25b7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:54.819041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7c79f6eb-1e4f-4eb6-8ab3-750d50e1fccc req-c223bf18-3f32-48ef-b7f1-60daddb25b7f service nova] Creating event network-vif-plugged:c3bacbb6-3fe7-4e74-9321-14b0f214c43d for instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 on n-h2-858383-3 Oct 03 11:19:54.825767 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7c79f6eb-1e4f-4eb6-8ab3-750d50e1fccc req-c223bf18-3f32-48ef-b7f1-60daddb25b7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129276 Oct 03 11:19:54.826522 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3568/6803] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:19:54.977725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:54.979932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:54.991531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:54.992333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:54.992970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:54.993838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:54.994456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:54.995040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:55.246496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:55.250420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:55.262484 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee8b7aa8-4c69-4e6a-abeb-8f088cfe87fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1202 microversion: 2.1 time: 0.293824 Oct 03 11:19:55.264105 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3236/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:54 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1202 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:56.296414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:56.297249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:56.300248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:56.311163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:56.311766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:56.312288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:56.313235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:56.313697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:56.314141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:56.318055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=89 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:56.470757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:56.479807 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e273503a-c3db-4bfa-87fb-5374ab2c049b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1389 microversion: 2.1 time: 0.187624 Oct 03 11:19:56.480686 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3569/6805] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:56 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1389 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:56.502670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:56.503292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:56.511930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:56.512692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:56.513163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:56.514033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:56.514663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:56.515096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:56.790420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:56.805201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-08d1fc4a-852d-4c30-acf7-4d574e0cb7f7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1389 microversion: 2.1 time: 0.306121 Oct 03 11:19:56.808758 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3237/6806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:56 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1389 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:56.833438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:56.834716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:56.845817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:56.857825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:56.858531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:56.859544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:56.860270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:56.860868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:57.098207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:57.108082 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-959f019b-b0bc-4651-b59b-47629a05fba1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1389 microversion: 2.1 time: 0.281762 Oct 03 11:19:57.113727 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3570/6807] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:56 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1389 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:57.204869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1122274038", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "ea39a8c7-6030-4eac-84d6-455e1ff05722"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1332482285", "security_groups": [{"name": "tempest-secgroup-smoke-2013619019"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:57.288109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:57.289353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:57.296022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:57.296903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:57.298016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:57.298940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:57.299760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:57.300391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:57.354148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:19:57.401143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] validate_networks() for [('ea39a8c7-6030-4eac-84d6-455e1ff05722', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:19:57.480589 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8f852515-167e-469f-8075-4b2a64356b4f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 204 len: 0 microversion: 2.1 time: 0.194410 Oct 03 11:19:57.482457 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3571/6808] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:19:57 2022] DELETE /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:19:57.497361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:57.498476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:57.505468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:57.508661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:57.510840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:57.511846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:57.512551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:57.513231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:57.716099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:57.716254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:19:57.727184 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13c2bfb8-9e71-41fb-97a0-7b5beafe4d7a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1395 microversion: 2.1 time: 0.236529 Oct 03 11:19:57.728115 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3572/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:57 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1395 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:57.919542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:19:57.919966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:19:57.920559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:19:57.921002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:19:57.921416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:19:57.932323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:57.932906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:57.933348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:57.934068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:57.934523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:57.934945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:57.953946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:19:57.959624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:19:57.974109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:19:57.977149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:19:58.026976 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6a244e12-2183-4347-9ba5-6a09a580fb3f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.827006 Oct 03 11:19:58.033756 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3238/6810] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:19:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:19:58.042105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-447f1cbd-fabb-4f32-b9d5-790b9c215eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:58.042841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-447f1cbd-fabb-4f32-b9d5-790b9c215eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:58.103473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-447f1cbd-fabb-4f32-b9d5-790b9c215eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:58.116569 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-447f1cbd-fabb-4f32-b9d5-790b9c215eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1267 microversion: 2.1 time: 0.080825 Oct 03 11:19:58.117784 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3573/6811] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:58 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:58.753520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:58.754773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:58.765935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:58.766433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:58.766874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:58.767779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:58.768248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:58.768683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:58.997795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:59.010849 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1441b3ad-661e-4cb9-93fe-b0c160bb48dd tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1395 microversion: 2.1 time: 0.261366 Oct 03 11:19:59.011734 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3239/6812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:58 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1395 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:59.146708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:19:59.147961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:19:59.161786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:59.163052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:59.164719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:59.166317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:59.167364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:59.168133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:59.303436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:19:59.314106 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d1c9b899-8bad-4b25-93ce-e0b547fc98d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1319 microversion: 2.1 time: 0.175690 Oct 03 11:19:59.315356 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3574/6813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:19:59 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:19:59.729258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4b729e56-128e-4c4b-8461-108540261324 req-0bf23fe3-e80b-4e68-9907-b91e6a39e4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0ca5be-8670-4df2-9b6c-926ec5ec6127", "name": "network-vif-deleted", "tag": "c3bacbb6-3fe7-4e74-9321-14b0f214c43d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:19:59.744546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4b729e56-128e-4c4b-8461-108540261324 req-0bf23fe3-e80b-4e68-9907-b91e6a39e4fd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:19:59.745292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4b729e56-128e-4c4b-8461-108540261324 req-0bf23fe3-e80b-4e68-9907-b91e6a39e4fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:19:59.745900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4b729e56-128e-4c4b-8461-108540261324 req-0bf23fe3-e80b-4e68-9907-b91e6a39e4fd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:19:59.768009 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4b729e56-128e-4c4b-8461-108540261324 req-0bf23fe3-e80b-4e68-9907-b91e6a39e4fd service nova] Creating event network-vif-deleted:c3bacbb6-3fe7-4e74-9321-14b0f214c43d for instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 on n-h2-858383-3 Oct 03 11:19:59.776372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4b729e56-128e-4c4b-8461-108540261324 req-0bf23fe3-e80b-4e68-9907-b91e6a39e4fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057019 Oct 03 11:19:59.777585 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3240/6814] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:20:00.045602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:00.046930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:00.060210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:00.061160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:00.061816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:00.064946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:00.068234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:00.070356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:00.168712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:00.177223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8398a639-adc1-4b68-9788-d48b2c4cee9e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1187 microversion: 2.1 time: 0.145502 Oct 03 11:20:00.193039 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3575/6815] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:00 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:00.340931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:00.341897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:00.350010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:00.350467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:00.351126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:00.352407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:00.354101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:00.354739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:00.612623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:00.621313 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9fda9333-3edf-484b-a879-24a7ddc76d59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1393 microversion: 2.1 time: 0.285285 Oct 03 11:20:00.627764 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3241/6816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:00 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1393 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:01.202066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:01.202859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:01.214841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:01.218412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:01.220453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:01.222371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:01.223579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:01.224309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:01.326032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:01.343955 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6eaa4880-7543-4e5a-8565-e953cb6a6607 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1187 microversion: 2.1 time: 0.141382 Oct 03 11:20:01.347531 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3576/6817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:01 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1187 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:01.645693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:01.647025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:01.655542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:01.656419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:01.657204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:01.658138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:01.658983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:01.659639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:01.814364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-68127411-7267-42da-abae-96eef547c4dc req-85661ed3-6ee7-4a0b-b91e-8226dd245c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:01.827647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-68127411-7267-42da-abae-96eef547c4dc req-85661ed3-6ee7-4a0b-b91e-8226dd245c20 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:01.828993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-68127411-7267-42da-abae-96eef547c4dc req-85661ed3-6ee7-4a0b-b91e-8226dd245c20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:01.830105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-68127411-7267-42da-abae-96eef547c4dc req-85661ed3-6ee7-4a0b-b91e-8226dd245c20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:01.858550 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-68127411-7267-42da-abae-96eef547c4dc req-85661ed3-6ee7-4a0b-b91e-8226dd245c20 service nova] Creating event network-changed:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h1-858383-3 Oct 03 11:20:01.871351 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-68127411-7267-42da-abae-96eef547c4dc req-85661ed3-6ee7-4a0b-b91e-8226dd245c20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072255 Oct 03 11:20:01.873332 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3577/6818] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:20:01.923630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:01.933278 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fd1a8ea-2877-498d-b683-10a2cea60d71 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1393 microversion: 2.1 time: 0.291547 Oct 03 11:20:01.933913 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3242/6819] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:01 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1393 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:02.372571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:02.373209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:02.381092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:02.381589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:02.382981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:02.390293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:02.390796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:02.391328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:02.463678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:02.472417 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8af6baea-3caa-43d6-b2ca-f2c9f47d209e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1187 microversion: 2.1 time: 0.104434 Oct 03 11:20:02.473075 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3578/6820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:02 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:02.957903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:02.959322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:02.967595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:02.968091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:02.968608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:02.969528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:02.969987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:02.970592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:03.112628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:03.120631 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-36819fe1-24b3-4e90-af47-29a629c4a40a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1393 microversion: 2.1 time: 0.166838 Oct 03 11:20:03.121329 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3243/6821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:02 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:03.496238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:03.497037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:03.504632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:03.505155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:03.505595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:03.506307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:03.506890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:03.507868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:03.579460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:03.588348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a8624e61-56e1-41dd-ac39-64998fdf1aef tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1187 microversion: 2.1 time: 0.096068 Oct 03 11:20:03.589113 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3579/6822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:03 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:04.152704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:04.153777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:04.163650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:04.165348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:04.165948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:04.166919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:04.167541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:04.168146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:04.404782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:04.415046 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b2d07e8-279d-438d-b03c-dfee161a5929 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1393 microversion: 2.1 time: 0.266095 Oct 03 11:20:04.415965 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3244/6823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:04 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1393 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:04.611524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:04.612247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:04.619951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:04.620433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:04.620905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:04.621594 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:04.622079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:04.622504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:04.656495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:04.657162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:04.657583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:04.658041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lazy-loading 'fault' on Instance uuid 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:20:04.719935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:04.728921 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-132d4f1e-49fd-44d8-afef-d61286fb303c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 200 len: 1192 microversion: 2.1 time: 0.121187 Oct 03 11:20:04.729761 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3580/6824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:04 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:05.440208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:05.441893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:05.450164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:05.450878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:05.451499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:05.452354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:05.452999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:05.453569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:05.618943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:05.628129 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42236386-9b9e-4a43-9f6c-225267227e4c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1393 microversion: 2.1 time: 0.192099 Oct 03 11:20:05.628984 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3245/6825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:05 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1393 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:05.751687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:05.752306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:05.760528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:05.761040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:05.761479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:05.762184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:05.762635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:05.763061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:05.777440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 HTTP/1.1 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3e0ca5be-8670-4df2-9b6c-926ec5ec6127'} Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:20:05.779135 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eaa9f28a-132b-46b9-8d2c-d64562bbfad2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 404 len: 111 microversion: 2.1 time: 0.032855 Oct 03 11:20:05.783058 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3581/6826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:05 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:20:06.652859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:06.653566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:06.660464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:06.660998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:06.661448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:06.662155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:06.662620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:06.663616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:06.805700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:06.814143 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cf37153-c536-46f7-9111-b2fc2491f8e3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1393 microversion: 2.1 time: 0.165343 Oct 03 11:20:06.814709 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3246/6827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:06 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:07.022063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-51421840-d3ac-4661-8ea2-6221649f9aeb req-0c391c4c-42c2-448c-ad4d-66350ae82b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "name": "network-vif-plugged", "status": "completed", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:07.034920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-51421840-d3ac-4661-8ea2-6221649f9aeb req-0c391c4c-42c2-448c-ad4d-66350ae82b77 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:07.035477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-51421840-d3ac-4661-8ea2-6221649f9aeb req-0c391c4c-42c2-448c-ad4d-66350ae82b77 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:07.035986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-51421840-d3ac-4661-8ea2-6221649f9aeb req-0c391c4c-42c2-448c-ad4d-66350ae82b77 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:07.048367 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-51421840-d3ac-4661-8ea2-6221649f9aeb req-0c391c4c-42c2-448c-ad4d-66350ae82b77 service nova] Creating event network-vif-plugged:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h1-858383-3 Oct 03 11:20:07.053964 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-51421840-d3ac-4661-8ea2-6221649f9aeb req-0c391c4c-42c2-448c-ad4d-66350ae82b77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036307 Oct 03 11:20:07.054562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3582/6828] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:20:07.838158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:07.838878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:07.845672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:07.846166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:07.846600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:07.847305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:07.847760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:07.848183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:07.938543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:07.939143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:07.942375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:07.949118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:07.949691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:07.950182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:07.951074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:07.951564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:07.952043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:07.967392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:07.973486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 HTTP/1.1 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3e0ca5be-8670-4df2-9b6c-926ec5ec6127'} Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:20:07.975717 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dd10bcab-a5ea-449f-b274-d88347c8d7b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 404 len: 111 microversion: 2.1 time: 0.046464 Oct 03 11:20:07.983173 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3583/6829] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:20:07 2022] DELETE /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:20:07.986973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:07.987647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 3e0ca5be-8670-4df2-9b6c-926ec5ec6127] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:07.998742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:07.999309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:07.999810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:08.000537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:08.001025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:08.001464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:08.017326 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:08.020277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 HTTP/1.1 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '3e0ca5be-8670-4df2-9b6c-926ec5ec6127'} Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:20:08.022535 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 3e0ca5be-8670-4df2-9b6c-926ec5ec6127 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4221303f-a901-41e4-9b39-4fec00eec8c3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127" status: 404 len: 111 microversion: 2.1 time: 0.042325 Oct 03 11:20:08.027522 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3584/6830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:07 2022] GET /compute/v2.1/servers/3e0ca5be-8670-4df2-9b6c-926ec5ec6127 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:20:08.030586 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d1b3051-6046-419d-9f8b-71e9bf7304f0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1393 microversion: 2.1 time: 0.197804 Oct 03 11:20:08.031482 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3247/6831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:07 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1393 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:09.055655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:09.056192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:09.059147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:09.064934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:09.065423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:09.065862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:09.066597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:09.067051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:09.067487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:09.220911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:09.232883 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bdb8d85f-702d-49ba-8f0b-623a2d5b4b27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1564 microversion: 2.1 time: 0.181942 Oct 03 11:20:09.233930 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3585/6832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:09 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:20:09.255998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:09.258600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:09.267089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:09.267089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:09.267089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:09.267925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:09.268431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:09.269179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:09.431762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:09.441497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e9c2a5c-7b5b-4dd0-808d-b5ea4c5c2f58 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1564 microversion: 2.1 time: 0.189267 Oct 03 11:20:09.442553 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3248/6833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:09 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:11.459382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:11.461795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:11.467403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b794c2b2-74d9-4c2e-9d58-fc6bf35bcd9f req-e2f70c74-c456-46af-b7b7-598087357402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:11.474973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:11.478020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:11.479605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:11.480576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:11.481270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:11.482099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b794c2b2-74d9-4c2e-9d58-fc6bf35bcd9f req-e2f70c74-c456-46af-b7b7-598087357402 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:11.482785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b794c2b2-74d9-4c2e-9d58-fc6bf35bcd9f req-e2f70c74-c456-46af-b7b7-598087357402 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:11.483050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b794c2b2-74d9-4c2e-9d58-fc6bf35bcd9f req-e2f70c74-c456-46af-b7b7-598087357402 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:11.483480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:11.495584 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b794c2b2-74d9-4c2e-9d58-fc6bf35bcd9f req-e2f70c74-c456-46af-b7b7-598087357402 service nova] Creating event network-changed:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h1-858383-3 Oct 03 11:20:11.501011 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b794c2b2-74d9-4c2e-9d58-fc6bf35bcd9f req-e2f70c74-c456-46af-b7b7-598087357402 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038071 Oct 03 11:20:11.504667 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3249/6834] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:20:11.664942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:11.676182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b6b9c07-97d2-4389-99fa-39692dc05c78 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1564 microversion: 2.1 time: 0.220837 Oct 03 11:20:11.688745 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3586/6835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:11 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1564 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:27.810449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:27.811805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=66 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:27.816562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1642766681", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e7836622-207d-437d-a5ed-e18c6756f857", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:27.878786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:20:28.246718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:20:28.247143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:20:28.247639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:20:28.248046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:20:28.248455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:20:28.257389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:28.257865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:28.258297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:28.259031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:28.259485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:28.259906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:28.276720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:20:28.281962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:20:28.342050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:20:28.344287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7836622-207d-437d-a5ed-e18c6756f857',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:20:28.473788 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78a1562a-5fe9-4f9e-b3e9-ba3525c5ce8a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665287 Oct 03 11:20:28.474477 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3250/6836] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:20:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:20:28.486022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-875fc049-a501-4dd8-86a9-0146b23f0ba8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:28.486644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-875fc049-a501-4dd8-86a9-0146b23f0ba8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:28.490974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:28.491710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:28.546251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-875fc049-a501-4dd8-86a9-0146b23f0ba8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:28.553062 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-875fc049-a501-4dd8-86a9-0146b23f0ba8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1071 microversion: 2.1 time: 0.071344 Oct 03 11:20:28.553647 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3587/6837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:28 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1071 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:29.578876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:29.579989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:29.587047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:29.587713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:29.588308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:29.588867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:29.589328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:29.589752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:29.676585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:29.685662 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-958005fa-1904-4243-a745-5a77e922b5e9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1187 microversion: 2.1 time: 0.111389 Oct 03 11:20:29.686589 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3251/6838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:29 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:30.709523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:30.710281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:30.717033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:30.717556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:30.718195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:30.718907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:30.719361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:30.719788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:30.851235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bb727378-3abb-4c55-a867-be00a05cc94a req-f4c9e0d7-43de-4b19-839b-17de2478ed8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ef1a20-c377-40bd-a073-83086dcd3988", "tag": "dfc72d4a-9456-4f8c-bd43-280451d88c4b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:30.873222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bb727378-3abb-4c55-a867-be00a05cc94a req-f4c9e0d7-43de-4b19-839b-17de2478ed8e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:30.874874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bb727378-3abb-4c55-a867-be00a05cc94a req-f4c9e0d7-43de-4b19-839b-17de2478ed8e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:30.875531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bb727378-3abb-4c55-a867-be00a05cc94a req-f4c9e0d7-43de-4b19-839b-17de2478ed8e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:30.877294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:30.887121 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-864e4ac5-07c8-4000-9943-7afa8e7ce7fb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1229 microversion: 2.1 time: 0.182099 Oct 03 11:20:30.895361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bb727378-3abb-4c55-a867-be00a05cc94a req-f4c9e0d7-43de-4b19-839b-17de2478ed8e service nova] Creating event network-changed:dfc72d4a-9456-4f8c-bd43-280451d88c4b for instance 00ef1a20-c377-40bd-a073-83086dcd3988 on n-h2-858383-3 Oct 03 11:20:30.901443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3588/6839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:30 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1229 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:30.901669 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bb727378-3abb-4c55-a867-be00a05cc94a req-f4c9e0d7-43de-4b19-839b-17de2478ed8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058802 Oct 03 11:20:30.902667 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3252/6840] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:20:31.912892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:31.913574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:31.920476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:31.920996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:31.921435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:31.922129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:31.922580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:31.923011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:32.060243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:32.068182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a127166e-b212-49c4-b2f1-5044a81c85c9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1229 microversion: 2.1 time: 0.160485 Oct 03 11:20:32.068697 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3589/6841] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:31 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:33.092179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:33.093100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:33.099518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:33.100106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:33.100620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:33.101437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:33.102021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:33.102517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:33.234577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:33.243041 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-31dff257-5ddf-4c38-95af-07660e64e8e2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1229 microversion: 2.1 time: 0.156103 Oct 03 11:20:33.243626 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3253/6842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:33 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:34.266935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:34.267587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:34.274935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:34.275426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:34.275864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:34.276570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:34.277072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:34.277486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:34.415372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:34.423437 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c7e6d99-43b8-4dda-a221-e5141a0c63d6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1229 microversion: 2.1 time: 0.161147 Oct 03 11:20:34.424108 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3590/6843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:34 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:35.447187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:35.447807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:35.457169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:35.457569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:35.458020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:35.458727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:35.459193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:35.459739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:35.600012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:35.607655 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f1b34043-f86d-42fd-bc26-c3ad372425d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.164614 Oct 03 11:20:35.608224 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3254/6844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:35 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:36.631791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:36.632437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:36.639465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:36.639946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:36.640381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:36.641106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:36.641565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:36.641991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:36.771911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:36.779656 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c736a93-d5b3-4685-8128-dd354fd6031d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.152487 Oct 03 11:20:36.780234 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3591/6845] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:36 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:37.802250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:37.802861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:37.810068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:37.810519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:37.810956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:37.811642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:37.812091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:37.812515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:37.941682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:37.951735 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4498b684-e54f-42c4-896b-835d856411fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.153279 Oct 03 11:20:37.952323 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3255/6846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:37 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:39.081104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:39.081714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:39.084503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:39.090569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:39.091138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:39.091524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:39.092213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:39.092694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:39.093384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:39.229941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:39.237741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df47617f-2bff-4c7a-bca3-09a5d7d78b26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.160819 Oct 03 11:20:39.238314 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3592/6847] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:39 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:40.261231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:40.261826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:40.263964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:40.264626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:40.272280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:40.272794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:40.273227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:40.273927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:40.274384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:40.274816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:40.488122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:40.496466 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-872d4d9f-d777-4c94-9c1b-e8e0a7c2ab0f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.239172 Oct 03 11:20:40.497086 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3256/6848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:40 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:41.520109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:41.521292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:41.530599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:41.531097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:41.531540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:41.532261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:41.532721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:41.533178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:41.765387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:41.773769 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b2989db-47fa-42da-85d6-f4ddbbd1e681 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.257604 Oct 03 11:20:41.774283 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3593/6849] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:41 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:42.796386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:42.796946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:42.804639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:42.805151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:42.805596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:42.806290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:42.806751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:42.807183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:42.936606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:42.944955 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2074228f-e795-405d-97cd-7aa750066425 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.152650 Oct 03 11:20:42.945527 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3257/6850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:42 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:43.967738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:43.968260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:43.975067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:43.975543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:43.975977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:43.976660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:43.977134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:43.977557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:44.107502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:44.115062 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-25319b9b-4cc0-4f5d-8332-82bb0f396919 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.151325 Oct 03 11:20:44.115632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3594/6851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:43 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:44.290312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0cc4d376-c63c-4c73-9143-41740baf773d req-36fedfca-ddb7-4a2a-b767-4ace9356611f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ef1a20-c377-40bd-a073-83086dcd3988", "name": "network-vif-plugged", "status": "completed", "tag": "dfc72d4a-9456-4f8c-bd43-280451d88c4b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:44.301123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0cc4d376-c63c-4c73-9143-41740baf773d req-36fedfca-ddb7-4a2a-b767-4ace9356611f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:44.301636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0cc4d376-c63c-4c73-9143-41740baf773d req-36fedfca-ddb7-4a2a-b767-4ace9356611f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:44.302137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0cc4d376-c63c-4c73-9143-41740baf773d req-36fedfca-ddb7-4a2a-b767-4ace9356611f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:44.314154 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0cc4d376-c63c-4c73-9143-41740baf773d req-36fedfca-ddb7-4a2a-b767-4ace9356611f service nova] Creating event network-vif-plugged:dfc72d4a-9456-4f8c-bd43-280451d88c4b for instance 00ef1a20-c377-40bd-a073-83086dcd3988 on n-h2-858383-3 Oct 03 11:20:44.320704 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0cc4d376-c63c-4c73-9143-41740baf773d req-36fedfca-ddb7-4a2a-b767-4ace9356611f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034046 Oct 03 11:20:44.321493 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3258/6852] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:20:44.990376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:44.992670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:44.999445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:44.999926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:45.000361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:45.001077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:45.001529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:45.001952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:45.070035 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2f2405e2-d6c1-4fba-b41a-14e0703f56dc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action" status: 200 len: 24567 microversion: 2.1 time: 0.083848 Oct 03 11:20:45.070709 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3595/6853] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:20:44 2022] POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action => generated 24567 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:20:45.138228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:45.138930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:45.145147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:45.145634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:45.146132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:45.146825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:45.147281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:45.147710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:45.281273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:45.289831 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-45a01931-da2d-40b4-b567-6c296e986ab7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1217 microversion: 2.1 time: 0.155786 Oct 03 11:20:45.290424 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3259/6854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:45 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:46.314232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:46.314943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:46.322952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:46.323437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:46.323878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:46.324572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:46.325060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:46.325489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:46.454689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:46.462891 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-02ead418-ab9c-4bbc-8e1a-8f27684d6f9a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1404 microversion: 2.1 time: 0.153280 Oct 03 11:20:46.463447 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3596/6855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:46 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:46.485273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:46.485890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:46.493228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:46.493718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:46.494163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:46.494861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:46.495323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:46.495756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:46.625721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:46.633657 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ffbf0ccd-9820-4dc0-922d-82a8ee56b8e0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1404 microversion: 2.1 time: 0.152236 Oct 03 11:20:46.634232 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3260/6856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:46 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:46.656183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1633604582"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:46.658535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:46.665579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:46.666061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:46.666501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:46.667192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:46.667644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:46.668073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:46.764259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Attempting to quiesce instance before volume snapshot. Oct 03 11:20:46.821050 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 03 11:20:46.889092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Creating snapshot from volume e7836622-207d-437d-a5ed-e18c6756f857. {{(pid=122269) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 03 11:20:47.767568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f71cae8c-3cfc-46c5-8ad6-68ab2350d98e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988/action" status: 202 len: 0 microversion: 2.1 time: 1.115157 Oct 03 11:20:47.768352 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3597/6857] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:20:46 2022] POST /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988/action => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 11:20:48.920372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-612928861", "imageRef": "182d6a59-6658-4a5d-9618-2368f5c53965", "flavorRef": "452", "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:48.976406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:20:49.393595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:20:49.394068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:20:49.394527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:20:49.394938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:20:49.395352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:20:49.404665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:49.405199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:49.405638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:49.406364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:49.406820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:49.407254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:49.424332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:20:49.430221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:20:49.442491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:20:49.445055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a9ee4121-1d65-4fe3-a24f-7e4ef897c1bb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:20:49.520170 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-347df22d-dc64-4e5f-8674-48a8605fd74c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603670 Oct 03 11:20:49.521336 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3261/6858] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:20:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:20:49.534452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b059b849-1da4-490e-881b-bef6c2f7c3e7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:49.535315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b059b849-1da4-490e-881b-bef6c2f7c3e7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:49.592597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b059b849-1da4-490e-881b-bef6c2f7c3e7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:49.600493 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b059b849-1da4-490e-881b-bef6c2f7c3e7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1229 microversion: 2.1 time: 0.071637 Oct 03 11:20:49.601105 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3598/6859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:49 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1229 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:50.625053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:50.625675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:50.633338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:50.633833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:50.634275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:50.634992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:50.635452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:50.635886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:50.727667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:50.736531 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-86b4c430-5ca5-4104-8c85-3dd9afec78b0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1289 microversion: 2.1 time: 0.116412 Oct 03 11:20:50.737304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3262/6860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:50 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:51.760334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:51.761123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:51.768719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:51.769337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:51.769864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:51.770836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:51.771384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:51.771931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:51.938276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:51.951821 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c55956c3-dc4b-4a0b-bab1-71fe9d6b7fce tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.196131 Oct 03 11:20:51.952407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3599/6861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:51 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:52.524267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5a449e39-0054-4615-81ec-19683431fdb0 req-66045997-6854-4cce-b561-063966998419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a745eb7a-055d-4d9d-a033-8eedae89202d", "tag": "5bc9cfcd-d1fa-473f-bac4-daddd7f618fd"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:20:52.535379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5a449e39-0054-4615-81ec-19683431fdb0 req-66045997-6854-4cce-b561-063966998419 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:52.535860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5a449e39-0054-4615-81ec-19683431fdb0 req-66045997-6854-4cce-b561-063966998419 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:52.536291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5a449e39-0054-4615-81ec-19683431fdb0 req-66045997-6854-4cce-b561-063966998419 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:52.548063 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5a449e39-0054-4615-81ec-19683431fdb0 req-66045997-6854-4cce-b561-063966998419 service nova] Creating event network-changed:5bc9cfcd-d1fa-473f-bac4-daddd7f618fd for instance a745eb7a-055d-4d9d-a033-8eedae89202d on n-h1-858383-3 Oct 03 11:20:52.553640 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5a449e39-0054-4615-81ec-19683431fdb0 req-66045997-6854-4cce-b561-063966998419 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040309 Oct 03 11:20:52.554696 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3263/6862] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:20:52.979484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:52.980340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:52.987726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:52.988210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:52.988664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:52.989406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:52.989875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:52.990316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:53.143350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:53.151065 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd861ff5-1cc3-4d13-af8f-c81c6aa95a47 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.175615 Oct 03 11:20:53.153137 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3600/6863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:52 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:54.177064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:54.177928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:54.185418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:54.186191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:54.186872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:54.188031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:54.189018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:54.189682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:54.392068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:54.405123 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a2fc7054-f412-40a9-9179-c717e33c1fcb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.232791 Oct 03 11:20:54.407528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3264/6864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:54 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:55.450583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:55.451732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:55.470596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:55.473276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:55.473877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:55.475644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:55.477000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:55.478302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:55.672284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:55.683183 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-31ec56fc-3625-4168-9c51-aaee1d752a6c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.243669 Oct 03 11:20:55.694500 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3601/6865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:55 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:56.729218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:56.729897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:56.745449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:56.745961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:56.746402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:56.747922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:56.748391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:56.748857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:56.940691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:56.951840 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db799562-581a-4614-a6ed-e68b4de9db8c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.227020 Oct 03 11:20:56.953005 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3265/6866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:56 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:57.979782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:57.980543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:57.987898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:57.988714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:57.989430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:57.990179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:57.991178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:57.991814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:58.164392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:58.184321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2803585f-1dee-4475-b192-39a99a40b236 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.209217 Oct 03 11:20:58.184966 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3602/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:57 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:20:59.207407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:20:59.208020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:20:59.210880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:59.216124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:59.216600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:59.217063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:59.217747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:20:59.218199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:20:59.218620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:20:59.222239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=77 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:20:59.368809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:20:59.378434 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-130145b1-1ab7-4704-bd7b-0e1dddd46e6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.175020 Oct 03 11:20:59.379056 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3266/6868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:20:59 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:00.402434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:00.403066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:00.405947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:00.406607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=37 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:00.413381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:00.413890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:00.414377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:00.415268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:00.415867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:00.416341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:00.419655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:00.558441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:00.567100 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-476c43fa-7662-4db7-af29-7ab9aaa59e3d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.168483 Oct 03 11:21:00.567714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3603/6869] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:00 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:01.592555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:01.593695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:01.595688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:01.596401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:01.604110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:01.604608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:01.605071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:01.605783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:01.606242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:01.606674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:01.766049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:01.783055 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c6c3303-ad82-4099-94df-91d08dfcf1e8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.195077 Oct 03 11:21:01.783821 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3267/6870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:01 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:02.812365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:02.813089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:02.820636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:02.821177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:02.821641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:02.822375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:02.822852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:02.823302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:02.981413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:02.992016 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e850d670-0107-4a2e-8450-3fc029ee7959 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.183961 Oct 03 11:21:02.992614 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3604/6871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:02 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:04.016550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:04.017321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:04.028126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:04.028696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:04.029301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:04.030026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:04.030579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:04.031104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:04.189320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:04.197591 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e6a403b-771c-4c82-a4f0-8189bd3fb1fa tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.186489 Oct 03 11:21:04.198152 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3268/6872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:04 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:05.220223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:05.220877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:05.229184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:05.229690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:05.230144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:05.231106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:05.231580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:05.232191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:05.394680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:05.403223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bfce266f-8c13-4fbf-a182-de7480663dc2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1341 microversion: 2.1 time: 0.187283 Oct 03 11:21:05.403977 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3605/6873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:05 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:06.430737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:06.431403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:06.438357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:06.438988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:06.439525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:06.440251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:06.440722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:06.441179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:06.601447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:06.611602 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-01f398df-8fc2-496d-8763-03594ae39081 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.186764 Oct 03 11:21:06.612208 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3269/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:06 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:07.636006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:07.636629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:07.643563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:07.644056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:07.644502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:07.645293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:07.645700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:07.646162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:07.783155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:07.792743 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb008364-e193-4216-95be-632a2d63e1ad tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.161163 Oct 03 11:21:07.793164 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3606/6875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:07 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:08.815573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:08.816184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:08.823308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:08.823800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:08.824244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:08.825029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:08.825488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:08.825914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:08.976602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:08.986228 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6bfed11d-bb98-431c-b909-134e6fd77ba7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.174421 Oct 03 11:21:08.992805 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3270/6876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:08 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:10.009878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:10.010782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:10.017474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:10.017977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:10.018427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:10.019137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:10.019601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:10.020063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:10.165130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:10.173537 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f76d7c5e-7ee7-4c32-bc38-58b42775fcc9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.167652 Oct 03 11:21:10.174134 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3607/6877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:10 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:11.198123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:11.198647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:11.205969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:11.206464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:11.206924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:11.207678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:11.208207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:11.208584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:11.346364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:11.355206 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bc13362-70c4-40f0-8369-be7f7779f33f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.161727 Oct 03 11:21:11.355766 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3271/6878] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:11 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:12.379702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:12.380327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:12.388145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:12.388643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:12.389143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:12.389850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:12.390318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:12.390758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:12.535016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:12.543305 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77b55c6c-a80a-4924-89df-b1ca5134d9f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.167483 Oct 03 11:21:12.543892 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3608/6879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:12 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:13.569273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:13.569953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:13.577730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:13.578221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:13.578658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:13.579363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:13.579842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:13.580270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:13.727988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:13.737048 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8cbd3ef9-f58b-4c61-b4aa-d9e5cafcfb36 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.172775 Oct 03 11:21:13.737641 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3272/6880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:13 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:14.760351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:14.761003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:14.768072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:14.768583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:14.769077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:14.769800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:14.770270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:14.770729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:14.912687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:14.921214 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1672d8e3-5c46-4400-ac42-0f2c95754b0b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.165404 Oct 03 11:21:14.921804 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3609/6881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:14 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:15.437591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1be99f91-8c4d-469c-a2b2-9494c687b275 req-5c25d6e2-d398-4dc0-8b3a-833dddc0e1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a745eb7a-055d-4d9d-a033-8eedae89202d", "name": "network-vif-plugged", "status": "completed", "tag": "5bc9cfcd-d1fa-473f-bac4-daddd7f618fd"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:15.451277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1be99f91-8c4d-469c-a2b2-9494c687b275 req-5c25d6e2-d398-4dc0-8b3a-833dddc0e1b1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.451917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1be99f91-8c4d-469c-a2b2-9494c687b275 req-5c25d6e2-d398-4dc0-8b3a-833dddc0e1b1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.452501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1be99f91-8c4d-469c-a2b2-9494c687b275 req-5c25d6e2-d398-4dc0-8b3a-833dddc0e1b1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.468246 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1be99f91-8c4d-469c-a2b2-9494c687b275 req-5c25d6e2-d398-4dc0-8b3a-833dddc0e1b1 service nova] Creating event network-vif-plugged:5bc9cfcd-d1fa-473f-bac4-daddd7f618fd for instance a745eb7a-055d-4d9d-a033-8eedae89202d on n-h1-858383-3 Oct 03 11:21:15.476688 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1be99f91-8c4d-469c-a2b2-9494c687b275 req-5c25d6e2-d398-4dc0-8b3a-833dddc0e1b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043194 Oct 03 11:21:15.478070 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3273/6882] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:21:15.478858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:15.479673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:15.486629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.487171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.487815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.488641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.489221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.489671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.627563 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ce7fea6-aef9-488c-9aa8-960391b2b0fa tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1834 microversion: 2.1 time: 0.153644 Oct 03 11:21:15.628158 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3610/6883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:15 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1834 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:15.651734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:15.652452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:15.658717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.659207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.659649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.660353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.660831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.661390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.810649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:15.821251 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-334464c5-5972-4f37-8f9f-c42f33111534 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1683 microversion: 2.1 time: 0.174170 Oct 03 11:21:15.822061 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3274/6884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:15 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:15.931332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:15.933840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:15.942218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.942808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.943387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.944350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.945001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.945412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:15.945627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.946060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:15.952500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.953036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.953500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:15.954284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:15.954732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:15.955170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:16.063971 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9696ea32-e0fb-446a-9b3d-f5931776086e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action" status: 200 len: 32640 microversion: 2.1 time: 0.136630 Oct 03 11:21:16.064982 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3611/6885] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:21:15 2022] POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action => generated 32640 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:21:16.101321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:16.109832 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-50940e6c-a0fb-4c75-b0b5-7ebfe4c5bf4d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.168579 Oct 03 11:21:16.110414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3275/6886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:15 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:16.257814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:16.258568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:16.266185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:16.266776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:16.267258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:16.268031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:16.268581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:16.269078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:16.374603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9bbc6b84dff24e13b74c5f29ccd05b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c76fd7eafd4605ac3b4c55fcc463cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:16.375218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] flavor_id is None. Assuming migration. {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 11:21:16.375668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:21:16.557531 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [550b53d0-5cd9-45fe-b521-894f231f725e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:21:17.135299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:17.136554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:17.146892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:17.147590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:17.148184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:17.149440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:17.150366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:17.150828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:17.305766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:17.314086 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e1fc8041-74df-467f-a0cd-a4a6202c5416 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1375 microversion: 2.1 time: 0.184205 Oct 03 11:21:17.314663 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3276/6887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:17 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:17.565506 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [550b53d0-5cd9-45fe-b521-894f231f725e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45522. Oct 03 11:21:17.574074 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-56be8d0d-f1db-4c6c-916a-67ddb26789d9 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action" status: 202 len: 0 microversion: 2.1 time: 1.316868 Oct 03 11:21:17.574074 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3612/6888] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:21:16 2022] POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:21:17.587277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:17.587909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:17.594170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:17.594675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:17.595112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:17.595823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:17.596403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:17.596752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:17.766347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:17.775604 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fcb31b4d-0335-4862-9ed0-f3568be2bd5c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1692 microversion: 2.1 time: 0.194218 Oct 03 11:21:17.776231 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3277/6889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:17 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:18.340156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:18.340578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:18.346912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.347422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.347879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.348602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.349112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.349538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.500110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:18.510005 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c02598e-5f1c-47f9-9983-d286dd511154 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1563 microversion: 2.1 time: 0.176491 Oct 03 11:21:18.510611 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3613/6890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:18 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:18.534483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:18.535097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:18.544647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.545186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.545621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.546325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.546786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.547214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.710827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:18.721463 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-35ded6b6-89e1-411b-87e0-6c33e9b4f373 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1563 microversion: 2.1 time: 0.190982 Oct 03 11:21:18.722150 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3278/6891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:18 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:18.804694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:18.805275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:18.808502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:18.809036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:18.813477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.814104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.814788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.815714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.815850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.816208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.816319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.816647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.816943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.817449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.817872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.818299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.845878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:21:18.931519 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40da7f90-66df-4dd9-a45e-2e7c28735b34 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 204 len: 0 microversion: 2.1 time: 0.126853 Oct 03 11:21:18.932437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3279/6892] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:21:18 2022] DELETE /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:21:18.942479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:18.943483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:18.951074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.951636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.952146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.953058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:18.953533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:18.954087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:18.975762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:18.984532 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f08e1459-9a53-4574-9cbe-e2fb45626286 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1692 microversion: 2.1 time: 0.185033 Oct 03 11:21:18.985193 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3614/6893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:18 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:19.106614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:19.114504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52fbcf85-90f7-4d2e-8c76-4f29902ebcb7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1569 microversion: 2.1 time: 0.177517 Oct 03 11:21:19.115114 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3280/6894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:18 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:20.009161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:20.009876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:20.017787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:20.018298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:20.018756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:20.019483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:20.019963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:20.020411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:20.138567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:20.139182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:20.150598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:20.151639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:20.152044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:20.152854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:20.153550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:20.154159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:20.348020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:20.350589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:20.358734 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3836bb1e-3b18-49fb-8d38-fb88b1129044 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1569 microversion: 2.1 time: 0.223765 Oct 03 11:21:20.372801 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3281/6895] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:20 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:20.514147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:20.523672 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-88b81cb3-ca70-406d-9e7d-114951ed7d27 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1692 microversion: 2.1 time: 0.518563 Oct 03 11:21:20.524258 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3615/6896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:20 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1692 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:21.363561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0602e909-356d-445e-be4d-c95bf54e048a req-e0857383-253a-4b11-bea7-2b8ffc3ba44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a745eb7a-055d-4d9d-a033-8eedae89202d", "name": "network-vif-deleted", "tag": "5bc9cfcd-d1fa-473f-bac4-daddd7f618fd"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:21.375572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0602e909-356d-445e-be4d-c95bf54e048a req-e0857383-253a-4b11-bea7-2b8ffc3ba44c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:21.376075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0602e909-356d-445e-be4d-c95bf54e048a req-e0857383-253a-4b11-bea7-2b8ffc3ba44c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:21.376524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0602e909-356d-445e-be4d-c95bf54e048a req-e0857383-253a-4b11-bea7-2b8ffc3ba44c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:21.384867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:21.385648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:21.395047 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0602e909-356d-445e-be4d-c95bf54e048a req-e0857383-253a-4b11-bea7-2b8ffc3ba44c service nova] Creating event network-vif-deleted:5bc9cfcd-d1fa-473f-bac4-daddd7f618fd for instance a745eb7a-055d-4d9d-a033-8eedae89202d on n-h1-858383-3 Oct 03 11:21:21.395788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:21.396490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:21.398340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:21.399158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:21.399867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:21.400378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:21.402668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0602e909-356d-445e-be4d-c95bf54e048a req-e0857383-253a-4b11-bea7-2b8ffc3ba44c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042983 Oct 03 11:21:21.405535 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3282/6897] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:21:21.502496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:21.511915 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-da539d7d-c4c4-47a2-bcfe-e2a74c4e9e9f tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1527 microversion: 2.1 time: 0.132670 Oct 03 11:21:21.512931 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3616/6898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:21 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1527 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:21.550876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:21.551832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:21.558418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:21.558920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:21.559365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:21.560084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:21.560543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:21.561002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:21.707556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:21.716287 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a161e00e-1c0b-40e1-84a0-14398595db49 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.169910 Oct 03 11:21:21.716891 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3283/6899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:21 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:22.536081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:22.536709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:22.544435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:22.545007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:22.545808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:22.547064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:22.547580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:22.548040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:22.618748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:22.627059 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c93fc822-1cec-4b6c-81d7-e50e6ff718d4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1360 microversion: 2.1 time: 0.094886 Oct 03 11:21:22.640794 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3617/6900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:22 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1360 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:22.740832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:22.741487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:22.748305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:22.748824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:22.749266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:22.749963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:22.750418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:22.750844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:22.892715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:22.905543 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5aedc8b3-ed2b-4610-82d5-6af0ba2bbe9f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.168623 Oct 03 11:21:22.906137 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3284/6901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:22 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:23.652226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:23.653133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:23.659720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:23.660214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:23.660656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:23.661400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:23.661859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:23.662322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:23.678100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:23.727832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:23.736956 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4342a69d-72d8-49d7-97c6-9f6762f8de26 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1360 microversion: 2.1 time: 0.088709 Oct 03 11:21:23.737537 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3618/6902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:23 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:23.933287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:23.933898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:23.941137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:23.941605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:23.942059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:23.942839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:23.943326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:23.943751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:24.089006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:24.098049 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40bc2ed7-1e0c-47a3-be0a-fdb3ed319d81 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.169559 Oct 03 11:21:24.098742 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3285/6903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:23 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:24.759781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:24.760526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:24.769656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:24.770575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:24.770936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:24.772369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:24.773041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:24.773493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:24.848014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:24.857381 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-492454b2-778c-45f5-abbf-ec43348cf890 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1360 microversion: 2.1 time: 0.101632 Oct 03 11:21:24.858162 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3619/6904] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:24 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1360 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:25.127123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:25.128235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:25.135598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:25.136112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:25.136535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:25.137261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:25.137738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:25.138163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:25.310661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:25.320551 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0031117e-306f-43fd-a214-cf1289cc9265 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.200687 Oct 03 11:21:25.321610 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3286/6905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:25 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:25.883267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:25.884895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:25.893058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:25.893573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:25.894031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:25.894792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:25.895339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:25.895858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:25.937186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:25.938033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:25.938607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:25.939125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lazy-loading 'fault' on Instance uuid a745eb7a-055d-4d9d-a033-8eedae89202d {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:21:25.988985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:26.000661 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4155d877-5f3b-45dd-af37-a938064caf22 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 200 len: 1365 microversion: 2.1 time: 0.122273 Oct 03 11:21:26.001537 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3620/6906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:25 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:26.355610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:26.356503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:26.373073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:26.374040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:26.374708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:26.375285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:26.375928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:26.376235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:26.579232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:26.590494 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e11171f-ea82-4020-b2e6-aaeb29f81b28 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.242648 Oct 03 11:21:26.591089 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3287/6907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:26 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:27.026708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:27.027562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:27.036009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:27.036786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:27.038187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:27.038926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:27.039483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:27.039896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:27.061222 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d HTTP/1.1 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a745eb7a-055d-4d9d-a033-8eedae89202d'} Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:27.063553 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-552e74fe-c33d-420a-9f5f-db373340e052 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 404 len: 111 microversion: 2.1 time: 0.045623 Oct 03 11:21:27.071148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3621/6908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:27 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:21:27.614762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:27.615382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:27.623101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:27.623603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:27.624053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:27.624791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:27.625315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:27.626038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:27.786076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:27.795137 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-76b514cc-5e1f-43ba-bfa2-ac81ef227b8d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.184303 Oct 03 11:21:27.795750 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3288/6909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:27 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:28.821633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:28.822265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:28.829341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:28.829846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:28.830309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:28.831028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:28.831500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:28.831955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:28.973966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:28.982763 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1799a06-6b4f-460a-b344-8682532faf4e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.165682 Oct 03 11:21:28.983339 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3622/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:28 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:30.010863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:30.011470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:30.014463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:30.019552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:30.020052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:30.020500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:30.021229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:30.021717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:30.022139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:30.166247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:30.174492 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bcc2b2b-35c7-4477-9df0-be7a829ee29d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.168218 Oct 03 11:21:30.175120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3289/6911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:30 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:31.199220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:31.199772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:31.202559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=44 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:31.207886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:31.208388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:31.209492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:31.210215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:31.210707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:31.211134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:31.350895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:31.359385 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06d5730e-c86b-4094-9905-c6de5e34d629 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.164160 Oct 03 11:21:31.359997 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3623/6912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:31 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:31.372193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:31.372786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:31.379636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:31.380119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:31.380709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:31.381511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:31.381995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:31.382422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:31.408125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:21:31.492791 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7483e5f6-639f-427e-bc18-7e23df966d73 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 204 len: 0 microversion: 2.1 time: 0.123896 Oct 03 11:21:31.493430 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3290/6913] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:21:31 2022] DELETE /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:21:31.502721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:31.503358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:31.509638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:31.510137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:31.510591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:31.511300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:31.511768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:31.512210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:31.644909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:31.653468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9499bcbe-fbb7-4b10-99ea-152ded8709d7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1410 microversion: 2.1 time: 0.155549 Oct 03 11:21:31.654109 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3624/6914] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:31 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1410 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:32.385396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:32.386393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:32.392796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:32.393290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:32.393726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:32.394412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:32.394867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:32.395292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:32.529690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:32.538028 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65064c6a-2875-4c63-9dbf-07f3bd0a9eb1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.158135 Oct 03 11:21:32.538597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3291/6915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:32 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:32.678593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:32.679162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:32.686292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:32.686785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:32.687245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:32.687960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:32.688429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:32.688903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:32.829772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:32.837921 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32007404-1830-4e98-a74f-3a3211b2000d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1410 microversion: 2.1 time: 0.164090 Oct 03 11:21:32.838559 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3625/6916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:32 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:33.537961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c3d30a0d-7769-4605-ae26-ef281d229362 req-b2a804b1-822f-45eb-8123-0eb9c89b65f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ef1a20-c377-40bd-a073-83086dcd3988", "name": "network-vif-deleted", "tag": "dfc72d4a-9456-4f8c-bd43-280451d88c4b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:33.549352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c3d30a0d-7769-4605-ae26-ef281d229362 req-b2a804b1-822f-45eb-8123-0eb9c89b65f2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:33.549352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c3d30a0d-7769-4605-ae26-ef281d229362 req-b2a804b1-822f-45eb-8123-0eb9c89b65f2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:33.549924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c3d30a0d-7769-4605-ae26-ef281d229362 req-b2a804b1-822f-45eb-8123-0eb9c89b65f2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:33.562967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:33.563183 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c3d30a0d-7769-4605-ae26-ef281d229362 req-b2a804b1-822f-45eb-8123-0eb9c89b65f2 service nova] Creating event network-vif-deleted:dfc72d4a-9456-4f8c-bd43-280451d88c4b for instance 00ef1a20-c377-40bd-a073-83086dcd3988 on n-h2-858383-3 Oct 03 11:21:33.563793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:33.569058 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c3d30a0d-7769-4605-ae26-ef281d229362 req-b2a804b1-822f-45eb-8123-0eb9c89b65f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034948 Oct 03 11:21:33.573236 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3292/6917] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:21:33.573405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:33.573848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:33.574311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:33.575146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:33.575661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:33.576113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:33.726838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:33.735409 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-45b25ba9-2f39-4f40-903c-1825335511ba tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.176881 Oct 03 11:21:33.735929 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3626/6918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:33 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:33.862773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:33.863844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:33.875077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:33.876020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:33.876669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:33.878074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:33.878994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:33.879680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:33.952528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:33.962373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19a5b383-b40c-4b8c-bc72-b2786155c4b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1202 microversion: 2.1 time: 0.104139 Oct 03 11:21:33.962973 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3293/6919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:33 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:34.759774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:34.760394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:34.767560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:34.768059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:34.768541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:34.769277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:34.769752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:34.770179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:34.918768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:34.926976 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca28c9aa-9be9-4315-a1ec-86c58ec74792 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.171735 Oct 03 11:21:34.928449 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3627/6920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:34 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:34.985109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:34.985732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:34.993526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:34.994021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:34.994466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:34.995519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:34.995987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:34.996421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:35.065328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:35.076337 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-136ec170-8445-4071-ad3f-31b2ac35283b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1202 microversion: 2.1 time: 0.095221 Oct 03 11:21:35.076942 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3294/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:34 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:35.951565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:35.952231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:35.960207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:35.960710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:35.961197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:35.961921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:35.962390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:35.962833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:36.100163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:36.100794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:36.107710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:36.108199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:36.109307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:36.109457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:36.109828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:36.110259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:36.129088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:36.138106 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7caf1121-6362-461f-9e70-c3c20201caa8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.190498 Oct 03 11:21:36.138704 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3628/6922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:35 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:36.176384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:36.186252 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7510ea38-0f2a-4662-9de3-35f7f11ef9ac tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1202 microversion: 2.1 time: 0.089766 Oct 03 11:21:36.186796 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3295/6923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:36 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:37.162834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:37.163365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:37.170464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:37.170887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:37.171343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:37.172059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:37.172526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:37.173007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:37.211378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:37.212251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:37.220611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:37.221130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:37.221569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:37.222304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:37.222756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:37.223179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:37.290716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:37.299584 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3a27fc76-90c3-4657-8ef5-89782b97409c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 200 len: 1202 microversion: 2.1 time: 0.092498 Oct 03 11:21:37.317107 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3296/6924] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:37 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:37.343826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:37.353077 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e3d8a35-2fce-4b4b-a013-77d408f4c43e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.194677 Oct 03 11:21:37.353677 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3629/6925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:37 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:38.327740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:38.328744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:38.353392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:38.354953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:38.355454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:38.356649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:38.357189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:38.357610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:38.376428 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 HTTP/1.1 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '00ef1a20-c377-40bd-a073-83086dcd3988'} Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:38.378407 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:38.383212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:38.383212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:38.383212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:38.383212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:21:38.383212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:21:38.383212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:38.383212 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:38.383677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:38.383677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:38.385222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:21:38.386458 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e4c44d17-90db-4b92-9db2-73bb4e78b663 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 404 len: 111 microversion: 2.1 time: 0.064301 Oct 03 11:21:38.387540 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3297/6926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:38 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:21:38.392463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:38.393821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:38.394882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:38.395915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:38.396555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:38.397665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:38.562740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:38.578191 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-48386845-a50a-400f-894f-ce278ea2ef6b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1697 microversion: 2.1 time: 0.204292 Oct 03 11:21:38.593869 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3630/6927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:38 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1697 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:21:39.014643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-52c2da62-bdc8-44b5-acdb-676f67befe27 req-562215e4-f1d7-4f3c-a3cc-622c23126898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "name": "network-vif-unplugged", "status": "completed", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:39.025284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-52c2da62-bdc8-44b5-acdb-676f67befe27 req-562215e4-f1d7-4f3c-a3cc-622c23126898 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:39.025875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-52c2da62-bdc8-44b5-acdb-676f67befe27 req-562215e4-f1d7-4f3c-a3cc-622c23126898 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:39.026300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-52c2da62-bdc8-44b5-acdb-676f67befe27 req-562215e4-f1d7-4f3c-a3cc-622c23126898 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:39.040001 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-52c2da62-bdc8-44b5-acdb-676f67befe27 req-562215e4-f1d7-4f3c-a3cc-622c23126898 service nova] Creating event network-vif-unplugged:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h2-858383-3 Oct 03 11:21:39.045924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-52c2da62-bdc8-44b5-acdb-676f67befe27 req-562215e4-f1d7-4f3c-a3cc-622c23126898 service nova] Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:21:39.057677 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-52c2da62-bdc8-44b5-acdb-676f67befe27 req-562215e4-f1d7-4f3c-a3cc-622c23126898 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047044 Oct 03 11:21:39.058593 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3298/6928] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:21:39.606337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:39.607316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:39.615380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:39.616251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:39.617165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:39.618241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:39.618945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:39.619725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:39.794113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:39.803956 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad16772a-8f8c-492f-b5e2-a8abf82cd17b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1696 microversion: 2.1 time: 0.201740 Oct 03 11:21:39.804916 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3631/6929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:39 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:40.829840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:40.830580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:40.837946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:40.838414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:40.838909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:40.839562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:40.840018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:40.840447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:40.843209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:40.988500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:40.997252 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c938ee62-aa41-4fa7-beb0-ef1c155b0fc7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1694 microversion: 2.1 time: 0.172581 Oct 03 11:21:40.997851 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3299/6930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:40 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:41.074913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-9c894669-bf7b-4d7e-a795-1f1169574cf1 req-7b3b7cfc-2329-4325-827a-52df76fd3682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:41.086190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9c894669-bf7b-4d7e-a795-1f1169574cf1 req-7b3b7cfc-2329-4325-827a-52df76fd3682 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:41.086690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9c894669-bf7b-4d7e-a795-1f1169574cf1 req-7b3b7cfc-2329-4325-827a-52df76fd3682 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:41.087060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-9c894669-bf7b-4d7e-a795-1f1169574cf1 req-7b3b7cfc-2329-4325-827a-52df76fd3682 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:41.100334 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-9c894669-bf7b-4d7e-a795-1f1169574cf1 req-7b3b7cfc-2329-4325-827a-52df76fd3682 service nova] Creating event network-changed:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h2-858383-3 Oct 03 11:21:41.106103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-9c894669-bf7b-4d7e-a795-1f1169574cf1 req-7b3b7cfc-2329-4325-827a-52df76fd3682 service nova] Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:21:41.118557 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-9c894669-bf7b-4d7e-a795-1f1169574cf1 req-7b3b7cfc-2329-4325-827a-52df76fd3682 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047321 Oct 03 11:21:41.119576 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3632/6931] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:21:41.635287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:41.636084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:41.643320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:41.644029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:41.644692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:41.645719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:41.647714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:41.648465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:41.665408 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d HTTP/1.1 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'a745eb7a-055d-4d9d-a033-8eedae89202d'} Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:21:41.667099 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:21:41.670552 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1996c1d2-f396-4e27-8050-1236dfbfe743 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 404 len: 111 microversion: 2.1 time: 0.037668 Oct 03 11:21:41.675050 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3300/6932] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:21:41 2022] DELETE /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:21:41.679543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:41.680281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: a745eb7a-055d-4d9d-a033-8eedae89202d] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:41.689277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:41.689795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:41.690250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:41.691148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:41.691628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:41.692077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:41.707791 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d HTTP/1.1 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'a745eb7a-055d-4d9d-a033-8eedae89202d'} Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:41.710151 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.713690 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:41.713690 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:41.713690 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:41.713690 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:21:41.713690 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:21:41.713690 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. Oct 03 11:21:41.713690 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:41.716676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance a745eb7a-055d-4d9d-a033-8eedae89202d could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:21:41.717287 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a4212a9-3e44-4dd5-b3c3-fe48cf668b56 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d" status: 404 len: 111 microversion: 2.1 time: 0.042987 Oct 03 11:21:41.718201 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3633/6933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:41 2022] GET /compute/v2.1/servers/a745eb7a-055d-4d9d-a033-8eedae89202d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:21:42.021031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:42.022423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:42.033339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.038437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.039080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.040014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.040648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.043793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.173707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:42.174214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:42.182061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.182560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.183010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.183719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.184182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.184619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.201100 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 HTTP/1.1 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '00ef1a20-c377-40bd-a073-83086dcd3988'} Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:21:42.202738 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b457138c-5362-4f56-8295-bc59d6ac1daf tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 404 len: 111 microversion: 2.1 time: 0.034292 Oct 03 11:21:42.206493 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3634/6934] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:21:42 2022] DELETE /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:21:42.215650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:42.216387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 00ef1a20-c377-40bd-a073-83086dcd3988] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:42.223234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.223731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.224372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.225086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.225601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.226207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.244695 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 HTTP/1.1 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '00ef1a20-c377-40bd-a073-83086dcd3988'} Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:21:42.246367 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 00ef1a20-c377-40bd-a073-83086dcd3988 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5fa2cba-620f-45e8-be8a-ca7d3e8bd8d9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988" status: 404 len: 111 microversion: 2.1 time: 0.038432 Oct 03 11:21:42.250443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3635/6935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:42 2022] GET /compute/v2.1/servers/00ef1a20-c377-40bd-a073-83086dcd3988 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:21:42.327783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-082e94c2-efa5-470f-8921-adb8432aae6b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: .version_select at 0x7f074df9c9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-129416654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKldBbDdOei0z3nSnVub0eCVTHQ8Qbt+oU4sw5eXFRh+33u31/5bdhhVOelkvfXviN1ZNUKyM50y4FqdFrkWattEdVz98uSNM8m0+bOSG1kxnOmLR/Sq+vMVeM6ML8tUHA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:42.344598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-082e94c2-efa5-470f-8921-adb8432aae6b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:21:42.350762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-082e94c2-efa5-470f-8921-adb8432aae6b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:21:42.355721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:42.365404 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ca51b266-e621-4504-bcbd-3ddedb8f6b89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1691 microversion: 2.1 time: 0.347930 Oct 03 11:21:42.366560 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3301/6936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:42 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1691 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:42.381277 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-082e94c2-efa5-470f-8921-adb8432aae6b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.056565 Oct 03 11:21:42.391145 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3636/6937] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:21:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:21:42.391456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:42.391456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:42.398642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.399070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.399703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.400640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.401129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.401566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.520821 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dad909bf-4de9-4b72-bb36-bf0086ec817f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action" status: 202 len: 0 microversion: 2.1 time: 0.134647 Oct 03 11:21:42.521441 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3302/6938] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:21:42 2022] POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:21:42.530026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:42.530913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:42.538688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.539522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.539976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.540977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:42.541640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:42.542242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:42.749099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:42.758581 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b79c929-6d24-4bff-9a7b-85afe37258fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1690 microversion: 2.1 time: 0.232489 Oct 03 11:21:42.760267 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3637/6939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:42 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:43.784629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:43.785334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:43.792389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:43.792784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:43.793224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:43.794117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:43.794459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:43.794890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:43.955388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:43.967646 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16fd1a82-ca5c-4230-b9d5-18f73f452c1d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1690 microversion: 2.1 time: 0.188171 Oct 03 11:21:43.968863 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3303/6940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:43 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:45.000504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:45.001164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:45.008754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:45.009980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:45.009980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:45.010730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:45.011214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:45.011664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:45.176401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:45.179634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:21:45.189268 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a541479-33ce-4d78-9678-82973af9b9d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1690 microversion: 2.1 time: 0.192535 Oct 03 11:21:45.205511 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3638/6941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:44 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:46.194870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4f67240a-1774-4e5a-bba5-461eff8ad593 req-c42a1f97-0c3c-413f-b591-1a3abf40a833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:46.205739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4f67240a-1774-4e5a-bba5-461eff8ad593 req-c42a1f97-0c3c-413f-b591-1a3abf40a833 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:46.206223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4f67240a-1774-4e5a-bba5-461eff8ad593 req-c42a1f97-0c3c-413f-b591-1a3abf40a833 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:46.206854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4f67240a-1774-4e5a-bba5-461eff8ad593 req-c42a1f97-0c3c-413f-b591-1a3abf40a833 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:46.220968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:46.222684 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4f67240a-1774-4e5a-bba5-461eff8ad593 req-c42a1f97-0c3c-413f-b591-1a3abf40a833 service nova] Creating event network-changed:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h1-858383-3 Oct 03 11:21:46.223232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:46.229303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-4f67240a-1774-4e5a-bba5-461eff8ad593 req-c42a1f97-0c3c-413f-b591-1a3abf40a833 service nova] Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:21:46.239403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:46.240295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:46.241088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:46.242417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:46.243505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:46.243714 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4f67240a-1774-4e5a-bba5-461eff8ad593 req-c42a1f97-0c3c-413f-b591-1a3abf40a833 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052864 Oct 03 11:21:46.244448 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3304/6942] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:21:46.245173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:46.433257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:46.443955 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f80fcc3-b8c6-4967-b807-a17b62fb6be3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1690 microversion: 2.1 time: 0.233775 Oct 03 11:21:46.444931 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3639/6943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:46 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:47.491015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:47.491726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:47.498389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:47.498879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:47.499517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:47.500230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:47.500868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:47.501482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:47.664632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:47.672918 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e2f5178-c4fe-4bb5-88c7-54050b206334 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1690 microversion: 2.1 time: 0.188924 Oct 03 11:21:47.673511 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3305/6944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:47 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:48.696875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:48.697657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:48.704729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:48.705252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:48.705705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:48.706409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:48.706876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:48.707315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:48.853769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:48.862383 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b089abb3-c2c9-4940-9529-95bdc96aa005 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1690 microversion: 2.1 time: 0.169444 Oct 03 11:21:48.863200 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3640/6945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:48 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:49.886321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:49.887092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:49.894235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:49.894841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:49.895337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:49.896042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:49.896494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:49.897075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:50.126550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:50.134752 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-693c36d6-2d95-47ae-8696-906a19eafc2e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1690 microversion: 2.1 time: 0.252240 Oct 03 11:21:50.135436 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3306/6946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:49 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1690 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:51.163083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:21:51.164318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:21:51.174524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:51.175034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:51.175498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:51.176231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:51.177568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:51.178131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:51.355838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:21:51.368689 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7aab158c-d889-4fe6-a8d8-5f613e0b1731 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1683 microversion: 2.1 time: 0.212711 Oct 03 11:21:51.369495 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3641/6947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:21:51 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:21:53.692049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-14018f83-8cae-48c3-872f-58c77482de46 req-90526298-33c8-4a18-b7f4-2f5f35eab2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "name": "network-vif-plugged", "status": "completed", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:53.705794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-14018f83-8cae-48c3-872f-58c77482de46 req-90526298-33c8-4a18-b7f4-2f5f35eab2de service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:21:53.707064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-14018f83-8cae-48c3-872f-58c77482de46 req-90526298-33c8-4a18-b7f4-2f5f35eab2de service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:21:53.707512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-14018f83-8cae-48c3-872f-58c77482de46 req-90526298-33c8-4a18-b7f4-2f5f35eab2de service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:21:53.723581 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-14018f83-8cae-48c3-872f-58c77482de46 req-90526298-33c8-4a18-b7f4-2f5f35eab2de service nova] Creating event network-vif-plugged:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h1-858383-3 Oct 03 11:21:53.729371 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-14018f83-8cae-48c3-872f-58c77482de46 req-90526298-33c8-4a18-b7f4-2f5f35eab2de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041931 Oct 03 11:21:53.730216 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3307/6948] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:21:59.943463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1296613194", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-129416654", "security_groups": [{"name": "tempest-secgroup-smoke-1035910451"}], "block_device_mapping_v2": [{"uuid": "d3d5ade5-0a8f-4cba-9093-192720f90868", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:21:59.953879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:00.059766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:22:00.445152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:22:00.445590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:22:00.446075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:22:00.446497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:22:00.447052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:22:00.456110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:00.456606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:00.457091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:00.457830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:00.458302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:00.458742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:00.475687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:22:00.481006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:22:00.538963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:22:00.541242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3d5ade5-0a8f-4cba-9093-192720f90868',volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:22:00.671504 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-662ee7f8-9e02-42e2-9c6b-8d734039b640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.732189 Oct 03 11:22:00.672168 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3642/6949] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:21:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:22:00.684064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dba4c465-2790-4171-bb03-3bc23b4f17b2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:00.684755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dba4c465-2790-4171-bb03-3bc23b4f17b2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:00.701124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:00.769180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dba4c465-2790-4171-bb03-3bc23b4f17b2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:00.778412 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dba4c465-2790-4171-bb03-3bc23b4f17b2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1094 microversion: 2.1 time: 0.098409 Oct 03 11:22:00.779734 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3308/6950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:00 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:01.805223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:01.805891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:01.808982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:01.813604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:01.814114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:01.814835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:01.815448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:01.816013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:01.816455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:01.898174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:01.906696 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b50c8cd7-7ad2-4470-9d3c-7b2d09ce83a4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1210 microversion: 2.1 time: 0.107889 Oct 03 11:22:01.907282 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3643/6951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:01 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:02.933331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:02.934418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:02.948655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:02.949389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:02.949990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:02.950861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:02.951320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:02.951745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:03.147300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:03.155151 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5433b1f1-5ef1-4f95-9ae2-2ee2c9bfeb33 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1278 microversion: 2.1 time: 0.228839 Oct 03 11:22:03.155726 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3309/6952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:02 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:03.232721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6d2bc172-ba0c-488b-a779-59b1ee8137d4 req-a112cd01-5a1a-464b-ab1c-52fd725b25ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d4d4f0-be66-4ea2-b0e5-cc91760d1108", "tag": "fd763220-bacb-42fd-b1d0-167db4726d79"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:03.244535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6d2bc172-ba0c-488b-a779-59b1ee8137d4 req-a112cd01-5a1a-464b-ab1c-52fd725b25ef service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:03.245073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6d2bc172-ba0c-488b-a779-59b1ee8137d4 req-a112cd01-5a1a-464b-ab1c-52fd725b25ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:03.245519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6d2bc172-ba0c-488b-a779-59b1ee8137d4 req-a112cd01-5a1a-464b-ab1c-52fd725b25ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:03.258166 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6d2bc172-ba0c-488b-a779-59b1ee8137d4 req-a112cd01-5a1a-464b-ab1c-52fd725b25ef service nova] Creating event network-changed:fd763220-bacb-42fd-b1d0-167db4726d79 for instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 on n-h2-858383-3 Oct 03 11:22:03.263390 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6d2bc172-ba0c-488b-a779-59b1ee8137d4 req-a112cd01-5a1a-464b-ab1c-52fd725b25ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037805 Oct 03 11:22:03.264025 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3644/6953] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:22:04.180796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:04.181485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:04.188718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:04.189269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:04.189713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:04.190548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:04.200466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:04.201003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:04.338264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:04.346357 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-17bb4b53-2358-44b4-8599-943b6cc92f5b tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1278 microversion: 2.1 time: 0.171891 Oct 03 11:22:04.346935 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3310/6954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:04 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:05.370395 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:05.371114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:05.377431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:05.377941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:05.378394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:05.379104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:05.379571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:05.380016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:05.519032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:05.531361 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0d07ad66-a1cf-441f-87ed-3e11671fc640 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1278 microversion: 2.1 time: 0.165958 Oct 03 11:22:05.531978 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3645/6955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:05 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:06.555705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:06.556317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:06.562582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:06.563062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:06.563508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:06.564190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:06.564731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:06.565184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:06.706338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:06.714842 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f9dbb331-ee65-4858-8c4d-e416a0be2316 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1278 microversion: 2.1 time: 0.164853 Oct 03 11:22:06.715647 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3311/6956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:06 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:07.738371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:07.739009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:07.746405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:07.746907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:07.747359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:07.748066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:07.748587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:07.749058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:07.883546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:07.891382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-de9fc547-d013-4cd1-8d88-97d408bba214 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.156906 Oct 03 11:22:07.891958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3646/6957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:07 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:08.913834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:08.914548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:08.921446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:08.921957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:08.922362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:08.923196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:08.923645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:08.924154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:09.057812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:09.065561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e1829b7-b933-4544-8c86-6bb41aa61796 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.155558 Oct 03 11:22:09.066130 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3312/6958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:08 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:22:10.088108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:10.088818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:10.095639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:10.096134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:10.096584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:10.097312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:10.097777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:10.098218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:10.232682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:10.240599 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e05a71f4-0a81-4357-9be0-f7c7fee7a033 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.156395 Oct 03 11:22:10.241231 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3647/6959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:10 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:11.263077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:11.263753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:11.266535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:11.272692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:11.273206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:11.273642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:11.274343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:11.274866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:11.275306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:11.277992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:11.412511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:11.420473 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-263064f4-22f9-468a-9f8b-56d3b88bcda3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.161278 Oct 03 11:22:11.421095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3313/6960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:11 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:12.443476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:12.444123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:12.446995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:12.447695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:12.454504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:12.455020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:12.455520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:12.456240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:12.456709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:12.457189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:12.589413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:12.597108 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caf35f9f-e234-4d26-809f-18d6674d3f6a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.157539 Oct 03 11:22:12.597683 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3648/6961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:12 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:13.619817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:13.620427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:13.627379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:13.627867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:13.628315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:13.629034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:13.629498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:13.629927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:13.763973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:13.772226 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7713aa7-a493-4ad1-81d0-0dbf77477904 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.156286 Oct 03 11:22:13.772806 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3314/6962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:13 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:14.794963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:14.795775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:14.803451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:14.803958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:14.804422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:14.805175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:14.805655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:14.806104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:14.953698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:14.961883 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-784f7993-49e3-4149-972b-098abd8773eb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.170728 Oct 03 11:22:14.962279 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3649/6963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:14 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:15.984154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:15.984761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:15.992049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:15.992527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:15.993069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:15.993748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:15.994198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:15.994618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:16.124937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:16.132567 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4231cc75-6f65-4d5c-929d-725475adb180 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.152264 Oct 03 11:22:16.133167 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3315/6964] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:15 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:16.791942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fd74d2c0-0376-4bd5-b381-2731d5716804 req-7282ebed-9506-4e1d-869a-2a2d11d16ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d4d4f0-be66-4ea2-b0e5-cc91760d1108", "name": "network-vif-plugged", "status": "completed", "tag": "fd763220-bacb-42fd-b1d0-167db4726d79"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:16.803305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fd74d2c0-0376-4bd5-b381-2731d5716804 req-7282ebed-9506-4e1d-869a-2a2d11d16ee5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:16.803801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fd74d2c0-0376-4bd5-b381-2731d5716804 req-7282ebed-9506-4e1d-869a-2a2d11d16ee5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:16.804255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fd74d2c0-0376-4bd5-b381-2731d5716804 req-7282ebed-9506-4e1d-869a-2a2d11d16ee5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:16.808195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=60 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:16.816403 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fd74d2c0-0376-4bd5-b381-2731d5716804 req-7282ebed-9506-4e1d-869a-2a2d11d16ee5 service nova] Creating event network-vif-plugged:fd763220-bacb-42fd-b1d0-167db4726d79 for instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 on n-h2-858383-3 Oct 03 11:22:16.821498 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fd74d2c0-0376-4bd5-b381-2731d5716804 req-7282ebed-9506-4e1d-869a-2a2d11d16ee5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033385 Oct 03 11:22:16.822110 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3650/6965] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:22:17.155173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:17.155778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:17.163484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:17.164331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:17.164571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:17.165297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:17.165758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:17.166185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:17.297640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:17.305725 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fcde38b4-2d1b-4a61-848f-99887d930ed5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1266 microversion: 2.1 time: 0.154450 Oct 03 11:22:17.306299 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3316/6966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:17 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:18.330275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:18.330986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:18.337734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:18.338226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:18.338673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:18.339368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:18.339830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:18.340266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:18.475411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:18.483225 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f05513f-291d-4c59-8565-2ad85fe457f9 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1453 microversion: 2.1 time: 0.158226 Oct 03 11:22:18.483799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3651/6967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:18 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:22:18.505505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:18.506132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:18.512983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:18.513465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:18.513902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:18.514590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:18.515046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:18.515472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:18.645765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:18.653605 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0055e662-c364-4390-b170-2369abb2c708 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1453 microversion: 2.1 time: 0.151905 Oct 03 11:22:18.654176 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3317/6968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:18 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:20.258460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fd947277-9562-4272-874a-8667efe20431 req-522cd091-b204-4a4b-88c8-b501ae8ac782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d4d4f0-be66-4ea2-b0e5-cc91760d1108", "tag": "fd763220-bacb-42fd-b1d0-167db4726d79"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:20.268493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fd947277-9562-4272-874a-8667efe20431 req-522cd091-b204-4a4b-88c8-b501ae8ac782 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:20.269033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fd947277-9562-4272-874a-8667efe20431 req-522cd091-b204-4a4b-88c8-b501ae8ac782 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:20.269702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fd947277-9562-4272-874a-8667efe20431 req-522cd091-b204-4a4b-88c8-b501ae8ac782 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:20.284341 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fd947277-9562-4272-874a-8667efe20431 req-522cd091-b204-4a4b-88c8-b501ae8ac782 service nova] Creating event network-changed:fd763220-bacb-42fd-b1d0-167db4726d79 for instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 on n-h2-858383-3 Oct 03 11:22:20.290534 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fd947277-9562-4272-874a-8667efe20431 req-522cd091-b204-4a4b-88c8-b501ae8ac782 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035999 Oct 03 11:22:20.291138 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3652/6969] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:22:23.614430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:23.617378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:23.624407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:23.624938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:23.625382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:23.626071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:23.626531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:23.626955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:23.699105 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6756eb3d-d0f3-4239-b2b7-eb23630d9f5b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action" status: 200 len: 63053 microversion: 2.1 time: 0.088282 Oct 03 11:22:23.699704 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3318/6970] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:22:23 2022] POST /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2/action => generated 63053 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:22:40.232448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=19 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:40.233300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=9 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:40.362347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:40.363117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:40.370197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:40.370694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:40.371149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:40.371855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:40.372321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:40.372790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:40.520726 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf1b6001-9349-4b5a-bc42-baf0806023bc tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1834 microversion: 2.1 time: 0.291061 Oct 03 11:22:40.521442 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3653/6971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:40 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1834 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:41.469838 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:41.471117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6e6507e0-a892-44f2-9da3-a6773e32385b req-9b093463-2c7c-42fd-b948-84bd931f6dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:41.471668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:41.475939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=23 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:41.477387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=33 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:41.483735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6507e0-a892-44f2-9da3-a6773e32385b req-9b093463-2c7c-42fd-b948-84bd931f6dbc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:41.484234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6507e0-a892-44f2-9da3-a6773e32385b req-9b093463-2c7c-42fd-b948-84bd931f6dbc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:41.484719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6e6507e0-a892-44f2-9da3-a6773e32385b req-9b093463-2c7c-42fd-b948-84bd931f6dbc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:41.489206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:41.490116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:41.490731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:41.492595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:41.493345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:41.494227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:41.498859 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6e6507e0-a892-44f2-9da3-a6773e32385b req-9b093463-2c7c-42fd-b948-84bd931f6dbc service nova] Creating event network-changed:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h1-858383-3 Oct 03 11:22:41.505534 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6e6507e0-a892-44f2-9da3-a6773e32385b req-9b093463-2c7c-42fd-b948-84bd931f6dbc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038599 Oct 03 11:22:41.506250 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3654/6972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:22:41.531147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:22:41.645786 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ff8b6be-cd71-4376-be6f-9ddf469043f5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 204 len: 0 microversion: 2.1 time: 0.180888 Oct 03 11:22:41.647066 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3319/6973] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:22:41 2022] DELETE /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:22:41.657761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:41.658949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:41.667830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:41.668916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:41.669607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:41.670558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:41.671236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:41.671896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:41.830514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:41.838832 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a215b1e0-0b52-44c2-bdb2-ad7791417340 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1689 microversion: 2.1 time: 0.187258 Oct 03 11:22:41.839416 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3655/6974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:41 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:42.863629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:42.864495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:42.872163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:42.872646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:42.873120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:42.873827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:42.874492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:42.874696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:43.030251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:43.038407 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aba02ef9-edb5-4d02-8d3e-788a27f620d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1689 microversion: 2.1 time: 0.178969 Oct 03 11:22:43.038993 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3320/6975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:42 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:43.726751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-35f68736-aeb3-4d1f-8bfa-dedebe884b77 req-7300247c-a9ca-45ef-b7c0-b7cdd9dc29f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2", "name": "network-vif-deleted", "tag": "6bac84a6-c892-41c3-9feb-999fb279101e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:43.737289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-35f68736-aeb3-4d1f-8bfa-dedebe884b77 req-7300247c-a9ca-45ef-b7c0-b7cdd9dc29f1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:43.737781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-35f68736-aeb3-4d1f-8bfa-dedebe884b77 req-7300247c-a9ca-45ef-b7c0-b7cdd9dc29f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:43.738245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-35f68736-aeb3-4d1f-8bfa-dedebe884b77 req-7300247c-a9ca-45ef-b7c0-b7cdd9dc29f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:43.750358 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-35f68736-aeb3-4d1f-8bfa-dedebe884b77 req-7300247c-a9ca-45ef-b7c0-b7cdd9dc29f1 service nova] Creating event network-vif-deleted:6bac84a6-c892-41c3-9feb-999fb279101e for instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 on n-h1-858383-3 Oct 03 11:22:43.755536 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-35f68736-aeb3-4d1f-8bfa-dedebe884b77 req-7300247c-a9ca-45ef-b7c0-b7cdd9dc29f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032601 Oct 03 11:22:43.757293 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3656/6976] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:22:44.062333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:44.063182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:44.072606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:44.073322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:44.073812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:44.074707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:44.075374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:44.075870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:44.112572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:44.113178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:44.113729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:44.114195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lazy-loading 'fault' on Instance uuid 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:22:44.168581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:44.176877 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c22154b2-4eca-43de-a150-0580710731df tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 200 len: 1357 microversion: 2.1 time: 0.119290 Oct 03 11:22:44.177463 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3321/6977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:44 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 1357 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:45.202535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:45.203221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:45.210629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:45.211360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:45.211588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:45.212335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:45.212886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:45.213356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:45.227892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] HTTP exception thrown: Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 could not be found. Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Request method failure captured: Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 HTTP/1.1 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTJX3me0ubgizALUMdHyD1Cm6Q07-p4WZHzszlZB8YEt9Nq7i2P1ClQ4xFbzLCdsQ5UL88hVP8HmaVFl6M5wMElRf5imNdRyYZ1IG2kIYmjxRrRhnCxuRQA5Vsoty-UKFenbZfiouTOk3PswpcCO3UBWSmKTL2i_yYd8TWbmOUwN9w Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}] Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 23c88a45a2c143cdab0a44ebf2022171 Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 could not be found. Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2'} Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 could not be found. Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 could not be found. Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:22:45.229615 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 could not be found. Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Returning 404 to user: Instance 67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-01b15c33-20f9-4e8e-b51f-523c5d825d21 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2" status: 404 len: 111 microversion: 2.1 time: 0.033042 Oct 03 11:22:45.233198 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3657/6978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:45 2022] GET /compute/v2.1/servers/67c7408f-d0e9-4306-80b5-c1cd4b2ac0c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:22:48.335444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e70d74b1-153f-4f69-975e-e64750615296 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '.version_select at 0x7f074dfb7670>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:48.340946 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e70d74b1-153f-4f69-975e-e64750615296 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:22:49.352570 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [None req-e70d74b1-153f-4f69-975e-e64750615296 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45998. Oct 03 11:22:49.372480 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e70d74b1-153f-4f69-975e-e64750615296 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1332482285" status: 202 len: 0 microversion: 2.1 time: 1.041885 Oct 03 11:22:49.373125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3322/6979] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 3 11:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1332482285 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:22:49.412020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f58c615-459b-411a-9733-f4f5c62b13ee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: .version_select at 0x7f074dc8cc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1891115446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqYuWf2FIv/dv2jZqxEQXr80FpBtmJni0toVc8l0s59laiFtC3xYA24/m4jq1Ml88HLwzMDJJzxVQr+vqwzB297AWqGPKMG00BBJUG+RGkhDYfp5u0OS+6Hsncg+oGxnA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:49.430110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3f58c615-459b-411a-9733-f4f5c62b13ee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:22:49.435306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3f58c615-459b-411a-9733-f4f5c62b13ee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:22:49.458260 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f58c615-459b-411a-9733-f4f5c62b13ee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050141 Oct 03 11:22:49.458862 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3658/6980] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:22:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:22:55.251737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:55.258048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-813217607", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "bded47fd-5369-4556-a537-b3ae3debd212"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1891115446", "security_groups": [{"name": "tempest-secgroup-smoke-411849367"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:55.418144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] validate_networks() for [('bded47fd-5369-4556-a537-b3ae3debd212', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:22:55.915165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:22:55.915709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:22:55.916243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:22:55.916758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:22:55.917259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:22:55.926987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:55.927591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:55.928120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:55.929282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:55.930350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:55.930950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:55.950579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:22:55.956070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:22:55.969934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:22:55.972287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:22:56.024343 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a8cb8c4-a29d-44a8-958f-6408ac9972a2 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.773889 Oct 03 11:22:56.025650 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3323/6981] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:22:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:22:56.035226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=18 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:22:56.040112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b88d6b3-6b74-4f95-8b92-ee4139ebbab1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:56.040809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b88d6b3-6b74-4f95-8b92-ee4139ebbab1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:56.111834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8b88d6b3-6b74-4f95-8b92-ee4139ebbab1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:56.120880 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b88d6b3-6b74-4f95-8b92-ee4139ebbab1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1266 microversion: 2.1 time: 0.087502 Oct 03 11:22:56.121481 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3659/6982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:56 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:22:57.146527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:57.147470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:57.155296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:57.155953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:57.156498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:57.157333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:57.157888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:57.158452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:57.276137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:57.287722 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3fb4ef97-7a6f-40ba-adf7-013c601a858b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1326 microversion: 2.1 time: 0.144945 Oct 03 11:22:57.291617 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3324/6983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:57 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:58.318033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:58.318807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:58.328441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:58.328985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:58.329441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:58.330169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:58.330632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:58.331071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:58.491420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:58.501784 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-926ac141-59af-4ff4-aab1-05a16bf5ceff tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1391 microversion: 2.1 time: 0.187298 Oct 03 11:22:58.503103 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3660/6984] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:58 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:22:59.261023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9428f9a4-d39d-468f-bcf3-0d924cb12b70 req-3444c7da-8a63-487e-a781-7c567b671525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489c255a-2262-4126-9bfb-cad292a5695a", "tag": "9de5068c-87e2-465f-8b66-ccf19f81b37d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:22:59.270406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9428f9a4-d39d-468f-bcf3-0d924cb12b70 req-3444c7da-8a63-487e-a781-7c567b671525 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:59.270879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9428f9a4-d39d-468f-bcf3-0d924cb12b70 req-3444c7da-8a63-487e-a781-7c567b671525 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:59.271374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9428f9a4-d39d-468f-bcf3-0d924cb12b70 req-3444c7da-8a63-487e-a781-7c567b671525 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:59.285233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9428f9a4-d39d-468f-bcf3-0d924cb12b70 req-3444c7da-8a63-487e-a781-7c567b671525 service nova] Creating event network-changed:9de5068c-87e2-465f-8b66-ccf19f81b37d for instance 489c255a-2262-4126-9bfb-cad292a5695a on n-h1-858383-3 Oct 03 11:22:59.290395 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9428f9a4-d39d-468f-bcf3-0d924cb12b70 req-3444c7da-8a63-487e-a781-7c567b671525 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106860 Oct 03 11:22:59.291001 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3325/6985] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:22:59.525550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:22:59.526301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:22:59.533309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:59.533805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:59.534258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:59.534964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:22:59.535435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:22:59.535874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:22:59.677025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:22:59.685652 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2402933d-f088-4518-8243-067b8f03e3d0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1391 microversion: 2.1 time: 0.164007 Oct 03 11:22:59.686268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3661/6986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:22:59 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:00.710134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:00.710977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:00.717407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:00.717962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:00.718464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:00.719219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:00.719743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:00.720232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:00.854472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:00.862159 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c59649b2-1248-48ad-9ad2-29044fe41395 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1391 microversion: 2.1 time: 0.157210 Oct 03 11:23:00.862731 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3326/6987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:00 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:01.886597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:01.887177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:01.895756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:01.896261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:01.896716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:01.897473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:01.898504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:01.898958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:02.043360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:02.051318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c2d7464-0a3b-4e49-befc-f419592bffd9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1391 microversion: 2.1 time: 0.169207 Oct 03 11:23:02.051887 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3662/6988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:01 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:03.074195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:03.074810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:03.081483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:03.081978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:03.082415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:03.083102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:03.083558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:03.083986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:03.223539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:03.231720 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-52a16c1c-b791-41fa-ae65-a71ca1d9098b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1391 microversion: 2.1 time: 0.161467 Oct 03 11:23:03.232288 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3327/6989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:03 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:03.940339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4d6942f9-85f9-4865-b8f0-56cd637f0f5a req-ef432bbb-35d0-4de2-a07e-18a9e8117d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489c255a-2262-4126-9bfb-cad292a5695a", "name": "network-vif-plugged", "status": "completed", "tag": "9de5068c-87e2-465f-8b66-ccf19f81b37d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:23:03.952075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4d6942f9-85f9-4865-b8f0-56cd637f0f5a req-ef432bbb-35d0-4de2-a07e-18a9e8117d0a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:03.952646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4d6942f9-85f9-4865-b8f0-56cd637f0f5a req-ef432bbb-35d0-4de2-a07e-18a9e8117d0a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:03.953305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4d6942f9-85f9-4865-b8f0-56cd637f0f5a req-ef432bbb-35d0-4de2-a07e-18a9e8117d0a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:03.964712 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4d6942f9-85f9-4865-b8f0-56cd637f0f5a req-ef432bbb-35d0-4de2-a07e-18a9e8117d0a service nova] Creating event network-vif-plugged:9de5068c-87e2-465f-8b66-ccf19f81b37d for instance 489c255a-2262-4126-9bfb-cad292a5695a on n-h1-858383-3 Oct 03 11:23:03.969908 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4d6942f9-85f9-4865-b8f0-56cd637f0f5a req-ef432bbb-35d0-4de2-a07e-18a9e8117d0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033495 Oct 03 11:23:03.970694 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3663/6990] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:23:04.255000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:04.255605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:04.262483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:04.262966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:04.263405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:04.264099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:04.264557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:04.265029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:04.400699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:04.408414 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b1298aa0-9084-46d5-aa5c-539233dd29ce tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1391 microversion: 2.1 time: 0.157293 Oct 03 11:23:04.409024 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3328/6991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:04 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:05.433948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:05.434734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:05.441059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:05.441556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:05.442006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:05.442706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:05.443486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:05.443826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:05.591074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:05.598926 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-21ede051-11d7-4edd-991b-da1a7fc204d1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1391 microversion: 2.1 time: 0.170889 Oct 03 11:23:05.599498 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3664/6992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:05 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:06.623071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:06.623740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:06.626811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:23:06.627482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:23:06.633763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:06.634245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:06.634682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:06.635372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:06.635976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:06.636509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:06.781459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:06.789572 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4cd1e3e4-099d-4034-8d6a-7a51e4add5d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1562 microversion: 2.1 time: 0.170422 Oct 03 11:23:06.790834 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3329/6993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:06 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:06.813404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:06.814038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:06.816087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:23:06.822370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:06.822876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:06.823333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:06.824080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:06.824560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:06.825034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:06.959778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:06.968509 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a71c3514-769a-443a-891d-ef1315fdff32 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1562 microversion: 2.1 time: 0.159168 Oct 03 11:23:06.969126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3665/6994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:06 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:23:08.536714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:23:08.537735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:08.539169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3aed14a3-c6b5-49c4-bbe0-f6d3eb87fea1 req-75b0b4f5-b39a-4357-9543-bdda27b3ec5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489c255a-2262-4126-9bfb-cad292a5695a", "tag": "9de5068c-87e2-465f-8b66-ccf19f81b37d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:23:08.545072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:08.545824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:08.546266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:08.546966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:08.547418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:08.547841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:08.550662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3aed14a3-c6b5-49c4-bbe0-f6d3eb87fea1 req-75b0b4f5-b39a-4357-9543-bdda27b3ec5d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:08.551426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3aed14a3-c6b5-49c4-bbe0-f6d3eb87fea1 req-75b0b4f5-b39a-4357-9543-bdda27b3ec5d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:08.551946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3aed14a3-c6b5-49c4-bbe0-f6d3eb87fea1 req-75b0b4f5-b39a-4357-9543-bdda27b3ec5d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:08.566944 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3aed14a3-c6b5-49c4-bbe0-f6d3eb87fea1 req-75b0b4f5-b39a-4357-9543-bdda27b3ec5d service nova] Creating event network-changed:9de5068c-87e2-465f-8b66-ccf19f81b37d for instance 489c255a-2262-4126-9bfb-cad292a5695a on n-h1-858383-3 Oct 03 11:23:08.575354 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3aed14a3-c6b5-49c4-bbe0-f6d3eb87fea1 req-75b0b4f5-b39a-4357-9543-bdda27b3ec5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039922 Oct 03 11:23:08.576859 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3666/6995] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:23:08.813785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:23:08.822867 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-de065ed9-f2cc-458a-9d16-2c27a93a1cd5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1562 microversion: 2.1 time: 0.290016 Oct 03 11:23:08.823858 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3330/6996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:23:08 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1562 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:23:44.148561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:23:44.149351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=34 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:23:44.154062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:23:44.156359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:23:44.163712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:44.164241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:44.164696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:44.165434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:23:44.165902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:23:44.167743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:23:44.236363 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2475b244-d0ce-49d6-9b4d-bae3397e854b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action" status: 200 len: 24582 microversion: 2.1 time: 0.089733 Oct 03 11:23:44.237056 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3667/6997] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:23:44 2022] POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action => generated 24582 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:24:16.657723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:16.658470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=40 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:16.712990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:16.713498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:16.720150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:16.720637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:16.721113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:16.721815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:16.722273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:16.722707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:16.746896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:24:16.831519 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3baebe55-367c-44d9-953b-8176b8a3e9be tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 204 len: 0 microversion: 2.1 time: 0.175002 Oct 03 11:24:16.832180 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3331/6998] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:24:16 2022] DELETE /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:24:16.841139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:16.841860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:16.845695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:16.846359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:16.851356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:16.851854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:16.852310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:16.853052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:16.853527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:16.853973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:16.997214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:17.005294 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d5b35a5-c765-4abc-abd6-b75a0de071c0 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1577 microversion: 2.1 time: 0.168517 Oct 03 11:24:17.005854 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3668/6999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:16 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:18.032337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:18.033597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:18.041222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:18.041707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:18.042139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:18.042823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:18.043275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:18.043697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:18.191321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:18.199131 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22020ef5-75d6-4310-badb-fd1ff4b5e8e6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1577 microversion: 2.1 time: 0.173686 Oct 03 11:24:18.200238 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3332/7000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:18 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:19.168980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0287636b-b6c6-4498-8214-a7207e8c8dca req-7182953c-43d3-4df4-99f1-d00fed6189ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d4d4f0-be66-4ea2-b0e5-cc91760d1108", "name": "network-vif-deleted", "tag": "fd763220-bacb-42fd-b1d0-167db4726d79"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:19.180238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0287636b-b6c6-4498-8214-a7207e8c8dca req-7182953c-43d3-4df4-99f1-d00fed6189ed service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:19.180730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0287636b-b6c6-4498-8214-a7207e8c8dca req-7182953c-43d3-4df4-99f1-d00fed6189ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:19.181191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0287636b-b6c6-4498-8214-a7207e8c8dca req-7182953c-43d3-4df4-99f1-d00fed6189ed service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:19.193631 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0287636b-b6c6-4498-8214-a7207e8c8dca req-7182953c-43d3-4df4-99f1-d00fed6189ed service nova] Creating event network-vif-deleted:fd763220-bacb-42fd-b1d0-167db4726d79 for instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 on n-h2-858383-3 Oct 03 11:24:19.198906 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0287636b-b6c6-4498-8214-a7207e8c8dca req-7182953c-43d3-4df4-99f1-d00fed6189ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034249 Oct 03 11:24:19.199548 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3669/7001] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:24:19.223905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:19.224514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:19.232387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:19.233363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:19.233996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:19.235331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:19.235996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:19.236583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:19.327879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:19.337044 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b89e44d6-6191-4a95-8305-1405a2463649 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1225 microversion: 2.1 time: 0.117364 Oct 03 11:24:19.338465 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3333/7002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:19 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:20.362004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:20.362505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:20.369300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:20.369810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:20.370266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:20.370991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:20.372113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:20.372570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:20.436876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:20.444947 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-25459eef-8128-483b-b06c-caf8e5ebd331 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1225 microversion: 2.1 time: 0.089191 Oct 03 11:24:20.445619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3670/7003] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:20 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:21.467850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:21.468393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:21.475524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:21.476019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:21.476463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:21.477203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:21.477667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:21.478099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:21.540630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:21.549039 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22cc0799-fb28-4864-b005-261560f38fc8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1225 microversion: 2.1 time: 0.085087 Oct 03 11:24:21.557980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3334/7004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:21 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:22.573782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:22.576155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:22.583192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:22.583691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:22.584161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:22.585229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:22.585698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:22.586140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:22.652464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:22.661440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-528d366e-bacf-49e8-b632-9d4274083eeb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1225 microversion: 2.1 time: 0.091547 Oct 03 11:24:22.662022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3671/7005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:22 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:23.002480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:23.003063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:23.009811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.010294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.010730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.011422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.011954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.013186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.151822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:23.160190 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee11cbfe-1992-4c7e-b1fa-bf2ab264a8d3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1681 microversion: 2.1 time: 0.161557 Oct 03 11:24:23.160800 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3335/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:22 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:23.264916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:23.267172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:23.273476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.273985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.274452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.275175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.275650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.276098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.344796 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79f52bdd-2e00-4ce8-9c93-11930c3e4571 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action" status: 200 len: 32651 microversion: 2.1 time: 0.083540 Oct 03 11:24:23.347377 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3672/7007] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:24:23 2022] POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action => generated 32651 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:24:23.481931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:23.482536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:23.488633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.489172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.489609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.490293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.490745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.491166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.619818 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2192f1c5-7b2d-4ef0-8a65-49d88f9c296d tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1832 microversion: 2.1 time: 0.142050 Oct 03 11:24:23.624974 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3336/7008] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:23 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1832 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:23.650455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:23.653990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:23.661759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.662314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.662731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.663465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.664038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.664406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.684812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:23.686408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:23.691848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lazy-loading 'flavor' on Instance uuid 489c255a-2262-4126-9bfb-cad292a5695a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:24:23.694703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.695549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.695990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.696893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.697354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.697779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.705006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Going to try to live migrate instance to another host {{(pid=122269) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 11:24:23.731777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:23.732355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:23.732705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:23.733180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lazy-loading 'fault' on Instance uuid 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:24:23.778025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:23.785513 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dbe28794-8999-4e38-bbb0-78fb6d67e698 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 200 len: 1184 microversion: 2.1 time: 0.104562 Oct 03 11:24:23.786243 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3337/7009] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:23 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 1184 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:23.788752 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [550b53d0-5cd9-45fe-b521-894f231f725e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:24:24.796528 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [550b53d0-5cd9-45fe-b521-894f231f725e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46160. Oct 03 11:24:24.809348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:24.810009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:24.816900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:24.817389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:24.817828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:24.818527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:24.818982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:24.819409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:24.835405 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 HTTP/1.1 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '33d4d4f0-be66-4ea2-b0e5-cc91760d1108'} Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:24:24.837019 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8295a45-130b-46eb-b9bc-a784d83d3f99 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 404 len: 111 microversion: 2.1 time: 0.033540 Oct 03 11:24:24.849548 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3338/7010] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:24 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:24:24.887791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1549383807", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-129416654", "security_groups": [{"name": "tempest-secgroup-smoke-1035910451"}], "block_device_mapping_v2": [{"uuid": "d3d5ade5-0a8f-4cba-9093-192720f90868", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:25.010618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:24:25.461806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:24:25.462274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:24:25.462745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:24:25.463155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:24:25.463565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:24:25.473948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:25.474428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:25.474858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:25.475578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:25.476028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:25.476449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:25.494530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:24:25.500716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:24:25.565678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:24:25.567998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3d5ade5-0a8f-4cba-9093-192720f90868',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:24:25.716540 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e777e6bc-a766-4b83-bb44-66befd676382 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.832983 Oct 03 11:24:25.718443 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3339/7011] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:24:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 11:24:25.731041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-953455ab-2127-460b-b74c-8dd0390cc343 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:25.731908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-953455ab-2127-460b-b74c-8dd0390cc343 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:25.835303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-953455ab-2127-460b-b74c-8dd0390cc343 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:25.852732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-953455ab-2127-460b-b74c-8dd0390cc343 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1094 microversion: 2.1 time: 0.127785 Oct 03 11:24:25.853615 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3340/7012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:25 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1094 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:24:26.331080 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-90e668f2-1b5a-4a19-91d7-6545eee67486 tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action" status: 202 len: 0 microversion: 2.1 time: 2.684602 Oct 03 11:24:26.332417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3673/7013] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:24:23 2022] POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action => generated 0 bytes in 2687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:24:26.342040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:26.343101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:26.349794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:26.350289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:26.350733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:26.351448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:26.351911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:26.352345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:26.512235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:26.520156 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24fdebe5-9eec-474a-b5e1-b0c119a85072 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.182735 Oct 03 11:24:26.520728 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3341/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:26 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:24:26.879740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:26.880402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:26.891520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:26.892267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:26.892725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:26.893638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:26.894806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:26.895413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:26.990092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:27.002154 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8077157e-816b-4d6a-a1dc-9bfb4aa66f42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1210 microversion: 2.1 time: 0.127625 Oct 03 11:24:27.014031 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3674/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:26 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1210 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:27.554327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:27.558800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:27.572128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:27.573260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:27.574523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:27.576037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:27.577349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:27.578319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:27.777135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6a72d431-2d20-4833-b48c-154c2a6a2600 req-ed6be102-977a-46e1-b6d2-3159a15dcd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489c255a-2262-4126-9bfb-cad292a5695a", "name": "network-vif-unplugged", "status": "completed", "tag": "9de5068c-87e2-465f-8b66-ccf19f81b37d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:27.794984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6a72d431-2d20-4833-b48c-154c2a6a2600 req-ed6be102-977a-46e1-b6d2-3159a15dcd5c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:27.795486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6a72d431-2d20-4833-b48c-154c2a6a2600 req-ed6be102-977a-46e1-b6d2-3159a15dcd5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:27.795930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6a72d431-2d20-4833-b48c-154c2a6a2600 req-ed6be102-977a-46e1-b6d2-3159a15dcd5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:27.819167 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6a72d431-2d20-4833-b48c-154c2a6a2600 req-ed6be102-977a-46e1-b6d2-3159a15dcd5c service nova] Creating event network-vif-unplugged:9de5068c-87e2-465f-8b66-ccf19f81b37d for instance 489c255a-2262-4126-9bfb-cad292a5695a on n-h1-858383-3 Oct 03 11:24:27.824982 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6a72d431-2d20-4833-b48c-154c2a6a2600 req-ed6be102-977a-46e1-b6d2-3159a15dcd5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050981 Oct 03 11:24:27.826129 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3675/7016] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:24:27.895806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:27.908284 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bbe77f2b-e283-4d56-86f6-d1c79e270667 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.366743 Oct 03 11:24:27.922932 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3342/7017] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:27 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:28.029209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:28.030614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:28.047026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:28.047551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:28.048009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:28.049113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:28.049869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:28.050396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:28.447043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:28.458413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d1a218d1-f454-44ba-b8d4-1a605ddce9b3 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1278 microversion: 2.1 time: 0.435930 Oct 03 11:24:28.459415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3676/7018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:28 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1278 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:28.935920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:28.936438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:28.946547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:28.947057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:28.947505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:28.948206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:28.948856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:28.949621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:29.108861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6b9910c2-1fbd-4033-9378-c4afd8543c99 req-8e7cd7f8-1716-486f-b2ac-690454ce949d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c4f57f-715d-4faf-a9f3-b895da0c731b", "tag": "025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:29.120265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:29.123490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6b9910c2-1fbd-4033-9378-c4afd8543c99 req-8e7cd7f8-1716-486f-b2ac-690454ce949d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:29.125056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6b9910c2-1fbd-4033-9378-c4afd8543c99 req-8e7cd7f8-1716-486f-b2ac-690454ce949d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:29.125748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6b9910c2-1fbd-4033-9378-c4afd8543c99 req-8e7cd7f8-1716-486f-b2ac-690454ce949d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:29.129484 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-476e5aff-008b-4086-a733-cd2a4e527241 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.197844 Oct 03 11:24:29.130142 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3343/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:28 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:29.139753 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6b9910c2-1fbd-4033-9378-c4afd8543c99 req-8e7cd7f8-1716-486f-b2ac-690454ce949d service nova] Creating event network-changed:025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb for instance 36c4f57f-715d-4faf-a9f3-b895da0c731b on n-h2-858383-3 Oct 03 11:24:29.150694 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6b9910c2-1fbd-4033-9378-c4afd8543c99 req-8e7cd7f8-1716-486f-b2ac-690454ce949d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170768 Oct 03 11:24:29.151618 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3677/7020] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:24:29.482255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:29.482888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:29.489193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:29.489694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:29.490565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:29.491276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:29.491742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:29.492183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:29.648798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:29.659167 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e71ed34-f55a-4079-9ea0-43142c48cc62 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1278 microversion: 2.1 time: 0.181216 Oct 03 11:24:29.660803 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3344/7021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:29 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:29.885521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5183fb3c-08c5-4260-817a-32e3bd6ef5b1 req-28c254db-e098-4de2-a72a-7a78e5eef67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489c255a-2262-4126-9bfb-cad292a5695a", "tag": "9de5068c-87e2-465f-8b66-ccf19f81b37d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:29.898531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5183fb3c-08c5-4260-817a-32e3bd6ef5b1 req-28c254db-e098-4de2-a72a-7a78e5eef67a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:29.899098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5183fb3c-08c5-4260-817a-32e3bd6ef5b1 req-28c254db-e098-4de2-a72a-7a78e5eef67a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:29.899787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5183fb3c-08c5-4260-817a-32e3bd6ef5b1 req-28c254db-e098-4de2-a72a-7a78e5eef67a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:29.912865 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5183fb3c-08c5-4260-817a-32e3bd6ef5b1 req-28c254db-e098-4de2-a72a-7a78e5eef67a service nova] Creating event network-changed:9de5068c-87e2-465f-8b66-ccf19f81b37d for instance 489c255a-2262-4126-9bfb-cad292a5695a on n-h1-858383-3 Oct 03 11:24:29.918059 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5183fb3c-08c5-4260-817a-32e3bd6ef5b1 req-28c254db-e098-4de2-a72a-7a78e5eef67a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037273 Oct 03 11:24:29.918903 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3678/7022] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:24:30.156660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:30.157909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:30.165179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:30.165987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:30.166677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:30.167444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:30.168450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:30.168915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:30.391550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:30.401872 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-29ba9613-daa0-4b07-9b68-19fba4d69afb tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.249339 Oct 03 11:24:30.412858 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3345/7023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:30 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:30.685358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:30.686509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:30.694923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:30.695541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:30.696026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:30.696788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:30.697277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:30.697746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:30.853560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:30.862891 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5656cb9e-bbc6-4ec4-aa3e-dc0ff25c4c50 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1278 microversion: 2.1 time: 0.183442 Oct 03 11:24:30.863674 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3679/7024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:30 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:31.427119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:31.427637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:31.435029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:31.435522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:31.435974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:31.436680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:31.437374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:31.437639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:31.584490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:31.592898 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c51d7dc-fffb-4e4e-a3fe-9786df95e3cd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.170063 Oct 03 11:24:31.593487 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3346/7025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:31 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:31.885935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:31.886611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:31.894215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:31.894730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:31.895197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:31.895928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:31.896403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:31.896889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:32.035871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:32.045257 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f602c63-7b3b-4263-9bd3-c74a1cdbfbb4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1278 microversion: 2.1 time: 0.163258 Oct 03 11:24:32.045837 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3680/7026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:31 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:32.616678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:32.617459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:32.624743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:32.625258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:32.625701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:32.626393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:32.626861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:32.627289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:32.766883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:32.770431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:32.776006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab512947-ed2d-4eaa-aab8-4d7f6326ccf9 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.163202 Oct 03 11:24:32.776705 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3347/7027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:32 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:33.068408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:33.069057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:33.075921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:33.076420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:33.076910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:33.077615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:33.078082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:33.078531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:33.215297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:33.223610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e44639dd-775c-4164-9e35-479f802032a1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.158910 Oct 03 11:24:33.223979 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3681/7028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:33 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:33.799677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:33.800391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:33.808131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:33.808604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:33.809350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:33.810080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:33.810545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:33.810980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:34.036439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:34.044196 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33b2bcd0-f325-463f-9e7e-578c03887252 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.248620 Oct 03 11:24:34.044785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3348/7029] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:33 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:34.248167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:34.249101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:34.256622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:34.257390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:34.258016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:34.258728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:34.259529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:34.259978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:34.395721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:34.403617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-909cb6bb-9893-406c-80e6-dc1b6c28637d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.159981 Oct 03 11:24:34.404193 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3682/7030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:34 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:35.068157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:35.068855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:35.076729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:35.077234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:35.077671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:35.078371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:35.078829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:35.079252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:35.217270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:35.225432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-910b028c-13a5-4397-9578-0e4e0283619d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1691 microversion: 2.1 time: 0.161126 Oct 03 11:24:35.225965 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3349/7031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:35 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:35.426943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:35.428210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:35.435738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:35.436239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:35.436688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:35.437479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:35.437949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:35.438386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:35.572847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:35.582917 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-561b2052-36bf-4141-b564-bc53280c10d2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.159493 Oct 03 11:24:35.583550 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3683/7032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:35 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:36.249486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:36.250100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:36.252266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:36.252980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:36.259537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.260030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.260473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.261215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.261686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.262130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.404663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:36.412411 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-10721bb4-18e1-4f5f-b933-e79a1ed68c89 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1681 microversion: 2.1 time: 0.167571 Oct 03 11:24:36.413032 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3350/7033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:36 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:36.436217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:36.436863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:36.443682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.444208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.444943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.445541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.446006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.446444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.575554 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5947ff0e-e7b1-43f9-acfa-5e4a0b4a0b3f tempest-TestNetworkAdvancedServerOps-1605353578 tempest-TestNetworkAdvancedServerOps-1605353578-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1832 microversion: 2.1 time: 0.142924 Oct 03 11:24:36.576152 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3684/7034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:36 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1832 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:36.599486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:36.600444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:36.607188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.607345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:36.607745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.608161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:36.608275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.608970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.609431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.609860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.616433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.617018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.617472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.618183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.618653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.619087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.746955 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:36.754868 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2a804970-3a93-43d7-bcc2-c6a3b08e70ad tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1681 microversion: 2.1 time: 0.159180 Oct 03 11:24:36.755447 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3351/7035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:36 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:36.762437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:36.766099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:36.771153 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ab6fa3f-80e8-4078-90f6-0de345039d15 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.168999 Oct 03 11:24:36.771729 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3685/7036] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:36 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:36.851782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:36.854122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:36.860356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.860881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.861324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.862023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:36.862480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:36.862905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:36.913653 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cef29893-3f44-4ef4-92e7-c49f597bf6fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action" status: 200 len: 38433 microversion: 2.1 time: 0.065658 Oct 03 11:24:36.914298 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3352/7037] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:24:36 2022] POST /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a/action => generated 38433 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:24:37.795294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:37.795917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:37.804539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:37.805070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:37.805521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:37.806338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:37.806807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:37.807244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:37.911387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:37.911985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:37.920922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:37.921418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:37.921860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:37.922571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:37.923024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:37.923451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:37.949436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:37.953872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:24:37.957702 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-737d0341-c9b7-4666-a005-3b9693cc859e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.166797 Oct 03 11:24:37.958286 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3686/7038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:37 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:37.963154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b8005157-4fd0-44be-8551-2da510d53842 req-529a06a0-3ae9-4097-8d59-ab40971d0989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489c255a-2262-4126-9bfb-cad292a5695a", "tag": "9de5068c-87e2-465f-8b66-ccf19f81b37d"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:37.973918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b8005157-4fd0-44be-8551-2da510d53842 req-529a06a0-3ae9-4097-8d59-ab40971d0989 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:37.974435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b8005157-4fd0-44be-8551-2da510d53842 req-529a06a0-3ae9-4097-8d59-ab40971d0989 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:37.974998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b8005157-4fd0-44be-8551-2da510d53842 req-529a06a0-3ae9-4097-8d59-ab40971d0989 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:37.987135 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b8005157-4fd0-44be-8551-2da510d53842 req-529a06a0-3ae9-4097-8d59-ab40971d0989 service nova] Creating event network-changed:9de5068c-87e2-465f-8b66-ccf19f81b37d for instance 489c255a-2262-4126-9bfb-cad292a5695a on n-h2-858383-3 Oct 03 11:24:37.993293 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b8005157-4fd0-44be-8551-2da510d53842 req-529a06a0-3ae9-4097-8d59-ab40971d0989 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032617 Oct 03 11:24:37.993541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3687/7039] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:24:38.044293 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e8b9db63-2817-4be2-9b63-a2f168a908ca tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 204 len: 0 microversion: 2.1 time: 0.136740 Oct 03 11:24:38.044910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3353/7040] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:24:37 2022] DELETE /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:24:38.054082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:38.054802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:38.061020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:38.061520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:38.061976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:38.062686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:38.063157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:38.063599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:38.206822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:38.216067 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-db8c0f9c-dcfa-443a-99c6-b288d28e6cc0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1687 microversion: 2.1 time: 0.166156 Oct 03 11:24:38.216903 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3688/7041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:38 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:24:38.982191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:38.982911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:38.990026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:38.990518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:38.990961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:38.991656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:38.992116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:38.992549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:39.200587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:39.208995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41a82bc7-68ce-45ff-a327-cad8797c7018 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.231499 Oct 03 11:24:39.209583 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3354/7042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:38 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:39.241114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:39.241840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:39.249767 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:39.250298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:39.250737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:39.251456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:39.251930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:39.252375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:39.286358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:39.286863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:39.287312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:39.288042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lazy-loading 'fault' on Instance uuid 489c255a-2262-4126-9bfb-cad292a5695a {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:24:39.332490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:39.341961 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-29a41c8d-d774-43c9-a8db-df0da17d997d tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 200 len: 1356 microversion: 2.1 time: 0.104883 Oct 03 11:24:39.342466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3689/7043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:39 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:40.007362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-a9b34236-8202-4d1e-a567-e3653206d672 req-eb72eec5-0579-49bb-8117-88a3536d0cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489c255a-2262-4126-9bfb-cad292a5695a", "name": "network-vif-deleted", "tag": "9de5068c-87e2-465f-8b66-ccf19f81b37d"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:40.017932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a9b34236-8202-4d1e-a567-e3653206d672 req-eb72eec5-0579-49bb-8117-88a3536d0cc2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:40.018402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a9b34236-8202-4d1e-a567-e3653206d672 req-eb72eec5-0579-49bb-8117-88a3536d0cc2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:40.018831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-a9b34236-8202-4d1e-a567-e3653206d672 req-eb72eec5-0579-49bb-8117-88a3536d0cc2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:40.030681 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-a9b34236-8202-4d1e-a567-e3653206d672 req-eb72eec5-0579-49bb-8117-88a3536d0cc2 service nova] Creating event network-vif-deleted:9de5068c-87e2-465f-8b66-ccf19f81b37d for instance 489c255a-2262-4126-9bfb-cad292a5695a on n-h2-858383-3 Oct 03 11:24:40.035520 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-a9b34236-8202-4d1e-a567-e3653206d672 req-eb72eec5-0579-49bb-8117-88a3536d0cc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Oct 03 11:24:40.036094 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3355/7044] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:24:40.233069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:40.233695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:40.239723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:40.240216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:40.240695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:40.241422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:40.241975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:40.242307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:40.366413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:40.367110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: 489c255a-2262-4126-9bfb-cad292a5695a] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:40.373818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:40.374304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:40.374801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:40.375511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:40.375966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:40.376404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:40.378582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:40.387754 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eca60e46-ebf5-4352-89c9-b4042cf2c580 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.158881 Oct 03 11:24:40.388438 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3690/7045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:40 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:40.391149 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] HTTP exception thrown: Instance 489c255a-2262-4126-9bfb-cad292a5695a could not be found. Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Request method failure captured: Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a HTTP/1.1 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTJX3me0ubgizALUMdHyD1Cm6Q07-p4WZHzszlZB8YEt9Nq7i2P1ClQ4xFbzLCdsQ5UL88hVP8HmaVFl6M5wMElRf5imNdRyYZ1IG2kIYmjxRrRhnCxuRQA5Vsoty-UKFenbZfiouTOk3PswpcCO3UBWSmKTL2i_yYd8TWbmOUwN9w Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}] Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 23c88a45a2c143cdab0a44ebf2022171 Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 489c255a-2262-4126-9bfb-cad292a5695a could not be found. Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '489c255a-2262-4126-9bfb-cad292a5695a'} Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489c255a-2262-4126-9bfb-cad292a5695a could not be found. Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489c255a-2262-4126-9bfb-cad292a5695a could not be found. Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:40.392827 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489c255a-2262-4126-9bfb-cad292a5695a could not be found. Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Returning 404 to user: Instance 489c255a-2262-4126-9bfb-cad292a5695a could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf3ee5d7-2602-4558-951b-4e8235d76e1e tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a" status: 404 len: 111 microversion: 2.1 time: 0.032218 Oct 03 11:24:40.397201 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3356/7046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:40 2022] GET /compute/v2.1/servers/489c255a-2262-4126-9bfb-cad292a5695a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:24:41.413471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:41.414823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:41.428093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:41.428881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:41.429565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:41.430522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:41.431192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:41.431849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:41.440061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-83e84dd1-7a12-477d-a2d9-a0d9c34bc937 req-e1821f7f-39b3-4511-9be4-7d4d0b043d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4f57f-715d-4faf-a9f3-b895da0c731b", "name": "network-vif-plugged", "status": "completed", "tag": "025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:41.461744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-83e84dd1-7a12-477d-a2d9-a0d9c34bc937 req-e1821f7f-39b3-4511-9be4-7d4d0b043d48 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:41.466431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-83e84dd1-7a12-477d-a2d9-a0d9c34bc937 req-e1821f7f-39b3-4511-9be4-7d4d0b043d48 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:41.467099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-83e84dd1-7a12-477d-a2d9-a0d9c34bc937 req-e1821f7f-39b3-4511-9be4-7d4d0b043d48 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:41.487727 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-83e84dd1-7a12-477d-a2d9-a0d9c34bc937 req-e1821f7f-39b3-4511-9be4-7d4d0b043d48 service nova] Creating event network-vif-plugged:025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb for instance 36c4f57f-715d-4faf-a9f3-b895da0c731b on n-h2-858383-3 Oct 03 11:24:41.498579 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-83e84dd1-7a12-477d-a2d9-a0d9c34bc937 req-e1821f7f-39b3-4511-9be4-7d4d0b043d48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062746 Oct 03 11:24:41.499098 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3357/7047] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:24:41.631048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:41.640007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9b259eda-26ea-49c8-9e18-c552437fb94d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.230320 Oct 03 11:24:41.640609 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3691/7048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:41 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:42.663248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:42.664845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:42.674735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:42.675230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:42.675666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:42.676378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:42.676858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:42.677284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:42.852732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:42.861541 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5055d763-b2a9-4f3b-9a61-5f757f177613 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1266 microversion: 2.1 time: 0.202474 Oct 03 11:24:42.862124 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3358/7049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:42 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:43.884682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:43.885382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:43.893453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:43.894004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:43.894408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:43.895126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:43.895595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:43.896041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:43.902469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f6ad377-5fcf-49ba-b931-746510b38fbe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '.version_select at 0x7f074de38a60>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:43.937108 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f6ad377-5fcf-49ba-b931-746510b38fbe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1891115446" status: 202 len: 0 microversion: 2.1 time: 0.038281 Oct 03 11:24:43.938312 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3359/7050] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 3 11:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1891115446 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 11:24:43.969588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3b1fc97c-d032-4272-a506-bcd38880e4fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: .version_select at 0x7f074dd81ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1556718306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqnwdjSvvLE26fJ7loN4g2Hm4PM/8dCwDl6CXqKNkgCdJfVRmyqkeZvcxga6dDqW8lZJ5o56ZBtRl0ws0/YzUgOQrFPQDeAmjq9x7ydfCJTG/atfQ1mYY8FCkz6uY37rQ=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:43.986107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3b1fc97c-d032-4272-a506-bcd38880e4fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:24:43.991487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-3b1fc97c-d032-4272-a506-bcd38880e4fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:24:43.993948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:44.022182 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3b1fc97c-d032-4272-a506-bcd38880e4fd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057498 Oct 03 11:24:44.022713 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3360/7051] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:24:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:24:44.063873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:44.077161 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a18b0e5d-2a4a-457e-90de-9dfbdf034308 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1453 microversion: 2.1 time: 0.196276 Oct 03 11:24:44.078148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3692/7052] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:43 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:44.101966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:44.103046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:44.110787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:44.111291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:44.111735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:44.112449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:44.113328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:44.113845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:44.258492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:44.266548 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8985e19a-7d44-401c-8d36-771b30bf2237 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1453 microversion: 2.1 time: 0.169386 Oct 03 11:24:44.267188 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3361/7053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:44 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:47.040344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-f6373a3d-162d-450c-9d0e-a5273811bf68 req-97e09d1c-a386-431c-8dc7-3b191080b47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c4f57f-715d-4faf-a9f3-b895da0c731b", "tag": "025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:47.047758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=55 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:24:47.054627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f6373a3d-162d-450c-9d0e-a5273811bf68 req-97e09d1c-a386-431c-8dc7-3b191080b47b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:47.055133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f6373a3d-162d-450c-9d0e-a5273811bf68 req-97e09d1c-a386-431c-8dc7-3b191080b47b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:47.055580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-f6373a3d-162d-450c-9d0e-a5273811bf68 req-97e09d1c-a386-431c-8dc7-3b191080b47b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:47.068138 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-f6373a3d-162d-450c-9d0e-a5273811bf68 req-97e09d1c-a386-431c-8dc7-3b191080b47b service nova] Creating event network-changed:025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb for instance 36c4f57f-715d-4faf-a9f3-b895da0c731b on n-h2-858383-3 Oct 03 11:24:47.074364 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-f6373a3d-162d-450c-9d0e-a5273811bf68 req-97e09d1c-a386-431c-8dc7-3b191080b47b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037106 Oct 03 11:24:47.075118 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3693/7054] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:24:51.195653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1725470080", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "31136536-8da9-458f-af62-b73d1c8821cc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1556718306", "security_groups": [{"name": "tempest-secgroup-smoke-997628395"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:51.363345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] validate_networks() for [('31136536-8da9-458f-af62-b73d1c8821cc', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:24:51.885118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:24:51.885819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:24:51.886538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:24:51.887597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:24:51.888238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:24:51.911075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:51.911692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:51.912272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:51.913395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:51.914161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:51.914813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:51.937223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:24:51.944457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Getting quotas for user 23c88a45a2c143cdab0a44ebf2022171 and project 9a21c6fdd814450386af5a1f7c9083a8. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:24:51.958273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:24:51.960916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:24:52.013938 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8f9ec304-51c4-490f-9a79-0b789c16e49b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.823344 Oct 03 11:24:52.027314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1f222da-a8a8-423a-8299-e8b51f6135a8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:52.028145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1f222da-a8a8-423a-8299-e8b51f6135a8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:52.033563 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3362/7055] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:24:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:24:52.091501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f1f222da-a8a8-423a-8299-e8b51f6135a8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:52.102607 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1f222da-a8a8-423a-8299-e8b51f6135a8 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1267 microversion: 2.1 time: 0.080149 Oct 03 11:24:52.103209 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3694/7056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:52 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:53.128548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:53.129445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:53.141992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:53.142781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:53.143399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:53.144311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:53.149370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:53.150075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:53.288887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:53.312792 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a27ef1c4-7b02-46da-895c-6fac23a42775 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1327 microversion: 2.1 time: 0.189031 Oct 03 11:24:53.313401 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3363/7057] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:53 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1327 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:24:54.337609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:54.338290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:54.350268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:54.350812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:54.351272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:54.352005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:54.352482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:54.352974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:54.521089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:54.530646 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbdb5f42-8a3a-46c5-8514-852157e88f8f tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.198477 Oct 03 11:24:54.531446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3695/7058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:54 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:54.936403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-450e6c80-1955-4a24-86fc-3c78fda8ec6e req-2f3344d9-8c52-49c5-89b0-1a3df8b206f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc264f42-7640-4dd1-b71c-057fbf6a38c4", "tag": "699eccf0-b38d-4006-82ae-586579d2d679"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:24:54.947973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-450e6c80-1955-4a24-86fc-3c78fda8ec6e req-2f3344d9-8c52-49c5-89b0-1a3df8b206f1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:54.948381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-450e6c80-1955-4a24-86fc-3c78fda8ec6e req-2f3344d9-8c52-49c5-89b0-1a3df8b206f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:54.948840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-450e6c80-1955-4a24-86fc-3c78fda8ec6e req-2f3344d9-8c52-49c5-89b0-1a3df8b206f1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:54.971549 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-450e6c80-1955-4a24-86fc-3c78fda8ec6e req-2f3344d9-8c52-49c5-89b0-1a3df8b206f1 service nova] Creating event network-changed:699eccf0-b38d-4006-82ae-586579d2d679 for instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 on n-h1-858383-3 Oct 03 11:24:54.976363 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-450e6c80-1955-4a24-86fc-3c78fda8ec6e req-2f3344d9-8c52-49c5-89b0-1a3df8b206f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044304 Oct 03 11:24:54.977671 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3364/7059] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:24:55.555648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:55.556272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:55.563114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:55.563604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:55.564052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:55.564750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:55.565231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:55.565672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:55.703021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:55.710910 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d14990b2-4c94-4c1d-850f-df0a96a0b7e6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.159317 Oct 03 11:24:55.711498 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3696/7060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:55 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:56.736463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:56.737191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:56.743360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:56.743853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:56.744299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:56.745033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:56.745496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:56.745932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:56.880300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:56.888002 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb489db6-a5f1-4b6c-8036-09ebb61869f3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.156672 Oct 03 11:24:56.888575 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3365/7061] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:56 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:57.911576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:57.912210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:57.919320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:57.919823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:57.920276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:57.921007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:57.921483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:57.921922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:58.057196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:58.065635 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3725b0f5-b824-4dcc-9312-6887263734bc tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.158114 Oct 03 11:24:58.066216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3697/7062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:57 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:24:59.091427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:24:59.092049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:24:59.099745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:59.100383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:59.101334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:59.102264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:24:59.102734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:24:59.103170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:24:59.239497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:24:59.248032 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75cd13c3-b78c-49c7-9af6-5d286397da14 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.162934 Oct 03 11:24:59.248653 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3366/7063] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:24:59 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:25:00.271429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:25:00.272087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:00.279035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:00.279540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:00.279993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:00.280708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:00.281295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:00.281730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:00.435286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:25:00.448813 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b9a1a42-1678-408b-8f08-a1a894a49a8a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.180376 Oct 03 11:25:00.450737 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3698/7064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:25:00 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:25:01.474260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:25:01.474878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:01.482571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:01.483057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:01.483498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:01.484198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:01.484649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:01.485100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:01.631817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:25:01.640324 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6dc1464e-6b8c-4ff1-92b4-47d7d960eca5 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.170060 Oct 03 11:25:01.640931 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3367/7065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:25:01 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:25:02.607678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:25:02.664002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:25:02.665302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:02.668237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:25:02.669166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:25:02.669296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-1a8e4710-a503-446e-ab81-f654340da18a req-6aa37816-7eaa-4e6d-b9e1-3b40e5fbcba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc264f42-7640-4dd1-b71c-057fbf6a38c4", "name": "network-vif-plugged", "status": "completed", "tag": "699eccf0-b38d-4006-82ae-586579d2d679"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:25:02.676881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:02.677039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:02.677670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:02.678377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:02.678840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:02.679270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:02.687986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1a8e4710-a503-446e-ab81-f654340da18a req-6aa37816-7eaa-4e6d-b9e1-3b40e5fbcba7 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:02.688437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1a8e4710-a503-446e-ab81-f654340da18a req-6aa37816-7eaa-4e6d-b9e1-3b40e5fbcba7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:02.688949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-1a8e4710-a503-446e-ab81-f654340da18a req-6aa37816-7eaa-4e6d-b9e1-3b40e5fbcba7 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:02.698229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:25:02.701137 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-1a8e4710-a503-446e-ab81-f654340da18a req-6aa37816-7eaa-4e6d-b9e1-3b40e5fbcba7 service nova] Creating event network-vif-plugged:699eccf0-b38d-4006-82ae-586579d2d679 for instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 on n-h1-858383-3 Oct 03 11:25:02.706882 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-1a8e4710-a503-446e-ab81-f654340da18a req-6aa37816-7eaa-4e6d-b9e1-3b40e5fbcba7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104433 Oct 03 11:25:02.707505 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3699/7066] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:25:02.841900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:25:02.850108 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bcad782-dfbf-449f-a94b-b52dc7916987 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.189870 Oct 03 11:25:02.850516 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3368/7067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:25:02 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:25:03.874974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:25:03.875606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:03.883122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:03.883615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:03.884063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:03.884760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:03.885248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:03.885686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:04.024295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:25:04.034657 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-57d49a10-be71-478a-b5ad-944a6768b59b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1392 microversion: 2.1 time: 0.164712 Oct 03 11:25:04.035229 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3700/7068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:25:03 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:25:05.062810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:25:05.063422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:05.070269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:05.070754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:05.071194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:05.071888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:05.072349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:05.072796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:05.210743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:25:05.218552 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48e16aae-ffe8-415f-b623-d373f13e38ae tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1563 microversion: 2.1 time: 0.160136 Oct 03 11:25:05.219168 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3369/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:25:05 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:25:05.241747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:25:05.242379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:05.249853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:05.250354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:05.250808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:05.251513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:05.251982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:05.252423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:05.394490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:25:05.402258 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-20a136f8-7e0b-4dd6-953a-e515bf872605 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1563 microversion: 2.1 time: 0.164510 Oct 03 11:25:05.402833 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3701/7070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:25:05 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:25:07.055804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:25:07.057083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e80ea7db-58ee-4b3a-b26b-23fff5a41d17 req-83d013e1-f270-40f4-9a2b-42b18e80c4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc264f42-7640-4dd1-b71c-057fbf6a38c4", "tag": "699eccf0-b38d-4006-82ae-586579d2d679"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:25:07.057826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:07.066845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:07.067426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:07.068093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:07.068618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e80ea7db-58ee-4b3a-b26b-23fff5a41d17 req-83d013e1-f270-40f4-9a2b-42b18e80c4d9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:07.068967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:07.069151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e80ea7db-58ee-4b3a-b26b-23fff5a41d17 req-83d013e1-f270-40f4-9a2b-42b18e80c4d9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:07.069583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:07.069731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e80ea7db-58ee-4b3a-b26b-23fff5a41d17 req-83d013e1-f270-40f4-9a2b-42b18e80c4d9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:07.070369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:07.082092 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e80ea7db-58ee-4b3a-b26b-23fff5a41d17 req-83d013e1-f270-40f4-9a2b-42b18e80c4d9 service nova] Creating event network-changed:699eccf0-b38d-4006-82ae-586579d2d679 for instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 on n-h1-858383-3 Oct 03 11:25:07.087509 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e80ea7db-58ee-4b3a-b26b-23fff5a41d17 req-83d013e1-f270-40f4-9a2b-42b18e80c4d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033922 Oct 03 11:25:07.088079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3702/7071] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:25:07.314288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:25:07.323598 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c0c3b90e-4955-4e51-b659-43358ef2e729 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1563 microversion: 2.1 time: 0.273120 Oct 03 11:25:07.324717 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3370/7072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:25:07 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1563 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:25:40.644897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=21 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:25:40.645867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=82 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:25:40.650118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:25:40.652429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:25:40.659487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:40.659987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:40.660442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:40.661231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:25:40.661700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:25:40.662142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:25:40.731762 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2b15f133-785e-4583-9513-f80484541a65 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4/action" status: 200 len: 24566 microversion: 2.1 time: 0.088842 Oct 03 11:25:40.733117 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3703/7073] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:25:40 2022] POST /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4/action => generated 24566 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:26:19.777129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:19.777886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:19.782072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:26:19.784835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:19.792682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:19.793218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:19.793664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:19.794366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:19.794826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:19.795770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:20.059647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:26:20.060066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:26:20.060541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:26:20.061016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:26:20.061448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:26:20.130116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:20.139984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:20.140632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:20.140960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:20.141611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:20.142075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:20.151103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:20.188745 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e09246f2-c233-49eb-a279-44f2c351bd93 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4/action" status: 202 len: 1137 microversion: 2.1 time: 0.413498 Oct 03 11:26:20.189448 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3371/7074] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:26:19 2022] POST /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4/action => generated 1137 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 11:26:20.215940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:20.218984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:20.222948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:20.224153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:20.234600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:20.235147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:20.236223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:20.237224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:20.237952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:20.238406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:20.514381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:20.523212 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-518eec1a-34e8-4577-bf60-79209dffeaa3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.314847 Oct 03 11:26:20.534390 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3704/7075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:20 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:21.573062 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:21.573748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:21.583862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:21.584392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:21.585012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:21.587744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:21.588538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:21.588993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:21.775589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:21.789424 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4703f8ab-0e76-42e4-afe4-ae2d6f50baa6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.221916 Oct 03 11:26:21.790014 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3372/7076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:21 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:22.819246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:22.820357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:22.832055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:22.832889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:22.833678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:22.834782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:22.835510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:22.836270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:22.996701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:23.011111 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e502db7-12d2-4f6b-815d-55b3568f13b7 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.196673 Oct 03 11:26:23.025222 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3705/7077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:22 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:24.039798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:24.040914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:24.052456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:24.053289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:24.054043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:24.055190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:24.056013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:24.056780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:24.223412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:24.231187 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dd5c8a3c-3457-48f3-adb7-5daf43027261 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.197710 Oct 03 11:26:24.231910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3373/7078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:24 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:25.255898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:25.256602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:25.264496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:25.265068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:25.265535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:25.266285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:25.266797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:25.267248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:25.424065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:25.431944 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff659a82-7339-40d5-a34d-8583d95dcd12 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.180073 Oct 03 11:26:25.432520 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3706/7079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:25 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:25.832411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-273253608", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-129416654", "security_groups": [{"name": "tempest-secgroup-smoke-1035910451"}], "block_device_mapping_v2": [{"uuid": "dc1f993f-2313-4480-96c6-a4eb96c1e656", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "797d8474-048e-49ff-877d-b858898b7046"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:26:25.949626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] validate_networks() for [('797d8474-048e-49ff-877d-b858898b7046', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:26:26.381363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:26:26.381790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:26:26.382268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:26:26.382704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:26:26.383116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:26:26.392603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:26.393117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:26.393556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:26.394282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:26.394737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:26.395163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:26.411651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:26:26.416893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Getting quotas for user 1c0a399b79464784a4bc3e74a180fde8 and project b99f8293e0e34766a6f8a9f441ecdff5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:26:26.455821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:26.456586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:26.463486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:26.463995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:26.464456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:26.465204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:26.465676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:26.466121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:26.476165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:26:26.478512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc1f993f-2313-4480-96c6-a4eb96c1e656',volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:26:26.609515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:26.617864 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dfe36192-2873-406d-b480-ca4e1cf37e59 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.166596 Oct 03 11:26:26.618541 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3707/7080] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:26 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:26.629155 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6601d413-3f4d-4f63-85a0-0d1b6a9649b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.800410 Oct 03 11:26:26.637205 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3374/7081] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:26:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:26:26.653149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf1510cb-a2a2-4cd9-9fa1-fbb71f53c797 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:26.653812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf1510cb-a2a2-4cd9-9fa1-fbb71f53c797 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:26.707972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf1510cb-a2a2-4cd9-9fa1-fbb71f53c797 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:26.715066 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf1510cb-a2a2-4cd9-9fa1-fbb71f53c797 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1093 microversion: 2.1 time: 0.065870 Oct 03 11:26:26.715645 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3708/7082] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:26 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:27.642991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:27.643600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:27.650674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:27.651219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:27.651658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:27.652351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:27.652830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:27.653256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:27.737768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:27.738416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:27.746976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:27.747492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:27.747962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:27.748711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:27.749218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:27.749665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:27.803917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:27.811975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f755c467-74d9-409b-9000-12076aacb6ea tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.174165 Oct 03 11:26:27.813437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3375/7083] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:27 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:27.819963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:27.828400 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82ffc932-63f1-4931-ab18-9bc35093edbe tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1191 microversion: 2.1 time: 0.094601 Oct 03 11:26:27.829322 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3709/7084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:27 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:28.837370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:28.837974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:28.845882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:28.846646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:28.847298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:28.848199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:28.848874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:28.855518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:28.856827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:28.858607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:28.872203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:28.877981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:28.878698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:28.879715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:28.887962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:28.889578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:29.072508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:29.081309 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b585d61b-affc-4049-bcdd-86242ab97632 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1277 microversion: 2.1 time: 0.229623 Oct 03 11:26:29.083143 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3710/7085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:28 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:29.276176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:29.287478 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b51e655d-5035-477e-b493-009465d6af23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.453909 Oct 03 11:26:29.288301 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3376/7086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:28 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:29.921038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4cc2e8ea-1269-4d50-ad2f-f7d192767a22 req-d589ca5d-12db-4c81-b5fe-2eb9e54e99c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f1ab48-5d86-4f99-8f41-ac286cc4eb91", "tag": "9cdab605-adc7-4e41-88ee-b231709c3f81"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:26:29.937115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4cc2e8ea-1269-4d50-ad2f-f7d192767a22 req-d589ca5d-12db-4c81-b5fe-2eb9e54e99c0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:29.937615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4cc2e8ea-1269-4d50-ad2f-f7d192767a22 req-d589ca5d-12db-4c81-b5fe-2eb9e54e99c0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:29.938059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4cc2e8ea-1269-4d50-ad2f-f7d192767a22 req-d589ca5d-12db-4c81-b5fe-2eb9e54e99c0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:29.950710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4cc2e8ea-1269-4d50-ad2f-f7d192767a22 req-d589ca5d-12db-4c81-b5fe-2eb9e54e99c0 service nova] Creating event network-changed:9cdab605-adc7-4e41-88ee-b231709c3f81 for instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 on n-h2-858383-3 Oct 03 11:26:29.956802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4cc2e8ea-1269-4d50-ad2f-f7d192767a22 req-d589ca5d-12db-4c81-b5fe-2eb9e54e99c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046180 Oct 03 11:26:29.958044 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3711/7087] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:26:30.104825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:30.106130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:30.113676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:30.114204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:30.114629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:30.115332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:30.115790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:30.116216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:30.314808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:30.316027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:30.324424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:30.325005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:30.325423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:30.326191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:30.326851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:30.327295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:30.339101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:30.348823 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f58a56c5-9dc7-45de-b4f1-b20fe4bb6b58 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1277 microversion: 2.1 time: 0.247814 Oct 03 11:26:30.349715 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3377/7088] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:30 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:30.482873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:30.491470 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e9ed7070-738f-49fa-825c-9d3a9e27fad0 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.182210 Oct 03 11:26:30.492076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3712/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:30 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:31.373396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:31.374154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:31.381853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:31.382339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:31.382778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:31.383509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:31.383963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:31.384392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:31.518199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:31.518837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:31.525788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:31.526379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:31.527331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:31.528135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:31.528680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:31.529261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:31.530136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:31.539164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e07d9f8-5481-45db-a519-ee040376c90d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1277 microversion: 2.1 time: 0.170295 Oct 03 11:26:31.539896 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3378/7090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:31 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:31.685108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:31.693700 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77c39040-783b-447d-9be7-2b456e079a23 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.180542 Oct 03 11:26:31.694307 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3713/7091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:31 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:32.563218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:32.563865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:32.570817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:32.571312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:32.571754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:32.572468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:32.573040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:32.573494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:32.718189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:32.718796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:32.721825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:32.726060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:32.726568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:32.727023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:32.727743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:32.728213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:32.728661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:32.730738 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e6c2788-0a60-4957-8a00-298d0e5b8783 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1277 microversion: 2.1 time: 0.171999 Oct 03 11:26:32.747045 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3379/7092] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:32 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:32.874317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:32.882726 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df33c560-05d3-465c-8d97-a70d9ee09749 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.168585 Oct 03 11:26:32.891465 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3714/7093] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:32 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:33.755204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:33.755806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:33.762635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:33.763125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:33.764231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:33.764990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:33.765453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:33.765884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:33.899231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:33.907487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fe289ae6-2156-4914-96c9-96ea6cb0f648 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.156107 Oct 03 11:26:33.907703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:33.908146 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3380/7094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:33 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:33.908247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:33.915239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:33.915748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:33.916213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:33.916984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:33.917460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:33.917907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:34.051283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:34.059104 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b3c6d07-a912-4ba5-acf0-af69485f8cee tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.155599 Oct 03 11:26:34.059682 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3715/7095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:33 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:34.930757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:34.931525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:34.940517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:34.941110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:34.941624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:34.942385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:34.942967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:34.943448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:35.084058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:35.084705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:35.093145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:35.093842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:35.094167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:35.094899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:35.095375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:35.095844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:35.386695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:35.395563 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c0ce867-0608-4cca-b5cf-91b5a4b80198 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.469178 Oct 03 11:26:35.396147 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3381/7096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:34 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:35.506300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:35.514515 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e927cc0-9d8f-48a5-924e-ebd96bfe5c38 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.435123 Oct 03 11:26:35.515097 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3716/7097] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:35 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:36.419238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:36.420356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:36.423260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:36.425052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:36.429881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:36.431031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:36.431479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:36.432192 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:36.432645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:36.433165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:36.538921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:36.539646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:36.547522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:36.548302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:36.548795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:36.549555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:36.550057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:36.550544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:36.596653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:36.606631 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a0ac8933-3987-422a-8a37-bf90ea8a02f1 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.190729 Oct 03 11:26:36.607984 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3382/7098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:36 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:36.698372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:36.707206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-438f16ab-ada2-4e37-a3f2-015f6769affe tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1691 microversion: 2.1 time: 0.172268 Oct 03 11:26:36.707803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3717/7099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:36 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:37.632018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:37.632631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:37.640795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:37.641298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:37.641747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:37.642461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:37.642922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:37.643353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:37.736962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:37.737824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:37.740133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:37.748402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:37.749069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:37.749583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:37.750375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:37.751484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:37.751641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:37.793721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:37.803629 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bdbf27f3-dea8-4bdc-8910-cffa861cb18d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.176139 Oct 03 11:26:37.804362 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3383/7100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:37 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:37.915647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:37.926642 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-46d98a4b-9ae1-413f-b064-a5eef7c7b562 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1697 microversion: 2.1 time: 0.195504 Oct 03 11:26:37.927368 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3718/7101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:37 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:38.828203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:38.828730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:38.835582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:38.836076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:38.836523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:38.837247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:38.837709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:38.838143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:38.956868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:38.957614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:38.965247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:38.965845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:38.966470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:38.967285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:38.967732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:38.968176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:39.117503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:39.126563 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7a01ffc-2456-4f2c-93c2-03b29ef92008 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1697 microversion: 2.1 time: 0.173978 Oct 03 11:26:39.127163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3719/7102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:38 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:39.328190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:39.336120 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-263a6f39-9b63-4f07-aaa5-3dcab8701ee7 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.512446 Oct 03 11:26:39.336702 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3384/7103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:38 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:40.151644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:40.152191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:40.159592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:40.160175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:40.160624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:40.161557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:40.162026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:40.162466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:40.303047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:40.311492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b3f180a-f620-4fb0-8d86-b566bf8afba3 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1697 microversion: 2.1 time: 0.163872 Oct 03 11:26:40.312156 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3720/7104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:40 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:40.359457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:40.360077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:40.366954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:40.367454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:40.367904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:40.368608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:40.369103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:40.369542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:40.501660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:40.510399 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9884ebd-39f9-49f2-aed6-cb2f6c907a8d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.155444 Oct 03 11:26:40.510976 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3385/7105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:40 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:40.941334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7d87925f-03c2-42d3-97cc-0c78788d5326 req-0594ae93-041e-4ac2-92b1-40840084f368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc264f42-7640-4dd1-b71c-057fbf6a38c4", "name": "network-vif-unplugged", "status": "completed", "tag": "699eccf0-b38d-4006-82ae-586579d2d679"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:26:40.951425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7d87925f-03c2-42d3-97cc-0c78788d5326 req-0594ae93-041e-4ac2-92b1-40840084f368 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:40.951870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7d87925f-03c2-42d3-97cc-0c78788d5326 req-0594ae93-041e-4ac2-92b1-40840084f368 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:40.952449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7d87925f-03c2-42d3-97cc-0c78788d5326 req-0594ae93-041e-4ac2-92b1-40840084f368 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:40.964373 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7d87925f-03c2-42d3-97cc-0c78788d5326 req-0594ae93-041e-4ac2-92b1-40840084f368 service nova] Creating event network-vif-unplugged:699eccf0-b38d-4006-82ae-586579d2d679 for instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 on n-h1-858383-3 Oct 03 11:26:40.969901 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7d87925f-03c2-42d3-97cc-0c78788d5326 req-0594ae93-041e-4ac2-92b1-40840084f368 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033578 Oct 03 11:26:40.970714 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3721/7106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:26:41.334809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:41.335491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:41.342348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:41.342847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:41.343299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:41.344016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:41.344484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:41.344982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:41.349361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:41.485331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:41.493398 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-17b43d82-14e1-4353-9cfb-3be303a82ff6 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1682 microversion: 2.1 time: 0.162498 Oct 03 11:26:41.493984 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3386/7107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:41 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:41.536073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:41.536823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:41.543307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:41.543814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:41.544270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:41.545114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:41.545527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:41.545984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:41.692022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:41.695669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=100 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:26:41.701075 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51928b39-1f82-4abb-857c-f4c998fe9be5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.170271 Oct 03 11:26:41.702179 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3722/7108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:41 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:42.734285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:42.734906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:42.741727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:42.742220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:42.742664 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:42.743363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:42.743824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:42.744256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:42.881878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:42.890880 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-60e1961c-b74c-4497-b279-bde17f872932 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.161071 Oct 03 11:26:42.891938 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3387/7109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:42 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:43.914185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:43.914920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:43.924401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:43.924946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:43.925411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:43.926145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:43.926623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:43.927072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:43.928516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b60d4f8c-1614-4719-bb77-8a70b8bbaf2d req-e1869245-930a-4a82-85d2-7489e98817d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f1ab48-5d86-4f99-8f41-ac286cc4eb91", "name": "network-vif-plugged", "status": "completed", "tag": "9cdab605-adc7-4e41-88ee-b231709c3f81"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:26:43.941095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b60d4f8c-1614-4719-bb77-8a70b8bbaf2d req-e1869245-930a-4a82-85d2-7489e98817d5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:43.941938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b60d4f8c-1614-4719-bb77-8a70b8bbaf2d req-e1869245-930a-4a82-85d2-7489e98817d5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:43.942383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b60d4f8c-1614-4719-bb77-8a70b8bbaf2d req-e1869245-930a-4a82-85d2-7489e98817d5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:43.955940 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b60d4f8c-1614-4719-bb77-8a70b8bbaf2d req-e1869245-930a-4a82-85d2-7489e98817d5 service nova] Creating event network-vif-plugged:9cdab605-adc7-4e41-88ee-b231709c3f81 for instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 on n-h2-858383-3 Oct 03 11:26:43.961680 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b60d4f8c-1614-4719-bb77-8a70b8bbaf2d req-e1869245-930a-4a82-85d2-7489e98817d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037551 Oct 03 11:26:43.962892 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3388/7110] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:26:44.080096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:44.088298 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bb3047b7-ef05-49a4-b31c-51e6034b71f6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1265 microversion: 2.1 time: 0.178055 Oct 03 11:26:44.088985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3723/7111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:43 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:26:45.115042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:45.115769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:45.124540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:45.125000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:45.125445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:45.126161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:45.126624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:45.127049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:45.276696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:45.287616 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-84d5a5df-e9c7-4ec1-818c-95b2af41426a tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1453 microversion: 2.1 time: 0.178818 Oct 03 11:26:45.288201 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3389/7112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:45 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:45.310068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:26:45.310690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:26:45.318196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:45.318685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:45.319129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:45.319827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:45.320291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:45.320730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:45.454988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:26:45.462843 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b7150e2-e3d4-4300-af94-322a088c3bd8 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1453 microversion: 2.1 time: 0.156692 Oct 03 11:26:45.463427 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3724/7113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:26:45 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:26:45.979383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-146ad1c5-8a8e-4669-8e45-f835fc3cc30b req-777665a5-4c81-4e29-b571-a3d9128cf42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc264f42-7640-4dd1-b71c-057fbf6a38c4", "name": "network-vif-plugged", "status": "completed", "tag": "699eccf0-b38d-4006-82ae-586579d2d679"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:26:45.988818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-146ad1c5-8a8e-4669-8e45-f835fc3cc30b req-777665a5-4c81-4e29-b571-a3d9128cf42c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:45.989247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-146ad1c5-8a8e-4669-8e45-f835fc3cc30b req-777665a5-4c81-4e29-b571-a3d9128cf42c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:45.989679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-146ad1c5-8a8e-4669-8e45-f835fc3cc30b req-777665a5-4c81-4e29-b571-a3d9128cf42c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:46.001249 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-146ad1c5-8a8e-4669-8e45-f835fc3cc30b req-777665a5-4c81-4e29-b571-a3d9128cf42c service nova] Creating event network-vif-plugged:699eccf0-b38d-4006-82ae-586579d2d679 for instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 on n-h1-858383-3 Oct 03 11:26:46.006478 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-146ad1c5-8a8e-4669-8e45-f835fc3cc30b req-777665a5-4c81-4e29-b571-a3d9128cf42c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031256 Oct 03 11:26:46.007189 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3390/7114] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:26:47.106391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ceeb9040-89a0-4e0c-93a0-8c0edfc20192 req-7d409c13-294b-4fa6-94f2-ec5d65b32a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f1ab48-5d86-4f99-8f41-ac286cc4eb91", "tag": "9cdab605-adc7-4e41-88ee-b231709c3f81"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:26:47.117036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ceeb9040-89a0-4e0c-93a0-8c0edfc20192 req-7d409c13-294b-4fa6-94f2-ec5d65b32a0f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:26:47.117532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ceeb9040-89a0-4e0c-93a0-8c0edfc20192 req-7d409c13-294b-4fa6-94f2-ec5d65b32a0f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:26:47.118067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ceeb9040-89a0-4e0c-93a0-8c0edfc20192 req-7d409c13-294b-4fa6-94f2-ec5d65b32a0f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:26:47.132244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ceeb9040-89a0-4e0c-93a0-8c0edfc20192 req-7d409c13-294b-4fa6-94f2-ec5d65b32a0f service nova] Creating event network-changed:9cdab605-adc7-4e41-88ee-b231709c3f81 for instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 on n-h2-858383-3 Oct 03 11:26:47.137979 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ceeb9040-89a0-4e0c-93a0-8c0edfc20192 req-7d409c13-294b-4fa6-94f2-ec5d65b32a0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 Oct 03 11:26:47.139830 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3725/7115] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:27:15.740629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:27:15.741403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=20 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:27:15.745993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:27:15.748255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:27:15.755991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:15.756471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:15.756965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:15.757650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:15.758111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:15.758535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:15.825146 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0613dbd1-2f6f-42b3-a4b6-b6fb0752d96a tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "POST /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4/action" status: 200 len: 24563 microversion: 2.1 time: 0.086284 Oct 03 11:27:15.825931 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3391/7116] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:27:15 2022] POST /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4/action => generated 24563 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:27:47.207927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:27:47.208517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:27:47.209696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9a647ef5-c50c-4562-9080-76f5d80a3ec1 req-9df1a604-af9a-4108-87fb-64e252d7529c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc264f42-7640-4dd1-b71c-057fbf6a38c4", "tag": "699eccf0-b38d-4006-82ae-586579d2d679"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:27:47.212377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=46 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:27:47.213717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:27:47.216678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:27:47.217602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:27:47.220352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:47.220922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:47.221574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:47.223193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:47.223866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:47.224263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9a647ef5-c50c-4562-9080-76f5d80a3ec1 req-9df1a604-af9a-4108-87fb-64e252d7529c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:47.224392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:47.224750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9a647ef5-c50c-4562-9080-76f5d80a3ec1 req-9df1a604-af9a-4108-87fb-64e252d7529c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:47.225453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9a647ef5-c50c-4562-9080-76f5d80a3ec1 req-9df1a604-af9a-4108-87fb-64e252d7529c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:47.237260 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9a647ef5-c50c-4562-9080-76f5d80a3ec1 req-9df1a604-af9a-4108-87fb-64e252d7529c service nova] Creating event network-changed:699eccf0-b38d-4006-82ae-586579d2d679 for instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 on n-h1-858383-3 Oct 03 11:27:47.243152 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9a647ef5-c50c-4562-9080-76f5d80a3ec1 req-9df1a604-af9a-4108-87fb-64e252d7529c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038670 Oct 03 11:27:47.243852 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3392/7117] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:27:47.258232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:27:47.345013 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59315e97-19d6-4c95-ac22-1434e1a0b7bd tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 204 len: 0 microversion: 2.1 time: 0.142581 Oct 03 11:27:47.349051 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3726/7118] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:27:47 2022] DELETE /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:27:47.358761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:27:47.359542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:27:47.369356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:47.370644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:47.370644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:47.371045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:47.371516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:47.372530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:47.537646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:27:47.546068 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f92b95f9-6fac-4608-acf4-815cc0b1c5c1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1688 microversion: 2.1 time: 0.191661 Oct 03 11:27:47.546660 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3393/7119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:27:47 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:27:48.571830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:27:48.572633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:27:48.579913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:48.580423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:48.581170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:48.581622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:48.582094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:48.582568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:48.716975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:27:48.725248 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-386b49d6-56ff-46c1-a9bf-34422fe6abd1 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1688 microversion: 2.1 time: 0.158011 Oct 03 11:27:48.725821 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3727/7120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:27:48 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:27:49.424356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0cf30185-613a-4ee4-ba56-aec343c6cd1b req-a23f614e-f89a-4b55-8fc0-b6268f404a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc264f42-7640-4dd1-b71c-057fbf6a38c4", "name": "network-vif-deleted", "tag": "699eccf0-b38d-4006-82ae-586579d2d679"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:27:49.434813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0cf30185-613a-4ee4-ba56-aec343c6cd1b req-a23f614e-f89a-4b55-8fc0-b6268f404a8d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:49.435291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0cf30185-613a-4ee4-ba56-aec343c6cd1b req-a23f614e-f89a-4b55-8fc0-b6268f404a8d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:49.435725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0cf30185-613a-4ee4-ba56-aec343c6cd1b req-a23f614e-f89a-4b55-8fc0-b6268f404a8d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:49.450442 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0cf30185-613a-4ee4-ba56-aec343c6cd1b req-a23f614e-f89a-4b55-8fc0-b6268f404a8d service nova] Creating event network-vif-deleted:699eccf0-b38d-4006-82ae-586579d2d679 for instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 on n-h1-858383-3 Oct 03 11:27:49.455623 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0cf30185-613a-4ee4-ba56-aec343c6cd1b req-a23f614e-f89a-4b55-8fc0-b6268f404a8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035274 Oct 03 11:27:49.456243 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3394/7121] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:27:49.750035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:27:49.750672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:27:49.758553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:49.759061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:49.759516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:49.760347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:49.760840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:49.761284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:49.793875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:49.794372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:49.794819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:49.795283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lazy-loading 'fault' on Instance uuid cc264f42-7640-4dd1-b71c-057fbf6a38c4 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:27:49.838116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c88a45a2c143cdab0a44ebf2022171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a21c6fdd814450386af5a1f7c9083a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:27:49.849199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2dff9aa-8548-4861-9f26-0232fdd13a1c tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 200 len: 1357 microversion: 2.1 time: 0.103699 Oct 03 11:27:49.849798 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3728/7122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:27:49 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:27:50.874053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:27:50.874667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [instance: cc264f42-7640-4dd1-b71c-057fbf6a38c4] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:27:50.881473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:50.881958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:50.882393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:50.883085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:27:50.883537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:27:50.883965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:27:50.899855 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] HTTP exception thrown: Instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 could not be found. Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Request method failure captured: Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 HTTP/1.1 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTJX3me0ubgizALUMdHyD1Cm6Q07-p4WZHzszlZB8YEt9Nq7i2P1ClQ4xFbzLCdsQ5UL88hVP8HmaVFl6M5wMElRf5imNdRyYZ1IG2kIYmjxRrRhnCxuRQA5Vsoty-UKFenbZfiouTOk3PswpcCO3UBWSmKTL2i_yYd8TWbmOUwN9w Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9a21c6fdd814450386af5a1f7c9083a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9a21c6fdd814450386af5a1f7c9083a8"}]}] Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 9a21c6fdd814450386af5a1f7c9083a8 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-447081836 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 23c88a45a2c143cdab0a44ebf2022171 Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestNetworkAdvancedServerOps-447081836-project Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 could not be found. Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'cc264f42-7640-4dd1-b71c-057fbf6a38c4'} Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 could not be found. Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 could not be found. Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:27:50.901555 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 could not be found. Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Returning 404 to user: Instance cc264f42-7640-4dd1-b71c-057fbf6a38c4 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-af258209-3a94-4887-9723-9e25211ea307 tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4" status: 404 len: 111 microversion: 2.1 time: 0.034163 Oct 03 11:27:50.905594 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3395/7123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:27:50 2022] GET /compute/v2.1/servers/cc264f42-7640-4dd1-b71c-057fbf6a38c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:27:54.441866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30e015e9-be58-4a5d-92fa-346a24cb460b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] Calling method '.version_select at 0x7f074f247dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:27:54.451081 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30e015e9-be58-4a5d-92fa-346a24cb460b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [a1154216-782c-479b-bce8-2deba5830e44] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:27:55.460207 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-30e015e9-be58-4a5d-92fa-346a24cb460b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] [a1154216-782c-479b-bce8-2deba5830e44] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 46720. Oct 03 11:27:55.480950 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30e015e9-be58-4a5d-92fa-346a24cb460b tempest-TestNetworkAdvancedServerOps-447081836 tempest-TestNetworkAdvancedServerOps-447081836-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1556718306" status: 202 len: 0 microversion: 2.1 time: 1.047067 Oct 03 11:27:55.481547 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3729/7124] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 3 11:27:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1556718306 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:28:15.795587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:28:15.796372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:15.797055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:15.798327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:28:15.800676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:28:15.801342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:28:15.807817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:15.808099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:15.808522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:15.809507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:15.809973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:15.810408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:15.841004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:28:15.926250 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63fecc08-ffe7-4f24-894a-4b2be7bb1f84 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 204 len: 0 microversion: 2.1 time: 0.134481 Oct 03 11:28:15.926925 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3396/7125] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:28:15 2022] DELETE /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:28:15.935818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:15.936704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:15.944100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:15.944606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:15.945686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:15.946408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:15.946868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:15.947295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:15.970825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-15d3f622-272b-4344-a74e-f89a19e72093 req-b35bea86-4836-4e56-8d04-2297e7ce1c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f1ab48-5d86-4f99-8f41-ac286cc4eb91", "tag": "9cdab605-adc7-4e41-88ee-b231709c3f81"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:28:15.981248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15d3f622-272b-4344-a74e-f89a19e72093 req-b35bea86-4836-4e56-8d04-2297e7ce1c0f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:15.982073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15d3f622-272b-4344-a74e-f89a19e72093 req-b35bea86-4836-4e56-8d04-2297e7ce1c0f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:15.982722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-15d3f622-272b-4344-a74e-f89a19e72093 req-b35bea86-4836-4e56-8d04-2297e7ce1c0f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:15.994477 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-15d3f622-272b-4344-a74e-f89a19e72093 req-b35bea86-4836-4e56-8d04-2297e7ce1c0f service nova] Creating event network-changed:9cdab605-adc7-4e41-88ee-b231709c3f81 for instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 on n-h2-858383-3 Oct 03 11:28:16.000009 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-15d3f622-272b-4344-a74e-f89a19e72093 req-b35bea86-4836-4e56-8d04-2297e7ce1c0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206494 Oct 03 11:28:16.000855 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3730/7126] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:28:16.107085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:16.116721 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c180eba1-6952-4d63-ad79-c54d9d329c93 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1578 microversion: 2.1 time: 0.185116 Oct 03 11:28:16.117374 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3397/7127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:15 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:28:17.141450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:17.142159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:17.149910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:17.150405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:17.150854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:17.151565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:17.152027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:17.152464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:17.300094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:17.309195 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5fe4cdad-a0d1-4a8c-a17e-ea33b15ab3f4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1578 microversion: 2.1 time: 0.171990 Oct 03 11:28:17.316850 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3731/7128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:17 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:18.285021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9686456b-a291-4259-8c71-63054c615d5b req-12ad52f0-796f-4bcc-8f32-1ffc6d4cac2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f1ab48-5d86-4f99-8f41-ac286cc4eb91", "name": "network-vif-deleted", "tag": "9cdab605-adc7-4e41-88ee-b231709c3f81"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:28:18.298245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9686456b-a291-4259-8c71-63054c615d5b req-12ad52f0-796f-4bcc-8f32-1ffc6d4cac2c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:18.299033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9686456b-a291-4259-8c71-63054c615d5b req-12ad52f0-796f-4bcc-8f32-1ffc6d4cac2c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:18.299643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9686456b-a291-4259-8c71-63054c615d5b req-12ad52f0-796f-4bcc-8f32-1ffc6d4cac2c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:18.312159 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9686456b-a291-4259-8c71-63054c615d5b req-12ad52f0-796f-4bcc-8f32-1ffc6d4cac2c service nova] Creating event network-vif-deleted:9cdab605-adc7-4e41-88ee-b231709c3f81 for instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 on n-h2-858383-3 Oct 03 11:28:18.318955 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9686456b-a291-4259-8c71-63054c615d5b req-12ad52f0-796f-4bcc-8f32-1ffc6d4cac2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036977 Oct 03 11:28:18.319954 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3398/7129] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:28:18.336914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:18.338385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:18.346374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:18.346920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:18.347379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:18.348106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:18.348579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:18.349064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:18.435374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:18.444547 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1fce210e-b39c-4464-9235-086b6bec06b5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1224 microversion: 2.1 time: 0.114661 Oct 03 11:28:18.445268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3732/7130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:18 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:28:19.470673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:19.471285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:19.478177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:19.478663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:19.479129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:19.479807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:19.480258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:19.480680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:19.547915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:19.556695 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2880b6cc-d680-4c08-8a50-b007707d8761 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1391 microversion: 2.1 time: 0.091241 Oct 03 11:28:19.557371 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3399/7131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:19 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1391 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:20.580575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:20.581237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:20.589140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:20.589648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:20.590296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:20.591023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:20.591489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:20.592108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:20.657482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:20.667325 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d46e92c-44c6-436a-8087-83a46101a04e tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1391 microversion: 2.1 time: 0.091545 Oct 03 11:28:20.668027 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3733/7132] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:20 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1391 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:21.691114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:21.691762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:21.699317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:21.699842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:21.700293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:21.701033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:21.701495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:21.701925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:21.766092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:21.774783 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da1469f1-0d31-4a47-a2c2-f336b8e8a108 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1391 microversion: 2.1 time: 0.087708 Oct 03 11:28:21.775378 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3400/7133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:21 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1391 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:22.798835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:22.799459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:22.811086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:22.811600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:22.812056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:22.812801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:22.813270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:22.813705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:22.846379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:22.846875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:22.847327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:22.847784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lazy-loading 'fault' on Instance uuid b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:28:22.890147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:22.898119 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e7e9df7b-7ac2-4d5b-893f-bc61ded4f393 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 200 len: 1396 microversion: 2.1 time: 0.103514 Oct 03 11:28:22.898695 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3734/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:22 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 1396 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:23.922167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:23.922960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: b7f1ab48-5d86-4f99-8f41-ac286cc4eb91] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:23.930742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:23.931241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:23.931683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:23.932383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:23.932874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:23.933301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:23.949835 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 could not be found. Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 HTTP/1.1 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 could not be found. Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'b7f1ab48-5d86-4f99-8f41-ac286cc4eb91'} Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 could not be found. Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 could not be found. Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:23.951511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 could not be found. Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa18aaad-c35d-43d4-af49-34f49dfae8b6 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91" status: 404 len: 111 microversion: 2.1 time: 0.034711 Oct 03 11:28:23.955502 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3401/7135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:23 2022] GET /compute/v2.1/servers/b7f1ab48-5d86-4f99-8f41-ac286cc4eb91 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:28:30.283095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:30.289088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-89194f4c-15d1-4e8a-821f-868937c9aeb1 req-58ee2a57-5192-4c35-8de9-eed04869d39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c4f57f-715d-4faf-a9f3-b895da0c731b", "tag": "025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:28:30.294826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:30.301866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:30.302389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:30.302989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:30.303812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:30.304314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:30.305221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:30.311679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-89194f4c-15d1-4e8a-821f-868937c9aeb1 req-58ee2a57-5192-4c35-8de9-eed04869d39c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:30.312555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-89194f4c-15d1-4e8a-821f-868937c9aeb1 req-58ee2a57-5192-4c35-8de9-eed04869d39c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:30.313001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-89194f4c-15d1-4e8a-821f-868937c9aeb1 req-58ee2a57-5192-4c35-8de9-eed04869d39c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:30.327148 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-89194f4c-15d1-4e8a-821f-868937c9aeb1 req-58ee2a57-5192-4c35-8de9-eed04869d39c service nova] Creating event network-changed:025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb for instance 36c4f57f-715d-4faf-a9f3-b895da0c731b on n-h2-858383-3 Oct 03 11:28:30.332406 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-89194f4c-15d1-4e8a-821f-868937c9aeb1 req-58ee2a57-5192-4c35-8de9-eed04869d39c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047478 Oct 03 11:28:30.336878 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3402/7136] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:28:30.337362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:28:30.426232 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d054af16-10fe-4335-877a-7ab3157ec7a2 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 204 len: 0 microversion: 2.1 time: 0.146541 Oct 03 11:28:30.430504 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3735/7137] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:28:30 2022] DELETE /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:28:30.437138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:30.437946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:30.448071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:30.448576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:30.449124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:30.449846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:30.450524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:30.450801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:30.800483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:30.809263 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-89079c4b-859c-4d78-a2b7-70e4594c3ba4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1577 microversion: 2.1 time: 0.376965 Oct 03 11:28:30.809855 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3403/7138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:30 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1577 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:31.833751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:31.834473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:31.841466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:31.842000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:31.842432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:31.843149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:31.843626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:31.844068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:32.462111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:32.469972 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-59ce9002-5fa4-4e1c-a501-c084c6f0a42c tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1577 microversion: 2.1 time: 0.640594 Oct 03 11:28:32.470559 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3736/7139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:31 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1577 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:32.686893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-97e75278-4f77-47ae-83d7-8e50302f03ba req-1ef436b8-b074-4478-aeea-328162d76f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c4f57f-715d-4faf-a9f3-b895da0c731b", "name": "network-vif-deleted", "tag": "025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:28:32.699075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-97e75278-4f77-47ae-83d7-8e50302f03ba req-1ef436b8-b074-4478-aeea-328162d76f37 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:32.699477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-97e75278-4f77-47ae-83d7-8e50302f03ba req-1ef436b8-b074-4478-aeea-328162d76f37 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:32.706941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-97e75278-4f77-47ae-83d7-8e50302f03ba req-1ef436b8-b074-4478-aeea-328162d76f37 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:32.720646 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-97e75278-4f77-47ae-83d7-8e50302f03ba req-1ef436b8-b074-4478-aeea-328162d76f37 service nova] Creating event network-vif-deleted:025c726d-d3eb-440f-9fa7-0e1e5fd3c0fb for instance 36c4f57f-715d-4faf-a9f3-b895da0c731b on n-h2-858383-3 Oct 03 11:28:32.725312 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-97e75278-4f77-47ae-83d7-8e50302f03ba req-1ef436b8-b074-4478-aeea-328162d76f37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042336 Oct 03 11:28:32.726106 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3404/7140] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:28:33.495174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:33.495839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:33.503320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:33.503835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:33.504337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:33.505096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:33.505635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:33.506086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:33.592425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:33.600972 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c092ba8c-1e6c-48f5-b855-fdbdb1ab034d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1225 microversion: 2.1 time: 0.109910 Oct 03 11:28:33.608819 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3737/7141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:33 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:34.626068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:34.626701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:34.633698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:34.634184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:34.634626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:34.635325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:34.635782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:34.636207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:34.699049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:34.708472 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22c84f67-15ea-4850-b2c3-1ee0591f7d14 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1225 microversion: 2.1 time: 0.087757 Oct 03 11:28:34.709099 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3405/7142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:34 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:35.732023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:35.732788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:35.739703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:35.740198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:35.740646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:35.745278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:35.745764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:35.746217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:35.819529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:35.827519 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13cff8c4-1f1a-43c1-bdb8-59a0e2f69ac4 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1225 microversion: 2.1 time: 0.099920 Oct 03 11:28:35.828020 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3738/7143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:35 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:36.850645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:36.851290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:36.858101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:36.858712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:36.859046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:36.859762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:36.860227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:36.860873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:36.893642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:36.894132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:36.894573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:36.895025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lazy-loading 'fault' on Instance uuid 36c4f57f-715d-4faf-a9f3-b895da0c731b {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:28:36.940166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0a399b79464784a4bc3e74a180fde8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99f8293e0e34766a6f8a9f441ecdff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:28:36.948612 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a544752a-5b39-490a-bc6b-f5e8cf18be2d tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 200 len: 1230 microversion: 2.1 time: 0.101933 Oct 03 11:28:36.949215 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3406/7144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:36 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:28:37.973900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:37.975669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 36c4f57f-715d-4faf-a9f3-b895da0c731b] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:37.981440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:37.981942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:37.982398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:37.983107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:37.983584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:37.984028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:37.997804 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 36c4f57f-715d-4faf-a9f3-b895da0c731b could not be found. Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b HTTP/1.1 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 36c4f57f-715d-4faf-a9f3-b895da0c731b could not be found. Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '36c4f57f-715d-4faf-a9f3-b895da0c731b'} Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c4f57f-715d-4faf-a9f3-b895da0c731b could not be found. Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c4f57f-715d-4faf-a9f3-b895da0c731b could not be found. Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:37.999506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c4f57f-715d-4faf-a9f3-b895da0c731b could not be found. Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 36c4f57f-715d-4faf-a9f3-b895da0c731b could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42e60516-a386-4029-97f8-f6558ad72058 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b" status: 404 len: 111 microversion: 2.1 time: 0.031045 Oct 03 11:28:38.004054 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3739/7145] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:37 2022] GET /compute/v2.1/servers/36c4f57f-715d-4faf-a9f3-b895da0c731b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:28:38.443508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:38.444110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:38.450951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:38.451452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:38.451903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:38.452605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:38.453110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:38.453549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:38.466880 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 HTTP/1.1 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '33d4d4f0-be66-4ea2-b0e5-cc91760d1108'} Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:28:38.468576 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac844468-4323-4798-a800-e900fc1dbc42 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 404 len: 111 microversion: 2.1 time: 0.031183 Oct 03 11:28:38.472819 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3407/7146] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:28:38 2022] DELETE /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:28:38.479036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:38.479657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] [instance: 33d4d4f0-be66-4ea2-b0e5-cc91760d1108] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:28:38.485676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:38.486170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:38.486619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:38.487316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:28:38.487778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:28:38.488217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:28:38.502489 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] HTTP exception thrown: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Request method failure captured: Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 HTTP/1.1 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsTiVcBPaxFg6ltR5uNyGto0G0OUIzVDzHft1k_HZJOIYMU6eiL3lyQ3QCxbFSjnFHBjCZrfqdnzJXQqGw1b68Tya84cJlaMCCPGwI0kC7y_QHAb3DbVXXK8kPCWaZgRebTYFDG25Pn3ggYt7VX1KUoXDlLJkhSRWhXfiStp0YPVgTw Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b99f8293e0e34766a6f8a9f441ecdff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b99f8293e0e34766a6f8a9f441ecdff5"}]}] Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b99f8293e0e34766a6f8a9f441ecdff5 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestVolumeBootPattern-1053238368 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1c0a399b79464784a4bc3e74a180fde8 Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestVolumeBootPattern-1053238368-project Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '33d4d4f0-be66-4ea2-b0e5-cc91760d1108'} Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:28:38.504007 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Returning 404 to user: Instance 33d4d4f0-be66-4ea2-b0e5-cc91760d1108 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f1325d9-0c06-463a-99d3-051caa859cdb tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108" status: 404 len: 111 microversion: 2.1 time: 0.030398 Oct 03 11:28:38.508994 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3740/7147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:28:38 2022] GET /compute/v2.1/servers/33d4d4f0-be66-4ea2-b0e5-cc91760d1108 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:28:41.922182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2cc18b49-0805-417d-9557-e2f4013839a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] Calling method '.version_select at 0x7f074de23820>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:28:41.950878 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2cc18b49-0805-417d-9557-e2f4013839a5 tempest-TestVolumeBootPattern-1053238368 tempest-TestVolumeBootPattern-1053238368-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-129416654" status: 202 len: 0 microversion: 2.1 time: 0.032062 Oct 03 11:28:41.952031 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3408/7148] 10.222.0.27 () {58 vars in 1260 bytes} [Mon Oct 3 11:28:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-129416654 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:28:59.924531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:28:59.925240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:00.036259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2066518037", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:00.091585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] validate_networks() for None {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:29:00.364911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:29:00.365486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:29:00.366123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:29:00.366678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:29:00.367211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:29:00.376123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:00.376614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:00.377171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:00.377902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:00.378368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:00.378814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:00.395702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Getting quotas for project 53aca96e9ee84ba4a53b59f3da0df574. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:29:00.400943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Getting quotas for user a2648bc58b5b4f74af134d3b6ef6ee80 and project 53aca96e9ee84ba4a53b59f3da0df574. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:29:00.413722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:29:00.416030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:29:00.463077 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc6a1e9f-3eb0-41ba-bfae-0db4a56ab7a0 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543890 Oct 03 11:29:00.463724 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3741/7149] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:28:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:29:00.474810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:00.475745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:00.480215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0f5d8091-ecd9-4385-b70f-bb69fd744390 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:00.480854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0f5d8091-ecd9-4385-b70f-bb69fd744390 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:00.540217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0f5d8091-ecd9-4385-b70f-bb69fd744390 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:00.547880 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0f5d8091-ecd9-4385-b70f-bb69fd744390 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1222 microversion: 2.1 time: 0.075176 Oct 03 11:29:00.548452 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3409/7150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:00 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:01.573540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:01.574510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:01.584159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:01.584827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:01.585359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:01.586189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:01.586775 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:01.587291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:01.676131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:01.685343 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca2a0e0e-2404-49c9-9a81-1939cd96767e tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1274 microversion: 2.1 time: 0.116822 Oct 03 11:29:01.686082 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3742/7151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:01 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:29:02.714465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:02.715229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:02.722373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:02.723003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:02.723541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:02.724656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:02.725359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:02.726005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:03.278295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:03.287129 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b30f5cae-9e03-4a3f-9e81-ad4f02eaab6b tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.578212 Oct 03 11:29:03.288151 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3410/7152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:02 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:03.756791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-38da4ce9-b5cd-4c2e-84fd-177d95ab1e0f req-0fd91168-2cae-4a89-97f9-bc7112b09a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ed4ffb-244a-400e-82c0-ebe26f7c34ad", "tag": "bc6d4c09-7c4e-4584-9203-796d685e3dfb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:03.766501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-38da4ce9-b5cd-4c2e-84fd-177d95ab1e0f req-0fd91168-2cae-4a89-97f9-bc7112b09a7f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:03.766999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-38da4ce9-b5cd-4c2e-84fd-177d95ab1e0f req-0fd91168-2cae-4a89-97f9-bc7112b09a7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:03.767445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-38da4ce9-b5cd-4c2e-84fd-177d95ab1e0f req-0fd91168-2cae-4a89-97f9-bc7112b09a7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:03.779256 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-38da4ce9-b5cd-4c2e-84fd-177d95ab1e0f req-0fd91168-2cae-4a89-97f9-bc7112b09a7f service nova] Creating event network-changed:bc6d4c09-7c4e-4584-9203-796d685e3dfb for instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad on n-h1-858383-3 Oct 03 11:29:03.784235 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-38da4ce9-b5cd-4c2e-84fd-177d95ab1e0f req-0fd91168-2cae-4a89-97f9-bc7112b09a7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085043 Oct 03 11:29:03.785075 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3743/7153] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:29:04.311575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:04.312193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:04.318996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:04.319487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:04.319963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:04.320643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:04.321128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:04.321559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:04.451863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:04.460097 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-521eef4c-876c-449b-a8a3-613b838a33e4 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.152415 Oct 03 11:29:04.461195 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3411/7154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:04 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:05.485047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:05.485802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:05.492679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:05.493200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:05.493649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:05.494353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:05.494818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:05.495256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:05.629790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:05.637883 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-60ac6f22-64ea-49e4-986c-db8be48655cf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.157902 Oct 03 11:29:05.638480 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3744/7155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:05 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:06.660938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:06.661667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:06.669115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:06.669615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:06.670058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:06.670764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:06.671225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:06.671655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:06.822276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:06.830718 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e258da50-8fe2-448f-8c5a-b9b7b9639546 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.173809 Oct 03 11:29:06.831229 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3412/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:06 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:07.854335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:07.855014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:07.864800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:07.865391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:07.865891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:07.867043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:07.867523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:07.867961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:08.005990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:08.013954 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e18ca6c4-9a1a-4f72-bb1d-c0294ccc2e7d tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.164239 Oct 03 11:29:08.014525 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3745/7157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:07 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:09.038092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:09.038713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:09.045781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:09.046276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:09.046728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:09.047735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:09.048200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:09.048638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:09.186129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:09.193824 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71c1f128-66b5-4cc3-a397-02ba81efa7e5 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.160430 Oct 03 11:29:09.194390 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3413/7158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:09 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:09.944112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8a1018ae-adb1-4069-be1f-78da5c017cd7 req-e4f77185-e5d3-4c32-b8be-e147d26269bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ed4ffb-244a-400e-82c0-ebe26f7c34ad", "name": "network-vif-plugged", "status": "completed", "tag": "bc6d4c09-7c4e-4584-9203-796d685e3dfb"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:09.953825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8a1018ae-adb1-4069-be1f-78da5c017cd7 req-e4f77185-e5d3-4c32-b8be-e147d26269bb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:09.954309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8a1018ae-adb1-4069-be1f-78da5c017cd7 req-e4f77185-e5d3-4c32-b8be-e147d26269bb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:09.954753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8a1018ae-adb1-4069-be1f-78da5c017cd7 req-e4f77185-e5d3-4c32-b8be-e147d26269bb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:09.966419 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8a1018ae-adb1-4069-be1f-78da5c017cd7 req-e4f77185-e5d3-4c32-b8be-e147d26269bb service nova] Creating event network-vif-plugged:bc6d4c09-7c4e-4584-9203-796d685e3dfb for instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad on n-h1-858383-3 Oct 03 11:29:09.973008 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8a1018ae-adb1-4069-be1f-78da5c017cd7 req-e4f77185-e5d3-4c32-b8be-e147d26269bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087852 Oct 03 11:29:09.973652 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3746/7159] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:29:10.217077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:10.217871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:10.225208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:10.225702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:10.226151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:10.226855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:10.227320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:10.227755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:10.366510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:10.374135 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bbb7f5f6-a24f-4e7e-85d3-305e3783db2c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.161172 Oct 03 11:29:10.374713 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3414/7160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:10 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:11.397505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:11.398211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:11.400379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:11.401082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:11.407454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:11.407947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:11.408392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:11.409149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:11.409616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:11.410050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:11.549706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:11.558926 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbb6811f-f584-42b6-b097-23e131cb95bf tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1322 microversion: 2.1 time: 0.165535 Oct 03 11:29:11.559451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3747/7161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:11 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:12.581898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:12.583122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:12.585116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:12.591533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:12.592021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:12.592461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:12.593189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:12.593645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:12.594076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:12.730356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:12.738242 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a39c9669-920b-43ea-950e-f1c321aa2e65 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1471 microversion: 2.1 time: 0.160296 Oct 03 11:29:12.739339 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3415/7162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:12 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:12.814547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-87095779-a457-469c-80c7-ccdc693ac910 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Calling method '.version_select at 0x7f074f6a3ca0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:12.883894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-87095779-a457-469c-80c7-ccdc693ac910 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b42c5979cc1944a2b2ff10c49d24613a" status: 200 len: 371 microversion: 2.1 time: 0.123599 Oct 03 11:29:12.884915 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3748/7163] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 11:29:12 2022] GET /compute/v2.1/os-quota-sets/b42c5979cc1944a2b2ff10c49d24613a => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:29:12.897029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f705e6cf-83e9-4daa-8f7e-2eb2585fa160 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1990403213", "id": 1906187030, "os-flavor-access:is_public": "True"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:12.916457 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f705e6cf-83e9-4daa-8f7e-2eb2585fa160 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.023428 Oct 03 11:29:12.924932 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3416/7164] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:29:12 2022] POST /compute/v2.1/flavors => generated 438 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:29:12.930830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1906187030"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:12.933369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:12.940298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:12.940933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:12.941469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:12.943017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:12.943679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:12.944137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.194485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cd2821033006494a8fcbd0171efcb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42c5979cc1944a2b2ff10c49d24613a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:13.200779 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1990403213 {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:29:13.207533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.208028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.208481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.209256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.209742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.210183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.232294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Getting quotas for project 53aca96e9ee84ba4a53b59f3da0df574. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:29:13.237500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Getting quotas for user a2648bc58b5b4f74af134d3b6ef6ee80 and project 53aca96e9ee84ba4a53b59f3da0df574. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:29:13.250265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.compute.api [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] ram quota exceeded for b42c5979cc1944a2b2ff10c49d24613a, tried to resize instance. Oct 03 11:29:13.250814 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Request method failure captured: Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad/action HTTP/1.1 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 39 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsd7qEjVJTA5ieQnfAbAF6aqQFRSHGsLvxbqSbIuCXOnluGwMg1v8Efwt5-v1R6-PRrQIPeTrZ6K45e6AL8shN5Hs0UkI2gFDfeGyaPMnn8WbLAHl7TdI4aAhkXmWgPva3ll1xWsZP_efQNULq8JKKGjXgIh8RGWS4OBYkgmHxC0ObE Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: b42c5979cc1944a2b2ff10c49d24613a Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-124625908 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member,admin Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member,admin Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b42c5979cc1944a2b2ff10c49d24613a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b42c5979cc1944a2b2ff10c49d24613a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b42c5979cc1944a2b2ff10c49d24613a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b42c5979cc1944a2b2ff10c49d24613a"}]}] Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersAdminNegativeTestJSON-124625908 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: b42c5979cc1944a2b2ff10c49d24613a Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-124625908 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersAdminNegativeTestJSON-124625908-project-admin Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: cd2821033006494a8fcbd0171efcb0d6 Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersAdminNegativeTestJSON-124625908-project-admin Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: {"resize": {"flavorRef": "1906187030"}} Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '40ed4ffb-244a-400e-82c0-ebe26f7c34ad', 'body': {'resize': {'flavorRef': '1906187030'}}} Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:29:13.258639 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-71319d6c-6cc1-43d3-8b03-e12874264297 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad/action" status: 403 len: 118 microversion: 2.1 time: 0.334258 Oct 03 11:29:13.263130 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3749/7165] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:29:12 2022] POST /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad/action => generated 118 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:29:13.269302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7e7556e-7fc7-4ddc-8c16-9b3a666e65f1 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:13.286455 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7e7556e-7fc7-4ddc-8c16-9b3a666e65f1 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1906187030" status: 202 len: 0 microversion: 2.1 time: 0.020392 Oct 03 11:29:13.287054 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3417/7166] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 11:29:13 2022] DELETE /compute/v2.1/flavors/1906187030 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:29:13.295217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9eabb28a-efde-47c2-9f69-075cdb19ed8f tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:13.321000 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9eabb28a-efde-47c2-9f69-075cdb19ed8f tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029308 Oct 03 11:29:13.321602 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3750/7167] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 11:29:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:13.341942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb3a61d7-c796-4a9c-9b49-a03dc40d5b5a tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Calling method '.version_select at 0x7f074de230d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:13.414662 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb3a61d7-c796-4a9c-9b49-a03dc40d5b5a tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/b42c5979cc1944a2b2ff10c49d24613a" status: 200 len: 371 microversion: 2.1 time: 0.076588 Oct 03 11:29:13.415249 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3418/7168] 10.222.0.27 () {58 vars in 1242 bytes} [Mon Oct 3 11:29:13 2022] GET /compute/v2.1/os-quota-sets/b42c5979cc1944a2b2ff10c49d24613a => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:29:13.427932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37275b1f-cb88-458f-becc-ec754a17a6d5 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1480959737", "id": 1725735154, "os-flavor-access:is_public": "True"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:13.446034 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37275b1f-cb88-458f-becc-ec754a17a6d5 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022512 Oct 03 11:29:13.446639 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3751/7169] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:29:13 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:29:13.459223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1725735154"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:13.461599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:13.467534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.468016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.468454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.469173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.469650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.470063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.558146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cd2821033006494a8fcbd0171efcb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42c5979cc1944a2b2ff10c49d24613a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:13.564453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1480959737 {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:29:13.571614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.572106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.572550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.573318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.573785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.574219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.598147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Getting quotas for project 53aca96e9ee84ba4a53b59f3da0df574. Resources: {'cores', 'ram'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:29:13.602638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Getting quotas for user a2648bc58b5b4f74af134d3b6ef6ee80 and project 53aca96e9ee84ba4a53b59f3da0df574. Resources: {'cores', 'ram'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:29:13.614486 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.compute.api [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] cores quota exceeded for b42c5979cc1944a2b2ff10c49d24613a, tried to resize instance. Oct 03 11:29:13.614981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Request method failure captured: Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad/action HTTP/1.1 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 39 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsd7qEjVJTA5ieQnfAbAF6aqQFRSHGsLvxbqSbIuCXOnluGwMg1v8Efwt5-v1R6-PRrQIPeTrZ6K45e6AL8shN5Hs0UkI2gFDfeGyaPMnn8WbLAHl7TdI4aAhkXmWgPva3ll1xWsZP_efQNULq8JKKGjXgIh8RGWS4OBYkgmHxC0ObE Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b42c5979cc1944a2b2ff10c49d24613a Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-124625908 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member,admin Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member,admin Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b42c5979cc1944a2b2ff10c49d24613a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b42c5979cc1944a2b2ff10c49d24613a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b42c5979cc1944a2b2ff10c49d24613a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b42c5979cc1944a2b2ff10c49d24613a"}]}] Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminNegativeTestJSON-124625908 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b42c5979cc1944a2b2ff10c49d24613a Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-124625908 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminNegativeTestJSON-124625908-project-admin Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: cd2821033006494a8fcbd0171efcb0d6 Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminNegativeTestJSON-124625908-project-admin Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: {"resize": {"flavorRef": "1725735154"}} Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '40ed4ffb-244a-400e-82c0-ebe26f7c34ad', 'body': {'resize': {'flavorRef': '1725735154'}}} Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:29:13.617002 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f0879cf8-669d-4a41-b20f-c001da5acc28 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad/action" status: 403 len: 113 microversion: 2.1 time: 0.163577 Oct 03 11:29:13.621484 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3419/7170] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:29:13 2022] POST /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad/action => generated 113 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:29:13.627189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0aee8821-fd0b-4044-a203-394df264efd9 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:13.644352 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0aee8821-fd0b-4044-a203-394df264efd9 tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1725735154" status: 202 len: 0 microversion: 2.1 time: 0.020866 Oct 03 11:29:13.645446 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3752/7171] 10.222.0.27 () {58 vars in 1161 bytes} [Mon Oct 3 11:29:13 2022] DELETE /compute/v2.1/flavors/1725735154 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:29:13.653234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1d3d3e0-84fd-49a8-abd7-e2d31c2c69ba tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:13.673874 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1d3d3e0-84fd-49a8-abd7-e2d31c2c69ba tempest-ServersAdminNegativeTestJSON-124625908 tempest-ServersAdminNegativeTestJSON-124625908-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024220 Oct 03 11:29:13.674460 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3420/7172] 10.222.0.27 () {58 vars in 1146 bytes} [Mon Oct 3 11:29:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:13.694990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:13.695538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:13.701637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.702139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.702602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.703313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.703786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.704231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.730444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:29:13.808294 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09473b52-bfb1-47f1-b41b-144c5490e02c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "DELETE /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 204 len: 0 microversion: 2.1 time: 0.116386 Oct 03 11:29:13.809311 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3753/7173] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:29:13 2022] DELETE /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:29:13.818715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:13.819346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:13.825456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.825951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.826420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.827124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:13.827595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:13.828029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:13.960308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:13.969904 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1c976bad-55ea-4003-82ac-c54ba80c725c tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1477 microversion: 2.1 time: 0.155836 Oct 03 11:29:13.970636 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3421/7174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:13 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:14.994984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:14.995691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:15.003630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:15.004127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:15.004577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:15.005858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:15.006323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:15.006762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:15.140279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:15.148191 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ff305cc-ddb7-4071-85d9-4ea9643edfe8 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1477 microversion: 2.1 time: 0.157435 Oct 03 11:29:15.148784 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3754/7175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:14 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:15.765814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c90ccb8b-d20f-45ef-959e-c93d94874527 req-5c2105f1-9690-4938-a7c7-f1e71d6d2516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ed4ffb-244a-400e-82c0-ebe26f7c34ad", "name": "network-vif-deleted", "tag": "bc6d4c09-7c4e-4584-9203-796d685e3dfb"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:15.778095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c90ccb8b-d20f-45ef-959e-c93d94874527 req-5c2105f1-9690-4938-a7c7-f1e71d6d2516 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:15.778583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c90ccb8b-d20f-45ef-959e-c93d94874527 req-5c2105f1-9690-4938-a7c7-f1e71d6d2516 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:15.779021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c90ccb8b-d20f-45ef-959e-c93d94874527 req-5c2105f1-9690-4938-a7c7-f1e71d6d2516 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:15.799881 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c90ccb8b-d20f-45ef-959e-c93d94874527 req-5c2105f1-9690-4938-a7c7-f1e71d6d2516 service nova] Creating event network-vif-deleted:bc6d4c09-7c4e-4584-9203-796d685e3dfb for instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad on n-h1-858383-3 Oct 03 11:29:15.805882 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c90ccb8b-d20f-45ef-959e-c93d94874527 req-5c2105f1-9690-4938-a7c7-f1e71d6d2516 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043648 Oct 03 11:29:15.806669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3422/7176] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:29:16.171251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:16.171874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:16.179166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:16.179661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:16.180111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:16.180837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:16.181304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:16.181740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:16.215282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:16.216027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:16.216851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:16.217679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lazy-loading 'fault' on Instance uuid 40ed4ffb-244a-400e-82c0-ebe26f7c34ad {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:29:16.268828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2648bc58b5b4f74af134d3b6ef6ee80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53aca96e9ee84ba4a53b59f3da0df574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:16.278019 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-423b46c4-046e-42d5-8a62-2906a5b627d9 tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 200 len: 1312 microversion: 2.1 time: 0.110651 Oct 03 11:29:16.283186 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3755/7177] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:16 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:29:17.303463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:17.304160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] [instance: 40ed4ffb-244a-400e-82c0-ebe26f7c34ad] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:17.312001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:17.312485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:17.312956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:17.313671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:17.314122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:17.314550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:17.328475 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] HTTP exception thrown: Instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad could not be found. Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Request method failure captured: Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad HTTP/1.1 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsd7ZCjyFLUTMZq-M1C6R1QaiKpqKdapiHF7_t6FZh27z8pqoSsGfpdsheHrMnD-SHp1IVeiToO8YM8jQnthGuAa2fJDqIhSeVgHNCG2z_O8OP2GE9ZqpK4ZEs-4ymLC_yn7zGK0lguEKD4czyw9WXkJiYlVEsdjdz2PjLSHTavWe8w Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 53aca96e9ee84ba4a53b59f3da0df574 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1312203820 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53aca96e9ee84ba4a53b59f3da0df574"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53aca96e9ee84ba4a53b59f3da0df574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53aca96e9ee84ba4a53b59f3da0df574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53aca96e9ee84ba4a53b59f3da0df574"}]}] Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1312203820 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 53aca96e9ee84ba4a53b59f3da0df574 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1312203820 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersAdminNegativeTestJSON-1312203820-project Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a2648bc58b5b4f74af134d3b6ef6ee80 Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1312203820-project Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad could not be found. Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '40ed4ffb-244a-400e-82c0-ebe26f7c34ad'} Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad could not be found. Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad could not be found. Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:17.330156 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad could not be found. Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] Returning 404 to user: Instance 40ed4ffb-244a-400e-82c0-ebe26f7c34ad could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a917676f-bae3-46fd-a184-15f4b96b12ad tempest-ServersAdminNegativeTestJSON-1312203820 tempest-ServersAdminNegativeTestJSON-1312203820-project] 10.222.0.27 "GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad" status: 404 len: 111 microversion: 2.1 time: 0.032411 Oct 03 11:29:17.334536 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3423/7178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:17 2022] GET /compute/v2.1/servers/40ed4ffb-244a-400e-82c0-ebe26f7c34ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:29:23.797696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:23.798480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:23.912197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2116387362", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "b657ee61-d0c8-4a1d-963b-3333933cf50a"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:23.970123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] validate_networks() for [('b657ee61-d0c8-4a1d-963b-3333933cf50a', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:29:24.397893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:29:24.398332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:29:24.398849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:29:24.399371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:29:24.399843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:29:24.409050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:24.409541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:24.409988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:24.410803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:24.411271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:24.411707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:24.431578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Getting quotas for project 0d5b306a09bc4ac28c01d0bb83ddd6f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:29:24.437172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Getting quotas for user f3a7ad284d494b4780d4a264fa1572bd and project 0d5b306a09bc4ac28c01d0bb83ddd6f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:29:24.452321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:29:24.454864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:29:24.502653 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc1ecb0f-6737-4dcb-89cc-b74e277a17a2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710647 Oct 03 11:29:24.503677 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3756/7179] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:29:24.515141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6c307b03-8563-4008-bda6-2c9775689cb2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:24.515753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6c307b03-8563-4008-bda6-2c9775689cb2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:24.521462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:24.523260 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:24.597775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6c307b03-8563-4008-bda6-2c9775689cb2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:24.606516 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6c307b03-8563-4008-bda6-2c9775689cb2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1215 microversion: 2.1 time: 0.095223 Oct 03 11:29:24.607504 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3424/7180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:24 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:25.632513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:25.633757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:25.642190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:25.642894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:25.643499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:25.644367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:25.645022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:25.646153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:25.733243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:25.749863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b42a7abe-315d-4dde-a1c9-4b704553f9bb tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1275 microversion: 2.1 time: 0.122389 Oct 03 11:29:25.750486 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3757/7181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:25 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:26.773879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:26.774499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:26.782175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:26.782989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:26.783499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:26.784292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:26.784842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:26.785357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:26.942220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:26.951351 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d52ee0df-a208-4319-81f7-1dbf0f012e83 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1315 microversion: 2.1 time: 0.181398 Oct 03 11:29:26.951962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3425/7182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:26 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:27.370448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-08bed9f3-e4e5-48fd-b60e-ae831c1273e5 req-794f4e52-2a2d-4e83-86ca-d52d888a7b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd536a3e-e454-4392-8681-f146b463ccdc", "tag": "de12b990-8262-479e-a329-aa03dbcfad6f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:27.382000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-08bed9f3-e4e5-48fd-b60e-ae831c1273e5 req-794f4e52-2a2d-4e83-86ca-d52d888a7b10 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:27.382496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-08bed9f3-e4e5-48fd-b60e-ae831c1273e5 req-794f4e52-2a2d-4e83-86ca-d52d888a7b10 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:27.382996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-08bed9f3-e4e5-48fd-b60e-ae831c1273e5 req-794f4e52-2a2d-4e83-86ca-d52d888a7b10 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:27.396939 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-08bed9f3-e4e5-48fd-b60e-ae831c1273e5 req-794f4e52-2a2d-4e83-86ca-d52d888a7b10 service nova] Creating event network-changed:de12b990-8262-479e-a329-aa03dbcfad6f for instance fd536a3e-e454-4392-8681-f146b463ccdc on n-h2-858383-3 Oct 03 11:29:27.405707 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-08bed9f3-e4e5-48fd-b60e-ae831c1273e5 req-794f4e52-2a2d-4e83-86ca-d52d888a7b10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101755 Oct 03 11:29:27.406407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3758/7183] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:29:27.977714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:27.978749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:27.985217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:27.985719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:27.986165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:27.986866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:27.987330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:27.987761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:28.123931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:28.132288 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-472e0194-2d89-428c-9efd-34a2c370caf5 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1315 microversion: 2.1 time: 0.159078 Oct 03 11:29:28.132889 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3426/7184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:27 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:29.156781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:29.157759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:29.165654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:29.166158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:29.166703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:29.167564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:29.168196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:29.168809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:29.375149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:29.386434 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0edd2527-9cb1-4789-b70a-bfedea793b33 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1315 microversion: 2.1 time: 0.234125 Oct 03 11:29:29.386944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3759/7185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:29 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:30.419090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:30.419704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:30.428100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:30.428605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:30.429124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:30.429843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:30.430300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:30.430730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:30.568483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:30.572318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=76 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:30.578188 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7b20d22-8872-4a53-9433-311f33e5dcf0 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1315 microversion: 2.1 time: 0.162967 Oct 03 11:29:30.579318 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3427/7186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:30 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:31.602033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:31.602656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:31.605510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:31.611140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:31.611653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:31.612112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:31.612848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:31.613320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:31.613789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:31.617620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:31.766254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:31.775319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80b03740-6eda-46aa-8b5d-ccbde5f8d4c2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1315 microversion: 2.1 time: 0.177854 Oct 03 11:29:31.775937 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3760/7187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:31 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:32.602451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-2f33e241-99b0-4483-b220-5b52e71a3bf3 req-73c65259-52f5-407a-8466-fce7469df126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd536a3e-e454-4392-8681-f146b463ccdc", "name": "network-vif-plugged", "status": "completed", "tag": "de12b990-8262-479e-a329-aa03dbcfad6f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:32.607911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:32.614105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f33e241-99b0-4483-b220-5b52e71a3bf3 req-73c65259-52f5-407a-8466-fce7469df126 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:32.614590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f33e241-99b0-4483-b220-5b52e71a3bf3 req-73c65259-52f5-407a-8466-fce7469df126 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:32.615053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f33e241-99b0-4483-b220-5b52e71a3bf3 req-73c65259-52f5-407a-8466-fce7469df126 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:32.628744 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-2f33e241-99b0-4483-b220-5b52e71a3bf3 req-73c65259-52f5-407a-8466-fce7469df126 service nova] Creating event network-vif-plugged:de12b990-8262-479e-a329-aa03dbcfad6f for instance fd536a3e-e454-4392-8681-f146b463ccdc on n-h2-858383-3 Oct 03 11:29:32.634121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-2f33e241-99b0-4483-b220-5b52e71a3bf3 req-73c65259-52f5-407a-8466-fce7469df126 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036422 Oct 03 11:29:32.634731 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3428/7188] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:29:32.799842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:32.800505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:32.808116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:32.808624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:32.809120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:32.809847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:32.810320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:32.810769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:32.945467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:32.953691 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf3dadab-a9a3-41ae-9f69-60b67d9cf796 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1315 microversion: 2.1 time: 0.158026 Oct 03 11:29:32.954282 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3761/7189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:32 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:33.978964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:33.979668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:33.985891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:33.986384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:33.986830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:33.987535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:33.987996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:33.988428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:34.122014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:34.130201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-558ebc19-07d1-4fbe-a59d-3a4a9ea3bb81 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1502 microversion: 2.1 time: 0.156357 Oct 03 11:29:34.130794 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3429/7190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:33 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:34.152450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:29:34.154854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:34.162343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:34.162850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:34.163307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:34.164090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:34.164747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:34.165219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:34.195859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:34.201735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Old instance type m1.heat2, new instance type m1.heat {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:29:34.208468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:29:34.208941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:29:34.209434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:29:34.209862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:29:34.210290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:29:34.275607 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ff03057-fa65-4eb7-85d4-8768cc995ee1 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "POST /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc/action" status: 202 len: 0 microversion: 2.1 time: 0.126973 Oct 03 11:29:34.276362 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3762/7191] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:29:34 2022] POST /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:29:34.284715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:34.285395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:34.292381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:34.292912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:34.293351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:34.294056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:34.294653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:34.295278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:34.491385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:34.500614 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b4adf165-c6f7-404f-889e-c1901c42a692 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1511 microversion: 2.1 time: 0.219723 Oct 03 11:29:34.501588 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3430/7192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:34 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:35.527623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:35.528284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:35.530403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:35.531185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:35.540407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:35.540951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:35.541414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:35.542167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:35.542644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:35.543090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:35.689418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:35.697375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d97145c1-eee7-4331-901f-30adcce06463 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1511 microversion: 2.1 time: 0.175502 Oct 03 11:29:35.697975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3763/7193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:35 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:36.720948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:36.721488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:36.723659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:29:36.729513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:36.730006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:36.730448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:36.731156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:36.731617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:36.732048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:36.869862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:36.878061 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5347d4f2-426b-4b91-9d45-12b752a00af9 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.161213 Oct 03 11:29:36.878646 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3431/7194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:36 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:37.902165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:37.902798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:37.909719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:37.910210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:37.910665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:37.911369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:37.911835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:37.912275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:38.052151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:38.059897 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cac14bb2-ae30-4549-805d-d7e58c27cd6c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.161690 Oct 03 11:29:38.060480 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3764/7195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:37 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:29:39.083732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:39.084344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:39.091772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:39.092267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:39.092712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:39.093449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:39.093913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:39.094344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:39.231350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:39.240097 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-75cf90a5-b06b-4eea-8647-c37d8165b129 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.160895 Oct 03 11:29:39.240670 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3432/7196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:39 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:40.263453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:40.264106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:40.271610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:40.272109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:40.272555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:40.273291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:40.273755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:40.274195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:40.407133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:40.415212 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d4bc3a7d-110c-4fbb-9179-23e46f3baf3b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.155902 Oct 03 11:29:40.415795 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3765/7197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:40 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:41.439144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:41.439679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:41.447267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:41.447757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:41.448198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:41.448936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:41.449409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:41.449823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:41.580052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:41.588363 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f4aa700d-6e43-4157-92ec-da8a17caa3e2 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.153129 Oct 03 11:29:41.589322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3433/7198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:41 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:29:42.619068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:42.619768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:42.629645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:42.630167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:42.630609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:42.631345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:42.631806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:42.632259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:42.780094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:42.790389 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a917b735-d775-4d0c-9275-fa51d04f4e1d tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.175143 Oct 03 11:29:42.791413 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3766/7199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:42 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:43.821101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:43.821732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:43.828957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:43.829491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:43.829877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:43.830564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:43.831021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:43.831444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:43.963705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:43.972306 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1a82ec51-b2a9-4814-94f0-983d01366449 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.155824 Oct 03 11:29:43.972888 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3434/7200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:43 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:44.995134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:44.995733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:45.002724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:45.003229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:45.003691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:45.004402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:45.004907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:45.005357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:45.137105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:45.147160 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4a9bc6db-6d3d-4345-8164-711d42429f38 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.155936 Oct 03 11:29:45.147744 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3767/7201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:44 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:46.171442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:46.172092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:46.180916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:46.181411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:46.181856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:46.182564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:46.183049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:46.183480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:46.316952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:46.325045 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19337554-1f14-4e36-975c-0644bbf55147 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.157587 Oct 03 11:29:46.325602 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3435/7202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:46 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:47.347805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:47.348433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:47.355461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:47.355962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:47.356645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:47.357166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:47.357644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:47.358088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:47.486507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:47.495314 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5400d486-7f62-4a3c-9ab4-236f0b35a03c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.151419 Oct 03 11:29:47.495894 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3768/7203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:47 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:48.519195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:48.520422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:48.527397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:48.527893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:48.528341 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:48.529064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:48.529525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:48.529956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:48.674444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:48.682886 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cfa03d49-37d5-4abb-97fd-23e71d257ddf tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.167564 Oct 03 11:29:48.683472 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3436/7204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:48 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:49.707745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:49.708424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:49.715457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:49.715953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:49.716402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:49.717131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:49.717601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:49.718044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:49.854108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:49.861948 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8ea21472-10e4-43a9-a27c-61922515220a tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.158127 Oct 03 11:29:49.862522 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3769/7205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:49 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:50.885960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:50.886481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:50.896666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:50.897186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:50.897651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:50.898343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:50.898810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:50.899244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:51.028317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:51.036112 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c5e60748-01a9-4b67-b25b-e71e914fc0da tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.154163 Oct 03 11:29:51.036695 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3437/7206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:50 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:52.059592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:52.060211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:52.067607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:52.068099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:52.068547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:52.069276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:52.069742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:52.070180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:52.201913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:52.210651 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4aa48975-9a98-4fa7-831f-affffedfc764 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.155025 Oct 03 11:29:52.211228 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3770/7207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:52 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:53.234077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:53.234680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:53.241417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:53.241908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:53.242340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:53.243030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:53.243487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:53.243913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:53.382931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:53.391329 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-767e71d5-1d29-499e-8f3b-0898c0773c5c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.161271 Oct 03 11:29:53.391908 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3438/7208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:53 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:29:54.415343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:54.416120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:54.423158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:54.423656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:54.424114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:54.424898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:54.425392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:54.425830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:54.566856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:54.575218 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b894faca-069c-4732-af3f-7f8ab7f1c5aa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.164333 Oct 03 11:29:54.575798 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3771/7209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:54 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:55.598857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:55.599465 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:55.606605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:55.607089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:55.607524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:55.608220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:55.608669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:55.609117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:55.745971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:55.753979 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e3b56492-dd96-438f-91b6-48d69e30b696 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.159059 Oct 03 11:29:55.754548 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3439/7210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:55 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:56.778565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:56.779184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:56.786960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:56.787532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:56.788085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:56.788889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:56.789365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:56.789808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:56.930965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:56.939025 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-292e99e6-84c2-4cbf-bb3f-9589c72bce75 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.164556 Oct 03 11:29:56.939614 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3772/7211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:56 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:57.962520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:57.963070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:57.970941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:57.971482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:57.971954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:57.972856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:57.973287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:57.973781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:58.103841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:58.111751 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99bcd5a8-bf31-4614-9c61-4dfd47cada28 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.153386 Oct 03 11:29:58.112350 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3440/7212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:57 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:29:59.136163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:29:59.136817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:29:59.143962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:59.144470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:59.144956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:59.145682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:29:59.146153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:29:59.146599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:29:59.284996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:29:59.292916 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-51efe3bb-bb13-4170-9ffd-d4e6bc2a75ff tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.160750 Oct 03 11:29:59.293534 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3773/7213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:29:59 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:00.317188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:00.317807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:00.325257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:00.325754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:00.326200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:00.326907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:00.327368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:00.327801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:00.463903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:00.472015 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e9712fc-348c-4f1e-9e39-7eb2c09fe107 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.158854 Oct 03 11:30:00.472598 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3441/7214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:00 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:01.496371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:01.497015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:01.504132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:01.504630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:01.505735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:01.506463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:01.506933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:01.507369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:01.657736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:01.660089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:01.667988 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f0da591-f515-4ed3-8c33-ab66a07e35fa tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.175532 Oct 03 11:30:01.668803 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3774/7215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:01 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:02.691493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:02.692101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:02.694681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=28 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:02.700389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:02.700923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:02.701370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:02.702085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:02.702550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:02.702981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:02.705939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=82 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:02.838745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:02.846600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1aab674-a4c5-43a9-ba2d-a9ca3cb1d795 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1516 microversion: 2.1 time: 0.158988 Oct 03 11:30:02.847178 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3442/7216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:02 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:03.778506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3c69d9a8-d866-4e69-88aa-2bfc7ae8dc30 req-ca1eabfc-e83f-4b68-8234-b618506561b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd536a3e-e454-4392-8681-f146b463ccdc", "name": "network-vif-unplugged", "status": "completed", "tag": "de12b990-8262-479e-a329-aa03dbcfad6f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:03.785235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=34 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:03.794413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3c69d9a8-d866-4e69-88aa-2bfc7ae8dc30 req-ca1eabfc-e83f-4b68-8234-b618506561b3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:03.795111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3c69d9a8-d866-4e69-88aa-2bfc7ae8dc30 req-ca1eabfc-e83f-4b68-8234-b618506561b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:03.795805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3c69d9a8-d866-4e69-88aa-2bfc7ae8dc30 req-ca1eabfc-e83f-4b68-8234-b618506561b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:03.810925 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3c69d9a8-d866-4e69-88aa-2bfc7ae8dc30 req-ca1eabfc-e83f-4b68-8234-b618506561b3 service nova] Creating event network-vif-unplugged:de12b990-8262-479e-a329-aa03dbcfad6f for instance fd536a3e-e454-4392-8681-f146b463ccdc on n-h1-858383-3 Oct 03 11:30:03.817131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-3c69d9a8-d866-4e69-88aa-2bfc7ae8dc30 req-ca1eabfc-e83f-4b68-8234-b618506561b3 service nova] Instance fd536a3e-e454-4392-8681-f146b463ccdc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:30:03.829353 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3c69d9a8-d866-4e69-88aa-2bfc7ae8dc30 req-ca1eabfc-e83f-4b68-8234-b618506561b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054409 Oct 03 11:30:03.830058 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3775/7217] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:30:03.870279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:03.870899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:03.878001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:03.878499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:03.878945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:03.879658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:03.880122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:03.880556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:04.084624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:04.093699 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13368797-4d29-4f05-a81c-2a00829a3419 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1515 microversion: 2.1 time: 0.227345 Oct 03 11:30:04.094302 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3443/7218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:03 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:05.119060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:05.119783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:05.126437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:05.126941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:05.127396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:05.128111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:05.128578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:05.129090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:05.270397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:05.278199 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a376a6c5-e7a0-4444-a390-7ff518695942 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1513 microversion: 2.1 time: 0.164766 Oct 03 11:30:05.278776 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3776/7219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:05 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:05.856099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-33ca90c0-2c51-4b79-a0f2-225b384dfb7f req-aec45856-e3ab-4c7d-9126-b8b9f571787f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd536a3e-e454-4392-8681-f146b463ccdc", "tag": "de12b990-8262-479e-a329-aa03dbcfad6f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:05.866075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-33ca90c0-2c51-4b79-a0f2-225b384dfb7f req-aec45856-e3ab-4c7d-9126-b8b9f571787f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:05.866561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-33ca90c0-2c51-4b79-a0f2-225b384dfb7f req-aec45856-e3ab-4c7d-9126-b8b9f571787f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:05.867000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-33ca90c0-2c51-4b79-a0f2-225b384dfb7f req-aec45856-e3ab-4c7d-9126-b8b9f571787f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:05.881843 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-33ca90c0-2c51-4b79-a0f2-225b384dfb7f req-aec45856-e3ab-4c7d-9126-b8b9f571787f service nova] Creating event network-changed:de12b990-8262-479e-a329-aa03dbcfad6f for instance fd536a3e-e454-4392-8681-f146b463ccdc on n-h1-858383-3 Oct 03 11:30:05.887608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-33ca90c0-2c51-4b79-a0f2-225b384dfb7f req-aec45856-e3ab-4c7d-9126-b8b9f571787f service nova] Instance fd536a3e-e454-4392-8681-f146b463ccdc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:30:05.899255 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-33ca90c0-2c51-4b79-a0f2-225b384dfb7f req-aec45856-e3ab-4c7d-9126-b8b9f571787f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046899 Oct 03 11:30:05.899894 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3444/7220] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:30:06.301730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:06.302906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:06.310885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:06.311393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:06.312102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:06.312874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:06.313338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:06.313778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:06.482517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:06.490804 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3a903cd-a45a-4114-85a6-5c52186c7f9b tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1513 microversion: 2.1 time: 0.193197 Oct 03 11:30:06.492028 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3777/7221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:06 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:07.516720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:07.517444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:07.524271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:07.524899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:07.525353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:07.526068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:07.526533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:07.526969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:07.763822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:07.771938 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df730b85-7001-4c75-8a00-ed3ce7795cc4 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1513 microversion: 2.1 time: 0.260377 Oct 03 11:30:07.772749 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3445/7222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:07 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:08.796553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:08.797208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:08.805309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:08.805812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:08.806260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:08.806976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:08.807440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:08.807880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:08.953118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:08.961447 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d74e5ca1-8dc3-4f25-85f8-d45bd1097c08 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1510 microversion: 2.1 time: 0.168794 Oct 03 11:30:08.962045 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3778/7223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:08 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:08.984422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:08.985010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:08.992117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:08.992641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:08.993159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:08.993863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:08.994318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:08.994743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:09.020434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:30:09.073845 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.compute.api [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Found an unconfirmed migration during delete, id: 16, status: finished Oct 03 11:30:10.477179 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d85501be-0f94-4ffd-8d47-8ea4ccb08590 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 204 len: 0 microversion: 2.1 time: 1.496179 Oct 03 11:30:10.478528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3446/7224] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:30:08 2022] DELETE /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:30:10.486957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:10.487590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:10.494678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:10.495244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:10.495709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:10.496432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:10.496940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:10.497385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:10.643199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:10.651726 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cc322c17-ffb5-483e-ada7-f75c5ffa797c tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1502 microversion: 2.1 time: 0.168658 Oct 03 11:30:10.652313 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3779/7225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:10 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:11.676137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:11.676872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:11.683489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:11.683982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:11.684429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:11.685165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:11.685716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:11.686157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:11.820941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a7ad284d494b4780d4a264fa1572bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5b306a09bc4ac28c01d0bb83ddd6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:11.829000 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d1727825-e456-4ae6-a0c1-2c9a19966d39 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 200 len: 1502 microversion: 2.1 time: 0.157652 Oct 03 11:30:11.829512 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3447/7226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:11 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:12.093361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-374b68ec-2d61-4790-970c-316f0c0df91c req-2bd7a990-ed31-4b13-910f-20ca79177037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd536a3e-e454-4392-8681-f146b463ccdc", "name": "network-vif-plugged", "status": "completed", "tag": "de12b990-8262-479e-a329-aa03dbcfad6f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:12.106093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-374b68ec-2d61-4790-970c-316f0c0df91c req-2bd7a990-ed31-4b13-910f-20ca79177037 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.106928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-374b68ec-2d61-4790-970c-316f0c0df91c req-2bd7a990-ed31-4b13-910f-20ca79177037 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.107644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-374b68ec-2d61-4790-970c-316f0c0df91c req-2bd7a990-ed31-4b13-910f-20ca79177037 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.120880 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-374b68ec-2d61-4790-970c-316f0c0df91c req-2bd7a990-ed31-4b13-910f-20ca79177037 service nova] Creating event network-vif-plugged:de12b990-8262-479e-a329-aa03dbcfad6f for instance fd536a3e-e454-4392-8681-f146b463ccdc on n-h1-858383-3 Oct 03 11:30:12.126492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-374b68ec-2d61-4790-970c-316f0c0df91c req-2bd7a990-ed31-4b13-910f-20ca79177037 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037321 Oct 03 11:30:12.129509 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3780/7227] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:30:12.544654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ce61e774-fe5b-4d6b-b71e-96185606e661 req-dd2b227e-9048-4ae5-b6d7-7a21cf4cf74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd536a3e-e454-4392-8681-f146b463ccdc", "name": "network-vif-deleted", "tag": "de12b990-8262-479e-a329-aa03dbcfad6f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:12.559116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce61e774-fe5b-4d6b-b71e-96185606e661 req-dd2b227e-9048-4ae5-b6d7-7a21cf4cf74c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.559904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce61e774-fe5b-4d6b-b71e-96185606e661 req-dd2b227e-9048-4ae5-b6d7-7a21cf4cf74c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.560069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce61e774-fe5b-4d6b-b71e-96185606e661 req-dd2b227e-9048-4ae5-b6d7-7a21cf4cf74c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.589165 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ce61e774-fe5b-4d6b-b71e-96185606e661 req-dd2b227e-9048-4ae5-b6d7-7a21cf4cf74c service nova] Creating event network-vif-deleted:de12b990-8262-479e-a329-aa03dbcfad6f for instance fd536a3e-e454-4392-8681-f146b463ccdc on n-h1-858383-3 Oct 03 11:30:12.596880 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ce61e774-fe5b-4d6b-b71e-96185606e661 req-dd2b227e-9048-4ae5-b6d7-7a21cf4cf74c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059380 Oct 03 11:30:12.597761 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3448/7228] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:30:12.857949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:12.857949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:12.864245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.864897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.865423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.866781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.867253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.867702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.881481 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] HTTP exception thrown: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Request method failure captured: Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc HTTP/1.1 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOseT14-W1Bp1DlZps-B2GQZRitQPv96k2cU15vHvrJVOx_bgNem3szBfv-FfDirVS9WKP0TI3fhMNpGddV5yGRadhHoCnUYM5pHCAUrxtCTS8EiI4QWtezGH1yBP3qUMjfGrdo0P7SGyBNRcwQ_TsmyP_pMi1lEp87DbQkhbMn3z9Qc Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 0d5b306a09bc4ac28c01d0bb83ddd6f8 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}] Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 0d5b306a09bc4ac28c01d0bb83ddd6f8 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-1411307611-project Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: f3a7ad284d494b4780d4a264fa1572bd Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-1411307611-project Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'fd536a3e-e454-4392-8681-f146b463ccdc'} Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:30:12.883740 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Returning 404 to user: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b30a20b0-b4d4-4a52-ae41-f106a73efea6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 404 len: 111 microversion: 2.1 time: 0.036975 Oct 03 11:30:12.888404 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3781/7229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:12 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:30:12.901925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:12.902512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:12.908855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.909297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.909732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.910426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.910886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.911312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.925121 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] HTTP exception thrown: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Request method failure captured: Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc HTTP/1.1 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOseT14-W1Bp1DlZps-B2GQZRitQPv96k2cU15vHvrJVOx_bgNem3szBfv-FfDirVS9WKP0TI3fhMNpGddV5yGRadhHoCnUYM5pHCAUrxtCTS8EiI4QWtezGH1yBP3qUMjfGrdo0P7SGyBNRcwQ_TsmyP_pMi1lEp87DbQkhbMn3z9Qc Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 0d5b306a09bc4ac28c01d0bb83ddd6f8 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}] Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 0d5b306a09bc4ac28c01d0bb83ddd6f8 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-DeleteServersTestJSON-1411307611-project Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f3a7ad284d494b4780d4a264fa1572bd Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-DeleteServersTestJSON-1411307611-project Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'fd536a3e-e454-4392-8681-f146b463ccdc'} Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:30:12.926791 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Returning 404 to user: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9330ea96-13de-4dfd-9b31-379fd1656c4f tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 404 len: 111 microversion: 2.1 time: 0.031615 Oct 03 11:30:12.931501 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3449/7230] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:30:12 2022] DELETE /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:30:12.937515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:12.938140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] [instance: fd536a3e-e454-4392-8681-f146b463ccdc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:12.944896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.945407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.945851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.946550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:12.947011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:12.947456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:12.961142 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] HTTP exception thrown: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Request method failure captured: Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc HTTP/1.1 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOseT14-W1Bp1DlZps-B2GQZRitQPv96k2cU15vHvrJVOx_bgNem3szBfv-FfDirVS9WKP0TI3fhMNpGddV5yGRadhHoCnUYM5pHCAUrxtCTS8EiI4QWtezGH1yBP3qUMjfGrdo0P7SGyBNRcwQ_TsmyP_pMi1lEp87DbQkhbMn3z9Qc Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 0d5b306a09bc4ac28c01d0bb83ddd6f8 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d5b306a09bc4ac28c01d0bb83ddd6f8"}]}] Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 0d5b306a09bc4ac28c01d0bb83ddd6f8 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-DeleteServersTestJSON-1411307611 Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-DeleteServersTestJSON-1411307611-project Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: f3a7ad284d494b4780d4a264fa1572bd Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-DeleteServersTestJSON-1411307611-project Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'fd536a3e-e454-4392-8681-f146b463ccdc'} Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:30:12.962678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] Returning 404 to user: Instance fd536a3e-e454-4392-8681-f146b463ccdc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2cacb7ea-191c-40c1-9f5f-6968f02c64d6 tempest-DeleteServersTestJSON-1411307611 tempest-DeleteServersTestJSON-1411307611-project] 10.222.0.27 "GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc" status: 404 len: 111 microversion: 2.1 time: 0.030542 Oct 03 11:30:12.966424 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3782/7231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:12 2022] GET /compute/v2.1/servers/fd536a3e-e454-4392-8681-f146b463ccdc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:30:21.911301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1961276828", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "229b1427-3bc2-413e-baa7-40b4afb7a8de"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:21.976050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] validate_networks() for [('229b1427-3bc2-413e-baa7-40b4afb7a8de', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:30:22.477119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:30:22.477560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:30:22.478029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:30:22.478429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:30:22.479033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:30:22.490702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:22.492335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:22.492829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:22.493537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:22.494013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:22.494431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:22.515305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Getting quotas for project 42bb97ce53084e44a337774126076584. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:30:22.520986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Getting quotas for user 1ea28e812c344e688fb6ee9bf98a1b7d and project 42bb97ce53084e44a337774126076584. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:30:22.534060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:30:22.536662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:30:22.586877 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e1dca987-9ec7-4fd8-bfcd-1c8f6a284176 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814554 Oct 03 11:30:22.587558 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3450/7232] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:30:22.599059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4fe59648-97df-4713-af37-bcc48bcc7fc7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:22.600461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4fe59648-97df-4713-af37-bcc48bcc7fc7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:22.665296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4fe59648-97df-4713-af37-bcc48bcc7fc7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:22.682319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4fe59648-97df-4713-af37-bcc48bcc7fc7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1218 microversion: 2.1 time: 0.080838 Oct 03 11:30:22.683491 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3783/7233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:22 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:23.708727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:23.716060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:23.722568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:23.723340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:23.724421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:23.725444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:23.726126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:23.726776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:23.797972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:23.806185 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-30dd11f7-8afe-42fe-8037-74c0a285014f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1288 microversion: 2.1 time: 0.102685 Oct 03 11:30:23.806778 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3451/7234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:23 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:24.832422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:24.832422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:24.837488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=35 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:24.840362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:24.840893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:24.841466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:24.842202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:24.842669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:24.843106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:25.338714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:25.347935 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ef78201-1f65-4383-bc2b-96124288fa24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1318 microversion: 2.1 time: 0.521770 Oct 03 11:30:25.349783 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3784/7235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:24 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:25.429489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-79359ac9-a6c8-49f3-9cec-2c1314a68e5c req-dfc3c771-cc24-4fb9-be3d-ca328b083317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bb3bb0-aa98-4509-9b6d-f9584722b271", "tag": "a695d1d1-3a67-4daa-8296-ba5e0bfe085f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:25.441019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-79359ac9-a6c8-49f3-9cec-2c1314a68e5c req-dfc3c771-cc24-4fb9-be3d-ca328b083317 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:25.442305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-79359ac9-a6c8-49f3-9cec-2c1314a68e5c req-dfc3c771-cc24-4fb9-be3d-ca328b083317 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:25.443018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-79359ac9-a6c8-49f3-9cec-2c1314a68e5c req-dfc3c771-cc24-4fb9-be3d-ca328b083317 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:25.468979 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-79359ac9-a6c8-49f3-9cec-2c1314a68e5c req-dfc3c771-cc24-4fb9-be3d-ca328b083317 service nova] Creating event network-changed:a695d1d1-3a67-4daa-8296-ba5e0bfe085f for instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 on n-h2-858383-3 Oct 03 11:30:25.476638 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-79359ac9-a6c8-49f3-9cec-2c1314a68e5c req-dfc3c771-cc24-4fb9-be3d-ca328b083317 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049835 Oct 03 11:30:25.477920 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3452/7236] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:30:26.379095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:26.379724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:26.387398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:26.387904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:26.388363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:26.389103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:26.389578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:26.390024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:26.527515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:26.535273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-35431db4-b08e-4612-82b7-11a38ff4961e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1318 microversion: 2.1 time: 0.160151 Oct 03 11:30:26.535849 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3785/7237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:26 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:27.560468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:27.561272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:27.567451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:27.567936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:27.568375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:27.569125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:27.569580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:27.570005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:27.703371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:27.711926 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-31899682-e647-44e6-a482-3924257ac129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1318 microversion: 2.1 time: 0.156557 Oct 03 11:30:27.712525 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3453/7238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:27 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:28.735593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:28.736246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:28.745426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:28.745931 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:28.746387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:28.747105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:28.747572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:28.748016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:28.881266 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:28.889258 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0c85b5e5-466d-44b8-81d2-a3e85be6f121 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1318 microversion: 2.1 time: 0.157649 Oct 03 11:30:28.889869 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3786/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:28 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:29.912338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:29.912941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:29.922878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:29.923380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:29.923849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:29.924543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:29.925031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:29.925468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:30.060255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:30.072865 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5da0cccc-aa25-48cd-90c1-3dbb72ad9a27 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1318 microversion: 2.1 time: 0.164452 Oct 03 11:30:30.073461 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3454/7240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:29 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:30.920414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a1842f86-6967-48d5-95ad-a480686aaf91 req-9716ac55-6011-4d01-8b96-0cf7d550ea05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bb3bb0-aa98-4509-9b6d-f9584722b271", "name": "network-vif-plugged", "status": "completed", "tag": "a695d1d1-3a67-4daa-8296-ba5e0bfe085f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:30.931604 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a1842f86-6967-48d5-95ad-a480686aaf91 req-9716ac55-6011-4d01-8b96-0cf7d550ea05 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:30.932114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a1842f86-6967-48d5-95ad-a480686aaf91 req-9716ac55-6011-4d01-8b96-0cf7d550ea05 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:30.932567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a1842f86-6967-48d5-95ad-a480686aaf91 req-9716ac55-6011-4d01-8b96-0cf7d550ea05 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:30.946244 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a1842f86-6967-48d5-95ad-a480686aaf91 req-9716ac55-6011-4d01-8b96-0cf7d550ea05 service nova] Creating event network-vif-plugged:a695d1d1-3a67-4daa-8296-ba5e0bfe085f for instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 on n-h2-858383-3 Oct 03 11:30:30.951501 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a1842f86-6967-48d5-95ad-a480686aaf91 req-9716ac55-6011-4d01-8b96-0cf7d550ea05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Oct 03 11:30:30.952273 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3787/7241] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:30:31.095682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:31.096464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:31.103395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:31.103889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:31.104339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:31.105079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:31.105546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:31.105979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:31.234744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:31.243262 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33709027-a8bb-4f21-8fd9-ab27e9b70e3c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1318 microversion: 2.1 time: 0.151690 Oct 03 11:30:31.243843 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3455/7242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:31 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:32.268885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:32.269718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:32.280239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.280781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.281317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.282034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.282503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.282939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.427531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:32.436235 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-97f668d3-fd53-4202-9bec-02b4ad3148be tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1509 microversion: 2.1 time: 0.172720 Oct 03 11:30:32.436823 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3788/7243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:32 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:32.461060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:32.461683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:32.471160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.471953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.472742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.473545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.474211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.474985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.508706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:32.527909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:32.622306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:32.630128 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2e682d80-7782-488a-8aa8-8004b443f85b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1509 microversion: 2.1 time: 0.173199 Oct 03 11:30:32.630707 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3456/7244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:32 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:32.653401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:32.655862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:32.662172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.662676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.664128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.664370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.664872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.665321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.672047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:32.744036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c4ea7819-266c-4bf9-925a-ac46b717a0bb tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "PUT /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1081 microversion: 2.1 time: 0.094445 Oct 03 11:30:32.745276 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3789/7245] 10.222.0.27 () {60 vars in 1256 bytes} [Mon Oct 3 11:30:32 2022] PUT /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1081 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:32.764136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:32.764754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:32.766828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:32.772905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.773526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.773998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.774667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.775170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.775598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.778778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:32.915287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:32.923306 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f4a0a5f-8578-4952-ae20-42bd2c0fcc24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1507 microversion: 2.1 time: 0.163217 Oct 03 11:30:32.923874 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3457/7246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:32 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:32.945139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:32.945758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:32.951694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.952186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.952632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:32.953392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:32.954923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:32.955364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:33.089742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:33.097531 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6c115a8d-c45c-43c3-8597-133a12e87fac tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1507 microversion: 2.1 time: 0.156430 Oct 03 11:30:33.098103 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3790/7247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:32 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:33.120225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:30:33.122667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:33.128591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:33.129111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:33.129549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:33.130242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:33.130698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:33.131126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:33.209232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:33.215282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Old instance type m1.heat2, new instance type m1.heat {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:30:33.221818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:30:33.222245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:30:33.222717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:30:33.223130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:30:33.223551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:30:33.331014 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-23fe0f24-1a5f-4f44-86e5-25dac5d92345 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "POST /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271/action" status: 202 len: 0 microversion: 2.1 time: 0.214821 Oct 03 11:30:33.331640 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3458/7248] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:30:33 2022] POST /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:30:33.339955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:33.340590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:33.347748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:33.348255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:33.348790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:33.349528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:33.350001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:33.350471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:33.494670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:33.502822 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42d89515-8fd3-456e-9ea1-41eb3ad5e001 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1518 microversion: 2.1 time: 0.166903 Oct 03 11:30:33.503391 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3791/7249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:33 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:34.526303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:34.526910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:34.534687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:34.535172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:34.535609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:34.536305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:34.536758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:34.537240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:34.670735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:34.679483 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2cc9e30c-9514-475c-a9ef-a64e460d2287 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1518 microversion: 2.1 time: 0.157443 Oct 03 11:30:34.680098 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3459/7250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:34 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:35.702742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:35.703361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:35.706079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=36 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:35.711444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:35.711942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:35.712391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:35.713119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:35.713585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:35.714020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:35.849214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:35.857661 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d1a94c49-5e36-40ea-90fc-37122cd7d98a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.158806 Oct 03 11:30:35.858226 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3792/7251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:35 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:30:36.880806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:36.881415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:36.888972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:36.889463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:36.889912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:36.890610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:36.891073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:36.891503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:37.034383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:37.042969 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-62aee094-56ea-4e28-9e79-49a63be716cd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.166059 Oct 03 11:30:37.043576 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3460/7252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:36 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:38.067128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:38.067801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:38.074790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:38.075296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:38.075751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:38.076470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:38.076974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:38.077425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:38.216590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:38.224535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-92065057-f14e-4154-a405-05b3f354866f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.161387 Oct 03 11:30:38.225139 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3793/7253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:38 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:39.249654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:39.250300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:39.257099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:39.257587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:39.258023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:39.258720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:39.259173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:39.259600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:39.395542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:39.403803 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b5d8737c-78cd-4f16-8d04-eba34a4a8554 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.158057 Oct 03 11:30:39.404385 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3461/7254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:39 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:40.431420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:40.432086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:40.439048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:40.439547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:40.439996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:40.440724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:40.441208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:40.441658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:40.586635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:40.595106 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8bc088c-dd31-4264-b54e-932c8acef941 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.168115 Oct 03 11:30:40.595694 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3794/7255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:40 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:41.618946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:41.619489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:41.626317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:41.626800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:41.627236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:41.627930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:41.628388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:41.628841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:41.765709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:41.775074 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a22131ed-96aa-4c04-93f8-dcb85b126c8c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.160167 Oct 03 11:30:41.775764 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3462/7256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:41 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:42.799935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:42.800561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:42.807550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:42.808050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:42.808511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:42.809256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:42.809732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:42.810181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:42.947569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:42.961725 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6265d8f-5049-442d-8852-ff9d344f21ed tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.165917 Oct 03 11:30:42.962326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3795/7257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:42 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:43.993022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:43.993632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:44.001308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:44.001789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:44.002225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:44.002918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:44.003373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:44.003796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:44.137065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:44.144953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40101076-d51e-4775-9c2f-d130a9e43231 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.163131 Oct 03 11:30:44.145528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3463/7258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:43 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:45.167610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:45.168212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:45.176001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:45.176607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:45.177085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:45.177811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:45.178304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:45.178801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:45.327085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:45.335367 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a4da7fba-a01e-4fca-b33a-3690ef094802 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.171658 Oct 03 11:30:45.335954 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3796/7259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:45 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:46.358577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:46.359190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:46.366492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:46.366991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:46.367956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:46.368666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:46.369146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:46.369577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:46.501424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:46.509715 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19451767-75ef-49c9-bdd8-21c459ccadc8 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.155078 Oct 03 11:30:46.510295 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3464/7260] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:46 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:47.532304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:47.532950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:47.539745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:47.540242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:47.540694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:47.541427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:47.541893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:47.542333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:47.675777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:47.683547 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e57e6ac5-2069-4771-831a-ece6e9dc0a33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.155195 Oct 03 11:30:47.684126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3797/7261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:47 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:48.707131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:48.707742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:48.715168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:48.715650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:48.716087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:48.716793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:48.717251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:48.717678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:48.845861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:48.854325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d9badc7-85fd-42ec-ab06-5f1d370bad00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.151122 Oct 03 11:30:48.854903 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3465/7262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:48 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:49.877350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:49.877923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:49.884738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:49.885263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:49.885717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:49.886423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:49.886894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:49.887331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:50.021437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:50.029956 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0a422dbd-d767-499f-b769-c7a1ea895210 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.156606 Oct 03 11:30:50.030536 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3798/7263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:49 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:51.054195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:51.055342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:51.062139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:51.062621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:51.063060 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:51.063753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:51.064203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:51.064626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:51.203848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:51.211624 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ebe1e75-bd2b-4724-b8f0-a951adabc2f9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.161428 Oct 03 11:30:51.212215 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3466/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:51 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:52.235854 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:52.236521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:52.243680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:52.244183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:52.244640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:52.245400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:52.246670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:52.246670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:52.377054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:52.385264 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0b22271-c39d-4d16-92d2-7f1018f82bca tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.153354 Oct 03 11:30:52.385941 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3799/7265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:52 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:30:53.408690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:53.409255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:53.416441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:53.416963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:53.417406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:53.418098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:53.418550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:53.418972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:53.551164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:53.559619 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0119c462-c9c7-4212-9438-cc38945f4632 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.154886 Oct 03 11:30:53.560204 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3467/7266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:53 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:54.582990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:54.583654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:54.591317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:54.591822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:54.592278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:54.593016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:54.593492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:54.593939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:54.612616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:30:54.727692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:54.735490 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c3a61dd1-43ab-4cea-baaa-2b515d049c5a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.156537 Oct 03 11:30:54.736064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3800/7267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:54 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:55.758774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:55.759398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:55.766637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:55.767124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:55.767565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:55.768257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:55.768713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:55.769165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:55.900631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:55.908289 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-25b5b1b9-2c18-42af-8624-f8b895d2fed4 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.153474 Oct 03 11:30:55.908881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3468/7268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:55 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:56.932978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:56.933598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:56.940458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:56.941016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:56.941464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:56.942204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:56.942713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:56.943148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:57.103135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:57.111464 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1996a485-3cd0-4635-addf-ebe580e42129 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.183281 Oct 03 11:30:57.112043 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3801/7269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:56 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:58.135829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:58.136470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:58.143443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:58.143940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:58.144389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:58.145120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:58.145588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:58.146021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:58.277601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:58.285485 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0a67e7b2-dde4-438b-af5d-79345281253d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.154222 Oct 03 11:30:58.286088 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3469/7270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:58 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:30:59.308682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:30:59.309371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:30:59.316265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:59.316783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:59.317258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:59.318032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:30:59.318464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:30:59.318912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:30:59.452069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:30:59.459948 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2216567d-d78c-4a35-b339-d2009ec2e62a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.155225 Oct 03 11:30:59.460533 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3802/7271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:30:59 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:00.486164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:00.486805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:00.496044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:00.496544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:00.497027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:00.497750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:00.498352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:00.498887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:00.635100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:00.642753 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2892f506-60a2-491e-93e1-7eadf671895d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.161423 Oct 03 11:31:00.643327 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3470/7272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:00 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:01.666661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:01.667310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:01.674978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:01.675487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:01.675945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:01.677299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:01.677299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:01.677586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:01.819080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:01.827702 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06d94d47-ae67-433a-818e-f9eb7800267d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1523 microversion: 2.1 time: 0.165515 Oct 03 11:31:01.828283 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3803/7273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:01 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:31:02.736428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c59b9393-c92a-46c6-9e0d-5adec290c667 req-9af2d1a6-c228-4868-91f8-5862c9cc5eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bb3bb0-aa98-4509-9b6d-f9584722b271", "name": "network-vif-unplugged", "status": "completed", "tag": "a695d1d1-3a67-4daa-8296-ba5e0bfe085f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:02.746306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c59b9393-c92a-46c6-9e0d-5adec290c667 req-9af2d1a6-c228-4868-91f8-5862c9cc5eef service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:02.746788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c59b9393-c92a-46c6-9e0d-5adec290c667 req-9af2d1a6-c228-4868-91f8-5862c9cc5eef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:02.747217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c59b9393-c92a-46c6-9e0d-5adec290c667 req-9af2d1a6-c228-4868-91f8-5862c9cc5eef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:02.760052 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c59b9393-c92a-46c6-9e0d-5adec290c667 req-9af2d1a6-c228-4868-91f8-5862c9cc5eef service nova] Creating event network-vif-unplugged:a695d1d1-3a67-4daa-8296-ba5e0bfe085f for instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 on n-h1-858383-3 Oct 03 11:31:02.765568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-c59b9393-c92a-46c6-9e0d-5adec290c667 req-9af2d1a6-c228-4868-91f8-5862c9cc5eef service nova] Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:31:02.777278 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c59b9393-c92a-46c6-9e0d-5adec290c667 req-9af2d1a6-c228-4868-91f8-5862c9cc5eef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044364 Oct 03 11:31:02.778083 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3471/7274] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:02.852606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:02.853856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:02.859885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:02.860391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:02.860869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:02.861591 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:02.862077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:02.862507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:03.000235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:03.012127 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a3780703-a94b-4bba-a48a-cdab96398532 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1522 microversion: 2.1 time: 0.164406 Oct 03 11:31:03.012805 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3804/7275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:02 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:04.038207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:04.038908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:04.041348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=34 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:04.047012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:04.047752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:04.048190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:04.048904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:04.049359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:04.049783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:04.052539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:04.191406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:04.200148 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f55ff8e-0a0f-4bf0-8514-84a29f636579 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1520 microversion: 2.1 time: 0.167060 Oct 03 11:31:04.200723 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3472/7276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:04 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:04.805190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5b7518b4-4208-43c5-8175-1ef2fc3dc9f1 req-dcfd921e-e4fe-40aa-a3ae-fe61a2231a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bb3bb0-aa98-4509-9b6d-f9584722b271", "tag": "a695d1d1-3a67-4daa-8296-ba5e0bfe085f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:04.815595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5b7518b4-4208-43c5-8175-1ef2fc3dc9f1 req-dcfd921e-e4fe-40aa-a3ae-fe61a2231a56 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:04.816139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5b7518b4-4208-43c5-8175-1ef2fc3dc9f1 req-dcfd921e-e4fe-40aa-a3ae-fe61a2231a56 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:04.816580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5b7518b4-4208-43c5-8175-1ef2fc3dc9f1 req-dcfd921e-e4fe-40aa-a3ae-fe61a2231a56 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:04.829233 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5b7518b4-4208-43c5-8175-1ef2fc3dc9f1 req-dcfd921e-e4fe-40aa-a3ae-fe61a2231a56 service nova] Creating event network-changed:a695d1d1-3a67-4daa-8296-ba5e0bfe085f for instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 on n-h1-858383-3 Oct 03 11:31:04.834613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-5b7518b4-4208-43c5-8175-1ef2fc3dc9f1 req-dcfd921e-e4fe-40aa-a3ae-fe61a2231a56 service nova] Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:31:04.846058 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5b7518b4-4208-43c5-8175-1ef2fc3dc9f1 req-dcfd921e-e4fe-40aa-a3ae-fe61a2231a56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044592 Oct 03 11:31:04.846662 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3805/7277] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:05.224083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:05.224742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:05.231764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:05.232249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:05.232718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:05.233440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:05.233893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:05.234322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:05.373848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:05.381707 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c30349fe-1c9d-4965-a24e-af2c22b22f48 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1520 microversion: 2.1 time: 0.161502 Oct 03 11:31:05.382297 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3473/7278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:05 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:06.412094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:06.413966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:06.416014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=28 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:06.421774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:06.422285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:06.423009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:06.423740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:06.424214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:06.424662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:06.585049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:06.593314 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6310a2b8-55e5-475a-94e4-c740ebb1c9fe tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1520 microversion: 2.1 time: 0.186487 Oct 03 11:31:06.593907 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3806/7279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:06 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:31:07.616334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:07.616983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:07.624039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:07.624527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:07.625102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:07.625871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:07.626336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:07.626770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:07.756139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:07.764561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b0b9e0ea-dbec-46c4-a12b-85dca2ea22b5 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1517 microversion: 2.1 time: 0.152197 Oct 03 11:31:07.765167 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3474/7280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:07 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:07.787316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:07.787890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:07.794740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:07.795238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:07.795687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:07.796394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:07.796891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:07.797335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:07.856785 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f0f5847c-557e-45f8-a7fa-43b2ce19767c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "POST /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271/action" status: 204 len: 0 microversion: 2.1 time: 0.073030 Oct 03 11:31:07.857388 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3807/7281] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:31:07 2022] POST /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:31:07.866880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:07.867493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:07.874442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:07.875129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:07.875823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:07.876602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:07.877182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:07.877611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:08.024496 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:08.032755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-12470127-0d93-49da-91d2-86c059c1c528 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1517 microversion: 2.1 time: 0.171028 Oct 03 11:31:08.033368 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3475/7282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:07 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:09.058434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:09.059151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:09.065909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:09.066417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:09.066868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:09.067656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:09.068132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:09.068571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:09.228260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:09.236152 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-654e5f7c-9296-4f03-93b5-66c011e3e7f7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1509 microversion: 2.1 time: 0.183072 Oct 03 11:31:09.236726 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3808/7283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:09 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:09.260832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:09.261494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:09.268962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:09.269428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:09.269862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:09.270723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:09.271174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:09.271600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:09.411934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:09.420086 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e80db0b3-b9d4-4948-ab12-97e2d1f73c0a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1509 microversion: 2.1 time: 0.164144 Oct 03 11:31:09.420676 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3476/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:09 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:09.445850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-49fb39c6-df61-42d6-844c-5ddc09756027 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'create', calling method: .version_select at 0x7f07549fb160>, body: {"keypair": {"name": "tempest-keypair-736579978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfgCsRYaMxb8WcowSp8Fvd+ohBKIRBsV0ZUYGXM5FVeb4yRIKhzoDT42q6m/CezcvAjngzO5ju7B8J9pzAa3BsltrVLf9fd5qxdOrD/Bvd3wubAm7OGT6vJosnkh+H0Fg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:09.461769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-49fb39c6-df61-42d6-844c-5ddc09756027 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Getting quotas for project 42bb97ce53084e44a337774126076584. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:31:09.467651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-49fb39c6-df61-42d6-844c-5ddc09756027 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Getting quotas for user 1ea28e812c344e688fb6ee9bf98a1b7d and project 42bb97ce53084e44a337774126076584. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:31:09.492938 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-49fb39c6-df61-42d6-844c-5ddc09756027 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050852 Oct 03 11:31:09.494060 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3809/7285] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:31:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:10.500687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d83161cf-4522-478e-b66f-f5c989ad2279 req-e486e347-4180-4dad-8d9d-6bdf2c5b2078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bb3bb0-aa98-4509-9b6d-f9584722b271", "name": "network-vif-plugged", "status": "completed", "tag": "a695d1d1-3a67-4daa-8296-ba5e0bfe085f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:10.512923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d83161cf-4522-478e-b66f-f5c989ad2279 req-e486e347-4180-4dad-8d9d-6bdf2c5b2078 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:10.513418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d83161cf-4522-478e-b66f-f5c989ad2279 req-e486e347-4180-4dad-8d9d-6bdf2c5b2078 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:10.513855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d83161cf-4522-478e-b66f-f5c989ad2279 req-e486e347-4180-4dad-8d9d-6bdf2c5b2078 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:10.527329 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d83161cf-4522-478e-b66f-f5c989ad2279 req-e486e347-4180-4dad-8d9d-6bdf2c5b2078 service nova] Creating event network-vif-plugged:a695d1d1-3a67-4daa-8296-ba5e0bfe085f for instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 on n-h1-858383-3 Oct 03 11:31:10.534151 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d83161cf-4522-478e-b66f-f5c989ad2279 req-e486e347-4180-4dad-8d9d-6bdf2c5b2078 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037159 Oct 03 11:31:10.535260 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3477/7286] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:10.734103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:10.734737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:10.742972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:10.743547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:10.744532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:10.745263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:10.745734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:10.746187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:10.881658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:10.889315 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6380dd32-e3cb-4c21-a5cd-b3cddec7f988 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 200 len: 1509 microversion: 2.1 time: 0.160415 Oct 03 11:31:10.889892 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3810/7287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:10 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:10.912287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:10.912916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:10.920061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:10.920586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:10.921067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:10.921779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:10.922243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:10.922940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:10.953453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:31:11.032432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3a9105aa-77bb-432a-96fd-17ca9d75ae33 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 204 len: 0 microversion: 2.1 time: 0.124063 Oct 03 11:31:11.033264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3478/7288] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:31:10 2022] DELETE /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:31:11.086539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1552420886", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "229b1427-3bc2-413e-baa7-40b4afb7a8de"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:11.144090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] validate_networks() for [('229b1427-3bc2-413e-baa7-40b4afb7a8de', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:31:11.522755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:31:11.523188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:31:11.523875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:31:11.524303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:31:11.525349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:31:11.534986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:11.535472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:11.536071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:11.537096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:11.537563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:11.537999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:11.558615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Getting quotas for project 42bb97ce53084e44a337774126076584. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:31:11.564090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Getting quotas for user 1ea28e812c344e688fb6ee9bf98a1b7d and project 42bb97ce53084e44a337774126076584. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:31:11.579576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:31:11.582116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:31:11.640492 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1227b213-0adf-4afa-b393-e55916d67ca2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557660 Oct 03 11:31:11.642060 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3811/7289] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:31:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:31:11.654564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bd501f6e-a151-4c54-8238-c5fba42ee4db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:11.655508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bd501f6e-a151-4c54-8238-c5fba42ee4db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:11.718086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bd501f6e-a151-4c54-8238-c5fba42ee4db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:11.729303 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bd501f6e-a151-4c54-8238-c5fba42ee4db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1218 microversion: 2.1 time: 0.079749 Oct 03 11:31:11.729893 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3479/7290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:11 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:12.754169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:12.754927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:12.762177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:12.762714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:12.763211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:12.763974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:12.764456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:12.765032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:12.830115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:12.838670 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1ed95d9a-e823-4c2f-8763-188970d510b0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1270 microversion: 2.1 time: 0.089443 Oct 03 11:31:12.839259 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3812/7291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:12 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:13.088924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-219d1b06-3745-4776-9224-89d023e8dff8 req-afdd17a2-7471-4f81-8e1a-78a2f0f797ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bb3bb0-aa98-4509-9b6d-f9584722b271", "name": "network-vif-deleted", "tag": "a695d1d1-3a67-4daa-8296-ba5e0bfe085f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:13.103281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-219d1b06-3745-4776-9224-89d023e8dff8 req-afdd17a2-7471-4f81-8e1a-78a2f0f797ae service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:13.104127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-219d1b06-3745-4776-9224-89d023e8dff8 req-afdd17a2-7471-4f81-8e1a-78a2f0f797ae service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:13.107067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-219d1b06-3745-4776-9224-89d023e8dff8 req-afdd17a2-7471-4f81-8e1a-78a2f0f797ae service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:13.122900 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-219d1b06-3745-4776-9224-89d023e8dff8 req-afdd17a2-7471-4f81-8e1a-78a2f0f797ae service nova] Creating event network-vif-deleted:a695d1d1-3a67-4daa-8296-ba5e0bfe085f for instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 on n-h1-858383-3 Oct 03 11:31:13.128901 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-219d1b06-3745-4776-9224-89d023e8dff8 req-afdd17a2-7471-4f81-8e1a-78a2f0f797ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044551 Oct 03 11:31:13.130147 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3480/7292] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:13.862460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:13.863181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:13.871119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:13.871717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:13.872238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:13.873110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:13.873576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:13.874016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:14.020267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:14.028659 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c0a84385-21da-4984-924b-41106184572d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.170052 Oct 03 11:31:14.029322 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3813/7293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:13 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:15.052807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:15.053536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:15.060680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:15.061215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:15.061661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:15.062381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:15.062844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:15.063280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:15.165691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-25d0a2ad-fb9e-4a42-a055-ccf6a3f6db33 req-29d90372-0f1f-4fba-b2ed-b31eb5c6f84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5a7797-8130-4996-9618-4bcfbd071bf1", "tag": "2ab37197-ce61-4800-aa85-247bfcc7f63e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:15.176762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-25d0a2ad-fb9e-4a42-a055-ccf6a3f6db33 req-29d90372-0f1f-4fba-b2ed-b31eb5c6f84e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:15.177384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-25d0a2ad-fb9e-4a42-a055-ccf6a3f6db33 req-29d90372-0f1f-4fba-b2ed-b31eb5c6f84e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:15.177745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-25d0a2ad-fb9e-4a42-a055-ccf6a3f6db33 req-29d90372-0f1f-4fba-b2ed-b31eb5c6f84e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:15.197849 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-25d0a2ad-fb9e-4a42-a055-ccf6a3f6db33 req-29d90372-0f1f-4fba-b2ed-b31eb5c6f84e service nova] Creating event network-changed:2ab37197-ce61-4800-aa85-247bfcc7f63e for instance bc5a7797-8130-4996-9618-4bcfbd071bf1 on n-h1-858383-3 Oct 03 11:31:15.204804 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-25d0a2ad-fb9e-4a42-a055-ccf6a3f6db33 req-29d90372-0f1f-4fba-b2ed-b31eb5c6f84e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042626 Oct 03 11:31:15.205579 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3814/7294] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:31:15.280292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:15.288414 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96beeeab-a8e6-4ce8-8dcb-73bb99d9b38d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.240571 Oct 03 11:31:15.288955 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3481/7295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:15 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:16.311704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:16.312453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:16.318754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:16.319255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:16.319721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:16.320424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:16.320932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:16.321382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:16.456882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:16.465295 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-af6f4afc-c00d-46b9-bce9-eff265dde01e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.158599 Oct 03 11:31:16.465881 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3815/7296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:16 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:17.488242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:17.489031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:17.496130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:17.496629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:17.497098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:17.497806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:17.498267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:17.498700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:17.629254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:17.637426 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f449475-2c1f-40a1-a899-4ad734d6b26e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.153105 Oct 03 11:31:17.637992 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3482/7297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:17 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:18.660917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:18.661549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:18.668561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:18.669098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:18.669563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:18.670284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:18.670756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:18.671203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:18.801920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:18.810604 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-27bb8f54-3a9f-46b4-a6e7-c202a5c65c2d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.153672 Oct 03 11:31:18.811191 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3816/7298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:18 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:19.834116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:19.834681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:19.842160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:19.842885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:19.843365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:19.844029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:19.844493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:19.844954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:19.986409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:19.994098 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93a47e0b-b01c-400b-81ce-99df5cc5da00 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.164003 Oct 03 11:31:19.994698 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3483/7299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:19 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:21.017357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:21.017983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:21.024789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:21.025292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:21.025750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:21.026458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:21.026923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:21.027355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:21.163288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:21.171528 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a4cc3a4-d142-4996-8205-ce62bcad71e9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.158074 Oct 03 11:31:21.172098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3817/7300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:21 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:22.194493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:22.195108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:22.198048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:22.204176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:22.204668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:22.205149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:22.205855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:22.206324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:22.206763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:22.339809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:22.347749 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8319a3e9-7fb9-43dd-83a0-dae62642a493 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.157148 Oct 03 11:31:22.348335 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3484/7301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:22 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:22.571470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-772424e7-dc42-4bc5-ad4a-4ccbc0deb7db req-e179fcf7-e67b-4b06-afc8-f910e19ad5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5a7797-8130-4996-9618-4bcfbd071bf1", "name": "network-vif-plugged", "status": "completed", "tag": "2ab37197-ce61-4800-aa85-247bfcc7f63e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:22.577806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:22.578738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:22.592688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-772424e7-dc42-4bc5-ad4a-4ccbc0deb7db req-e179fcf7-e67b-4b06-afc8-f910e19ad5f4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:22.593245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-772424e7-dc42-4bc5-ad4a-4ccbc0deb7db req-e179fcf7-e67b-4b06-afc8-f910e19ad5f4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:22.593719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-772424e7-dc42-4bc5-ad4a-4ccbc0deb7db req-e179fcf7-e67b-4b06-afc8-f910e19ad5f4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:22.605704 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-772424e7-dc42-4bc5-ad4a-4ccbc0deb7db req-e179fcf7-e67b-4b06-afc8-f910e19ad5f4 service nova] Creating event network-vif-plugged:2ab37197-ce61-4800-aa85-247bfcc7f63e for instance bc5a7797-8130-4996-9618-4bcfbd071bf1 on n-h1-858383-3 Oct 03 11:31:22.611673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-772424e7-dc42-4bc5-ad4a-4ccbc0deb7db req-e179fcf7-e67b-4b06-afc8-f910e19ad5f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043575 Oct 03 11:31:22.612305 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3818/7302] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:23.371297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:23.371824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:23.378628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:23.379119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:23.379563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:23.380257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:23.380718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:23.381168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:23.509791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:23.518330 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dde4cf4-24d9-40fa-90c3-2bac993aed9f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1318 microversion: 2.1 time: 0.151054 Oct 03 11:31:23.519167 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3485/7303] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:23 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:24.543178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:24.543919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:24.551207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:24.551700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:24.552144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:24.552875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:24.553338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:24.553773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:24.568398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:24.684708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:24.692572 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7083c151-f0c3-44b3-aef4-bed89075f79b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1508 microversion: 2.1 time: 0.154378 Oct 03 11:31:24.693178 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3819/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:24 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:24.715104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:24.715730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:24.722510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:24.723003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:24.723449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:24.724152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:24.724619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:24.725087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:24.858099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:24.866218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a29eec2f-9520-4c90-a35d-d18bf8f6a2db tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1508 microversion: 2.1 time: 0.155524 Oct 03 11:31:24.866805 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3486/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:24 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:31:24.888450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:24.890829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:24.897002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:24.897563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:24.898115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:24.898819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:24.899279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:24.899717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:24.928497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:24.933939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Old instance type m1.heat2, new instance type m1.heat {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:31:24.940365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:31:24.940818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:31:24.941438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:31:24.941860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:31:24.942281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:31:25.007172 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ee4360b6-c179-4aba-b344-3bf413faa880 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "POST /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.123091 Oct 03 11:31:25.007793 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3820/7306] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:31:24 2022] POST /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:31:25.016812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:25.017811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:25.024247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:25.024755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:25.025232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:25.025947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:25.026414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:25.027429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:25.189029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:25.197557 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4836a908-f110-467e-856a-218017efc0a2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1515 microversion: 2.1 time: 0.184793 Oct 03 11:31:25.198133 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3487/7307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:25 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:26.223386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:26.223965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:26.231955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:26.232473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:26.232965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:26.233701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:26.234178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:26.234628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:26.641049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:26.649112 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f846fccb-14ba-48fc-bdd8-11e323f35f24 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1515 microversion: 2.1 time: 0.430652 Oct 03 11:31:26.649698 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3821/7308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:26 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:27.673207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:27.673823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:27.680675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:27.681196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:27.681638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:27.682329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:27.686856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:27.687335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:27.820407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:27.828387 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-24f33bb7-7df8-4b26-be6b-01db1c9979fd tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.159348 Oct 03 11:31:27.828933 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3488/7309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:27 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:28.852035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:28.852587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:28.859255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:28.859753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:28.860208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:28.860947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:28.861421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:28.861867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:28.989830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:28.998090 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d8dce31e-2c99-4472-96dc-4885c1513548 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.150245 Oct 03 11:31:28.998660 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3822/7310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:28 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:30.022139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:30.022821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:30.030485 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:30.030970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:30.031413 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:30.032119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:30.032578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:30.033038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:30.048791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:30.168202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:30.176463 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-622e5a73-6904-463b-a398-3ed5006a8f59 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.158411 Oct 03 11:31:30.177077 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3489/7311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:30 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:31.200206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:31.200875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:31.207689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:31.208177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:31.208621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:31.209345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:31.209807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:31.210243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:31.341988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:31.349811 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5366cffb-7d4a-4566-8917-04408eebcc9e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.154120 Oct 03 11:31:31.350383 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3823/7312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:31 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:32.373267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:32.373883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:32.381095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:32.381589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:32.382035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:32.382750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:32.383246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:32.383678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:32.521674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:32.531541 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eeab1986-c430-4c2f-b624-28daf9ddba3a tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.162369 Oct 03 11:31:32.532125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3490/7313] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:32 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:33.558061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:33.558689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:33.565670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:33.566171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:33.566625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:33.567344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:33.567819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:33.568267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:33.704414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:33.712429 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f06b453c-ce91-4d86-b2b1-5cd65a0db288 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.158375 Oct 03 11:31:33.713055 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3824/7314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:33 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:34.736076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:34.736682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:34.739421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:34.744762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:34.745277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:34.745712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:34.746451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:34.746903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:34.747354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:34.875604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:34.883286 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-57429e2a-8278-4090-a545-8ec1b74cde1b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.151129 Oct 03 11:31:34.883854 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3491/7315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:34 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:35.906873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:35.907429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:35.914305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:35.914805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:35.915263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:35.915965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:35.916434 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:35.916900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:36.048554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:36.056240 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-85358c4a-104c-46d8-92b9-d387c0bae5a0 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.153316 Oct 03 11:31:36.056839 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3825/7316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:35 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:37.080305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:37.080979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:37.087733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:37.088217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:37.088655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:37.089383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:37.090649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:37.091079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:37.234716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:37.242903 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eee47a7a-6695-4030-be20-a2d7eacbf6fc tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.166572 Oct 03 11:31:37.243492 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3492/7317] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:37 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:38.266789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:38.267437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:38.270805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:38.276688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:38.277834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:38.278291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:38.279026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:38.279501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:38.279948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:38.417776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:38.425990 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1630c791-898a-4f3f-87d6-5bec2f290c2b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.163209 Oct 03 11:31:38.426561 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3826/7318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:38 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:39.448684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:39.449359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:39.451834 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:31:39.451987 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 (ip 10.222.0.27) !!! Oct 03 11:31:39.461597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:39.462111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:39.462548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:39.463472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:39.463923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:39.464860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:39.599036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:39.608213 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0106b618-2f00-4988-84ac-773e42043df6 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.163510 Oct 03 11:31:39.608821 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3493/7319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:39 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:40.631432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:40.632089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:40.638909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:40.639411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:40.639860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:40.640563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:40.641050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:40.641493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:40.772446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:40.781023 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96a6c95e-6f55-4f18-9da9-ddfcd0b14739 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.153466 Oct 03 11:31:40.781591 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3827/7320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:40 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:41.804505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:41.805145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:41.811990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:41.812473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:41.812946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:41.813637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:41.814091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:41.814516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:41.949810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:41.958635 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55f5326d-16fc-4c2c-bb2d-6676225df4c3 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.157194 Oct 03 11:31:41.958635 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3494/7321] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:41 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:42.982318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:42.982955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:42.989680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:42.990187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:42.990646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:42.991371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:42.991870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:42.992325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:43.126358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:43.134219 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b0518dc6-2347-491a-a5dc-58dfb6757b92 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.156615 Oct 03 11:31:43.134784 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3828/7322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:42 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:44.157151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:44.157770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:44.164783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:44.165290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:44.165742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:44.166440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:44.166901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:44.167336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:44.298377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:44.306332 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-49ac51c3-1521-4e71-98b9-ba8ae2547b7d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.153141 Oct 03 11:31:44.306905 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3495/7323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:44 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:45.329874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:45.330485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:45.338103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:45.338601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:45.339048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:45.339763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:45.340226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:45.340660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:45.481938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:45.489627 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3968c2da-103a-42b6-a046-e3184e870b0d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.163656 Oct 03 11:31:45.490935 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3829/7324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:45 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:46.513674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:46.514300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:46.521307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:46.521802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:46.522256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:46.522970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:46.523447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:46.523881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:46.665267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:46.673686 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-56aeeda1-f365-4799-a00e-08bbe544c77d tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.164605 Oct 03 11:31:46.674265 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3496/7325] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:46 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:47.696455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:47.697133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:47.704504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:47.705031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:47.705483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:47.706183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:47.706643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:47.707081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:47.844448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:47.853056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbe1afa4-6e31-4586-ab0f-6d72c9d9753f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.160410 Oct 03 11:31:47.853642 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3830/7326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:47 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:48.876692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:48.877248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:48.884104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:48.884585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:48.885050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:48.885742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:48.886346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:48.886776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:49.021526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:49.029541 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-23ce4ab5-34a1-456e-b71e-c0f7fe72e889 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.156801 Oct 03 11:31:49.030135 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3497/7327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:48 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:50.053484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:50.054111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:50.061019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:50.061519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:50.061974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:50.062680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:50.063198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:50.063641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:50.190695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:50.198524 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6a42d5e1-dcd0-401a-bbfc-4f2f4be4a202 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.148930 Oct 03 11:31:50.199096 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3831/7328] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:50 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:51.221727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:51.222350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:51.229283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:51.230284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:51.230727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:51.231430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:51.231891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:51.232323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:51.366207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:51.374975 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa2f8408-197a-48fc-a0c2-8fc6566eb65c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.157127 Oct 03 11:31:51.375890 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3498/7329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:51 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:52.397744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:52.398370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:52.405728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:52.406228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:52.406680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:52.407388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:52.407856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:52.408294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:52.547462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:52.555571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d893686-db54-4f6a-b059-5d82c9473f2c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.161771 Oct 03 11:31:52.556154 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3832/7330] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:52 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:53.582359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:53.582970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:53.590448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:53.590928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:53.591362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:53.592052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:53.592500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:53.593030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:53.768899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:53.776735 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bc81f4c4-855e-4c8b-9f75-ab406391110e tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1520 microversion: 2.1 time: 0.198275 Oct 03 11:31:53.777338 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3499/7331] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:53 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:54.320406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-36c3cf4c-64d9-4214-a4fa-17e5d80b128e req-95299855-7aba-4714-b72a-e5fc683a076d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5a7797-8130-4996-9618-4bcfbd071bf1", "name": "network-vif-unplugged", "status": "completed", "tag": "2ab37197-ce61-4800-aa85-247bfcc7f63e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:54.331175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36c3cf4c-64d9-4214-a4fa-17e5d80b128e req-95299855-7aba-4714-b72a-e5fc683a076d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:54.331732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36c3cf4c-64d9-4214-a4fa-17e5d80b128e req-95299855-7aba-4714-b72a-e5fc683a076d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:54.332244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36c3cf4c-64d9-4214-a4fa-17e5d80b128e req-95299855-7aba-4714-b72a-e5fc683a076d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:54.345341 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-36c3cf4c-64d9-4214-a4fa-17e5d80b128e req-95299855-7aba-4714-b72a-e5fc683a076d service nova] Creating event network-vif-unplugged:2ab37197-ce61-4800-aa85-247bfcc7f63e for instance bc5a7797-8130-4996-9618-4bcfbd071bf1 on n-h2-858383-3 Oct 03 11:31:54.351214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-36c3cf4c-64d9-4214-a4fa-17e5d80b128e req-95299855-7aba-4714-b72a-e5fc683a076d service nova] Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:31:54.363871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-36c3cf4c-64d9-4214-a4fa-17e5d80b128e req-95299855-7aba-4714-b72a-e5fc683a076d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047657 Oct 03 11:31:54.365021 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3833/7332] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:54.800754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:54.801398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:54.809463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:54.809957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:54.810406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:54.811121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:54.811586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:54.812020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:54.952854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:54.960913 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47783320-7075-4a62-9799-dd0f850b7d37 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1519 microversion: 2.1 time: 0.164256 Oct 03 11:31:54.961589 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3500/7333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:54 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:55.985565 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:55.986287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:55.993476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:55.993970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:55.994421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:55.995122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:55.996096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:55.996542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:55.999205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:31:56.150823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:56.158593 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-236df550-1139-4713-8fd7-8cea0a9a5319 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1517 microversion: 2.1 time: 0.177674 Oct 03 11:31:56.159168 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3834/7334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:55 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:56.388549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-31fa0036-0ebd-48bf-87a3-fa82d24d65fc req-e6229ce3-1d03-4770-87cf-76656b8bda66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5a7797-8130-4996-9618-4bcfbd071bf1", "tag": "2ab37197-ce61-4800-aa85-247bfcc7f63e"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:56.398756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-31fa0036-0ebd-48bf-87a3-fa82d24d65fc req-e6229ce3-1d03-4770-87cf-76656b8bda66 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:56.399232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-31fa0036-0ebd-48bf-87a3-fa82d24d65fc req-e6229ce3-1d03-4770-87cf-76656b8bda66 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:56.399659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-31fa0036-0ebd-48bf-87a3-fa82d24d65fc req-e6229ce3-1d03-4770-87cf-76656b8bda66 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:56.411726 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-31fa0036-0ebd-48bf-87a3-fa82d24d65fc req-e6229ce3-1d03-4770-87cf-76656b8bda66 service nova] Creating event network-changed:2ab37197-ce61-4800-aa85-247bfcc7f63e for instance bc5a7797-8130-4996-9618-4bcfbd071bf1 on n-h2-858383-3 Oct 03 11:31:56.417781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-31fa0036-0ebd-48bf-87a3-fa82d24d65fc req-e6229ce3-1d03-4770-87cf-76656b8bda66 service nova] Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:31:56.429401 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-31fa0036-0ebd-48bf-87a3-fa82d24d65fc req-e6229ce3-1d03-4770-87cf-76656b8bda66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044441 Oct 03 11:31:56.430172 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3501/7335] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:57.183403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:57.183962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:57.190742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:57.191247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:57.191698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:57.192411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:57.192905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:57.193338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:57.327067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:57.334731 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c01e45d-2428-46ee-bf63-f022d32d79e2 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1514 microversion: 2.1 time: 0.155758 Oct 03 11:31:57.335643 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3835/7336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:57 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:57.358562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:57.359181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:57.365377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:57.365868 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:57.366305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:57.366999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:57.367449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:57.367872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:57.430644 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3180ef27-1631-4bc0-a803-ecf5c2a0a82b tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "POST /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1/action" status: 204 len: 0 microversion: 2.1 time: 0.076133 Oct 03 11:31:57.432322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3502/7337] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:31:57 2022] POST /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:31:57.441459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:57.442343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:57.449955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:57.450605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:57.451123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:57.452200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:57.452728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:57.453412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:57.608526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:57.616509 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c9b4cc61-5422-4026-9ea1-ccc695db7daa tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1514 microversion: 2.1 time: 0.179447 Oct 03 11:31:57.617129 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3836/7338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:57 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:58.641293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:58.642025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:58.649898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:58.650404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:58.650850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:58.652119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:58.652614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:58.653220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:58.806832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:58.817593 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-88872969-a06c-4137-9800-4d83039cfcea tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1514 microversion: 2.1 time: 0.180371 Oct 03 11:31:58.818142 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3503/7339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:58 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:31:59.425808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-94782783-3355-46aa-a8d9-9e1446d817f0 req-38b26fb6-e8f0-460c-aedc-0b7b29dcb5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5a7797-8130-4996-9618-4bcfbd071bf1", "name": "network-vif-plugged", "status": "completed", "tag": "2ab37197-ce61-4800-aa85-247bfcc7f63e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:31:59.436966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-94782783-3355-46aa-a8d9-9e1446d817f0 req-38b26fb6-e8f0-460c-aedc-0b7b29dcb5a3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:59.437470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-94782783-3355-46aa-a8d9-9e1446d817f0 req-38b26fb6-e8f0-460c-aedc-0b7b29dcb5a3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:59.437919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-94782783-3355-46aa-a8d9-9e1446d817f0 req-38b26fb6-e8f0-460c-aedc-0b7b29dcb5a3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:59.451280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-94782783-3355-46aa-a8d9-9e1446d817f0 req-38b26fb6-e8f0-460c-aedc-0b7b29dcb5a3 service nova] Creating event network-vif-plugged:2ab37197-ce61-4800-aa85-247bfcc7f63e for instance bc5a7797-8130-4996-9618-4bcfbd071bf1 on n-h2-858383-3 Oct 03 11:31:59.456538 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-94782783-3355-46aa-a8d9-9e1446d817f0 req-38b26fb6-e8f0-460c-aedc-0b7b29dcb5a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034601 Oct 03 11:31:59.457310 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3837/7340] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:31:59.842487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:31:59.843099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:31:59.850005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:59.850483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:59.850928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:59.851616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:31:59.852071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:31:59.852502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:31:59.985273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:31:59.992874 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c765cbd-bbfa-4e66-8615-5d8214153e89 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1506 microversion: 2.1 time: 0.154844 Oct 03 11:31:59.993443 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3504/7341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:31:59 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:32:00.016092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:00.016860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:00.023241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.023731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.024184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.024910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.025393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.025821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.157339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:00.165249 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4c19af13-d59f-4249-968c-17bb790e951c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1506 microversion: 2.1 time: 0.153471 Oct 03 11:32:00.165833 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3838/7342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:00 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:00.187298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:00.187906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:00.193859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.194344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.194784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.195478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.195937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.196364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.199604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:00.331039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:00.338787 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65a43e53-ef76-4812-b0a5-a3fb7b885ac7 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1506 microversion: 2.1 time: 0.155385 Oct 03 11:32:00.339933 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3505/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:00 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:00.361406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:00.361879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:00.367813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.368308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.368783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.369492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.369965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.370402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.395164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:32:00.474440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c06af492-2a81-41b8-8e7d-cbcbefe17cf1 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 204 len: 0 microversion: 2.1 time: 0.116804 Oct 03 11:32:00.475157 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3839/7344] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:32:00 2022] DELETE /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:32:00.489870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:00.490370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:00.497107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.497569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.498008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.498702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.499158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.499588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.526999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:32:00.575394 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.compute.api [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Instance is already in deleting state, ignoring this request Oct 03 11:32:00.576233 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-420a9b2e-fef8-47ad-94de-03172aa1d7c9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 204 len: 0 microversion: 2.1 time: 0.090257 Oct 03 11:32:00.576824 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3506/7345] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:32:00 2022] DELETE /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:32:00.585524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:00.586245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:00.592206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.592703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.593203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.593913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:00.594378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:00.594818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:00.734759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:00.742862 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ae21886c-205b-4f67-9f21-422dcf00f1ba tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1512 microversion: 2.1 time: 0.161530 Oct 03 11:32:00.743530 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3840/7346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:00 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:01.766318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:01.766973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:01.774116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:01.774615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:01.775058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:01.775771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:01.776223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:01.776650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:01.928919 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea28e812c344e688fb6ee9bf98a1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bb97ce53084e44a337774126076584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:01.938325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e5b979f-c6d9-4895-b65e-9443eef7b4b9 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 200 len: 1512 microversion: 2.1 time: 0.176005 Oct 03 11:32:01.940411 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3507/7347] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:01 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:02.264787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3b50e306-b588-400c-a687-ecfa24d2bde8 req-a4fd0dec-4e51-40ff-a496-6fe9eaeb20b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5a7797-8130-4996-9618-4bcfbd071bf1", "name": "network-vif-deleted", "tag": "2ab37197-ce61-4800-aa85-247bfcc7f63e"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:32:02.274869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b50e306-b588-400c-a687-ecfa24d2bde8 req-a4fd0dec-4e51-40ff-a496-6fe9eaeb20b8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:02.275376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b50e306-b588-400c-a687-ecfa24d2bde8 req-a4fd0dec-4e51-40ff-a496-6fe9eaeb20b8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:02.275834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3b50e306-b588-400c-a687-ecfa24d2bde8 req-a4fd0dec-4e51-40ff-a496-6fe9eaeb20b8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:02.288454 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3b50e306-b588-400c-a687-ecfa24d2bde8 req-a4fd0dec-4e51-40ff-a496-6fe9eaeb20b8 service nova] Creating event network-vif-deleted:2ab37197-ce61-4800-aa85-247bfcc7f63e for instance bc5a7797-8130-4996-9618-4bcfbd071bf1 on n-h2-858383-3 Oct 03 11:32:02.294443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3b50e306-b588-400c-a687-ecfa24d2bde8 req-a4fd0dec-4e51-40ff-a496-6fe9eaeb20b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034597 Oct 03 11:32:02.295076 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3841/7348] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:32:02.963069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:02.963676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: bc5a7797-8130-4996-9618-4bcfbd071bf1] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:02.970477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:02.971534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:02.971688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:02.972374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:02.972855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:02.973282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:02.988453 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] HTTP exception thrown: Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 could not be found. Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Request method failure captured: Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 HTTP/1.1 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsfNIn29mzuF22rTpDsWv5x_SDZ_KTQCJ8PyICektyLDdOagv7CS3nJ9vUkaWrwv_xQoxG6xw6gSAVSsYEV0OgSuKogxTO4OVGBblncKV3HaxfUXEnyT6eIBLk0HTZxuHzUy81R0wTzPpz6AsRHHWUK7e-TMYgOHFcCfIVm29zi31Os Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 42bb97ce53084e44a337774126076584 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42bb97ce53084e44a337774126076584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42bb97ce53084e44a337774126076584"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42bb97ce53084e44a337774126076584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42bb97ce53084e44a337774126076584"}]}] Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 42bb97ce53084e44a337774126076584 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerDiskConfigTestJSON-627533093-project Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1ea28e812c344e688fb6ee9bf98a1b7d Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerDiskConfigTestJSON-627533093-project Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 could not be found. Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'bc5a7797-8130-4996-9618-4bcfbd071bf1'} Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 could not be found. Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 could not be found. Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:32:02.990178 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 could not be found. Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Returning 404 to user: Instance bc5a7797-8130-4996-9618-4bcfbd071bf1 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-58de5aec-6540-4f51-9fe0-74d57444bc65 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1" status: 404 len: 111 microversion: 2.1 time: 0.032403 Oct 03 11:32:02.995950 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3508/7349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:02 2022] GET /compute/v2.1/servers/bc5a7797-8130-4996-9618-4bcfbd071bf1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:32:03.001546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-088b39d0-b2b8-4b95-be17-0755c9e7951f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '.version_select at 0x7f074dd98820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:03.027617 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-088b39d0-b2b8-4b95-be17-0755c9e7951f tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736579978" status: 202 len: 0 microversion: 2.1 time: 0.030178 Oct 03 11:32:03.028216 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3842/7350] 10.222.0.27 () {58 vars in 1218 bytes} [Mon Oct 3 11:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736579978 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:32:03.653209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:03.653714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:03.661250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:03.661906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:03.662363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:03.663087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:03.663585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:03.664076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:03.680526 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] HTTP exception thrown: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Request method failure captured: Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 HTTP/1.1 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsfNIn29mzuF22rTpDsWv5x_SDZ_KTQCJ8PyICektyLDdOagv7CS3nJ9vUkaWrwv_xQoxG6xw6gSAVSsYEV0OgSuKogxTO4OVGBblncKV3HaxfUXEnyT6eIBLk0HTZxuHzUy81R0wTzPpz6AsRHHWUK7e-TMYgOHFcCfIVm29zi31Os Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 42bb97ce53084e44a337774126076584 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42bb97ce53084e44a337774126076584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42bb97ce53084e44a337774126076584"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42bb97ce53084e44a337774126076584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42bb97ce53084e44a337774126076584"}]}] Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 42bb97ce53084e44a337774126076584 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerDiskConfigTestJSON-627533093-project Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 1ea28e812c344e688fb6ee9bf98a1b7d Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerDiskConfigTestJSON-627533093-project Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '29bb3bb0-aa98-4509-9b6d-f9584722b271'} Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:32:03.682131 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Returning 404 to user: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fec21e87-db31-4242-8673-9ba9b021947c tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 404 len: 111 microversion: 2.1 time: 0.034904 Oct 03 11:32:03.686577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3509/7351] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:32:03 2022] DELETE /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:32:03.694403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:03.695148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] [instance: 29bb3bb0-aa98-4509-9b6d-f9584722b271] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:03.704238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:03.704733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:03.705213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:03.705982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:03.706448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:03.706977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:03.720908 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] HTTP exception thrown: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Request method failure captured: Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 HTTP/1.1 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsfNIn29mzuF22rTpDsWv5x_SDZ_KTQCJ8PyICektyLDdOagv7CS3nJ9vUkaWrwv_xQoxG6xw6gSAVSsYEV0OgSuKogxTO4OVGBblncKV3HaxfUXEnyT6eIBLk0HTZxuHzUy81R0wTzPpz6AsRHHWUK7e-TMYgOHFcCfIVm29zi31Os Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 42bb97ce53084e44a337774126076584 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42bb97ce53084e44a337774126076584"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_42bb97ce53084e44a337774126076584"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/42bb97ce53084e44a337774126076584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/42bb97ce53084e44a337774126076584"}]}] Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 42bb97ce53084e44a337774126076584 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-627533093 Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerDiskConfigTestJSON-627533093-project Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 1ea28e812c344e688fb6ee9bf98a1b7d Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerDiskConfigTestJSON-627533093-project Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '29bb3bb0-aa98-4509-9b6d-f9584722b271'} Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:32:03.722481 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] Returning 404 to user: Instance 29bb3bb0-aa98-4509-9b6d-f9584722b271 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f1961d4a-1962-4558-b0a0-5853734b3a06 tempest-ServerDiskConfigTestJSON-627533093 tempest-ServerDiskConfigTestJSON-627533093-project] 10.222.0.27 "GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271" status: 404 len: 111 microversion: 2.1 time: 0.034275 Oct 03 11:32:03.726777 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3843/7352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:03 2022] GET /compute/v2.1/servers/29bb3bb0-aa98-4509-9b6d-f9584722b271 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:32:12.799068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cdf55029-af98-4f6e-89cd-a8a64fdbb337 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'create', calling method: .version_select at 0x7f074f0d9040>, body: {"keypair": {"name": "tempest-keypair-1248876917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhoOpdF3bzxEbIt/dB3Wz+4YTtj44kcKzqol1kYqQiPURKpFAaoCGMQsQqhCH17JbHtKJps7LXlReJbtjC3p69yGpAAyvAzTM9ryGg8wETO2uQJoJyX1Y7CiKx/qpZnWg=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:32:12.804439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=38 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:12.817400 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cdf55029-af98-4f6e-89cd-a8a64fdbb337 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:32:12.823561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-cdf55029-af98-4f6e-89cd-a8a64fdbb337 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for user 03345f507def4b4382885e163c77fbae and project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:32:12.864655 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cdf55029-af98-4f6e-89cd-a8a64fdbb337 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227058 Oct 03 11:32:12.867011 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3510/7353] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:32:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:32:14.626249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1477662362", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd483bc4-5cf7-4935-950c-ba83c35d326b"}], "security_groups": [{"name": "tempest-securitygroup--680542793"}], "key_name": "tempest-keypair-1248876917", "user_data": "}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:32:14.639378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:14.639716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:14.751305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] validate_networks() for [('bd483bc4-5cf7-4935-950c-ba83c35d326b', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:32:15.165032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:32:15.165470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:32:15.165952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:32:15.166401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:32:15.167348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:32:15.177042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:15.177542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:15.177989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:15.178816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:15.179281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:15.179717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:15.198207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:32:15.204855 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for user 03345f507def4b4382885e163c77fbae and project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:32:15.220865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:32:15.223292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:32:15.279201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8446f7b8-a80f-4d5c-bcb6-788499861549 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.657483 Oct 03 11:32:15.288844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:15.292869 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3844/7354] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:32:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:32:15.294160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b02456d7-18b2-4ee2-aaa8-d9fec1b389c3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:15.294791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b02456d7-18b2-4ee2-aaa8-d9fec1b389c3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:15.397704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b02456d7-18b2-4ee2-aaa8-d9fec1b389c3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:15.406177 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b02456d7-18b2-4ee2-aaa8-d9fec1b389c3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1239 microversion: 2.1 time: 0.118902 Oct 03 11:32:15.407414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3511/7355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:15 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:16.430825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:16.431504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:16.441340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:16.441842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:16.442296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:16.443059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:16.443518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:16.443960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:16.508844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:16.517432 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-389e3375-15e8-41cf-8f34-03407f711cff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1291 microversion: 2.1 time: 0.091453 Oct 03 11:32:16.518025 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3845/7356] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:16 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1291 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:17.540791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:17.541411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:17.548592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:17.549489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:17.549615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:17.550275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:17.550736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:17.551169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:17.704510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:17.716737 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d4bfd5b4-a13d-4ffe-8194-42602db10be2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1364 microversion: 2.1 time: 0.179737 Oct 03 11:32:17.717414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3512/7357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:17 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:18.021438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-da26e004-a077-4ae8-a153-4b369a0ccec8 req-3bbe29a0-f0b7-4c63-a4f9-efa973f99eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70405b31-b5bb-4a1c-8bc7-f0239316ee36", "tag": "63a982ee-843d-4d46-b2c8-8db904ecc822"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:32:18.044872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-da26e004-a077-4ae8-a153-4b369a0ccec8 req-3bbe29a0-f0b7-4c63-a4f9-efa973f99eff service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:18.045382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-da26e004-a077-4ae8-a153-4b369a0ccec8 req-3bbe29a0-f0b7-4c63-a4f9-efa973f99eff service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:18.045831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-da26e004-a077-4ae8-a153-4b369a0ccec8 req-3bbe29a0-f0b7-4c63-a4f9-efa973f99eff service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:18.059088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-da26e004-a077-4ae8-a153-4b369a0ccec8 req-3bbe29a0-f0b7-4c63-a4f9-efa973f99eff service nova] Creating event network-changed:63a982ee-843d-4d46-b2c8-8db904ecc822 for instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 on n-h2-858383-3 Oct 03 11:32:18.063973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-da26e004-a077-4ae8-a153-4b369a0ccec8 req-3bbe29a0-f0b7-4c63-a4f9-efa973f99eff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046206 Oct 03 11:32:18.065159 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3846/7358] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:32:18.739566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:18.740211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:18.747758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:18.748244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:18.748693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:18.749415 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:18.749872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:18.750299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:18.885783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:18.893627 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-64a37983-d16f-47fe-8a67-c26d7d4808b1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1364 microversion: 2.1 time: 0.157987 Oct 03 11:32:18.894203 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3513/7359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:18 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:19.921994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:19.923312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:19.933848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:19.934574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:19.935171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:19.936133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:19.936703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:19.937294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:20.070851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:20.079749 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-548d1f1d-bf77-49b5-a5ed-f03ed54c8faf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1364 microversion: 2.1 time: 0.166447 Oct 03 11:32:20.080324 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3847/7360] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:19 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:21.103307 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:21.103930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:21.111356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:21.112104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:21.112405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:21.113110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:21.113574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:21.113996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:21.254909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:21.263487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-058a3b8d-5f6d-41ad-a1e6-06140044eeaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1364 microversion: 2.1 time: 0.164423 Oct 03 11:32:21.264081 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3514/7361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:21 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:22.287487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:22.288112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:22.296102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:22.296602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:22.297112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:22.298083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:22.298575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:22.299012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:22.439347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:22.447183 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e5ec3f24-4d45-45dd-ab22-a9221d52daa5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1364 microversion: 2.1 time: 0.163628 Oct 03 11:32:22.447857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3848/7362] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:22 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:23.470080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:23.470699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:23.477638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:23.478132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:23.478572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:23.479776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:23.480236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:23.480718 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:23.526740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a503fd47-5627-4a47-8063-ccc43a4ad5c0 req-6f5cf1b9-5c36-49ea-9b8b-edf4359d6773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70405b31-b5bb-4a1c-8bc7-f0239316ee36", "name": "network-vif-plugged", "status": "completed", "tag": "63a982ee-843d-4d46-b2c8-8db904ecc822"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:32:23.537619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a503fd47-5627-4a47-8063-ccc43a4ad5c0 req-6f5cf1b9-5c36-49ea-9b8b-edf4359d6773 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:23.538113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a503fd47-5627-4a47-8063-ccc43a4ad5c0 req-6f5cf1b9-5c36-49ea-9b8b-edf4359d6773 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:23.538555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a503fd47-5627-4a47-8063-ccc43a4ad5c0 req-6f5cf1b9-5c36-49ea-9b8b-edf4359d6773 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:23.551950 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a503fd47-5627-4a47-8063-ccc43a4ad5c0 req-6f5cf1b9-5c36-49ea-9b8b-edf4359d6773 service nova] Creating event network-vif-plugged:63a982ee-843d-4d46-b2c8-8db904ecc822 for instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 on n-h2-858383-3 Oct 03 11:32:23.557849 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a503fd47-5627-4a47-8063-ccc43a4ad5c0 req-6f5cf1b9-5c36-49ea-9b8b-edf4359d6773 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034220 Oct 03 11:32:23.558578 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3849/7363] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:32:23.627278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:23.635628 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-baeca093-685d-4e6f-a8a5-a8eb0f2c7eaf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1364 microversion: 2.1 time: 0.169395 Oct 03 11:32:23.636322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3515/7364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:23 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:24.660376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:24.661128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:24.667319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:24.667849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:24.668303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:24.669026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:24.669496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:24.669935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:24.804002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:24.812921 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e53137a4-3d4b-4a36-bc27-2b25d9afcfba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1364 microversion: 2.1 time: 0.157581 Oct 03 11:32:24.813520 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3850/7365] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:24 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:32:25.837021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:25.837555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:25.841065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:25.846774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:25.847254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:25.847689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:25.848375 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:25.848912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:25.849313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:25.977950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:32:25.986269 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5d96aa29-fc65-462a-9eb4-2061bd80dd48 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1550 microversion: 2.1 time: 0.153817 Oct 03 11:32:25.986854 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3516/7366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:32:25 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:32:26.009006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:32:26.009529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:32:26.012040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:26.012721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:32:26.019398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:26.019896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:26.020348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:26.021080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:26.021550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:26.021994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:26.102812 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a5b5ea5e-b4de-4c0b-923b-b26c2187622a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097730 Oct 03 11:32:26.103415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3851/7367] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 11:32:26 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:32:27.048394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ce129048-ead8-4eca-917f-ec781a806c94 req-f9aa9331-1c41-4899-899b-f96157f54d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70405b31-b5bb-4a1c-8bc7-f0239316ee36", "tag": "63a982ee-843d-4d46-b2c8-8db904ecc822"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:32:27.058606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce129048-ead8-4eca-917f-ec781a806c94 req-f9aa9331-1c41-4899-899b-f96157f54d7f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:32:27.059079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce129048-ead8-4eca-917f-ec781a806c94 req-f9aa9331-1c41-4899-899b-f96157f54d7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:32:27.059508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ce129048-ead8-4eca-917f-ec781a806c94 req-f9aa9331-1c41-4899-899b-f96157f54d7f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:32:27.071870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ce129048-ead8-4eca-917f-ec781a806c94 req-f9aa9331-1c41-4899-899b-f96157f54d7f service nova] Creating event network-changed:63a982ee-843d-4d46-b2c8-8db904ecc822 for instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 on n-h2-858383-3 Oct 03 11:32:27.077693 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ce129048-ead8-4eca-917f-ec781a806c94 req-f9aa9331-1c41-4899-899b-f96157f54d7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033544 Oct 03 11:32:27.078497 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3517/7368] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:33:03.348411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:03.349392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=34 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:03.353585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:03.354203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:03.361912 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.362408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.362860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.363569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.364037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.364481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.505189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:03.513011 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32f2854d-4993-43eb-8a8f-feff17e190d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1668 microversion: 2.1 time: 0.166525 Oct 03 11:33:03.513599 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3852/7369] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:03 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:03.536340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:03.537059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:03.539349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:03.540006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=32 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:03.547174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.547660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.548350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.549135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.549612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.550104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.688991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:03.697096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9a98e94-3598-43e2-85a6-711d29c5580e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1668 microversion: 2.1 time: 0.165137 Oct 03 11:33:03.697691 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3518/7370] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:03 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:03.722408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:03.723029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:03.729676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.730011 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.730464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.731172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.731638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.732080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.862884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:03.870676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a5c0ff2-5f2a-4d65-adf6-78bc7339fadd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1668 microversion: 2.1 time: 0.152179 Oct 03 11:33:03.871255 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3853/7371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:03 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:03.893489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:03.895908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:03.901905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.902387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.902828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.903514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:03.903983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:03.904475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:03.933801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:03.940213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Old instance type m1.heat2, new instance type m1.heat {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:33:03.946690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:33:03.947115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:33:03.947594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:33:03.948033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:33:03.948444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:33:04.015358 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ee7e097-409c-46cd-81f2-d235ba5c458a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36/action" status: 202 len: 0 microversion: 2.1 time: 0.125791 Oct 03 11:33:04.016138 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3519/7372] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:33:03 2022] POST /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:33:04.024449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:04.025165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:04.032082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:04.032592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:04.033096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:04.033813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:04.034279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:04.034721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:04.182262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:04.191841 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5aec6b42-1d18-4564-b923-65f18eaecdb1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1677 microversion: 2.1 time: 0.171149 Oct 03 11:33:04.192452 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3854/7373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:04 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:05.216402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:05.217687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:05.224729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:05.225252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:05.225682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:05.226385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:05.226889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:05.227318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:05.373716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:05.381832 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-27644425-34b1-4683-902f-976f5f6a3a2d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1677 microversion: 2.1 time: 0.170340 Oct 03 11:33:05.382453 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3520/7374] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:05 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:06.405914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:06.406538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:06.413441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:06.413943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:06.414402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:06.415115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:06.415584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:06.416029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:06.554024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:06.561894 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-863e0fdf-ddde-4302-9c12-695dfcc1e442 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.159914 Oct 03 11:33:06.562468 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3855/7375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:06 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:33:07.585957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:07.586576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:07.593342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:07.593826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:07.594267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:07.594967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:07.595422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:07.595850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:07.729318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:07.738041 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7d7cbdcc-0b8c-4522-bfde-5fee00586236 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.155849 Oct 03 11:33:07.738688 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3521/7376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:07 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:08.763843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:08.764466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:08.771556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:08.772048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:08.772497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:08.773235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:08.773700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:08.774136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:08.910551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:08.918372 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8a7d318-a44f-45b8-91c2-2df0432a41c2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.158609 Oct 03 11:33:08.918958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3856/7377] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:08 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:09.942960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:09.943543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:09.950469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:09.950953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:09.951391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:09.952093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:09.952551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:09.953011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:10.096411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:10.104192 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf9cb6ac-78df-42b7-b8c2-bf3f5112a376 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.165276 Oct 03 11:33:10.104796 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3522/7378] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:09 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:11.131848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:11.132505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:11.139236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:11.139757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:11.140232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:11.141481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:11.142052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:11.142501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:11.288158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:11.295986 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f1544cb-bf89-44bc-b4a3-b814f4659a23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.168207 Oct 03 11:33:11.296560 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3857/7379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:11 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:12.320080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:12.320691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:12.327595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:12.328079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:12.328516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:12.329329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:12.329781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:12.330209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:12.459797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:12.467603 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9d58f398-8e54-4085-8bc0-7d2c690ec4d1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.151563 Oct 03 11:33:12.468178 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3523/7380] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:12 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:13.491488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:13.492140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:13.499337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:13.499769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:13.500219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:13.501561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:13.502029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:13.502467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:13.661264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:13.669229 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d7b712b-42ad-475c-81b6-f92236b03684 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.181705 Oct 03 11:33:13.669816 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3858/7381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:13 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:14.694836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:14.696266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:14.704101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:14.704690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:14.705155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:14.705859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:14.706310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:14.706759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:14.847959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:14.855957 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b8aab335-9df3-478a-9b5d-4fe7e83d83fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.165873 Oct 03 11:33:14.856550 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3524/7382] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:14 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:15.882261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:15.882883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:15.889915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:15.890407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:15.890900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:15.891570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:15.892035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:15.892471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:16.027278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:16.035799 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-211b7072-f3de-4a92-a196-f7d604604534 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.158267 Oct 03 11:33:16.036383 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3859/7383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:15 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:17.060324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:17.060970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:17.068273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:17.068871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:17.069312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:17.070041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:17.070538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:17.070970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:17.206872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:17.215013 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee4fec69-610b-4506-8169-3fae5e6cff3d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1682 microversion: 2.1 time: 0.158684 Oct 03 11:33:17.215598 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3525/7384] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:17 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:18.240227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:18.245684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fa2e794b-a098-4bcb-a8bf-b85e79201890 req-ad251841-b906-4b7f-91f6-97edb16fe1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70405b31-b5bb-4a1c-8bc7-f0239316ee36", "name": "network-vif-unplugged", "status": "completed", "tag": "63a982ee-843d-4d46-b2c8-8db904ecc822"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:18.250333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:18.259880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:18.260534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:18.261017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:18.261893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:18.262006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa2e794b-a098-4bcb-a8bf-b85e79201890 req-ad251841-b906-4b7f-91f6-97edb16fe1ea service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:18.262373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:18.262549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa2e794b-a098-4bcb-a8bf-b85e79201890 req-ad251841-b906-4b7f-91f6-97edb16fe1ea service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:18.262940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:18.263102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa2e794b-a098-4bcb-a8bf-b85e79201890 req-ad251841-b906-4b7f-91f6-97edb16fe1ea service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:18.276286 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fa2e794b-a098-4bcb-a8bf-b85e79201890 req-ad251841-b906-4b7f-91f6-97edb16fe1ea service nova] Creating event network-vif-unplugged:63a982ee-843d-4d46-b2c8-8db904ecc822 for instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 on n-h1-858383-3 Oct 03 11:33:18.283666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-fa2e794b-a098-4bcb-a8bf-b85e79201890 req-ad251841-b906-4b7f-91f6-97edb16fe1ea service nova] Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:33:18.294152 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fa2e794b-a098-4bcb-a8bf-b85e79201890 req-ad251841-b906-4b7f-91f6-97edb16fe1ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051989 Oct 03 11:33:18.294906 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3526/7385] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:33:18.405672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:18.414561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-145bce2c-a8a5-4501-8e38-c9ae482ea995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1681 microversion: 2.1 time: 0.178319 Oct 03 11:33:18.415155 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3860/7386] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:18 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:19.442874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:19.443572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:19.449834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:19.450322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:19.450758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:19.451446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:19.451903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:19.452332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:19.592831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:19.601272 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83ccd6d6-beea-42b4-9c3e-696c214e66eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1679 microversion: 2.1 time: 0.163603 Oct 03 11:33:19.601859 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3527/7387] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:19 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:20.319987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-144c6f7e-12b6-4fd3-a58c-7ae37cb13cfc req-ce31ffb9-dd2a-4152-bcd4-95c9b33c92d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70405b31-b5bb-4a1c-8bc7-f0239316ee36", "tag": "63a982ee-843d-4d46-b2c8-8db904ecc822"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:20.330257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-144c6f7e-12b6-4fd3-a58c-7ae37cb13cfc req-ce31ffb9-dd2a-4152-bcd4-95c9b33c92d2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:20.330778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-144c6f7e-12b6-4fd3-a58c-7ae37cb13cfc req-ce31ffb9-dd2a-4152-bcd4-95c9b33c92d2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:20.331226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-144c6f7e-12b6-4fd3-a58c-7ae37cb13cfc req-ce31ffb9-dd2a-4152-bcd4-95c9b33c92d2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:20.342863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-144c6f7e-12b6-4fd3-a58c-7ae37cb13cfc req-ce31ffb9-dd2a-4152-bcd4-95c9b33c92d2 service nova] Creating event network-changed:63a982ee-843d-4d46-b2c8-8db904ecc822 for instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 on n-h1-858383-3 Oct 03 11:33:20.348204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-144c6f7e-12b6-4fd3-a58c-7ae37cb13cfc req-ce31ffb9-dd2a-4152-bcd4-95c9b33c92d2 service nova] Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:33:20.359345 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-144c6f7e-12b6-4fd3-a58c-7ae37cb13cfc req-ce31ffb9-dd2a-4152-bcd4-95c9b33c92d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043042 Oct 03 11:33:20.360508 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3861/7388] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:33:20.625841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:20.626559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:20.634020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:20.634518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:20.634957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:20.635719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:20.636242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:20.636670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:20.771416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:20.779336 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f0f0efcd-4c82-44e6-9d79-57a1d29f6c37 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1679 microversion: 2.1 time: 0.157882 Oct 03 11:33:20.779932 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3528/7389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:20 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:21.805703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:21.806410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:21.812671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:21.813752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:21.814311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:21.815035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:21.815498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:21.815939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:21.964371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:21.975602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-71fa9d49-7246-4d7e-875a-b5f2b93163ce tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1679 microversion: 2.1 time: 0.174933 Oct 03 11:33:21.976555 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3862/7390] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:21 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:23.001019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:23.001848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:23.008721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:23.009238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:23.009674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:23.010380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:23.010829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:23.011254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:23.153283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:23.164559 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b527e63d-4e58-402b-8dc3-c19d7a967c23 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1676 microversion: 2.1 time: 0.167971 Oct 03 11:33:23.165451 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3529/7391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:22 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:23.190323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:23.191049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:23.198526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:23.199144 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:23.199676 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:23.200473 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:23.201046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:23.201911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:23.266951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf3a2267-18ac-464a-b8cd-8f5153db983c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36/action" status: 204 len: 0 microversion: 2.1 time: 0.081718 Oct 03 11:33:23.267829 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3863/7392] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:33:23 2022] POST /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:33:23.276106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:23.276726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:23.287326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:23.288318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:23.289032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:23.290035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:23.290563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:23.291276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:23.469660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:23.478064 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a387abbc-013b-49fa-af69-f38cf972ee42 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1676 microversion: 2.1 time: 0.205787 Oct 03 11:33:23.478661 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3530/7393] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:23 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:24.504365 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:24.505115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:24.513188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:24.513700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:24.514158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:24.514876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:24.515378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:24.515820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:24.660734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:24.669159 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d33e03e-b1da-4151-9b59-0d01b756e76e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1668 microversion: 2.1 time: 0.170598 Oct 03 11:33:24.669740 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3864/7394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:24 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:24.692596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:24.693238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:24.700205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:24.700701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:24.701197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:24.701903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:24.702364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:24.702800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:24.834502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:24.842553 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f2b69fd4-782d-4c9e-aa21-7751bc0e833b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1668 microversion: 2.1 time: 0.154442 Oct 03 11:33:24.843133 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3531/7395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:24 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:24.865060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:24.865694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:24.871851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:24.872349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:24.872834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:24.873552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:24.874023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:24.874469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:25.010971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:25.018909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c1eb839-32eb-4f80-aeec-c5259ede0a8f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1668 microversion: 2.1 time: 0.157630 Oct 03 11:33:25.019408 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3865/7396] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:24 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:25.041495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:25.041989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:25.048596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:25.049104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:25.049558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:25.050232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:25.050683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:25.051103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:25.076070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:33:25.105829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:25.159963 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cec6550e-6078-4211-a149-ed6280283bb4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 204 len: 0 microversion: 2.1 time: 0.121970 Oct 03 11:33:25.160865 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3532/7397] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:33:25 2022] DELETE /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:33:25.172483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:25.173743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:25.179940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:25.180461 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:25.180915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:25.181651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:25.182112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:25.182547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:25.296875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ffb16641-c86d-4134-87dd-9062046275de req-d403ade1-c3de-4d5e-bd86-95c7bf6d502c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70405b31-b5bb-4a1c-8bc7-f0239316ee36", "name": "network-vif-plugged", "status": "completed", "tag": "63a982ee-843d-4d46-b2c8-8db904ecc822"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:25.308482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ffb16641-c86d-4134-87dd-9062046275de req-d403ade1-c3de-4d5e-bd86-95c7bf6d502c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:25.308991 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ffb16641-c86d-4134-87dd-9062046275de req-d403ade1-c3de-4d5e-bd86-95c7bf6d502c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:25.309614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ffb16641-c86d-4134-87dd-9062046275de req-d403ade1-c3de-4d5e-bd86-95c7bf6d502c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:25.323056 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ffb16641-c86d-4134-87dd-9062046275de req-d403ade1-c3de-4d5e-bd86-95c7bf6d502c service nova] Creating event network-vif-plugged:63a982ee-843d-4d46-b2c8-8db904ecc822 for instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 on n-h1-858383-3 Oct 03 11:33:25.328181 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ffb16641-c86d-4134-87dd-9062046275de req-d403ade1-c3de-4d5e-bd86-95c7bf6d502c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035604 Oct 03 11:33:25.329507 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3533/7398] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:33:25.338238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:25.347470 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6e82014-24d4-4f1a-8d26-da917ad0ef6f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1674 microversion: 2.1 time: 0.180292 Oct 03 11:33:25.348247 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3866/7399] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:25 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:26.372818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:26.373703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:26.380181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:26.380997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:26.381530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:26.382366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:26.382964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:26.383482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:26.901143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:26.910504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94e4a464-37c9-47a5-86f4-d13e4562a4b5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1674 microversion: 2.1 time: 0.543188 Oct 03 11:33:26.911090 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3534/7400] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:26 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1674 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:27.714533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b78d063b-bfa7-47f3-89b8-e716cfb10588 req-f035d028-2eb2-4ebb-b856-ae2c4c5233b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70405b31-b5bb-4a1c-8bc7-f0239316ee36", "name": "network-vif-deleted", "tag": "63a982ee-843d-4d46-b2c8-8db904ecc822"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:27.725385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b78d063b-bfa7-47f3-89b8-e716cfb10588 req-f035d028-2eb2-4ebb-b856-ae2c4c5233b5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:27.725882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b78d063b-bfa7-47f3-89b8-e716cfb10588 req-f035d028-2eb2-4ebb-b856-ae2c4c5233b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:27.726324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b78d063b-bfa7-47f3-89b8-e716cfb10588 req-f035d028-2eb2-4ebb-b856-ae2c4c5233b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:27.739491 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b78d063b-bfa7-47f3-89b8-e716cfb10588 req-f035d028-2eb2-4ebb-b856-ae2c4c5233b5 service nova] Creating event network-vif-deleted:63a982ee-843d-4d46-b2c8-8db904ecc822 for instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 on n-h1-858383-3 Oct 03 11:33:27.744957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b78d063b-bfa7-47f3-89b8-e716cfb10588 req-f035d028-2eb2-4ebb-b856-ae2c4c5233b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035444 Oct 03 11:33:27.745555 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3867/7401] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:33:27.934915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:27.935517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:27.946431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:27.946982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:27.947423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:27.948133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:27.948591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:27.949047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:27.989645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:27.990197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:27.990734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:27.991263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lazy-loading 'fault' on Instance uuid 70405b31-b5bb-4a1c-8bc7-f0239316ee36 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:33:28.040040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:28.047185 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-480b59da-a163-4a10-a5ea-32883ff821ca tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 200 len: 1329 microversion: 2.1 time: 0.116184 Oct 03 11:33:28.047768 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3535/7402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:27 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 1329 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:29.072430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:29.073169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:29.079370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:29.079868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:29.080961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:29.081698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:29.082166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:29.082603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:29.096844 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 HTTP/1.1 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '70405b31-b5bb-4a1c-8bc7-f0239316ee36'} Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:33:29.098533 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-36281892-9a2e-4396-9daf-faa2dae4c42a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 404 len: 111 microversion: 2.1 time: 0.032697 Oct 03 11:33:29.103723 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3868/7403] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:29 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:33:29.114052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:29.114720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:29.121564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:29.122058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:29.122500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:29.123197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:29.123685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:29.124118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:29.138998 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 HTTP/1.1 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '70405b31-b5bb-4a1c-8bc7-f0239316ee36'} Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:33:29.140654 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8398cac0-31de-45d5-8978-77402c0a4ad6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 404 len: 111 microversion: 2.1 time: 0.031925 Oct 03 11:33:29.146472 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3536/7404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:29 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:33:29.197010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2067408366", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "bd483bc4-5cf7-4935-950c-ba83c35d326b"}], "security_groups": [{"name": "tempest-securitygroup--680542793"}], "key_name": "tempest-keypair-1248876917", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:29.304382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] validate_networks() for [('bd483bc4-5cf7-4935-950c-ba83c35d326b', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:33:29.692722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:33:29.693211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:33:29.693705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:33:29.694132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:33:29.694563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:33:29.703374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:29.703871 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:29.704331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:29.705732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:29.706214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:29.706661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:29.713532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:29.727339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:33:29.732590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for user 03345f507def4b4382885e163c77fbae and project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:33:29.748190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:33:29.750599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:33:29.799741 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ddfab9fe-60f0-4d52-ad7c-a28e783cdb77 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.606092 Oct 03 11:33:29.800387 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3869/7405] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:33:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:33:29.813733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-83eb32c4-a777-48c0-96c8-bfdec2a2882a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:29.814340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-83eb32c4-a777-48c0-96c8-bfdec2a2882a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:29.870449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-83eb32c4-a777-48c0-96c8-bfdec2a2882a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:29.878070 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-83eb32c4-a777-48c0-96c8-bfdec2a2882a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1239 microversion: 2.1 time: 0.067427 Oct 03 11:33:29.878647 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3537/7406] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:29 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:30.902179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:30.902805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:30.909830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:30.910334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:30.910793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:30.911510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:30.911978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:30.912419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:31.010951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:31.018647 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-36257758-f6bd-43f3-a20a-5bc20d04e8fd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1297 microversion: 2.1 time: 0.121307 Oct 03 11:33:31.019395 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3870/7407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:30 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:32.042631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:32.043272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:32.051605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:32.052088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:32.052524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:32.053235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:32.053688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:32.054112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:32.186918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b95f8127-39ee-49c7-b5e6-95d148ef312c req-474a9462-e819-44d8-bb31-24b04f0f8198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cbc8bc-c58e-40d3-89c3-b9da5858e7d8", "tag": "e919a3cd-efac-4940-b7c7-0f932b4dfa05"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:32.202502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b95f8127-39ee-49c7-b5e6-95d148ef312c req-474a9462-e819-44d8-bb31-24b04f0f8198 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:32.203107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b95f8127-39ee-49c7-b5e6-95d148ef312c req-474a9462-e819-44d8-bb31-24b04f0f8198 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:32.203695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b95f8127-39ee-49c7-b5e6-95d148ef312c req-474a9462-e819-44d8-bb31-24b04f0f8198 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:32.219333 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b95f8127-39ee-49c7-b5e6-95d148ef312c req-474a9462-e819-44d8-bb31-24b04f0f8198 service nova] Creating event network-changed:e919a3cd-efac-4940-b7c7-0f932b4dfa05 for instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 on n-h2-858383-3 Oct 03 11:33:32.225329 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b95f8127-39ee-49c7-b5e6-95d148ef312c req-474a9462-e819-44d8-bb31-24b04f0f8198 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044506 Oct 03 11:33:32.226233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3871/7408] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:33:32.271497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:32.279685 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-681e850a-904f-41ee-a6e8-b3f54de64d72 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1364 microversion: 2.1 time: 0.240967 Oct 03 11:33:32.280262 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3538/7409] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:32 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:33.305897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:33.306645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:33.313397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:33.313889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:33.314355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:33.315070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:33.315531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:33.315966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:33.622707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:33.630954 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-82d94c72-2f28-410b-a602-71308c990060 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1364 microversion: 2.1 time: 0.330369 Oct 03 11:33:33.631539 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3872/7410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:33 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:34.656650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:34.657295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:34.660729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:34.666789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:34.667306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:34.667777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:34.668470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:34.668971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:34.669424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:34.801287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:34.809023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-641db48d-57f8-4e8f-b642-f5a66b014e12 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1364 microversion: 2.1 time: 0.156228 Oct 03 11:33:34.809605 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3539/7411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:34 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:35.833678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:35.834488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-819e8da7-726e-4560-bba9-e78bff47cc1d req-4ec4149a-509e-478e-85fb-0e59752912aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cbc8bc-c58e-40d3-89c3-b9da5858e7d8", "name": "network-vif-plugged", "status": "completed", "tag": "e919a3cd-efac-4940-b7c7-0f932b4dfa05"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:35.835311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:35.838377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:33:35.844533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:35.845302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:35.846692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:35.846855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-819e8da7-726e-4560-bba9-e78bff47cc1d req-4ec4149a-509e-478e-85fb-0e59752912aa service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:35.847198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-819e8da7-726e-4560-bba9-e78bff47cc1d req-4ec4149a-509e-478e-85fb-0e59752912aa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:35.847863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-819e8da7-726e-4560-bba9-e78bff47cc1d req-4ec4149a-509e-478e-85fb-0e59752912aa service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:35.848196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:35.848879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:35.849505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:35.859711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-819e8da7-726e-4560-bba9-e78bff47cc1d req-4ec4149a-509e-478e-85fb-0e59752912aa service nova] Creating event network-vif-plugged:e919a3cd-efac-4940-b7c7-0f932b4dfa05 for instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 on n-h2-858383-3 Oct 03 11:33:35.864665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-819e8da7-726e-4560-bba9-e78bff47cc1d req-4ec4149a-509e-478e-85fb-0e59752912aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034462 Oct 03 11:33:35.865304 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3540/7412] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:33:36.319793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:36.327502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7310dc29-4610-4b5f-877b-2ec5f386f96a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1364 microversion: 2.1 time: 0.498709 Oct 03 11:33:36.328091 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3873/7413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:35 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1364 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:37.353030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:37.353733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:37.360078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:37.360562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:37.361040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:37.361762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:37.362218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:37.362652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:37.510179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:33:37.519165 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-50c5c80c-4120-425e-a513-7b371ba0f2c6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1551 microversion: 2.1 time: 0.172031 Oct 03 11:33:37.519772 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3541/7414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:33:37 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:33:37.543280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:33:37.543934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:33:37.551788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:37.552288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:37.552749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:37.553487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:37.553958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:37.554397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:37.638081 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a3804cc-037f-4f86-b5a1-ce4b8e0257cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099224 Oct 03 11:33:37.638682 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3874/7415] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 11:33:37 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:33:38.582105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-74a5e994-d91c-429e-9f88-81d25395320d req-525c5d8e-c10b-46af-ba63-3eda6bc1fbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cbc8bc-c58e-40d3-89c3-b9da5858e7d8", "tag": "e919a3cd-efac-4940-b7c7-0f932b4dfa05"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:33:38.592355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-74a5e994-d91c-429e-9f88-81d25395320d req-525c5d8e-c10b-46af-ba63-3eda6bc1fbb1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:33:38.592959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-74a5e994-d91c-429e-9f88-81d25395320d req-525c5d8e-c10b-46af-ba63-3eda6bc1fbb1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:33:38.593391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-74a5e994-d91c-429e-9f88-81d25395320d req-525c5d8e-c10b-46af-ba63-3eda6bc1fbb1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:33:38.604365 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-74a5e994-d91c-429e-9f88-81d25395320d req-525c5d8e-c10b-46af-ba63-3eda6bc1fbb1 service nova] Creating event network-changed:e919a3cd-efac-4940-b7c7-0f932b4dfa05 for instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 on n-h2-858383-3 Oct 03 11:33:38.609835 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-74a5e994-d91c-429e-9f88-81d25395320d req-525c5d8e-c10b-46af-ba63-3eda6bc1fbb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 Oct 03 11:33:38.610440 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3542/7416] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:34:13.568047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:13.568861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:13.569575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:13.570241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=25 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:13.574283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e194ae9a-ced8-4dd2-8216-00ef460c72e0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:13.583435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e194ae9a-ced8-4dd2-8216-00ef460c72e0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:13.583943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e194ae9a-ced8-4dd2-8216-00ef460c72e0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:13.584402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e194ae9a-ced8-4dd2-8216-00ef460c72e0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:13.609180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e194ae9a-ced8-4dd2-8216-00ef460c72e0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Going to try to stop instance {{(pid=122269) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 11:34:13.659896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e194ae9a-ced8-4dd2-8216-00ef460c72e0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.093715 Oct 03 11:34:13.660591 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3875/7417] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:34:13 2022] POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:34:13.669750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:13.670839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:13.673134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:13.674178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=7 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:13.674866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:13.682135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:13.682629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:13.683067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:13.684690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:13.684690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:13.685025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:13.821097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:13.828834 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ec51d13b-6270-49b2-800c-24a9d5fd6229 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.163609 Oct 03 11:34:13.829407 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3543/7418] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:13 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:14.854093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:14.854730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:14.861029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:14.861525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:14.861980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:14.862698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:14.863168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:14.864241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:14.997314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:15.005433 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1b9771a-ed78-4db3-ae92-53efb8d19f7b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.156588 Oct 03 11:34:15.006018 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3876/7419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:14 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:16.029803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:16.031046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:16.039552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:16.040034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:16.040519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:16.041255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:16.041703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:16.042124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:16.171935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:16.180710 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-763db54f-c2dc-4b14-95c6-d700103ac79a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.155740 Oct 03 11:34:16.181329 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3544/7420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:16 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:17.204597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:17.205298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:17.212205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:17.212850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:17.213306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:17.214006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:17.214468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:17.214903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:17.353054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:17.360727 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-286fe670-bd55-4b46-a98a-cef87ecbb936 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.160100 Oct 03 11:34:17.361324 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3877/7421] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:17 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:18.384075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:18.384859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:18.392634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:18.393237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:18.393678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:18.394539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:18.395003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:18.396051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:18.547737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:18.556500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c5b7478c-82a8-498f-a086-229c33612317 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.176650 Oct 03 11:34:18.557158 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3545/7422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:18 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:19.579746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:19.580198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:19.587969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:19.588581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:19.589103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:19.589809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:19.590298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:19.590734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:19.722665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:19.730676 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e94df503-2245-4ffc-848c-3c134cbbf41c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.154934 Oct 03 11:34:19.731276 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3878/7423] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:19 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:20.753926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:20.754525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:20.762468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:20.762951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:20.763384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:20.764117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:20.764567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:20.765161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:20.901676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:20.910328 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-216b19bd-eece-4e94-ae73-c39ac8517f34 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.160314 Oct 03 11:34:20.910941 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3546/7424] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:20 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:21.934280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:21.934823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:21.941978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:21.943129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:21.943611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:21.944313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:21.944795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:21.945240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:22.073976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:22.082231 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8e222b3-9dde-49ef-b7cb-e78987c759cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.151848 Oct 03 11:34:22.083355 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3879/7425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:21 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:23.109134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:23.109134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:23.116806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:23.117298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:23.117732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:23.118425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:23.119084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:23.119510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:23.253533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:23.261219 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8d8d47b6-b897-4ad7-9b45-0711aeb4a7ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.157337 Oct 03 11:34:23.261794 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3547/7426] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:23 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:24.285021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:24.285652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:24.292582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:24.293117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:24.293574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:24.294295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:24.294766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:24.295208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:24.427598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:24.435559 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5828a518-1b80-400b-a8cd-683e2cd6534d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.154511 Oct 03 11:34:24.436316 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3880/7427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:24 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:34:25.460517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:25.461147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:25.468001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:25.468487 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:25.468956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:25.469643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:25.470094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:25.470518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:25.601466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:25.609218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4e7905b-4010-4d85-955f-e527ff23e563 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.153280 Oct 03 11:34:25.609810 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3548/7428] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:25 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:26.633456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:26.634091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:26.640984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:26.641484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:26.641946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:26.642651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:26.643115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:26.643559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:26.775198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:26.783076 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2816ed30-5cd6-494c-b3d8-963dc57ee978 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.154256 Oct 03 11:34:26.783656 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3881/7429] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:26 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:27.806946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:27.807552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:27.814635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:27.815114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:27.815547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:27.816228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:27.816678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:27.817221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:27.948971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:27.957872 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f0c147f-3ad3-4d8d-878a-daf999105ff5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.155418 Oct 03 11:34:27.958449 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3549/7430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:27 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:28.982110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:28.982816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:28.989750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:28.990248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:28.990700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:28.991413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:28.991916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:28.992360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:29.128757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:29.137259 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-24e0e68d-efa0-4c92-981c-26ca3f54d98f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.159344 Oct 03 11:34:29.137836 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3882/7431] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:28 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:30.161292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:30.161890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:30.169371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:30.169852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:30.170286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:30.170971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:30.171422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:30.171843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:30.307301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:30.314953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e21fe486-abe5-4926-99d1-fbb6255940ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1656 microversion: 2.1 time: 0.157543 Oct 03 11:34:30.315533 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3550/7432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:30 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:30.337893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:30.340219 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:30.347066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:30.347569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:30.348026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:30.348738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:30.349237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:30.350340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:30.377803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:30.383215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Old instance type m1.heat2, new instance type m1.heat {{(pid=122269) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:34:30.389792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:34:30.390229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:34:30.390750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:34:30.391179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:34:30.391607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:34:30.455720 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-670cb029-c39e-488d-9d92-b9e45f12492b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.122147 Oct 03 11:34:30.456250 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3883/7433] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:34:30 2022] POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:34:30.465459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:30.466069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:30.471956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:30.472443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:30.472922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:30.473630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:30.474086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:30.474511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:30.634136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:30.642280 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1383b667-6112-4f64-8703-ed8bc9c830f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.180832 Oct 03 11:34:30.642857 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3551/7434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:30 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:31.668439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:31.669103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:31.676368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:31.676894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:31.677354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:31.678118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:31.678590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:31.679039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:31.827281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:31.836161 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-70d541bc-4d35-41c3-bb45-6236d0650fc2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1679 microversion: 2.1 time: 0.172495 Oct 03 11:34:31.836746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3884/7435] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:31 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:32.860344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:32.860989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:32.868287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:32.868790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:32.869229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:32.869923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:32.870379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:32.870807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:32.999286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:33.007049 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c626884b-eabc-42b1-b45b-b6efb909c330 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1684 microversion: 2.1 time: 0.150685 Oct 03 11:34:33.007623 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3552/7436] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:32 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:34.030657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:34.031276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:34.038381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:34.038863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:34.039315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:34.040023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:34.040486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:34.041029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:34.213652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:34.223419 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8959dd88-f0a6-47e6-83c7-601e0c79c6bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1684 microversion: 2.1 time: 0.196650 Oct 03 11:34:34.224049 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3885/7437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:34 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1684 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:34.867113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-92337b9a-4f28-4f6f-995e-7a8e7da3e7dd req-cdeb0f8a-ef21-48db-af7e-08639f72a84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cbc8bc-c58e-40d3-89c3-b9da5858e7d8", "name": "network-vif-unplugged", "status": "completed", "tag": "e919a3cd-efac-4940-b7c7-0f932b4dfa05"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:34.878362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-92337b9a-4f28-4f6f-995e-7a8e7da3e7dd req-cdeb0f8a-ef21-48db-af7e-08639f72a84a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:34.878839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-92337b9a-4f28-4f6f-995e-7a8e7da3e7dd req-cdeb0f8a-ef21-48db-af7e-08639f72a84a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:34.879270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-92337b9a-4f28-4f6f-995e-7a8e7da3e7dd req-cdeb0f8a-ef21-48db-af7e-08639f72a84a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:34.891427 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-92337b9a-4f28-4f6f-995e-7a8e7da3e7dd req-cdeb0f8a-ef21-48db-af7e-08639f72a84a service nova] Creating event network-vif-unplugged:e919a3cd-efac-4940-b7c7-0f932b4dfa05 for instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 on n-h1-858383-3 Oct 03 11:34:34.897376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-92337b9a-4f28-4f6f-995e-7a8e7da3e7dd req-cdeb0f8a-ef21-48db-af7e-08639f72a84a service nova] Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:34:34.909580 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-92337b9a-4f28-4f6f-995e-7a8e7da3e7dd req-cdeb0f8a-ef21-48db-af7e-08639f72a84a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103172 Oct 03 11:34:34.910200 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3553/7438] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:34:35.247122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:35.247754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:35.254680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:35.255181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:35.255636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:35.256872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:35.257342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:35.257785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:35.411382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:35.420036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6aca2304-f6ab-4dc1-b940-76391c739abb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1683 microversion: 2.1 time: 0.176949 Oct 03 11:34:35.420620 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3886/7439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:35 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:36.446417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:36.447142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:36.453397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:36.453920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:36.454347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:36.455034 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:36.455490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:36.455917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:36.590287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:36.597963 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa5e2444-7bcf-4824-9a14-ba235ce9f5fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1681 microversion: 2.1 time: 0.157701 Oct 03 11:34:36.598538 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3554/7440] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:36 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:36.929363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-52796bdc-9c98-477a-b796-8e95c48cb1b3 req-2ec75d91-99e4-4bac-9f23-e2ba682479c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cbc8bc-c58e-40d3-89c3-b9da5858e7d8", "tag": "e919a3cd-efac-4940-b7c7-0f932b4dfa05"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:36.939433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-52796bdc-9c98-477a-b796-8e95c48cb1b3 req-2ec75d91-99e4-4bac-9f23-e2ba682479c6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:36.939917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-52796bdc-9c98-477a-b796-8e95c48cb1b3 req-2ec75d91-99e4-4bac-9f23-e2ba682479c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:36.940357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-52796bdc-9c98-477a-b796-8e95c48cb1b3 req-2ec75d91-99e4-4bac-9f23-e2ba682479c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:36.952606 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-52796bdc-9c98-477a-b796-8e95c48cb1b3 req-2ec75d91-99e4-4bac-9f23-e2ba682479c6 service nova] Creating event network-changed:e919a3cd-efac-4940-b7c7-0f932b4dfa05 for instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 on n-h1-858383-3 Oct 03 11:34:36.957828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-52796bdc-9c98-477a-b796-8e95c48cb1b3 req-2ec75d91-99e4-4bac-9f23-e2ba682479c6 service nova] Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:34:36.968485 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-52796bdc-9c98-477a-b796-8e95c48cb1b3 req-2ec75d91-99e4-4bac-9f23-e2ba682479c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043371 Oct 03 11:34:36.969103 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3887/7441] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:34:37.621818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:37.622441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:37.629319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:37.629803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:37.630241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:37.630982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:37.631385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:37.631811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:37.763032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:37.770873 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2993a777-a869-45a0-9bd7-f47fdf9a4b5b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1681 microversion: 2.1 time: 0.152945 Oct 03 11:34:37.771962 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3555/7442] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:37 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:34:38.796017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:38.796734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:38.803690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:38.804182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:38.804629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:38.805358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:38.805827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:38.806265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:38.950510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:38.959017 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7fc2b103-ab3c-42c7-8eee-56f2cb81b4e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1677 microversion: 2.1 time: 0.168132 Oct 03 11:34:38.959615 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3888/7443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:38 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:38.984308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:38.984928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:38.992582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:38.993102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:38.993539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:38.994266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:38.994762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:38.995251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:39.059719 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-542fc0dd-1305-48a6-9359-c6785dd16ea3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action" status: 204 len: 0 microversion: 2.1 time: 0.079171 Oct 03 11:34:39.060598 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3556/7444] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:34:38 2022] POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:34:39.070613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:39.071616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:39.078158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:39.078671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:39.079127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:39.080149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:39.080625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:39.081087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:39.108494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:39.310744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:39.319166 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8df7b9a4-8c81-45d0-a45a-c06ed9a4d6b7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1677 microversion: 2.1 time: 0.254216 Oct 03 11:34:39.319784 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3889/7445] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:39 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:40.345099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:40.346249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:40.352579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:40.353103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:40.353552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:40.354283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:40.354742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:40.355171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:40.501736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:40.510617 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3c7d2c3e-d6d1-431a-b966-8598550283e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1656 microversion: 2.1 time: 0.171278 Oct 03 11:34:40.511286 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3557/7446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:40 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:40.535173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:40.535904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:40.542985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:40.543490 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:40.543943 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:40.544658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:40.545153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:40.545598 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:40.674248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:40.682459 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5c3f42d5-3a9b-488a-9c6f-0a7ae123c399 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1656 microversion: 2.1 time: 0.151388 Oct 03 11:34:40.683022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3890/7447] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:40 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:40.705081 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-800aac81-4e58-4dd7-b757-ccff371db290 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:40.711502 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-800aac81-4e58-4dd7-b757-ccff371db290 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:40.711983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-800aac81-4e58-4dd7-b757-ccff371db290 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:40.712418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-800aac81-4e58-4dd7-b757-ccff371db290 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:40.734379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-800aac81-4e58-4dd7-b757-ccff371db290 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Going to try to start instance {{(pid=122270) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 11:34:40.738614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:40.778168 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-800aac81-4e58-4dd7-b757-ccff371db290 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.076754 Oct 03 11:34:40.778873 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3558/7448] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:34:40 2022] POST /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:34:40.788130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:40.788791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:40.795096 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:40.795597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:40.796057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:40.796908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:40.797397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:40.798006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:40.932436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:40.941628 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5152fd36-e372-469c-a49d-59510ce4a3cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1665 microversion: 2.1 time: 0.158270 Oct 03 11:34:40.942254 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3891/7449] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:40 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:41.757984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-09899711-67e6-477f-9d1c-fa3ed345bf78 req-df83ff17-f0e4-4355-b5a4-291adee309b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cbc8bc-c58e-40d3-89c3-b9da5858e7d8", "name": "network-vif-plugged", "status": "completed", "tag": "e919a3cd-efac-4940-b7c7-0f932b4dfa05"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:41.767713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-09899711-67e6-477f-9d1c-fa3ed345bf78 req-df83ff17-f0e4-4355-b5a4-291adee309b3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:41.768193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-09899711-67e6-477f-9d1c-fa3ed345bf78 req-df83ff17-f0e4-4355-b5a4-291adee309b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:41.768628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-09899711-67e6-477f-9d1c-fa3ed345bf78 req-df83ff17-f0e4-4355-b5a4-291adee309b3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:41.781044 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-09899711-67e6-477f-9d1c-fa3ed345bf78 req-df83ff17-f0e4-4355-b5a4-291adee309b3 service nova] Creating event network-vif-plugged:e919a3cd-efac-4940-b7c7-0f932b4dfa05 for instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 on n-h1-858383-3 Oct 03 11:34:41.785686 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-09899711-67e6-477f-9d1c-fa3ed345bf78 req-df83ff17-f0e4-4355-b5a4-291adee309b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094878 Oct 03 11:34:41.786274 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3559/7450] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:34:41.965896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:41.966526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:41.973160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:41.973663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:41.974121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:41.974842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:41.975314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:41.975760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:42.109769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:42.119424 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65ce8464-6324-426c-8e42-3835619b8239 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1665 microversion: 2.1 time: 0.157558 Oct 03 11:34:42.120025 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3892/7451] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:41 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:43.144791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:43.145503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:43.152124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:43.152601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:43.153064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:43.153752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:43.154203 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:43.154628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:43.286434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:43.294722 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fff9d768-a3c8-477b-8b12-da603a661f96 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1669 microversion: 2.1 time: 0.155133 Oct 03 11:34:43.295316 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3560/7452] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:43 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:43.317455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:43.317961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:43.325220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:43.325719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:43.326176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:43.326878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:43.327343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:43.327782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:43.355802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:34:43.431523 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e13d39a4-b91c-421c-ae9b-8b013e08d1ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 204 len: 0 microversion: 2.1 time: 0.117755 Oct 03 11:34:43.432230 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3893/7453] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:34:43 2022] DELETE /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:34:43.440751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:43.441480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:43.448211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:43.448706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:43.449181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:43.449898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:43.450360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:43.450799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:43.587696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:43.595685 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-82f0164b-841b-4f60-b0be-164658a0d4ea tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1675 microversion: 2.1 time: 0.158819 Oct 03 11:34:43.596251 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3561/7454] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:43 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:44.621077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:44.621788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:44.624436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:44.633238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:44.633853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:44.634305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:44.635128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:44.635733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:44.636178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:44.783914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:44.793031 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cce935c9-2e7f-4da9-8cc4-5430b1393bfa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1675 microversion: 2.1 time: 0.177042 Oct 03 11:34:44.793620 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3894/7455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:44 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:34:45.817717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:45.819053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:45.822053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=39 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:45.827397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:45.828073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:45.828587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:45.829379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:45.829904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:45.830394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:45.914429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:45.922612 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b9e36a9-c24c-484e-baf9-240c13841e86 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 200 len: 1608 microversion: 2.1 time: 0.108867 Oct 03 11:34:45.923297 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3562/7456] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:45 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 1608 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:45.948403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a6445ec4-3e12-467b-bbb0-1cc50cd8c947 req-97780a53-b8e9-40f2-a282-4ca54f73e544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cbc8bc-c58e-40d3-89c3-b9da5858e7d8", "name": "network-vif-deleted", "tag": "e919a3cd-efac-4940-b7c7-0f932b4dfa05"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:45.961741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6445ec4-3e12-467b-bbb0-1cc50cd8c947 req-97780a53-b8e9-40f2-a282-4ca54f73e544 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:45.962288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6445ec4-3e12-467b-bbb0-1cc50cd8c947 req-97780a53-b8e9-40f2-a282-4ca54f73e544 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:45.962727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6445ec4-3e12-467b-bbb0-1cc50cd8c947 req-97780a53-b8e9-40f2-a282-4ca54f73e544 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:45.976000 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a6445ec4-3e12-467b-bbb0-1cc50cd8c947 req-97780a53-b8e9-40f2-a282-4ca54f73e544 service nova] Creating event network-vif-deleted:e919a3cd-efac-4940-b7c7-0f932b4dfa05 for instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 on n-h1-858383-3 Oct 03 11:34:45.983512 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a6445ec4-3e12-467b-bbb0-1cc50cd8c947 req-97780a53-b8e9-40f2-a282-4ca54f73e544 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038817 Oct 03 11:34:45.984134 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3895/7457] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:34:46.951183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:46.952236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:46.960628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:46.961162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:46.961606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:46.962316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:46.962776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:46.963195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:46.982481 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 HTTP/1.1 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '64cbc8bc-c58e-40d3-89c3-b9da5858e7d8'} Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:34:46.984215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d5d754e9-c76e-4f20-8248-e45b763b08c1 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 404 len: 111 microversion: 2.1 time: 0.041125 Oct 03 11:34:46.992511 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3563/7458] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:46 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:34:47.010400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:47.011143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:47.018618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:47.019118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:47.019574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:47.020293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:47.020797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:47.021294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:47.037443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 HTTP/1.1 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '64cbc8bc-c58e-40d3-89c3-b9da5858e7d8'} Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:34:47.040225 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:34:47.044935 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1691a357-9c58-4d8b-86e1-889b8288f283 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 404 len: 111 microversion: 2.1 time: 0.038230 Oct 03 11:34:47.049186 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3896/7459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:47 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:34:47.103553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1524198456", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "bd483bc4-5cf7-4935-950c-ba83c35d326b"}], "security_groups": [{"name": "tempest-securitygroup--680542793"}], "key_name": "tempest-keypair-1248876917", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:47.218837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] validate_networks() for [('bd483bc4-5cf7-4935-950c-ba83c35d326b', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:34:47.626660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:34:47.627112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:34:47.627587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:34:47.628027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:34:47.628434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:34:47.638029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:47.638509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:47.638944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:47.639670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:47.640120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:47.640542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:47.659980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:34:47.665629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for user 03345f507def4b4382885e163c77fbae and project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:34:47.678692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:34:47.681054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:34:47.730348 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d4e1ff11-e526-44fb-802d-352542e852b2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.632550 Oct 03 11:34:47.731115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3564/7460] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:34:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:34:47.743388 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66b8fefb-3061-47c6-a9db-b0b5d95448a2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:47.744097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66b8fefb-3061-47c6-a9db-b0b5d95448a2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:47.804890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66b8fefb-3061-47c6-a9db-b0b5d95448a2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:47.813778 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66b8fefb-3061-47c6-a9db-b0b5d95448a2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1239 microversion: 2.1 time: 0.074032 Oct 03 11:34:47.814420 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3897/7461] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:47 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:48.839076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:48.839686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:48.846881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:48.847388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:48.848020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:48.848929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:48.850045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:48.850663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:48.927265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:48.935059 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-862300d4-7ff3-40be-8cdd-2fbb806bb6ef tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1299 microversion: 2.1 time: 0.099836 Oct 03 11:34:48.936028 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3565/7462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:48 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:49.959750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:49.960632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:49.969135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:49.969728 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:49.970190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:49.970935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:49.971404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:49.971848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:50.107270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:50.116224 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0988f52e-6369-49e2-a6b9-8079cffe2b84 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.160348 Oct 03 11:34:50.116824 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3898/7463] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:49 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:50.250917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-72f70d15-5799-497d-8f3a-ed4c1627676e req-23f985d5-7530-4298-acab-d2d3047c07f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:50.264250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-72f70d15-5799-497d-8f3a-ed4c1627676e req-23f985d5-7530-4298-acab-d2d3047c07f3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:50.264731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-72f70d15-5799-497d-8f3a-ed4c1627676e req-23f985d5-7530-4298-acab-d2d3047c07f3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:50.265175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-72f70d15-5799-497d-8f3a-ed4c1627676e req-23f985d5-7530-4298-acab-d2d3047c07f3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:50.278445 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-72f70d15-5799-497d-8f3a-ed4c1627676e req-23f985d5-7530-4298-acab-d2d3047c07f3 service nova] Creating event network-changed:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h1-858383-3 Oct 03 11:34:50.284303 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-72f70d15-5799-497d-8f3a-ed4c1627676e req-23f985d5-7530-4298-acab-d2d3047c07f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036759 Oct 03 11:34:50.285118 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3566/7464] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:34:51.139625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:51.140270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:51.147202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:51.147702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:51.148156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:51.148909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:51.149383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:51.149831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:51.280661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:51.288311 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9882b7e4-7e82-4bcb-8ba9-c65ce650e7bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.152620 Oct 03 11:34:51.288894 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3899/7465] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:51 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:52.314048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:52.314759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:52.321425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:52.321899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:52.322333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:52.323012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:52.323459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:52.323880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:52.462197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:52.469903 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-034ee9ab-9e86-4929-9401-6520f887b404 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.161011 Oct 03 11:34:52.470474 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3567/7466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:52 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:53.494081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:53.501442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:53.501607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:53.502098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:53.502541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:53.503245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:53.503717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:53.504149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:53.636553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:53.644125 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c06404a3-8cee-4dcf-8afd-02eeedffd448 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.154805 Oct 03 11:34:53.644699 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3900/7467] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:53 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:54.667379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:54.667979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:54.675529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:54.676012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:54.676490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:54.677230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:54.677669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:54.678097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:54.811137 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:54.819476 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dbeae4f8-4fcf-4cf4-b523-b02e93e13ed5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.156121 Oct 03 11:34:54.820071 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3568/7468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:54 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:55.843074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:55.843607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:55.851088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:55.851817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:55.852047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:55.852758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:55.853255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:55.853697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:55.985694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:55.993944 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99353ea0-f50e-4624-9d93-40ad4d01e88f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.154814 Oct 03 11:34:55.994634 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3901/7469] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:55 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:57.019073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:57.019680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:57.026536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:57.027027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:57.027471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:57.028169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:57.028630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:57.029099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:57.167886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:57.176178 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f012c4c-d399-42ce-b8a1-ce6083a0c247 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.161129 Oct 03 11:34:57.176755 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3569/7470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:57 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:57.764646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-36bbe1fe-9d55-4c92-a330-9e8129717476 req-a8eb21b8-2dad-443d-8c4c-1701669ba54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "name": "network-vif-plugged", "status": "completed", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:34:57.775722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36bbe1fe-9d55-4c92-a330-9e8129717476 req-a8eb21b8-2dad-443d-8c4c-1701669ba54d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:57.776257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36bbe1fe-9d55-4c92-a330-9e8129717476 req-a8eb21b8-2dad-443d-8c4c-1701669ba54d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:57.776706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-36bbe1fe-9d55-4c92-a330-9e8129717476 req-a8eb21b8-2dad-443d-8c4c-1701669ba54d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:57.788441 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-36bbe1fe-9d55-4c92-a330-9e8129717476 req-a8eb21b8-2dad-443d-8c4c-1701669ba54d service nova] Creating event network-vif-plugged:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h1-858383-3 Oct 03 11:34:57.793456 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-36bbe1fe-9d55-4c92-a330-9e8129717476 req-a8eb21b8-2dad-443d-8c4c-1701669ba54d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032589 Oct 03 11:34:57.794253 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3902/7471] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:34:58.200079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:58.201010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:58.203005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:58.203810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:58.211943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:58.212624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:58.213082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:58.213790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:58.214244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:58.214666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:58.349229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:58.357392 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd613549-99e6-4c6d-a628-97408c15da5d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1364 microversion: 2.1 time: 0.161178 Oct 03 11:34:58.357973 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3570/7472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:58 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:59.378432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:34:59.380480 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:34:59.380719 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:34:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 (ip 10.222.0.27) !!! Oct 03 11:34:59.390568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:59.391884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:59.405633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:59.406135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:59.406737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:59.407332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:59.407783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:59.408247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:59.547513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:34:59.555653 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39e2967d-5e87-4f5c-aba4-b6dd17d92a2c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1550 microversion: 2.1 time: 0.178334 Oct 03 11:34:59.556233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3903/7473] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:34:59 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:34:59.578595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:34:59.579097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:34:59.582185 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:34:59.582337 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:34:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964/os-interface (ip 10.222.0.27) !!! Oct 03 11:34:59.588704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:59.589217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:59.589654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:59.590346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:34:59.590803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:34:59.591262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:34:59.670060 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-799c018b-3c25-4dd1-89b6-333c69f471d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095487 Oct 03 11:34:59.670688 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3571/7474] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 11:34:59 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:35:00.968708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-0004f4de-bc81-4fcd-a190-a60821888252 req-607c3eb5-5e1c-4a5e-b87a-44b5db8a3bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:35:00.981183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0004f4de-bc81-4fcd-a190-a60821888252 req-607c3eb5-5e1c-4a5e-b87a-44b5db8a3bd2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:35:00.981997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0004f4de-bc81-4fcd-a190-a60821888252 req-607c3eb5-5e1c-4a5e-b87a-44b5db8a3bd2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:35:00.982692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-0004f4de-bc81-4fcd-a190-a60821888252 req-607c3eb5-5e1c-4a5e-b87a-44b5db8a3bd2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:35:00.994815 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-0004f4de-bc81-4fcd-a190-a60821888252 req-607c3eb5-5e1c-4a5e-b87a-44b5db8a3bd2 service nova] Creating event network-changed:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h1-858383-3 Oct 03 11:35:01.000876 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-0004f4de-bc81-4fcd-a190-a60821888252 req-607c3eb5-5e1c-4a5e-b87a-44b5db8a3bd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035691 Oct 03 11:35:01.001817 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3904/7475] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:36:12.984443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:12.985780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:12.990802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:12.993091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:13.001267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:13.002080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:13.002737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:13.003623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:13.004082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:13.004532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:13.034445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:13.040390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Old instance type m1.heat2, new instance type m1.heat {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:36:13.046836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:36:13.047257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:36:13.047727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:36:13.048131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:36:13.048539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:36:13.118336 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eafee18b-8382-4a6e-9fa3-098f126ba5ab tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964/action" status: 202 len: 0 microversion: 2.1 time: 0.136828 Oct 03 11:36:13.122699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3572/7476] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:36:12 2022] POST /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:36:13.130390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=23 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:13.132652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:13.137508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:13.138872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:13.145969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:13.146556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:13.147150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:13.147900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:13.148416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:13.148935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:13.292102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:13.300967 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e9b7dca3-1bc2-4f38-8c04-8381f341f05c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1677 microversion: 2.1 time: 0.176551 Oct 03 11:36:13.301649 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3905/7477] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:13 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:36:14.324443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:14.325091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:14.332104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:14.332598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:14.333070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:14.333772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:14.334741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:14.335174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:14.505539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:14.513756 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a8b10355-87cd-480b-b064-5abd693f3023 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1677 microversion: 2.1 time: 0.194149 Oct 03 11:36:14.514336 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3573/7478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:14 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:15.538916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:15.539579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:15.546546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:15.547050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:15.547507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:15.548216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:15.548690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:15.549422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:15.679619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:15.687376 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-03fa84e6-eb4b-4458-af57-ec44e3d4d38b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.152418 Oct 03 11:36:15.687948 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3906/7479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:15 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:16.712150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:16.712756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:16.719519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:16.720001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:16.720431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:16.721165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:16.721602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:16.722024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:16.852333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:16.860275 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bb8ffde0-d443-4a36-9b1b-2680756e9fb6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.152649 Oct 03 11:36:16.860957 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3574/7480] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:16 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:17.885344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:17.885974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:17.892784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:17.893290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:17.893746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:17.894454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:17.895007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:17.895449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:18.033008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:18.040818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cfe24f04-3d74-434b-9218-e5da9edff77d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.160146 Oct 03 11:36:18.041401 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3907/7481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:17 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:19.068371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:19.069001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:19.076556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:19.077070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:19.077519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:19.078218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:19.078676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:19.079106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:19.215853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:19.230802 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-09968af4-e55b-47b6-951e-245b284c4303 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.166232 Oct 03 11:36:19.231384 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3575/7482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:19 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:20.259768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:20.260371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:20.267484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:20.267986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:20.268440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:20.269187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:20.269656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:20.270097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:20.401468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:20.409250 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d24412b2-e36b-4a5b-a590-666e4fbfc99f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.153931 Oct 03 11:36:20.409822 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3908/7483] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:20 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:21.433276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:21.433909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:21.441134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:21.441619 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:21.442059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:21.442746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:21.443205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:21.443631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:21.573411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:21.582957 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7c37bdb-a3d1-4331-a845-09ca2b393f98 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.153561 Oct 03 11:36:21.583476 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3576/7484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:21 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:22.606809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:22.607464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:22.615253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:22.615757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:22.616213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:22.616966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:22.617435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:22.617877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:22.750197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:22.758777 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6b58cfae-be8f-4cc1-ba08-2376e35a9088 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.155877 Oct 03 11:36:22.759359 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3909/7485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:22 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:23.783443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:23.784059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:23.791773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:23.792270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:23.792720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:23.793454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:23.793916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:23.794349 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:23.946644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:23.954591 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-841bd1c4-6dff-4656-81a3-fd9de442806a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.175992 Oct 03 11:36:23.955181 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3577/7486] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:23 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:36:24.982442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:24.983081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:24.991720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:24.992223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:24.992681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:24.993416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:24.993889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:24.994333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:25.130662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:25.139035 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6613a18-e589-422a-be30-fff9cb573765 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.162704 Oct 03 11:36:25.139609 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3910/7487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:24 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:26.163193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:26.163832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:26.170736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:26.171219 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:26.171654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:26.172346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:26.172817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:26.173251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:26.308196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:26.316136 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-38011431-1d46-440a-b9f1-122491f86a69 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1682 microversion: 2.1 time: 0.157696 Oct 03 11:36:26.316716 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3578/7488] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:26 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:27.339852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:27.340479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:27.347385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:27.347899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:27.348341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:27.349080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:27.349547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:27.349986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:27.568736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:27.577800 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-323871b6-40ff-4fb3-8666-2d81d6008995 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1681 microversion: 2.1 time: 0.241491 Oct 03 11:36:27.587439 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3911/7489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:27 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:27.729878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-d62fd536-f18c-49b7-9641-13b557d0a0fa req-636744a2-a130-43f0-bd2d-330517b83006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "name": "network-vif-unplugged", "status": "completed", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:27.741163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d62fd536-f18c-49b7-9641-13b557d0a0fa req-636744a2-a130-43f0-bd2d-330517b83006 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:27.742058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d62fd536-f18c-49b7-9641-13b557d0a0fa req-636744a2-a130-43f0-bd2d-330517b83006 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:27.742736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-d62fd536-f18c-49b7-9641-13b557d0a0fa req-636744a2-a130-43f0-bd2d-330517b83006 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:27.755517 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-d62fd536-f18c-49b7-9641-13b557d0a0fa req-636744a2-a130-43f0-bd2d-330517b83006 service nova] Creating event network-vif-unplugged:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h2-858383-3 Oct 03 11:36:27.761436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-d62fd536-f18c-49b7-9641-13b557d0a0fa req-636744a2-a130-43f0-bd2d-330517b83006 service nova] Instance 27c50776-39b6-4006-a588-e173a88fa964 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:36:27.775576 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-d62fd536-f18c-49b7-9641-13b557d0a0fa req-636744a2-a130-43f0-bd2d-330517b83006 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127062 Oct 03 11:36:27.776208 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3579/7490] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:36:28.601738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:28.602321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:28.612213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:28.612715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:28.613184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:28.613902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:28.614369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:28.614804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:28.813176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:28.823823 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d34ceed3-b747-4b3b-ba48-76d1a31b0300 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1681 microversion: 2.1 time: 0.226074 Oct 03 11:36:28.824408 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3912/7491] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:28 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:29.848601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:29.849235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:29.855917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:29.856405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:29.856889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:29.857587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:29.858045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:29.858474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:30.007348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:30.015194 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ec2b456-8eef-4aa8-829a-05e75bcc1c81 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1679 microversion: 2.1 time: 0.171740 Oct 03 11:36:30.015783 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3580/7492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:29 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:30.060712 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c9be3565-5c4e-4ee2-b1cb-c60be20a7cac req-c03b682f-dd53-4cde-9615-9198f7eb2679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:30.071125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c9be3565-5c4e-4ee2-b1cb-c60be20a7cac req-c03b682f-dd53-4cde-9615-9198f7eb2679 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:30.071629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c9be3565-5c4e-4ee2-b1cb-c60be20a7cac req-c03b682f-dd53-4cde-9615-9198f7eb2679 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:30.072077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c9be3565-5c4e-4ee2-b1cb-c60be20a7cac req-c03b682f-dd53-4cde-9615-9198f7eb2679 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:30.085010 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c9be3565-5c4e-4ee2-b1cb-c60be20a7cac req-c03b682f-dd53-4cde-9615-9198f7eb2679 service nova] Creating event network-changed:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h2-858383-3 Oct 03 11:36:30.090742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-c9be3565-5c4e-4ee2-b1cb-c60be20a7cac req-c03b682f-dd53-4cde-9615-9198f7eb2679 service nova] Instance 27c50776-39b6-4006-a588-e173a88fa964 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:36:30.102330 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c9be3565-5c4e-4ee2-b1cb-c60be20a7cac req-c03b682f-dd53-4cde-9615-9198f7eb2679 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045179 Oct 03 11:36:30.103062 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3913/7493] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:36:31.038756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:31.039361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:31.046324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.046802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.047241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.047928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.048384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.048830 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.185938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:31.193766 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7eeed7aa-79b8-4682-b6b1-7fffcd43c659 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1676 microversion: 2.1 time: 0.158951 Oct 03 11:36:31.194347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3581/7494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:31 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:31.218402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:31.219028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:31.225751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.226226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.226668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.227363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.227822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.228254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.270781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.271274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.271781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.272517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.273014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.273451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.294927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:36:31.300552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for user 03345f507def4b4382885e163c77fbae and project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:36:31.402263 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f2b4a0ae-df48-4a0c-bbc9-688f077889eb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964/action" status: 202 len: 0 microversion: 2.1 time: 0.188728 Oct 03 11:36:31.403279 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3914/7495] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:36:31 2022] POST /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:36:31.414299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:31.414922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:31.421299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.421971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.422527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.423256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:31.423823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:31.424529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:31.559879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:31.568879 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c78d4398-2457-4bd4-bc8d-3b016b306985 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1675 microversion: 2.1 time: 0.159916 Oct 03 11:36:31.569478 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3582/7496] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:31 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:32.594465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:32.595185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:32.601375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:32.601878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:32.602329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:32.603041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:32.603505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:32.603944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:32.746156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:32.754802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-aae4e2e3-2bb6-4314-8fc3-bda40bacd152 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1675 microversion: 2.1 time: 0.165580 Oct 03 11:36:32.755382 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3915/7497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:32 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:33.780747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:33.781981 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:33.791248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:33.791745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:33.792188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:33.792930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:33.793467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:33.793824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:33.947479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:33.955501 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72e04f7b-8393-4cdc-8db9-f1d23b4464e9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1675 microversion: 2.1 time: 0.180915 Oct 03 11:36:33.956087 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3583/7498] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:33 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:34.979881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:34.980860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:34.989682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-63dbd89e-fc82-4124-9d07-fa52a822542e req-095e6777-7970-4066-8941-3475594cc5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:34.990781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:34.991402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:34.991863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:34.992602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:34.993116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:34.993576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:35.005144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-63dbd89e-fc82-4124-9d07-fa52a822542e req-095e6777-7970-4066-8941-3475594cc5af service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:35.006249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-63dbd89e-fc82-4124-9d07-fa52a822542e req-095e6777-7970-4066-8941-3475594cc5af service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:35.006758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-63dbd89e-fc82-4124-9d07-fa52a822542e req-095e6777-7970-4066-8941-3475594cc5af service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:35.020312 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-63dbd89e-fc82-4124-9d07-fa52a822542e req-095e6777-7970-4066-8941-3475594cc5af service nova] Creating event network-changed:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h1-858383-3 Oct 03 11:36:35.027845 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-63dbd89e-fc82-4124-9d07-fa52a822542e req-095e6777-7970-4066-8941-3475594cc5af service nova] Instance 27c50776-39b6-4006-a588-e173a88fa964 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-3', 'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:36:35.041264 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-63dbd89e-fc82-4124-9d07-fa52a822542e req-095e6777-7970-4066-8941-3475594cc5af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055346 Oct 03 11:36:35.041902 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3584/7499] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:36:35.241319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:35.249645 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-872f4ef7-204d-4cc4-8167-d8fe0a1b0c2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1675 microversion: 2.1 time: 0.273990 Oct 03 11:36:35.250236 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3916/7500] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:34 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:36:36.278989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:36.279688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:36.285992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:36.286478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:36.287527 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:36.288228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:36.288683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:36.289136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:36.423805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:36.431879 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6fb40a73-3b15-4595-994d-162dda98acc6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1675 microversion: 2.1 time: 0.158025 Oct 03 11:36:36.432456 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3585/7501] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:36 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:37.455117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:37.455739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:37.463137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:37.463633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:37.464086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:37.464817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:37.465286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:37.465724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:37.597662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:37.606086 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-716aef6e-3efe-42c0-b8d1-d340c59efb30 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1675 microversion: 2.1 time: 0.154878 Oct 03 11:36:37.606668 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3917/7502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:37 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:36:38.630215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:38.631474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:38.639154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:38.639650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:38.640125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:38.640866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:38.641321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:38.641744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:38.891668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:38.901462 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94e73d37-7083-4fd7-93ce-5d5f42caba85 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1675 microversion: 2.1 time: 0.274988 Oct 03 11:36:38.902781 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3586/7503] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:38 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:36:39.930352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:39.931307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:39.942990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:39.944484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:39.945008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:39.945788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:39.946274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:39.946725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.083379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:40.087048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:40.092223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e4e72db5-3ab7-4262-baef-3172b3e27fe4 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1668 microversion: 2.1 time: 0.168507 Oct 03 11:36:40.092840 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3918/7504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:39 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:40.114512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:40.115645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:40.123540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.124026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.124454 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.125183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.125636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.126056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.284444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:40.288796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:40.294437 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3d2f55e5-b369-4913-b5d4-29ba98d71c4d tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1668 microversion: 2.1 time: 0.183689 Oct 03 11:36:40.295162 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3587/7505] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:40 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1668 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:40.317977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:40.318704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:40.326684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.327204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.327636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.328352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.328847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.329289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.469247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:40.478470 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-beb64f94-5912-48fa-bbf9-f63ba24633fa tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1668 microversion: 2.1 time: 0.164202 Oct 03 11:36:40.479225 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3919/7506] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:40 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:40.505491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:40.506314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:40.513926 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.514419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.514853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.515555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.516007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.516473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.551759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:36:40.641891 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa1d927d-49ae-45a1-ab20-d1a038594a5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 204 len: 0 microversion: 2.1 time: 0.140838 Oct 03 11:36:40.642637 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3588/7507] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:36:40 2022] DELETE /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:36:40.651964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:40.652582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:40.658589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.659078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.659524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.660218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:40.660679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:40.661141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:40.798468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:40.806798 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7892a8a7-4246-464f-ba8e-dfa6f2f93155 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1674 microversion: 2.1 time: 0.158970 Oct 03 11:36:40.807386 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3920/7508] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:40 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:36:41.830702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:41.831409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:41.838295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:41.838783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:41.839223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:41.839923 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:41.840380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:41.840837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:41.981240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:41.989475 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9b5c61f4-4c37-41b0-abf4-4ad942299e21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1674 microversion: 2.1 time: 0.163006 Oct 03 11:36:41.990581 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3589/7509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:41 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:42.337975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6ae7a04d-c41a-4f5a-aad5-6f0626852d62 req-a0ae2aa4-847b-4529-a721-6adb2247d8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "name": "network-vif-plugged", "status": "completed", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:42.343795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:42.351523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ae7a04d-c41a-4f5a-aad5-6f0626852d62 req-a0ae2aa4-847b-4529-a721-6adb2247d8c8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:42.352026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ae7a04d-c41a-4f5a-aad5-6f0626852d62 req-a0ae2aa4-847b-4529-a721-6adb2247d8c8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:42.352484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ae7a04d-c41a-4f5a-aad5-6f0626852d62 req-a0ae2aa4-847b-4529-a721-6adb2247d8c8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:42.364604 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6ae7a04d-c41a-4f5a-aad5-6f0626852d62 req-a0ae2aa4-847b-4529-a721-6adb2247d8c8 service nova] Creating event network-vif-plugged:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h1-858383-3 Oct 03 11:36:42.370794 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6ae7a04d-c41a-4f5a-aad5-6f0626852d62 req-a0ae2aa4-847b-4529-a721-6adb2247d8c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036574 Oct 03 11:36:42.371596 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3921/7510] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:36:43.016961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:43.017705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:43.020645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:43.027686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:43.028292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:43.028988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:43.029880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:43.030401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:43.030778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:43.252723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:43.261936 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6a62b449-52de-4e9f-9d01-de0851629860 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1674 microversion: 2.1 time: 0.249384 Oct 03 11:36:43.263449 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3590/7511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:43 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:43.543518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-aa8ff3c8-704f-4b1d-a01d-c427bd08a890 req-37cb80c6-17be-4843-afbb-1ec9fd2521d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c50776-39b6-4006-a588-e173a88fa964", "name": "network-vif-deleted", "tag": "f1f7de49-61d3-470c-80b6-c4fc23564598"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:43.553513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:43.559774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa8ff3c8-704f-4b1d-a01d-c427bd08a890 req-37cb80c6-17be-4843-afbb-1ec9fd2521d0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:43.560346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa8ff3c8-704f-4b1d-a01d-c427bd08a890 req-37cb80c6-17be-4843-afbb-1ec9fd2521d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:43.560842 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-aa8ff3c8-704f-4b1d-a01d-c427bd08a890 req-37cb80c6-17be-4843-afbb-1ec9fd2521d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:43.574924 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-aa8ff3c8-704f-4b1d-a01d-c427bd08a890 req-37cb80c6-17be-4843-afbb-1ec9fd2521d0 service nova] Creating event network-vif-deleted:f1f7de49-61d3-470c-80b6-c4fc23564598 for instance 27c50776-39b6-4006-a588-e173a88fa964 on n-h1-858383-3 Oct 03 11:36:43.581873 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-aa8ff3c8-704f-4b1d-a01d-c427bd08a890 req-37cb80c6-17be-4843-afbb-1ec9fd2521d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042717 Oct 03 11:36:43.587427 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3922/7512] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:36:44.288021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:44.288622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:44.296050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:44.296541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:44.297243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:44.297949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:44.298463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:44.299134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:44.333319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:44.334394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:44.334899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:44.335416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lazy-loading 'fault' on Instance uuid 27c50776-39b6-4006-a588-e173a88fa964 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:36:44.380147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:44.388710 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-597e8ecd-f11f-47ea-8b80-7863fbfeffa7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 200 len: 1329 microversion: 2.1 time: 0.105173 Oct 03 11:36:44.389333 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3591/7513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:44 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:45.413268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:45.413989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:45.421364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:45.421863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:45.422316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:45.423034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:45.423516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:45.423945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:45.438246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 HTTP/1.1 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '27c50776-39b6-4006-a588-e173a88fa964'} Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:36:45.439913 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbcfe400-eabd-4605-a651-212c659babc9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 404 len: 111 microversion: 2.1 time: 0.033042 Oct 03 11:36:45.445475 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3923/7514] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:45 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:36:45.459380 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:45.459937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:45.466963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:45.467466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:45.467908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:45.468612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:45.469105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:45.469541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:45.483230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 HTTP/1.1 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '27c50776-39b6-4006-a588-e173a88fa964'} Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:36:45.484794 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-687dc082-0df9-4058-930f-98147efc41d6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 404 len: 111 microversion: 2.1 time: 0.031528 Oct 03 11:36:45.489450 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3592/7515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:45 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:36:45.535697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-130403426", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "bd483bc4-5cf7-4935-950c-ba83c35d326b"}], "security_groups": [{"name": "tempest-securitygroup--680542793"}], "key_name": "tempest-keypair-1248876917", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:45.642960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] validate_networks() for [('bd483bc4-5cf7-4935-950c-ba83c35d326b', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:36:46.063130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:36:46.063567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:36:46.064088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:36:46.064489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:36:46.064947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:36:46.074608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:46.075034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:46.075484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:46.076226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:46.076695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:46.077167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:46.094253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:36:46.099602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for user 03345f507def4b4382885e163c77fbae and project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:36:46.111894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:36:46.114283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:36:46.163262 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b11799f-0d0a-4049-9c0b-8cbd57fb542b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.631686 Oct 03 11:36:46.163918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3924/7516] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:36:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:36:46.175459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa3e041e-ee8b-46c1-a54c-69dee92bd086 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:46.176071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa3e041e-ee8b-46c1-a54c-69dee92bd086 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:46.246803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa3e041e-ee8b-46c1-a54c-69dee92bd086 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:46.253862 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa3e041e-ee8b-46c1-a54c-69dee92bd086 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1238 microversion: 2.1 time: 0.082438 Oct 03 11:36:46.254348 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3593/7517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:46 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:47.278605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:47.279230 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:47.287672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:47.288176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:47.288626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:47.289376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:47.289841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:47.290280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:47.381980 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:47.390467 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9984bbfb-6851-48c3-b928-8398532bc581 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1296 microversion: 2.1 time: 0.116453 Oct 03 11:36:47.391067 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3925/7518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:47 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:48.415857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-33d5118f-1972-4d55-b818-68edb001b2d8 req-56e3a745-3ee1-4495-8acf-415e6debfcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "tag": "00417f32-069a-41a0-bd0d-9180f38e2f53"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:48.416794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:48.418033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:48.428329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-33d5118f-1972-4d55-b818-68edb001b2d8 req-56e3a745-3ee1-4495-8acf-415e6debfcd3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:48.428825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:48.428983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-33d5118f-1972-4d55-b818-68edb001b2d8 req-56e3a745-3ee1-4495-8acf-415e6debfcd3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:48.429440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-33d5118f-1972-4d55-b818-68edb001b2d8 req-56e3a745-3ee1-4495-8acf-415e6debfcd3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:48.429813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:48.431107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:48.432167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:48.432807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:48.433468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:48.441355 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-33d5118f-1972-4d55-b818-68edb001b2d8 req-56e3a745-3ee1-4495-8acf-415e6debfcd3 service nova] Creating event network-changed:00417f32-069a-41a0-bd0d-9180f38e2f53 for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h2-858383-3 Oct 03 11:36:48.447510 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-33d5118f-1972-4d55-b818-68edb001b2d8 req-56e3a745-3ee1-4495-8acf-415e6debfcd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035644 Oct 03 11:36:48.448135 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3926/7519] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:36:48.570706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:48.579030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5748ff9a-9e75-4c81-9916-c5dd9b6de7e8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.168841 Oct 03 11:36:48.579627 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3594/7520] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:48 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:49.605033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:49.605843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:49.612185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:49.612694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:49.613187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:49.613910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:49.614378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:49.614864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:49.811203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:49.821105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-74e26b86-fc64-465b-a5e7-6567e4d801a5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1307 microversion: 2.1 time: 0.220490 Oct 03 11:36:49.821403 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3927/7521] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:49 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:49.879950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3c14b1e7-0ddd-4ce6-b10c-e812b1f24eba req-44f47f5d-f8d0-4364-8071-75347987f349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "name": "network-vif-deleted", "tag": "00417f32-069a-41a0-bd0d-9180f38e2f53"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:49.892337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c14b1e7-0ddd-4ce6-b10c-e812b1f24eba req-44f47f5d-f8d0-4364-8071-75347987f349 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:49.893213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c14b1e7-0ddd-4ce6-b10c-e812b1f24eba req-44f47f5d-f8d0-4364-8071-75347987f349 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:49.893892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3c14b1e7-0ddd-4ce6-b10c-e812b1f24eba req-44f47f5d-f8d0-4364-8071-75347987f349 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:49.906697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.server_external_events [req-3c14b1e7-0ddd-4ce6-b10c-e812b1f24eba req-44f47f5d-f8d0-4364-8071-75347987f349 service nova] Unable to find a host for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa. Dropping event network-vif-deleted {{(pid=122270) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 11:36:49.907767 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3c14b1e7-0ddd-4ce6-b10c-e812b1f24eba req-44f47f5d-f8d0-4364-8071-75347987f349 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031743 Oct 03 11:36:49.908392 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3595/7522] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 11:36:50.844878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:50.845493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:50.852398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:50.852930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:50.853378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:50.854099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:50.854559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:50.854993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:50.923589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:50.931740 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1415e94-cad4-4a58-a9de-9d178429077b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1290 microversion: 2.1 time: 0.090966 Oct 03 11:36:50.932332 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3928/7523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:50 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:51.955810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:51.956459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:51.966178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:51.967298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:51.967941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:51.968665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:51.969185 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:51.969626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:52.185445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:52.194008 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f14f51e5-f37a-4b78-ac55-95e4c70e6981 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.242088 Oct 03 11:36:52.194606 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3596/7524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:51 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:52.585483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-8d1793f0-32fb-4c2f-aaf9-b83fcf4a7962 req-77bd054c-022f-492b-a150-b423b162623f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:52.595951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d1793f0-32fb-4c2f-aaf9-b83fcf4a7962 req-77bd054c-022f-492b-a150-b423b162623f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:52.596441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d1793f0-32fb-4c2f-aaf9-b83fcf4a7962 req-77bd054c-022f-492b-a150-b423b162623f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:52.596918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-8d1793f0-32fb-4c2f-aaf9-b83fcf4a7962 req-77bd054c-022f-492b-a150-b423b162623f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:52.608237 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-8d1793f0-32fb-4c2f-aaf9-b83fcf4a7962 req-77bd054c-022f-492b-a150-b423b162623f service nova] Creating event network-changed:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:36:52.613183 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-8d1793f0-32fb-4c2f-aaf9-b83fcf4a7962 req-77bd054c-022f-492b-a150-b423b162623f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Oct 03 11:36:52.613799 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3929/7525] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:36:53.218834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:53.219447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:53.225892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:53.226367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:53.226800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:53.227482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:53.227932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:53.228352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:53.360852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:53.368614 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0cb09e9-8d0a-4773-83cc-f4dd97fc2bf0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.154597 Oct 03 11:36:53.369214 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3597/7526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:53 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:54.392530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:54.393278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:54.400083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:54.400581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:54.401067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:54.401771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:54.402241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:54.402681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:54.530209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:54.537953 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9c8ee25-1876-4c01-8752-9c75d13874a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.150516 Oct 03 11:36:54.538522 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3930/7527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:54 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:55.561431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:55.562079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:55.569308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:55.569808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:55.570250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:55.570988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:55.571672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:55.573216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:55.707915 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:55.716171 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04280646-70d4-4837-a088-e1de7e9f5c87 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.158653 Oct 03 11:36:55.716738 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3598/7528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:55 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:56.740963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:56.741722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:56.744190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:56.745000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:56.750677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:56.751178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:56.751630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:56.752336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:56.752833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:56.753277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:56.886738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:56.895818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d3a1d097-5b4e-4121-be31-7c059f0fe02a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.159342 Oct 03 11:36:56.896787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3931/7529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:56 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:57.919472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:57.920078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:57.921968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:36:57.928161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:57.928639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:57.929099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:57.929780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:57.930229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:57.930650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:58.059142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:58.066838 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c40bcb3c-2db1-42d5-adf1-1d01ea1ac03c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.151207 Oct 03 11:36:58.067661 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3599/7530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:57 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:36:58.360402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-368b2acc-7979-4db6-a2e9-e41d9c072f83 req-22d33c23-4888-496f-8304-c53226b09858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "name": "network-vif-plugged", "status": "completed", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:36:58.371333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-368b2acc-7979-4db6-a2e9-e41d9c072f83 req-22d33c23-4888-496f-8304-c53226b09858 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:58.371802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-368b2acc-7979-4db6-a2e9-e41d9c072f83 req-22d33c23-4888-496f-8304-c53226b09858 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:58.372247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-368b2acc-7979-4db6-a2e9-e41d9c072f83 req-22d33c23-4888-496f-8304-c53226b09858 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:58.384565 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-368b2acc-7979-4db6-a2e9-e41d9c072f83 req-22d33c23-4888-496f-8304-c53226b09858 service nova] Creating event network-vif-plugged:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:36:58.390096 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-368b2acc-7979-4db6-a2e9-e41d9c072f83 req-22d33c23-4888-496f-8304-c53226b09858 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034014 Oct 03 11:36:58.390854 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3932/7531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:36:59.090686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:36:59.091302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:36:59.098125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:59.098609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:59.099559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:59.100255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:36:59.100708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:36:59.101230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:36:59.237169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:36:59.245638 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad6c99b8-05e3-4fab-ba8c-40d70f8cf663 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1363 microversion: 2.1 time: 0.159375 Oct 03 11:36:59.246213 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3600/7532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:36:59 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:37:00.269606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:37:00.270316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:37:00.276475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:37:00.277000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:37:00.277458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:37:00.278160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:37:00.278623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:37:00.279060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:37:00.408786 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:37:00.416974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac19d2b6-fe4b-4e84-9814-60452a383fbc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1549 microversion: 2.1 time: 0.152481 Oct 03 11:37:00.417538 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3933/7533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:37:00 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:37:00.440624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:37:00.441194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:37:00.448384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:37:00.448903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:37:00.449353 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:37:00.450053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:37:00.450507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:37:00.450935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:37:00.529270 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0db4a17e-7a8f-458f-9a8e-c520f5bca1db tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092585 Oct 03 11:37:00.529887 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3601/7534] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 11:37:00 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:37:01.479898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a09dc696-bcfd-4272-b759-969fea6d869b req-ce0e7be7-db98-4e67-bc30-1e3b36bd46d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:37:01.492276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a09dc696-bcfd-4272-b759-969fea6d869b req-ce0e7be7-db98-4e67-bc30-1e3b36bd46d2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:37:01.492799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a09dc696-bcfd-4272-b759-969fea6d869b req-ce0e7be7-db98-4e67-bc30-1e3b36bd46d2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:37:01.493321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a09dc696-bcfd-4272-b759-969fea6d869b req-ce0e7be7-db98-4e67-bc30-1e3b36bd46d2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:37:01.505751 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a09dc696-bcfd-4272-b759-969fea6d869b req-ce0e7be7-db98-4e67-bc30-1e3b36bd46d2 service nova] Creating event network-changed:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:37:01.511020 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a09dc696-bcfd-4272-b759-969fea6d869b req-ce0e7be7-db98-4e67-bc30-1e3b36bd46d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034883 Oct 03 11:37:01.511673 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3934/7535] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:38:15.062028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=27 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:15.062826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:15.067363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:15.067983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:15.075248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:15.075740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:15.076186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:15.076913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:15.077374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:15.077813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:15.207747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:15.216013 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ebccb01-cb77-452a-ba50-e880ad81926b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1667 microversion: 2.1 time: 0.157132 Oct 03 11:38:15.216590 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3602/7536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:15 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:15.237710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:15.238499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=64 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:15.243411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb2e052e-ee4f-4797-aa7e-77304684c2e0"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:38:15.245828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:15.253532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:15.254026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:15.254470 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:15.255172 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:15.255633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:15.256067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:15.528393 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-46d62624-7f1e-4c44-9e92-7a53f33d4afd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293172 Oct 03 11:38:15.529336 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3935/7537] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:38:15 2022] POST /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:38:27.343208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:38:27.345484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:27.349211 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:38:27.349389 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/action (ip 10.222.0.27) !!! Oct 03 11:38:27.351016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:27.351748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:27.361216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:27.361709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:27.362149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:27.362878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:27.363335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:27.363762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:27.393037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:27.398964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Old instance type m1.heat2, new instance type m1.heat {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:38:27.408278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:38:27.408699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:38:27.409224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:38:27.409634 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:38:27.410052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:38:27.476487 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9853bf5b-69ed-4453-bc8b-e99f5946dd13 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.137311 Oct 03 11:38:27.480363 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3603/7538] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:38:27 2022] POST /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:38:27.484354 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:38:27.484887 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa (ip 10.222.0.27) !!! Oct 03 11:38:27.485661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:27.486426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:27.491491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:27.492536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:27.503263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:27.503895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:27.504392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:27.505164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:27.505603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:27.506264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:27.668496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:27.677471 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-68e4c156-be33-460d-a03a-6603556d8222 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1722 microversion: 2.1 time: 0.195416 Oct 03 11:38:27.678065 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3936/7539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:27 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:28.703681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:28.704392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:28.711436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:28.711927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:28.712371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:28.713102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:28.713565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:28.713997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:28.854074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:28.863096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea0d8615-07a5-4b0c-9aaa-4c27533e9385 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1722 microversion: 2.1 time: 0.164131 Oct 03 11:38:28.863628 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3604/7540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:28 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:29.887560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:29.888182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:29.895578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:29.896071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:29.896520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:29.897350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:29.897816 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:29.898253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:30.029100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:30.037335 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b53512dc-fccc-4ce2-94c5-ce523abe7969 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1722 microversion: 2.1 time: 0.153917 Oct 03 11:38:30.037928 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3937/7541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:29 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:31.061285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:31.062187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:31.068929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:31.069412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:31.069846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:31.070542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:31.070995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:31.071418 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:31.280238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:31.289156 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-34c66dfb-c887-42cb-b06c-489e425f5a3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1722 microversion: 2.1 time: 0.232068 Oct 03 11:38:31.289772 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3605/7542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:31 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:38:32.312900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:32.313550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:32.320244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:32.320736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:32.321210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:32.322111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:32.322376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:32.322811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:32.457726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:32.466092 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f5953176-8b39-4131-8b0e-877fa420bb93 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.157123 Oct 03 11:38:32.466668 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3938/7543] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:32 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:33.490683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:33.491280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:33.497986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:33.498466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:33.498905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:33.499626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:33.500082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:33.500506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:33.721663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:33.730017 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-145bd054-3276-4743-8c65-5a9e1dc08758 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.243351 Oct 03 11:38:33.730600 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3606/7544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:33 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:34.754260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:34.754885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:34.761907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:34.762403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:34.762849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:34.763557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:34.764020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:34.764457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:34.955481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:34.963808 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7e8d8a2a-f2ab-46bd-805e-ae63a000c29f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.214202 Oct 03 11:38:34.965012 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3939/7545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:34 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:35.988161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:35.988788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:35.995520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:35.996002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:35.996439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:35.997165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:35.997621 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:35.998045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:36.129229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:36.137696 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91c114db-c515-4e3e-80f8-2d1b94e27203 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.153449 Oct 03 11:38:36.138272 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3607/7546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:35 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:37.161306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:37.161937 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:37.169214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:37.169715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:37.170164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:37.170921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:37.171407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:37.171844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:37.311809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:37.321130 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f5a620d5-0eac-4c61-a045-f49df3566691 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.164245 Oct 03 11:38:37.321718 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3940/7547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:37 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:38.345794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:38.346396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:38.353303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:38.353785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:38.354222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:38.354914 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:38.355369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:38.355798 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:38.492194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:38.501134 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1bceae4-f34d-484e-8a53-454055ef709c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.159410 Oct 03 11:38:38.501708 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3608/7548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:38 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:39.524834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:39.525566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:39.532904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:39.533419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:39.533878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:39.534615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:39.535089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:39.535535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:39.682321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:39.691254 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1c0cf660-eb35-4bd6-a6ec-9f4679c2cef2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.170330 Oct 03 11:38:39.691857 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3941/7549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:39 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:40.715387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:40.716006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:40.723215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:40.723708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:40.724256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:40.725262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:40.725993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:40.726640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:40.881100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:40.889632 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc18aabd-317b-494c-880e-3d022595537c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.178342 Oct 03 11:38:40.890220 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3609/7550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:40 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:41.913618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:41.914251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:41.921253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:41.921748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:41.922859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:41.923588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:41.924063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:41.924504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:42.086454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:42.095776 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ab35d95-6282-4caa-8b10-da53d5b23d21 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.186106 Oct 03 11:38:42.096366 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3942/7551] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:41 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:43.121159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:43.121779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:43.129323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:43.129821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:43.130268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:43.130974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:43.131442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:43.131879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:43.287782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:43.298614 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2f4c993f-2ee3-437e-9238-6d19d0efab25 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.181361 Oct 03 11:38:43.299206 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3610/7552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:43 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:44.322733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:44.323367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:44.331013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:44.331518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:44.331972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:44.332683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:44.333183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:44.333626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:44.472346 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:44.480756 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-070f078c-a8a3-46f9-aebf-eacd0c6e3c29 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.161972 Oct 03 11:38:44.481365 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3943/7553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:44 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:45.505247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:45.505866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:45.513141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:45.513667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:45.514106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:45.514819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:45.515278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:45.516323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:45.669920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:45.678744 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-189a67e4-dd2b-4007-8a90-3e2a721288a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.177503 Oct 03 11:38:45.679340 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3611/7554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:45 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:46.703414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:46.703985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:46.710997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:46.711494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:46.712035 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:46.712709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:46.713272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:46.713718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:46.846740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:46.855571 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62ea0f0f-215e-4427-a41b-7c0b03edd1c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.156614 Oct 03 11:38:46.856148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3944/7555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:46 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:47.878721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:47.879339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:47.886086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:47.886567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:47.887001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:47.887683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:47.888134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:47.888553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:48.016131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:48.024301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c1fbfca5-e150-437c-9bdc-ad7bd432f971 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.149514 Oct 03 11:38:48.024907 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3612/7556] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:47 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:49.047441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:49.048062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:49.055134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:49.055724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:49.056174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:49.056893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:49.057358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:49.057795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:49.194161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:49.202545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65c0166b-709e-48cf-8eb5-663197f5db70 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.159433 Oct 03 11:38:49.203163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3945/7557] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:49 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:50.226058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:50.226668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:50.233648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:50.234126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:50.235134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:50.235831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:50.236286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:50.236716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:50.369767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:50.378160 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9ed44b26-c692-43a7-ba15-6f3715bd460c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.156013 Oct 03 11:38:50.378746 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3613/7558] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:50 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:51.401865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:51.403125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:51.411040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:51.411578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:51.412036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:51.412806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:51.413284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:51.413729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:51.546778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:51.555594 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95f0280b-7ba4-4f08-b8a8-745aa8cbd930 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.157657 Oct 03 11:38:51.556178 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3946/7559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:51 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:52.582738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:52.583593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:52.593170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:52.593170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:52.593170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:52.593170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:52.596976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:52.596976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:52.743436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:52.752280 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d80330b9-12eb-4d24-ab4b-5dde6fdadf68 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.174110 Oct 03 11:38:52.752877 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3614/7560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:52 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:38:53.776394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:53.777075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:53.784534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:53.785064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:53.785522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:53.786232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:53.786703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:53.787148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:53.923264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:53.931970 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-71be0171-0141-4c6c-adab-a24e836b9879 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.159449 Oct 03 11:38:53.932572 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3947/7561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:53 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:54.955028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:54.955652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:54.962592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:54.963082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:54.963529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:54.964287 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:54.964754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:54.965207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:55.107461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:55.116391 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b7074a9-e058-4816-8086-4693310acbfd tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1727 microversion: 2.1 time: 0.165266 Oct 03 11:38:55.116995 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3615/7562] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:54 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:56.141326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:56.142414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:56.150187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:56.150692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:56.151155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:56.151875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:56.152349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:56.152809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:56.285941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:56.294816 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4dfef075-e979-4c8c-8af9-48bca823251c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1726 microversion: 2.1 time: 0.159134 Oct 03 11:38:56.295392 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3948/7563] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:56 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:56.920497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bdb4595a-f325-4aff-9366-a4937454e219 req-2bda966c-bc51-41e4-a509-a2537b774e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "name": "network-vif-unplugged", "status": "completed", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:38:56.933193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bdb4595a-f325-4aff-9366-a4937454e219 req-2bda966c-bc51-41e4-a509-a2537b774e11 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:56.933818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bdb4595a-f325-4aff-9366-a4937454e219 req-2bda966c-bc51-41e4-a509-a2537b774e11 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:56.934331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bdb4595a-f325-4aff-9366-a4937454e219 req-2bda966c-bc51-41e4-a509-a2537b774e11 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:56.947201 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bdb4595a-f325-4aff-9366-a4937454e219 req-2bda966c-bc51-41e4-a509-a2537b774e11 service nova] Creating event network-vif-unplugged:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:38:56.952689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-bdb4595a-f325-4aff-9366-a4937454e219 req-2bda966c-bc51-41e4-a509-a2537b774e11 service nova] Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:38:56.960987 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bdb4595a-f325-4aff-9366-a4937454e219 req-2bda966c-bc51-41e4-a509-a2537b774e11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044178 Oct 03 11:38:56.961729 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3616/7564] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:38:57.318996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:57.319633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:57.327428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:57.327976 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:57.328477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:57.329241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:57.329716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:57.330196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:57.469632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:57.478105 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a1d6edb4-25a2-4c7c-ba79-db67b1999af2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.163038 Oct 03 11:38:57.478690 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3949/7565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:57 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:58.504540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:58.505286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:58.507204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=33 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:58.513435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:58.513933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:58.514394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:58.515083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:58.516105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:58.516538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:58.519258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:58.662431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:58.675274 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-34d631fa-1d4a-4051-aa24-7d0055128988 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.176336 Oct 03 11:38:58.676105 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3617/7566] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:58 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:38:59.701202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:38:59.701839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:38:59.704940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=29 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:59.712058 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:59.712638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:59.713134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:59.713878 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:38:59.714358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:38:59.714806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:38:59.718332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=85 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:38:59.853867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:38:59.863488 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4f415daa-d3f9-4873-99f9-411dab1a68c9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.167534 Oct 03 11:38:59.864166 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3950/7567] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:38:59 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:00.887676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:00.888492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:00.895570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:00.896130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:00.896639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:00.897429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:00.897953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:00.898478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:01.044004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:01.055824 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab4c086c-42e9-4a14-8ef5-e55343722636 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.171887 Oct 03 11:39:01.056852 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3618/7568] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:00 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:02.081074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:02.081733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:02.088670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:02.089198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:02.089647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:02.090344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:02.090807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:02.091244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:02.222859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:02.231170 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0800fe80-6b20-4c50-b362-e14e622c424f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.154618 Oct 03 11:39:02.231740 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3951/7569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:02 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:39:03.255182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:03.255959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:03.263717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:03.264211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:03.264649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:03.265954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:03.266449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:03.266875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:03.408505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:03.417680 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8dbdd5e6-a1e3-40d3-b819-8d95b4fdc9f2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.166649 Oct 03 11:39:03.418266 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3619/7570] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:03 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:04.441201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:04.441836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:04.449133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:04.449303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:04.449672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:04.450384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:04.450889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:04.451333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:04.586806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:04.595575 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9103446f-7272-48fe-942a-87f3202c12bc tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.158273 Oct 03 11:39:04.596157 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3952/7571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:04 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:05.619004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:05.619641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:05.626783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:05.627284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:05.627700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:05.628393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:05.628873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:05.629304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:05.768223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:05.776804 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94390e50-cf10-45bd-9013-8c90ae21bf73 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.161906 Oct 03 11:39:05.777390 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3620/7572] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:05 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:06.801844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:06.802497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:06.809429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:06.809927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:06.810377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:06.811084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:06.811561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:06.812502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:06.954895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:06.963273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-266c3601-f4f3-4c90-8b83-0c2d5b1743e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.165672 Oct 03 11:39:06.963859 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3953/7573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:06 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:39:07.987118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:07.987742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:07.995384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:07.995876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:07.996312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:07.997050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:07.997505 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:07.997927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:08.134852 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:08.143158 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d373d092-56d0-415e-8a91-818cf7e40492 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.160561 Oct 03 11:39:08.143747 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3621/7574] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:07 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:09.167375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:09.167998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:09.175301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:09.176070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:09.176543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:09.177282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:09.177751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:09.178187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:09.317734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:09.326169 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca216e99-3b19-4483-aebd-e60be39c81a6 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1724 microversion: 2.1 time: 0.162966 Oct 03 11:39:09.326749 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3954/7575] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:09 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:10.351263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:10.351985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:10.359533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.360019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.360456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.361247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.361706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.362132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.497310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:10.506396 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2b9ca89f-1491-4e5f-b940-e25bfcfdaed9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1721 microversion: 2.1 time: 0.158395 Oct 03 11:39:10.507002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3622/7576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:10 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:10.529216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:39:10.529799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:10.537258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.537759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.538217 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.538925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.539392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.539840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.578692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.579194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.579642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.580377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.580869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.581313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.602222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:39:10.607410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Getting quotas for user 03345f507def4b4382885e163c77fbae and project cbf373fd925e4c4a9ed7effd67d1a2f5. Resources: {'cores', 'ram'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:39:10.707153 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff4ed291-3ad8-453c-b740-8d9066c379f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "POST /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.181694 Oct 03 11:39:10.707807 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3955/7577] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:39:10 2022] POST /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 11:39:10.716867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:10.717494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:10.724215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.724716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.725243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.726101 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:10.726635 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:10.727148 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:10.924009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:10.932726 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e08c72dc-3a6e-45b5-b5c6-9779affe5bec tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.220636 Oct 03 11:39:10.934625 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3623/7578] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:10 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:11.961411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:11.962133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:11.969416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:11.969913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:11.970360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:11.971067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:11.971530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:11.971971 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:12.106637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:12.115651 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e680acfd-c041-48d4-919f-a88b8c359d0f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.159433 Oct 03 11:39:12.116230 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3956/7579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:11 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:13.090590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9b8454a6-946d-4115-bd2c-b00e129a8d13 req-ff608c9a-566b-415b-88bc-8ab422519fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "name": "network-vif-plugged", "status": "completed", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:39:13.101609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9b8454a6-946d-4115-bd2c-b00e129a8d13 req-ff608c9a-566b-415b-88bc-8ab422519fc8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:13.102368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9b8454a6-946d-4115-bd2c-b00e129a8d13 req-ff608c9a-566b-415b-88bc-8ab422519fc8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:13.102560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9b8454a6-946d-4115-bd2c-b00e129a8d13 req-ff608c9a-566b-415b-88bc-8ab422519fc8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:13.119267 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9b8454a6-946d-4115-bd2c-b00e129a8d13 req-ff608c9a-566b-415b-88bc-8ab422519fc8 service nova] Creating event network-vif-plugged:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:39:13.131795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-9b8454a6-946d-4115-bd2c-b00e129a8d13 req-ff608c9a-566b-415b-88bc-8ab422519fc8 service nova] Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:39:13.139369 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9b8454a6-946d-4115-bd2c-b00e129a8d13 req-ff608c9a-566b-415b-88bc-8ab422519fc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052672 Oct 03 11:39:13.139724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:13.141193 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3624/7580] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:39:13.141313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:13.148170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:13.148668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:13.149147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:13.150080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:13.150554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:13.150998 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:13.286357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:13.295246 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19560cba-154c-4709-8ed8-c400e281ad2e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.159395 Oct 03 11:39:13.295845 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3957/7581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:13 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:14.320968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:14.321667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:14.328337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:14.328847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:14.329295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:14.330043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:14.330514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:14.330945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:14.468640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:14.477432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a83ed5f0-654c-428e-b893-48ebf642faf3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.161631 Oct 03 11:39:14.478016 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3625/7582] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:14 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:39:15.502991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:15.503617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:15.511467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:15.511967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:15.512416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:15.513227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:15.513699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:15.514142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:15.667435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:15.677368 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf78333d-ac7d-4af0-a415-66685eb05f5a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.179350 Oct 03 11:39:15.689093 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3958/7583] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:15 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:16.704075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:16.704683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:16.711998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:16.712482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:16.712943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:16.713648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:16.714096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:16.714518 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:16.851572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:16.861695 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db1d9bda-1c28-42fe-a6d7-c516156b44d2 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.161998 Oct 03 11:39:16.862385 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3626/7584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:16 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:17.214132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-bb12f6e1-0ac5-41c9-8f31-d1680d51577b req-20a323aa-d3d4-416d-9afb-ce3e454dcbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "name": "network-vif-unplugged", "status": "completed", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:39:17.226919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bb12f6e1-0ac5-41c9-8f31-d1680d51577b req-20a323aa-d3d4-416d-9afb-ce3e454dcbc0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:17.227419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bb12f6e1-0ac5-41c9-8f31-d1680d51577b req-20a323aa-d3d4-416d-9afb-ce3e454dcbc0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:17.227864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-bb12f6e1-0ac5-41c9-8f31-d1680d51577b req-20a323aa-d3d4-416d-9afb-ce3e454dcbc0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:17.244265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-bb12f6e1-0ac5-41c9-8f31-d1680d51577b req-20a323aa-d3d4-416d-9afb-ce3e454dcbc0 service nova] Creating event network-vif-unplugged:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:39:17.252359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [req-bb12f6e1-0ac5-41c9-8f31-d1680d51577b req-20a323aa-d3d4-416d-9afb-ce3e454dcbc0 service nova] Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-3'} {{(pid=122269) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:39:17.259099 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-bb12f6e1-0ac5-41c9-8f31-d1680d51577b req-20a323aa-d3d4-416d-9afb-ce3e454dcbc0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048591 Oct 03 11:39:17.260088 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3959/7585] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:39:17.885638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:17.886258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:17.893115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:17.893608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:17.894048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:17.894760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:17.895223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:17.895654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:18.045024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:18.054935 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b95ee384-d04c-49b9-985a-9b8848d6f1ed tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.173130 Oct 03 11:39:18.055549 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3627/7586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:17 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:19.080409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:19.081187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:19.087646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:19.088090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:19.088549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:19.089347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:19.089758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:19.090206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:19.230400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:19.240629 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7d11d542-1264-41ec-ba44-f436274f2d62 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.165210 Oct 03 11:39:19.241261 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3960/7587] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:19 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:20.266436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:20.267054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:20.274076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:20.274573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:20.275019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:20.275743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:20.276199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:20.276630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:20.420600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:20.430373 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-876daa08-cb5f-45a7-9c0e-39b9a2bb8f3b tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.168286 Oct 03 11:39:20.431381 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3628/7588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:20 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:21.512580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:21.513331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:21.516951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:39:21.522624 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:21.523125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:21.523575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:21.524291 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:21.524761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:21.525231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:21.662313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:21.670753 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-29f4a519-3262-4ca7-96c4-ec71ff77c39a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.162014 Oct 03 11:39:21.671349 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3961/7589] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:21 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:22.695299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:22.696067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:22.703755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:22.704235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:22.704666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:22.705385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:22.705837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:22.706294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:22.839290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:22.848349 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6ee92139-fadb-4957-b5b7-7695a3ed2364 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.156947 Oct 03 11:39:22.848952 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3629/7590] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:22 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:39:23.872248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:23.872902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:23.880019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:23.880519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:23.881012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:23.881718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:23.882198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:23.882646 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:24.024137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:24.033124 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7db1c58-b152-45d2-98f2-2c2df92b188a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.164859 Oct 03 11:39:24.033705 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3962/7591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:23 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:25.057367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:25.057976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:25.065495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:25.065982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:25.066426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:25.067130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:25.067593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:25.068128 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:25.205754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:25.214882 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-abd85f08-7e67-4344-8e0c-85cc012f434e tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.161263 Oct 03 11:39:25.215466 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3630/7592] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:25 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:26.239073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:26.239709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:26.246582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:26.247081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:26.247530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:26.248263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:26.248731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:26.249825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:26.383040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:26.391388 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b8820c58-dac7-43fa-927b-1e13df7985bb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.156242 Oct 03 11:39:26.391970 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3963/7593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:26 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:27.414894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:27.415506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:27.422789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:27.423272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:27.423703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:27.424386 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:27.424863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:27.425524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:27.552345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:27.560493 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-19ecfb39-42fd-41e1-a0ed-9dda89dec2a9 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.149510 Oct 03 11:39:27.561222 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3631/7594] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:27 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:28.586546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:28.587178 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:28.594502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:28.595000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:28.595451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:28.596159 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:28.596622 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:28.597085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:28.599633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:39:28.730496 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:28.738814 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-52968124-e6fd-4cc7-afa6-0a1204e888cf tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.156451 Oct 03 11:39:28.739388 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3964/7595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:28 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:29.762653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:29.763345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:29.766270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=30 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:39:29.772066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:29.772558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:29.773017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:29.773712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:29.774162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:29.774586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:29.777393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=88 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:39:29.918948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:29.928789 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b31c2a93-ae1c-48ba-af59-a51b644013f3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1720 microversion: 2.1 time: 0.170625 Oct 03 11:39:29.929541 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3632/7596] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:29 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:30.953778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:30.954329 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:30.957436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:39:30.962801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:30.963287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:30.963748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:30.964458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:30.964967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:30.965415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.099155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:31.107568 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dba43821-8d4e-4231-8c46-aea87dac1b41 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1713 microversion: 2.1 time: 0.157724 Oct 03 11:39:31.108180 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3965/7597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:30 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:31.130933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:31.131539 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:31.138242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.138729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.139163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.139896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.140999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.141607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.286493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:31.295030 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b046a2e3-cb32-4d4e-bc28-0371544d62f7 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1713 microversion: 2.1 time: 0.167896 Oct 03 11:39:31.295651 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3633/7598] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:31 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:31.318369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:31.318987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:31.324939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.325437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.325887 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.326586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.327081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.327520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.723206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:31.731386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f852fba-6cba-4785-ad74-9bd083f51bc8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1713 microversion: 2.1 time: 0.416883 Oct 03 11:39:31.731966 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3966/7599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:31 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1713 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:31.754660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:31.755220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:31.761818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.762296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.762737 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.763470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.763949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.764395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.789088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:39:31.863131 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aee16547-25e1-436b-a603-d782a04c24c0 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 204 len: 0 microversion: 2.1 time: 0.111968 Oct 03 11:39:31.863531 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3634/7600] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:39:31 2022] DELETE /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 11:39:31.871619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:31.872242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:31.879019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.879486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.880003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:31.880716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:31.881214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:31.881655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:32.008386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:32.016743 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-515f0851-16f5-44cb-b2a8-6832f0167d5c tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1719 microversion: 2.1 time: 0.148811 Oct 03 11:39:32.017375 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3967/7601] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:31 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:33.042859 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:33.043716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:33.051588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:33.052057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:33.052500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:33.053224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:33.053683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:33.054105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:33.166500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-111f490e-fe49-47a5-a282-d952dde9b0c4 req-1dad4107-7b98-475d-b41f-d47b9dad7117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "name": "network-vif-plugged", "status": "completed", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:39:33.181422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-111f490e-fe49-47a5-a282-d952dde9b0c4 req-1dad4107-7b98-475d-b41f-d47b9dad7117 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:33.181928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-111f490e-fe49-47a5-a282-d952dde9b0c4 req-1dad4107-7b98-475d-b41f-d47b9dad7117 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:33.182374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-111f490e-fe49-47a5-a282-d952dde9b0c4 req-1dad4107-7b98-475d-b41f-d47b9dad7117 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:33.192481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:33.193214 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-111f490e-fe49-47a5-a282-d952dde9b0c4 req-1dad4107-7b98-475d-b41f-d47b9dad7117 service nova] Creating event network-vif-plugged:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:39:33.198525 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-111f490e-fe49-47a5-a282-d952dde9b0c4 req-1dad4107-7b98-475d-b41f-d47b9dad7117 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036613 Oct 03 11:39:33.199776 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3968/7602] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:39:33.201939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f8446005-700e-4bb4-9d5f-b83b31e7acba tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1719 microversion: 2.1 time: 0.163373 Oct 03 11:39:33.203099 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3635/7603] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:33 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:34.227640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:34.228351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:34.235599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:34.236431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:34.236911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:34.237635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:34.238095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:34.238538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:34.307641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:34.319893 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0cd3a489-4856-4eaf-ba48-3913f34e1390 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1652 microversion: 2.1 time: 0.097168 Oct 03 11:39:34.321027 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3969/7604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:34 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1652 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:34.914770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-21a0a7c3-7fde-41ce-99c5-24419f438b73 req-a87f61e6-6393-4ffc-a42f-27b58f52205f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa", "name": "network-vif-deleted", "tag": "78b4012e-6906-4d26-8c7f-b00124963a4c"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:39:34.928033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21a0a7c3-7fde-41ce-99c5-24419f438b73 req-a87f61e6-6393-4ffc-a42f-27b58f52205f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:34.928932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21a0a7c3-7fde-41ce-99c5-24419f438b73 req-a87f61e6-6393-4ffc-a42f-27b58f52205f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:34.929475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-21a0a7c3-7fde-41ce-99c5-24419f438b73 req-a87f61e6-6393-4ffc-a42f-27b58f52205f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:34.944361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-21a0a7c3-7fde-41ce-99c5-24419f438b73 req-a87f61e6-6393-4ffc-a42f-27b58f52205f service nova] Creating event network-vif-deleted:78b4012e-6906-4d26-8c7f-b00124963a4c for instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa on n-h1-858383-3 Oct 03 11:39:34.950284 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-21a0a7c3-7fde-41ce-99c5-24419f438b73 req-a87f61e6-6393-4ffc-a42f-27b58f52205f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039678 Oct 03 11:39:34.951014 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3636/7605] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:39:35.346583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:35.347345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:35.354476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:35.354974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:35.355687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:35.356468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:35.357031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:35.357581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:35.426429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:35.441280 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fdb20c05-8537-4efd-a357-41583313fbb5 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1369 microversion: 2.1 time: 0.094054 Oct 03 11:39:35.449565 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3970/7606] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:35 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:36.466999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:36.467901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:36.474242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:36.474733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:36.475177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:36.475882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:36.476342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:36.476831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:36.541417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:36.550402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65be5320-46a0-4537-a534-3a405cfc2456 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1369 microversion: 2.1 time: 0.088582 Oct 03 11:39:36.551274 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3637/7607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:36 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:37.574669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:37.576143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:37.583701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:37.584201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:37.584655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:37.585417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:37.585911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:37.586351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:37.649304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:37.658238 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3a84d624-5ead-46a1-a6cd-998875709b32 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1369 microversion: 2.1 time: 0.087476 Oct 03 11:39:37.658815 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3971/7608] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:37 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:38.681740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:38.682342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:38.689675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:38.690159 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:38.690593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:38.691277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:38.691730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:38.692151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:38.754694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03345f507def4b4382885e163c77fbae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf373fd925e4c4a9ed7effd67d1a2f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:38.762909 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a14161c6-c02e-46a5-8874-8aa47c26b3e3 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 200 len: 1369 microversion: 2.1 time: 0.085129 Oct 03 11:39:38.763472 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3638/7609] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:38 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:39.787536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:39.788165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:39.795187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:39.796338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:39.796835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:39.797546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:39.798170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:39.798620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:39.812363 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa HTTP/1.1 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa'} Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:39.814173 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a51277ed-7b1b-4a0d-9c4d-c7c8301d9da8 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 404 len: 111 microversion: 2.1 time: 0.032245 Oct 03 11:39:39.819507 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3972/7610] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:39 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:39.877804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:39.880059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:39.886908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:39.887389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:39.887825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:39.888507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:39.888989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:39.889920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:39.906151 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/os-volume_attachments HTTP/1.1 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': 'c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa'} Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:39.907815 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f404772-cdd8-4148-a2b6-f66e535b89fe tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035464 Oct 03 11:39:39.912672 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3639/7611] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:39:39 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.245994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.246510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.254016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.254514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.254965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.255670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.256137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.256577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.272970 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa HTTP/1.1 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa'} Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.274539 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-416cee6e-d92a-4889-acec-4bf16d6dd048 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 404 len: 111 microversion: 2.1 time: 0.034173 Oct 03 11:39:43.278573 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3973/7612] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:39:43 2022] DELETE /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.284561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.285194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.292666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.293170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.293604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.294317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.294770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.295193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.308974 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa HTTP/1.1 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa'} Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.310489 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-63e447a7-8754-496c-86ed-3d747213055f tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa" status: 404 len: 111 microversion: 2.1 time: 0.031724 Oct 03 11:39:43.315771 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3640/7613] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:43 2022] GET /compute/v2.1/servers/c98e97a2-4424-4ce0-a4eb-80df2aaf1bfa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.322491 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.323032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.330064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.330573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.331026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.331735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.332199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.332638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.347810 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 HTTP/1.1 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '27c50776-39b6-4006-a588-e173a88fa964'} Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.349711 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2dc88625-2654-4b12-b565-e1d55e068786 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 404 len: 111 microversion: 2.1 time: 0.032733 Oct 03 11:39:43.354098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3974/7614] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:39:43 2022] DELETE /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.360399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.361080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 27c50776-39b6-4006-a588-e173a88fa964] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.367381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.367878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.368344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.369085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.369548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.369978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.385162 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 HTTP/1.1 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '27c50776-39b6-4006-a588-e173a88fa964'} Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.386750 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 27c50776-39b6-4006-a588-e173a88fa964 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e542770-ee61-4d6f-9fb3-849b33aa6e6a tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964" status: 404 len: 111 microversion: 2.1 time: 0.031826 Oct 03 11:39:43.392020 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3641/7615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:43 2022] GET /compute/v2.1/servers/27c50776-39b6-4006-a588-e173a88fa964 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.398065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.398610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.404753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.405366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.405818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.406716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.407189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.407636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.421878 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 HTTP/1.1 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '64cbc8bc-c58e-40d3-89c3-b9da5858e7d8'} Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.423477 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5da6437e-9ff0-4a42-9701-d25587bc4ccb tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 404 len: 111 microversion: 2.1 time: 0.030907 Oct 03 11:39:43.428075 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3975/7616] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:39:43 2022] DELETE /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.434441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.435052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.441747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.442230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.442678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.443365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.443816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.444240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.458696 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 HTTP/1.1 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '64cbc8bc-c58e-40d3-89c3-b9da5858e7d8'} Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.460220 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-231c64b8-1d5d-4204-99b3-e89319a5cdff tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8" status: 404 len: 111 microversion: 2.1 time: 0.031160 Oct 03 11:39:43.464780 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3642/7617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:43 2022] GET /compute/v2.1/servers/64cbc8bc-c58e-40d3-89c3-b9da5858e7d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.470948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.471460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.477500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.477999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.478453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.479163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.479633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.480104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.493922 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 HTTP/1.1 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '70405b31-b5bb-4a1c-8bc7-f0239316ee36'} Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.495499 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.500517 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5f6db139-58f7-4b7d-9cee-f0a4aa444c11 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 404 len: 111 microversion: 2.1 time: 0.030106 Oct 03 11:39:43.504797 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3976/7618] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:39:43 2022] DELETE /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:39:43.506516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.507135 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] [instance: 70405b31-b5bb-4a1c-8bc7-f0239316ee36] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:43.513229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.513719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.514162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.515482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:43.515942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:43.516372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:43.529760 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] HTTP exception thrown: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Request method failure captured: Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 HTTP/1.1 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsg8D0d62fQ_NTxzTr-ldHYnOeRNegXGvFQrW29tdkC3K4rX-Rs4WgISTJiYKWUCIVeVsxHEHoiuOUjKoVoe0lDEcoON5wMp7oi0kMcARU8LrcRvTag15kTOcqfmRV_jg1wB1fFiv0LysJGQSqdXF5a36e-fFKB4Dzdef4PqJFYm8_0 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cbf373fd925e4c4a9ed7effd67d1a2f5"}]}] Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: cbf373fd925e4c4a9ed7effd67d1a2f5 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServerActionsTestJSON-1992255135 Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 03345f507def4b4382885e163c77fbae Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServerActionsTestJSON-1992255135-project Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '70405b31-b5bb-4a1c-8bc7-f0239316ee36'} Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:39:43.531296 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Returning 404 to user: Instance 70405b31-b5bb-4a1c-8bc7-f0239316ee36 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-69fc6ae0-1dae-408e-bd08-1e4389275e35 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36" status: 404 len: 111 microversion: 2.1 time: 0.030053 Oct 03 11:39:43.535775 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3643/7619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:43 2022] GET /compute/v2.1/servers/70405b31-b5bb-4a1c-8bc7-f0239316ee36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 11:39:43.541468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce0bfc8a-2ad5-4877-ae27-487a12e8c004 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] Calling method '.version_select at 0x7f074f1c7dc0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:43.565751 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce0bfc8a-2ad5-4877-ae27-487a12e8c004 tempest-ServerActionsTestJSON-1992255135 tempest-ServerActionsTestJSON-1992255135-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248876917" status: 202 len: 0 microversion: 2.1 time: 0.027998 Oct 03 11:39:43.566334 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3977/7620] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Oct 3 11:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248876917 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:39:52.689142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-204592168", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "6ffef8ba-fb2f-41a3-8e91-5647caa4afc3"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:39:52.745678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] validate_networks() for [('6ffef8ba-fb2f-41a3-8e91-5647caa4afc3', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:39:53.185905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:39:53.186372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:39:53.186876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:39:53.187299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:39:53.187715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:39:53.198595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:53.199177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:53.199705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:53.200511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:53.201076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:53.201777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:53.224723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Getting quotas for project 035ffc94b15d44c7bdcb52c8af062ffb. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:39:53.232456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Getting quotas for user a80bcca3f1ee48f08799b8b9f19f35bd and project 035ffc94b15d44c7bdcb52c8af062ffb. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:39:53.249564 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:39:53.251894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:39:53.314215 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-305b68a7-2954-43e3-a186-d2280ea2fbd3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755349 Oct 03 11:39:53.315056 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3644/7621] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:39:53.332045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1ebce08b-9653-4d2f-b633-fe0c1a1a7f66 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:53.333336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1ebce08b-9653-4d2f-b633-fe0c1a1a7f66 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:53.407567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1ebce08b-9653-4d2f-b633-fe0c1a1a7f66 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:53.414864 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1ebce08b-9653-4d2f-b633-fe0c1a1a7f66 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1216 microversion: 2.1 time: 0.091919 Oct 03 11:39:53.425606 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3978/7622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:53 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:54.439632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:54.440241 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:54.447626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:54.448119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:54.448560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:54.449297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:54.449756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:54.450186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:54.511901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:54.519697 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0112328f-48f7-4936-8546-ba8125dda56e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1268 microversion: 2.1 time: 0.085595 Oct 03 11:39:54.520269 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3645/7623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:54 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1268 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:55.543516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:55.544158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:55.549897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=53 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:39:55.554041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:55.554750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:55.555394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:55.556678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:55.557332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:55.558133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:55.727051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:55.735088 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-79d33e0b-1898-407c-b64e-ba0304691f5e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1316 microversion: 2.1 time: 0.195369 Oct 03 11:39:55.735885 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3979/7624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:55 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:56.249357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-663772a3-a6c8-4d8f-bcde-7567376bf6a5 req-0d664185-c11d-4056-915c-15aa74c9fc41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3543f80-e3f7-4673-9f98-69a70bcb49f8", "tag": "e369b967-f3e0-4f8d-84e9-6bd5f2ddb2b3"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:39:56.260096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-663772a3-a6c8-4d8f-bcde-7567376bf6a5 req-0d664185-c11d-4056-915c-15aa74c9fc41 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:56.260598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-663772a3-a6c8-4d8f-bcde-7567376bf6a5 req-0d664185-c11d-4056-915c-15aa74c9fc41 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:56.261077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-663772a3-a6c8-4d8f-bcde-7567376bf6a5 req-0d664185-c11d-4056-915c-15aa74c9fc41 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:56.272930 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-663772a3-a6c8-4d8f-bcde-7567376bf6a5 req-0d664185-c11d-4056-915c-15aa74c9fc41 service nova] Creating event network-changed:e369b967-f3e0-4f8d-84e9-6bd5f2ddb2b3 for instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 on n-h1-858383-3 Oct 03 11:39:56.278227 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-663772a3-a6c8-4d8f-bcde-7567376bf6a5 req-0d664185-c11d-4056-915c-15aa74c9fc41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114496 Oct 03 11:39:56.278765 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3646/7625] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:39:56.759811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:56.760439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:56.767487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:56.767989 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:56.768439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:56.769174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:56.769638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:56.770070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:56.909203 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:56.918122 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-44ef6832-76a5-4134-8535-c5aadc2a8a08 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1316 microversion: 2.1 time: 0.162485 Oct 03 11:39:56.918704 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3980/7626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:56 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:57.943560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:57.944255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:57.950603 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:57.951112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:57.951547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:57.952233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:57.952685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:57.953136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:58.084921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:58.094289 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e65cda9-584d-4110-ad60-3b3b384208c9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1316 microversion: 2.1 time: 0.155760 Oct 03 11:39:58.094866 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3647/7627] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:57 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:39:59.117581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:39:59.119027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:39:59.127368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:59.127869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:59.128601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:59.129596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:39:59.130369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:39:59.131034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:39:59.276004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:39:59.284877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-efe0ac6b-3eb9-41f4-a895-a33dfc39a9d0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1316 microversion: 2.1 time: 0.171035 Oct 03 11:39:59.286010 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3981/7628] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:39:59 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:00.310102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:00.310725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:00.314115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:00.319407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:00.319900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:00.320343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:00.321070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:00.321530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:00.321960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:00.325268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:00.460796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:00.468690 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b43369f6-7d99-48de-86ed-01c07a5f4e20 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1316 microversion: 2.1 time: 0.162434 Oct 03 11:40:00.469301 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3648/7629] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:00 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:01.358467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6ffbf512-6e75-4c96-8816-cd225dfbec51 req-5d683046-1e60-4090-a208-5d11cd48686e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3543f80-e3f7-4673-9f98-69a70bcb49f8", "name": "network-vif-plugged", "status": "completed", "tag": "e369b967-f3e0-4f8d-84e9-6bd5f2ddb2b3"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:01.364311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:01.371596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ffbf512-6e75-4c96-8816-cd225dfbec51 req-5d683046-1e60-4090-a208-5d11cd48686e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:01.372123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ffbf512-6e75-4c96-8816-cd225dfbec51 req-5d683046-1e60-4090-a208-5d11cd48686e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:01.372757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6ffbf512-6e75-4c96-8816-cd225dfbec51 req-5d683046-1e60-4090-a208-5d11cd48686e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:01.385871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6ffbf512-6e75-4c96-8816-cd225dfbec51 req-5d683046-1e60-4090-a208-5d11cd48686e service nova] Creating event network-vif-plugged:e369b967-f3e0-4f8d-84e9-6bd5f2ddb2b3 for instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 on n-h1-858383-3 Oct 03 11:40:01.391388 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6ffbf512-6e75-4c96-8816-cd225dfbec51 req-5d683046-1e60-4090-a208-5d11cd48686e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111813 Oct 03 11:40:01.392006 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3982/7630] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:40:01.491617 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:01.492228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:01.499406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:01.499902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:01.500361 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:01.501079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:01.501734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:01.502169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:01.663998 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:01.672110 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5bfb717e-0cb9-43d2-b325-64466d446187 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1316 microversion: 2.1 time: 0.184497 Oct 03 11:40:01.672685 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3649/7631] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:01 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:02.695851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:02.696486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:02.703574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:02.704069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:02.704525 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:02.705252 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:02.705726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:02.706167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:02.848835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:02.856552 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e41ca3f7-feed-4a5d-91c9-12ef6f801590 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1316 microversion: 2.1 time: 0.165097 Oct 03 11:40:02.857180 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3983/7632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:02 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:03.880620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:03.881257 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:03.883876 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:03.884585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:03.890881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:03.891374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:03.891817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:03.892516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:03.893032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:03.893464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:04.021594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:04.029419 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c8e9b6a5-4a62-43eb-939c-22e2aeccf0ea tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1505 microversion: 2.1 time: 0.152716 Oct 03 11:40:04.029994 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3650/7633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:03 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:04.089611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-668406271", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "6ffef8ba-fb2f-41a3-8e91-5647caa4afc3"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:04.098142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:04.143632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] validate_networks() for [('6ffef8ba-fb2f-41a3-8e91-5647caa4afc3', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:40:04.812260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:40:04.812704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:40:04.813270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:40:04.813703 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:40:04.814133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:40:04.823108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:04.823605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:04.824066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:04.824867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:04.825345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:04.825791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:04.843549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Getting quotas for project 035ffc94b15d44c7bdcb52c8af062ffb. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:40:04.848809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Getting quotas for user a80bcca3f1ee48f08799b8b9f19f35bd and project 035ffc94b15d44c7bdcb52c8af062ffb. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:40:04.861122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:40:04.863457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:40:04.908183 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [550b53d0-5cd9-45fe-b521-894f231f725e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:40:05.915730 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [550b53d0-5cd9-45fe-b521-894f231f725e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48822. Oct 03 11:40:05.920069 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7a539e8a-bae3-44c5-804b-12f6bd5ce2df tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834342 Oct 03 11:40:05.921443 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3984/7634] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:40:05.932758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab0dff0c-f207-410a-8a31-746cdc1d70f0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:05.933396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab0dff0c-f207-410a-8a31-746cdc1d70f0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:05.987022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab0dff0c-f207-410a-8a31-746cdc1d70f0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:05.993940 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab0dff0c-f207-410a-8a31-746cdc1d70f0 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1216 microversion: 2.1 time: 0.065156 Oct 03 11:40:05.994510 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3651/7635] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:05 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:07.018784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:07.019469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:07.025864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:07.026378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:07.026856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:07.027587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:07.028063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:07.028541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:07.096613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:07.105515 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c7a521b3-742b-434c-bead-81ceac90ec75 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1268 microversion: 2.1 time: 0.091537 Oct 03 11:40:07.106556 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3985/7636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:07 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1268 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:08.131322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:08.132065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:08.141612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:08.142097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:08.142529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:08.143232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:08.143683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:08.144104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:08.361170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:08.369711 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-85beca14-1c7e-489f-9c6e-b487baf1a673 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.242383 Oct 03 11:40:08.370275 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3652/7637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:08 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:08.649946 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5d63a986-99ab-41c5-9640-7fb6868fe6b6 req-afaaa667-466b-45ce-a54c-7f50b4f57b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea489cc-fed0-4c5b-9774-811e78dca955", "tag": "d9d161f9-e899-4767-b143-7fa8d7583487"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:08.669634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5d63a986-99ab-41c5-9640-7fb6868fe6b6 req-afaaa667-466b-45ce-a54c-7f50b4f57b7b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:08.670208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5d63a986-99ab-41c5-9640-7fb6868fe6b6 req-afaaa667-466b-45ce-a54c-7f50b4f57b7b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:08.671333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5d63a986-99ab-41c5-9640-7fb6868fe6b6 req-afaaa667-466b-45ce-a54c-7f50b4f57b7b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:08.683843 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5d63a986-99ab-41c5-9640-7fb6868fe6b6 req-afaaa667-466b-45ce-a54c-7f50b4f57b7b service nova] Creating event network-changed:d9d161f9-e899-4767-b143-7fa8d7583487 for instance 1ea489cc-fed0-4c5b-9774-811e78dca955 on n-h1-858383-3 Oct 03 11:40:08.689951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5d63a986-99ab-41c5-9640-7fb6868fe6b6 req-afaaa667-466b-45ce-a54c-7f50b4f57b7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046687 Oct 03 11:40:08.690602 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3986/7638] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:40:09.395445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:09.395967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:09.403491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:09.404007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:09.404439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:09.405730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:09.406208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:09.406632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:09.548882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:09.556849 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a00d1dda-ca14-41b0-98ba-6fc8573fc8e6 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.165384 Oct 03 11:40:09.557426 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3653/7639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:09 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:10.581627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:10.582373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:10.588651 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:10.589186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:10.589641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:10.590345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:10.590818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:10.591258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:10.727234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:10.735135 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fe26ef4d-ad9b-42a0-9f60-53cdeed1bf22 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.159226 Oct 03 11:40:10.735706 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3987/7640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:10 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:11.758098 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:11.763003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:11.767428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:11.767928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:11.768429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:11.769301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:11.769776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:11.770202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:11.922880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:11.930861 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e0a9738a-1030-421e-beaf-03d0f18dd9ad tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.177119 Oct 03 11:40:11.931432 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3654/7641] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:11 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:12.954985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:12.955524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:12.962384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:12.962888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:12.963374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:12.964116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:12.964586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:12.965076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:13.096111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:13.103870 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0b2f3c42-dcac-42b4-bd9d-f21d507e17ca tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.153681 Oct 03 11:40:13.104451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3988/7642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:12 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:14.126222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:14.126907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:14.133943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:14.134408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:14.134842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:14.135531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:14.135983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:14.136409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:14.264650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:14.272301 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a8a5979b-3c6f-40c0-9efa-83504a1ea7d7 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.149976 Oct 03 11:40:14.272964 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3655/7643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:14 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:15.296264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:15.297627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:15.300641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:15.301609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:15.307349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:15.307852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:15.308306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:15.309046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:15.309518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:15.310089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:15.406839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-24859234-9317-4c89-a8d1-c2f8badb110e req-23d108cb-38e9-4ccd-8c68-12a0f72a9bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea489cc-fed0-4c5b-9774-811e78dca955", "name": "network-vif-plugged", "status": "completed", "tag": "d9d161f9-e899-4767-b143-7fa8d7583487"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:15.418166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-24859234-9317-4c89-a8d1-c2f8badb110e req-23d108cb-38e9-4ccd-8c68-12a0f72a9bb9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:15.418650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-24859234-9317-4c89-a8d1-c2f8badb110e req-23d108cb-38e9-4ccd-8c68-12a0f72a9bb9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:15.419083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-24859234-9317-4c89-a8d1-c2f8badb110e req-23d108cb-38e9-4ccd-8c68-12a0f72a9bb9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:15.431943 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-24859234-9317-4c89-a8d1-c2f8badb110e req-23d108cb-38e9-4ccd-8c68-12a0f72a9bb9 service nova] Creating event network-vif-plugged:d9d161f9-e899-4767-b143-7fa8d7583487 for instance 1ea489cc-fed0-4c5b-9774-811e78dca955 on n-h1-858383-3 Oct 03 11:40:15.437741 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-24859234-9317-4c89-a8d1-c2f8badb110e req-23d108cb-38e9-4ccd-8c68-12a0f72a9bb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Oct 03 11:40:15.439028 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3656/7644] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:40:15.448858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:15.457296 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4d6b6173-db7b-40f1-95c3-695128e9726b tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.165050 Oct 03 11:40:15.458080 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3989/7645] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:15 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:16.476847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:16.482006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:16.482706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:16.489109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:16.489590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:16.490032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:16.490719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:16.491181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:16.491609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:16.631429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:16.639096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3beb6c24-00b8-4ecc-9baf-82f0c2546396 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1316 microversion: 2.1 time: 0.163229 Oct 03 11:40:16.639671 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3657/7646] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:16 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:17.661870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:17.662498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:17.669677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:17.670170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:17.671132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:17.671837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:17.672312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:17.672754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:17.804305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:17.812028 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1443b56e-4345-4328-a566-f64be865cac3 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1505 microversion: 2.1 time: 0.154153 Oct 03 11:40:17.812603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3990/7647] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:17 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:17.834048 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:17.834563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:17.841331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:17.841815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:17.842797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:17.843486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:17.843940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:17.844371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:17.869887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:40:17.943161 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ad9be8ce-fc1e-4f6c-98a4-513c984d9882 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 204 len: 0 microversion: 2.1 time: 0.112558 Oct 03 11:40:17.943765 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3658/7648] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:40:17 2022] DELETE /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:40:17.952143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:17.952796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:17.960362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:17.960914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:17.961376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:17.962195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:17.962680 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:17.963122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:18.096360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:18.104233 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ea931718-70b0-466a-8b52-3eb55d45be97 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1511 microversion: 2.1 time: 0.156257 Oct 03 11:40:18.104929 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3991/7649] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:17 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:40:19.129770 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:19.134321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:19.137759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:19.138266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:19.138704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:19.139394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:19.139843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:19.140262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:19.273096 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:19.281531 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eeae5123-1af6-4f07-9889-6eb8b60da5b4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1511 microversion: 2.1 time: 0.155961 Oct 03 11:40:19.282115 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3659/7650] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:19 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:20.117952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-451a0b9a-4be1-495e-b900-93c05e84c7c2 req-17dd2953-897b-4460-a382-9f33b6553cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea489cc-fed0-4c5b-9774-811e78dca955", "name": "network-vif-deleted", "tag": "d9d161f9-e899-4767-b143-7fa8d7583487"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:20.130337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-451a0b9a-4be1-495e-b900-93c05e84c7c2 req-17dd2953-897b-4460-a382-9f33b6553cd6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:20.130992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-451a0b9a-4be1-495e-b900-93c05e84c7c2 req-17dd2953-897b-4460-a382-9f33b6553cd6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:20.131546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-451a0b9a-4be1-495e-b900-93c05e84c7c2 req-17dd2953-897b-4460-a382-9f33b6553cd6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:20.144220 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-451a0b9a-4be1-495e-b900-93c05e84c7c2 req-17dd2953-897b-4460-a382-9f33b6553cd6 service nova] Creating event network-vif-deleted:d9d161f9-e899-4767-b143-7fa8d7583487 for instance 1ea489cc-fed0-4c5b-9774-811e78dca955 on n-h1-858383-3 Oct 03 11:40:20.154973 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-451a0b9a-4be1-495e-b900-93c05e84c7c2 req-17dd2953-897b-4460-a382-9f33b6553cd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Oct 03 11:40:20.155627 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3992/7651] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:40:20.306266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:20.306266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:20.313910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:20.314391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:20.315044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:20.315758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:20.316213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:20.316643 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:20.348834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:20.349322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:20.349758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:20.350206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lazy-loading 'fault' on Instance uuid 1ea489cc-fed0-4c5b-9774-811e78dca955 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:40:20.397752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:20.405601 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-69155b3f-cd1f-4778-a26c-d06fb3cba105 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 200 len: 1306 microversion: 2.1 time: 0.104447 Oct 03 11:40:20.406181 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3660/7652] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:20 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:40:21.430375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:21.431092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:21.437848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.438351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.438806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.439515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.439982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.440425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.455145 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] HTTP exception thrown: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Request method failure captured: Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 HTTP/1.1 Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsoI7xrmdRo6DigNpsJqEJLwpZewfB0wm_UOibqPwU1NtNVs0JhU17ELTAOgIDZz25qKetVuG5hAureYWKh7AiGYny3qyj_2Q4d3iPze4lIYyeglHNtqxrMi-0VdLOp50aTrE02LhHBKTVLC5FgnJuQFbILB0hcDK_Itldn6bZ7YsZo Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}] Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a80bcca3f1ee48f08799b8b9f19f35bd Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1ea489cc-fed0-4c5b-9774-811e78dca955'} Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:21.456891 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Returning 404 to user: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-466e37c5-705b-415c-8384-574610e3488d tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 404 len: 111 microversion: 2.1 time: 0.033494 Oct 03 11:40:21.461506 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3993/7653] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:21 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:40:21.467817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:21.468596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:21.475432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.475921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.476377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.477077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.477530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.477953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.610303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:21.618014 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc18ec23-f033-4c63-b561-86adc30c35e2 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1505 microversion: 2.1 time: 0.154260 Oct 03 11:40:21.618601 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3661/7654] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:21 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:21.642161 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5973efb-4c92-4b37-ad45-e15d36fcc54e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:21.644352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d5973efb-4c92-4b37-ad45-e15d36fcc54e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 39606aab-3bc4-4327-9e76-0298d2dddb4e] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:21.649888 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-d5973efb-4c92-4b37-ad45-e15d36fcc54e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] HTTP exception thrown: Instance 39606aab-3bc4-4327-9e76-0298d2dddb4e could not be found. Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5973efb-4c92-4b37-ad45-e15d36fcc54e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Request method failure captured: Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/39606aab-3bc4-4327-9e76-0298d2dddb4e/action HTTP/1.1 Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 32 Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsoI7xrmdRo6DigNpsJqEJLwpZewfB0wm_UOibqPwU1NtNVs0JhU17ELTAOgIDZz25qKetVuG5hAureYWKh7AiGYny3qyj_2Q4d3iPze4lIYyeglHNtqxrMi-0VdLOp50aTrE02LhHBKTVLC5FgnJuQFbILB0hcDK_Itldn6bZ7YsZo Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}] Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a80bcca3f1ee48f08799b8b9f19f35bd Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: {"resize": {"flavorRef": "452"}} Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 39606aab-3bc4-4327-9e76-0298d2dddb4e could not be found. Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '39606aab-3bc4-4327-9e76-0298d2dddb4e', 'body': {'resize': {'flavorRef': '452'}}} Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39606aab-3bc4-4327-9e76-0298d2dddb4e could not be found. Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:40:21.651448 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39606aab-3bc4-4327-9e76-0298d2dddb4e could not be found. Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39606aab-3bc4-4327-9e76-0298d2dddb4e could not be found. Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d5973efb-4c92-4b37-ad45-e15d36fcc54e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Returning 404 to user: Instance 39606aab-3bc4-4327-9e76-0298d2dddb4e could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d5973efb-4c92-4b37-ad45-e15d36fcc54e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "POST /compute/v2.1/servers/39606aab-3bc4-4327-9e76-0298d2dddb4e/action" status: 404 len: 111 microversion: 2.1 time: 0.015297 Oct 03 11:40:21.656315 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3994/7655] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:40:21 2022] POST /compute/v2.1/servers/39606aab-3bc4-4327-9e76-0298d2dddb4e/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:40:21.661310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:21.661921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:21.667829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.668310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.668750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.669470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.669924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.670398 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.799006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:21.807396 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c093f6c-807e-472f-a33c-f6a0b0b00973 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1505 microversion: 2.1 time: 0.149816 Oct 03 11:40:21.807968 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3662/7656] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:21 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:21.830655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:21.831277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:21.838107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.838610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.839061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.839774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:21.840240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:21.840682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:21.967167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:21.974928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-289f7c2b-ca8c-4045-a8ee-d6347bd10510 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1505 microversion: 2.1 time: 0.148259 Oct 03 11:40:21.975488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3995/7657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:21 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:21.998019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "24383297-26ec-4540-a533-6e6ea22cdead"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:22.000918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.006858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.007339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.007774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.008461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.008948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.009378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.050129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:22.056238 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] HTTP exception thrown: Flavor 24383297-26ec-4540-a533-6e6ea22cdead could not be found. Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Request method failure captured: Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: request: POST /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8/action HTTP/1.1 Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 65 Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsoI7xrmdRo6DigNpsJqEJLwpZewfB0wm_UOibqPwU1NtNVs0JhU17ELTAOgIDZz25qKetVuG5hAureYWKh7AiGYny3qyj_2Q4d3iPze4lIYyeglHNtqxrMi-0VdLOp50aTrE02LhHBKTVLC5FgnJuQFbILB0hcDK_Itldn6bZ7YsZo Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}] Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a80bcca3f1ee48f08799b8b9f19f35bd Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: {"resize": {"flavorRef": "24383297-26ec-4540-a533-6e6ea22cdead"}} Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: exception: Flavor 24383297-26ec-4540-a533-6e6ea22cdead could not be found. Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f3543f80-e3f7-4673-9f98-69a70bcb49f8', 'body': {'resize': {'flavorRef': '24383297-26ec-4540-a533-6e6ea22cdead'}}} Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:22.062679 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 24383297-26ec-4540-a533-6e6ea22cdead could not be found. Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 24383297-26ec-4540-a533-6e6ea22cdead could not be found. Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 24383297-26ec-4540-a533-6e6ea22cdead could not be found. Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Returning 400 to user: Flavor 24383297-26ec-4540-a533-6e6ea22cdead could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-040561b2-ccf1-4645-b76b-cb30adc98e61 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "POST /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8/action" status: 400 len: 107 microversion: 2.1 time: 0.070094 Oct 03 11:40:22.066874 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3663/7658] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:40:21 2022] POST /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8/action => generated 107 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 11:40:22.073008 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:22.073641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.079642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.080136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.080589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.081333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.081798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.082241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.213992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:22.222241 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4eeea52b-fa70-46a9-adbc-408cd49f8993 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1505 microversion: 2.1 time: 0.153259 Oct 03 11:40:22.222811 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3996/7659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:22 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:22.245783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:22.246388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.252234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.252709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.253176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.253858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.254308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.254729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.388510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:22.390978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:22.398826 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7406943-344a-4ae7-a2ba-162f3a19917c tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1505 microversion: 2.1 time: 0.156824 Oct 03 11:40:22.399564 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3664/7660] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:22 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:22.423072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1d2e505-c0a6-4be2-b1c6-0714729ba5af tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1d2e505-c0a6-4be2-b1c6-0714729ba5af tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Request method failure captured: Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: request: POST /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8/action HTTP/1.1 Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 29 Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsoI7xrmdRo6DigNpsJqEJLwpZewfB0wm_UOibqPwU1NtNVs0JhU17ELTAOgIDZz25qKetVuG5hAureYWKh7AiGYny3qyj_2Q4d3iPze4lIYyeglHNtqxrMi-0VdLOp50aTrE02LhHBKTVLC5FgnJuQFbILB0hcDK_Itldn6bZ7YsZo Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}] Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a80bcca3f1ee48f08799b8b9f19f35bd Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: {"resize": {"flavorRef": ""}} Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'f3543f80-e3f7-4673-9f98-69a70bcb49f8', 'body': {'resize': {'flavorRef': ''}}} Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise error Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi '' Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.429324 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1d2e505-c0a6-4be2-b1c6-0714729ba5af tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1d2e505-c0a6-4be2-b1c6-0714729ba5af tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "POST /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8/action" status: 400 len: 113 microversion: 2.1 time: 0.012247 Oct 03 11:40:22.434643 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3997/7661] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:40:22 2022] POST /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 11:40:22.440298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:22.440899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.447574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.448053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.448490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.449218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.449671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.450091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.581782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:22.589680 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bdb94368-3a9f-433f-91a7-0e155396a7a9 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1505 microversion: 2.1 time: 0.154141 Oct 03 11:40:22.590251 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3665/7662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:22 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:22.616561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:22.617100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.624188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.624687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.625173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.625880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.626352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.626794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.641119 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] HTTP exception thrown: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Request method failure captured: Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 HTTP/1.1 Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOsoI7xrmdRo6DigNpsJqEJLwpZewfB0wm_UOibqPwU1NtNVs0JhU17ELTAOgIDZz25qKetVuG5hAureYWKh7AiGYny3qyj_2Q4d3iPze4lIYyeglHNtqxrMi-0VdLOp50aTrE02LhHBKTVLC5FgnJuQFbILB0hcDK_Itldn6bZ7YsZo Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}] Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: a80bcca3f1ee48f08799b8b9f19f35bd Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '1ea489cc-fed0-4c5b-9774-811e78dca955'} Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:40:22.642720 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Returning 404 to user: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b3413d2c-52e7-4e56-b4d2-3c2c9e29daf1 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 404 len: 111 microversion: 2.1 time: 0.032321 Oct 03 11:40:22.646909 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3998/7663] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:40:22 2022] DELETE /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:40:22.652717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:22.653420 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: 1ea489cc-fed0-4c5b-9774-811e78dca955] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.660223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.660892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.661177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.661869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.662326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.662755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.676640 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] HTTP exception thrown: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Request method failure captured: Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 HTTP/1.1 Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsoI7xrmdRo6DigNpsJqEJLwpZewfB0wm_UOibqPwU1NtNVs0JhU17ELTAOgIDZz25qKetVuG5hAureYWKh7AiGYny3qyj_2Q4d3iPze4lIYyeglHNtqxrMi-0VdLOp50aTrE02LhHBKTVLC5FgnJuQFbILB0hcDK_Itldn6bZ7YsZo Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}] Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a80bcca3f1ee48f08799b8b9f19f35bd Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '1ea489cc-fed0-4c5b-9774-811e78dca955'} Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:22.678184 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Returning 404 to user: Instance 1ea489cc-fed0-4c5b-9774-811e78dca955 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7a45a4e1-9168-41da-9842-6052771d3770 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955" status: 404 len: 111 microversion: 2.1 time: 0.030777 Oct 03 11:40:22.683596 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3666/7664] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:22 2022] GET /compute/v2.1/servers/1ea489cc-fed0-4c5b-9774-811e78dca955 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:40:22.688088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:22.688602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.694817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.695147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.695597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.696304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.696825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.697240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.724858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:40:22.775528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:22.802625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d7051e5b-0809-4d0e-8315-debf95130f6e tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 204 len: 0 microversion: 2.1 time: 0.118074 Oct 03 11:40:22.803440 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 3999/7665] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:40:22 2022] DELETE /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:40:22.811550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:22.812271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:22.818268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.818761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.819202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.819896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:22.820355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:22.820806 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:22.953727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:22.961453 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-530ceda1-ca4d-4223-abd9-d5801434ca5a tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1511 microversion: 2.1 time: 0.153820 Oct 03 11:40:22.962020 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3667/7666] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:22 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:23.985489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:23.986210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:23.993072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:23.993574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:23.994031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:23.994739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:23.995210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:23.995654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:24.124860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:24.132634 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-345853cf-3df4-43b7-a99f-df9ba6a89517 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1511 microversion: 2.1 time: 0.152067 Oct 03 11:40:24.133233 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4000/7667] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:23 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:25.035422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-6af2fa10-9170-4e21-9d53-51d440e5d7ce req-b871e764-c9de-4542-a398-25b6f513ccc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3543f80-e3f7-4673-9f98-69a70bcb49f8", "name": "network-vif-deleted", "tag": "e369b967-f3e0-4f8d-84e9-6bd5f2ddb2b3"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:25.047667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6af2fa10-9170-4e21-9d53-51d440e5d7ce req-b871e764-c9de-4542-a398-25b6f513ccc0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:25.048147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6af2fa10-9170-4e21-9d53-51d440e5d7ce req-b871e764-c9de-4542-a398-25b6f513ccc0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:25.048582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6af2fa10-9170-4e21-9d53-51d440e5d7ce req-b871e764-c9de-4542-a398-25b6f513ccc0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:25.061917 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-6af2fa10-9170-4e21-9d53-51d440e5d7ce req-b871e764-c9de-4542-a398-25b6f513ccc0 service nova] Creating event network-vif-deleted:e369b967-f3e0-4f8d-84e9-6bd5f2ddb2b3 for instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 on n-h1-858383-3 Oct 03 11:40:25.067247 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-6af2fa10-9170-4e21-9d53-51d440e5d7ce req-b871e764-c9de-4542-a398-25b6f513ccc0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035575 Oct 03 11:40:25.067851 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3668/7668] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:40:25.156290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:25.156962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:25.163985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:25.164494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:25.164990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:25.165830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:25.166244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:25.166873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:25.202862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:25.203293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:25.204093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:25.204569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lazy-loading 'fault' on Instance uuid f3543f80-e3f7-4673-9f98-69a70bcb49f8 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:40:25.251263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80bcca3f1ee48f08799b8b9f19f35bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035ffc94b15d44c7bdcb52c8af062ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:25.259805 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8dc78aae-2e7b-4f32-b0e7-4762d79b1629 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 200 len: 1306 microversion: 2.1 time: 0.107594 Oct 03 11:40:25.260414 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4001/7669] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:25 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:26.283373 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:26.284070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] [instance: f3543f80-e3f7-4673-9f98-69a70bcb49f8] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:26.290300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:26.290788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:26.291229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:26.291921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:26.292381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:26.292831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:26.306875 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] HTTP exception thrown: Instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 could not be found. Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Request method failure captured: Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 HTTP/1.1 Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsoI7xrmdRo6DigNpsJqEJLwpZewfB0wm_UOibqPwU1NtNVs0JhU17ELTAOgIDZz25qKetVuG5hAureYWKh7AiGYny3qyj_2Q4d3iPze4lIYyeglHNtqxrMi-0VdLOp50aTrE02LhHBKTVLC5FgnJuQFbILB0hcDK_Itldn6bZ7YsZo Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/035ffc94b15d44c7bdcb52c8af062ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/035ffc94b15d44c7bdcb52c8af062ffb"}]}] Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 035ffc94b15d44c7bdcb52c8af062ffb Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-ServersNegativeTestJSON-983458594 Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: a80bcca3f1ee48f08799b8b9f19f35bd Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-ServersNegativeTestJSON-983458594-project Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 could not be found. Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'f3543f80-e3f7-4673-9f98-69a70bcb49f8'} Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 could not be found. Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 could not be found. Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:40:26.308494 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 could not be found. Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] Returning 404 to user: Instance f3543f80-e3f7-4673-9f98-69a70bcb49f8 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c7e0cd3f-1e81-4d75-a778-45641a2cdfb4 tempest-ServersNegativeTestJSON-983458594 tempest-ServersNegativeTestJSON-983458594-project] 10.222.0.27 "GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8" status: 404 len: 111 microversion: 2.1 time: 0.031736 Oct 03 11:40:26.313370 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3669/7670] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:26 2022] GET /compute/v2.1/servers/f3543f80-e3f7-4673-9f98-69a70bcb49f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:40:56.738364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:56.739614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=14 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:56.922349 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cbace7ad-2237-4fcb-991f-ecb180b3a491 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: .version_select at 0x7f074eb2c430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-283876371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8pfHibfJSSSgVkEfNIbqEFSnYrOkI/l8qsCwwwkM2/GvNodvFgI1FjGJyPgnmt5eZmyRxO3VAZMeHNt+zPNSfjxQUl7/B4IO1rdgT4v+WSuFM2Xhp2NwabyllD2VzPxQ=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:56.950850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-cbace7ad-2237-4fcb-991f-ecb180b3a491 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for project 979b490475f4448bb039208a936602f9. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:40:56.957485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-cbace7ad-2237-4fcb-991f-ecb180b3a491 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for user f7cc375731484aacb981f98f35d4b5d2 and project 979b490475f4448bb039208a936602f9. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:40:56.983655 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cbace7ad-2237-4fcb-991f-ecb180b3a491 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.250638 Oct 03 11:40:56.984272 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4002/7671] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:40:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:40:57.038996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1736840541", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-283876371", "networks": [{"uuid": "04156fc7-276a-46d6-a456-f86e14ff31ce"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:40:57.048473 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:57.049142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=19 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:40:57.096584 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] validate_networks() for [('04156fc7-276a-46d6-a456-f86e14ff31ce', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:40:57.481193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:40:57.481626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:40:57.482102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:40:57.482514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:40:57.482932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:40:57.492542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:57.493063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:57.493592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:57.494223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:57.494682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:57.495193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:57.513458 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for project 979b490475f4448bb039208a936602f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:40:57.519384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for user f7cc375731484aacb981f98f35d4b5d2 and project 979b490475f4448bb039208a936602f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:40:57.533463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:40:57.535960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:40:57.585451 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c393a3b1-e8a2-4b3b-b818-0e51c8e78235 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550584 Oct 03 11:40:57.586101 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3670/7672] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:40:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:40:57.598233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-272e1b3a-6fbe-4b44-9e91-be92177b8260 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:57.598867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-272e1b3a-6fbe-4b44-9e91-be92177b8260 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:57.674239 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-272e1b3a-6fbe-4b44-9e91-be92177b8260 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:57.682442 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-272e1b3a-6fbe-4b44-9e91-be92177b8260 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1262 microversion: 2.1 time: 0.088539 Oct 03 11:40:57.683208 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4003/7673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:57 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:58.707067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:58.708512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:58.715507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:58.716288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:58.716917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:58.718044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:58.718694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:58.719457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:58.800100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:40:58.811630 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eecdaccc-c171-4abc-973e-4fa9e2ab0d66 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1322 microversion: 2.1 time: 0.109480 Oct 03 11:40:58.813881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3671/7674] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:58 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1322 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:40:59.836815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:40:59.838059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:40:59.846707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:59.847209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:59.847837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:40:59.848727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:40:59.849424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:40:59.850115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:00.002379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:00.010443 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4043b9d4-712b-49a9-b9e1-b49479829cae tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1362 microversion: 2.1 time: 0.178618 Oct 03 11:41:00.011115 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4004/7675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:40:59 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:00.435902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-6dc64323-cab0-4129-baf6-0930ab5d98cd req-52f09ca1-ede0-418a-b98b-807b5dfd083c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa09448-854c-473b-935e-5f29a40d2986", "tag": "af08fc46-ebd0-4e0a-8a3a-19b19975c8e1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:00.449801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6dc64323-cab0-4129-baf6-0930ab5d98cd req-52f09ca1-ede0-418a-b98b-807b5dfd083c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:00.450710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6dc64323-cab0-4129-baf6-0930ab5d98cd req-52f09ca1-ede0-418a-b98b-807b5dfd083c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:00.450710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-6dc64323-cab0-4129-baf6-0930ab5d98cd req-52f09ca1-ede0-418a-b98b-807b5dfd083c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:00.463288 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-6dc64323-cab0-4129-baf6-0930ab5d98cd req-52f09ca1-ede0-418a-b98b-807b5dfd083c service nova] Creating event network-changed:af08fc46-ebd0-4e0a-8a3a-19b19975c8e1 for instance 7fa09448-854c-473b-935e-5f29a40d2986 on n-h1-858383-3 Oct 03 11:41:00.468547 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-6dc64323-cab0-4129-baf6-0930ab5d98cd req-52f09ca1-ede0-418a-b98b-807b5dfd083c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037087 Oct 03 11:41:00.469442 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3672/7676] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:01.034783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:01.035540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:01.042768 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:01.043275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:01.043735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:01.044456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:01.044968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:01.045420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:01.189629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:01.198151 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0aa6f049-ad28-44ee-a2b9-79339941990f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1362 microversion: 2.1 time: 0.167300 Oct 03 11:41:01.198733 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4005/7677] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:01 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:02.222571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:02.223396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:02.230021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:02.230511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:02.230948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:02.231661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:02.232116 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:02.232542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:02.371129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:02.379734 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b063169b-927b-400c-94b3-283e153ffaea tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1362 microversion: 2.1 time: 0.162309 Oct 03 11:41:02.380306 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3673/7678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:02 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:03.402723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:03.403458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:03.410929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:03.411462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:03.411910 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:03.412723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:03.413246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:03.413697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:03.581806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:03.593868 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-802becff-2e2c-4277-9d9b-da7592eff46b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1362 microversion: 2.1 time: 0.194853 Oct 03 11:41:03.594466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4006/7679] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:03 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:41:04.617680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:04.618467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:04.626036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:04.626530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:04.626972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:04.627681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:04.628147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:04.628578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:04.767389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:04.777813 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2d21c691-ed08-4ff0-85ae-4620afc085fc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1362 microversion: 2.1 time: 0.163641 Oct 03 11:41:04.778881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3674/7680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:04 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:05.584661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4909bed9-0db2-41e5-aa11-e680e9551357 req-6b92a835-af13-450f-b8f1-a3aadccd4ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa09448-854c-473b-935e-5f29a40d2986", "name": "network-vif-plugged", "status": "completed", "tag": "af08fc46-ebd0-4e0a-8a3a-19b19975c8e1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:05.595339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4909bed9-0db2-41e5-aa11-e680e9551357 req-6b92a835-af13-450f-b8f1-a3aadccd4ef5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:05.595831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4909bed9-0db2-41e5-aa11-e680e9551357 req-6b92a835-af13-450f-b8f1-a3aadccd4ef5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:05.596280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4909bed9-0db2-41e5-aa11-e680e9551357 req-6b92a835-af13-450f-b8f1-a3aadccd4ef5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:05.607545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4909bed9-0db2-41e5-aa11-e680e9551357 req-6b92a835-af13-450f-b8f1-a3aadccd4ef5 service nova] Creating event network-vif-plugged:af08fc46-ebd0-4e0a-8a3a-19b19975c8e1 for instance 7fa09448-854c-473b-935e-5f29a40d2986 on n-h1-858383-3 Oct 03 11:41:05.613279 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4909bed9-0db2-41e5-aa11-e680e9551357 req-6b92a835-af13-450f-b8f1-a3aadccd4ef5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032411 Oct 03 11:41:05.613888 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4007/7681] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:41:05.802590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:05.803314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:05.809963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:05.810450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:05.810887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:05.811864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:05.812355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:05.812793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:05.944928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:05.952568 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-93b20fa2-d0a3-4c48-b24c-11dc0d839e18 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1362 microversion: 2.1 time: 0.154274 Oct 03 11:41:05.953219 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3675/7682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:05 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:06.976884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:06.977623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:06.984458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:06.984993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:06.985446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:06.986158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:06.986630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:06.987072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:07.125512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:07.133691 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f13ccacb-86cc-444a-aae4-900c93db1af4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1362 microversion: 2.1 time: 0.162067 Oct 03 11:41:07.134823 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4008/7683] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:06 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:08.157954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:08.158593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:08.161411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:08.162073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:08.168146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:08.168633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:08.169139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:08.169837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:08.170327 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:08.170755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:08.307146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:08.316140 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b60f8bf9-8e4b-4b3e-ab8e-b6d4934a2990 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1554 microversion: 2.1 time: 0.162509 Oct 03 11:41:08.316718 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3676/7684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:08 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:08.339296 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:08.339929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:08.341958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:08.348815 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:08.349327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:08.349781 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:08.350505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:08.350977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:08.351430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:08.487313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:08.495247 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad506a61-90c2-42de-bc2c-07500d678169 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1554 microversion: 2.1 time: 0.159761 Oct 03 11:41:08.495842 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4009/7685] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:08 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:10.127178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "645505fb-fdef-4d97-a1ee-16200ad91440"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:10.129573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:10.136308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:10.136877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:10.137322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:10.138010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:10.138464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:10.139252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:10.405810 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a4fd9736-ff09-44de-a187-d2ced754aaa3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282910 Oct 03 11:41:10.406609 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3677/7686] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:41:10 2022] POST /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:21.126987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:21.127542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:21.129984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:21.130803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=32 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:21.136666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:21.137197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:21.137662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:21.138384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:21.138862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:21.139307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:21.226746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lazy-loading 'services' on Instance uuid 7fa09448-854c-473b-935e-5f29a40d2986 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:41:21.303880 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13a28c12-347f-44eb-97a4-7bada11c1f80 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments/645505fb-fdef-4d97-a1ee-16200ad91440" status: 202 len: 0 microversion: 2.1 time: 0.180760 Oct 03 11:41:21.304478 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4010/7687] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:41:21 2022] DELETE /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments/645505fb-fdef-4d97-a1ee-16200ad91440 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:41:21.314167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:21.315405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:21.320264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:21.322818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:21.331769 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:21.332265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:21.332708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:21.333451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:21.333907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:21.334336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:21.366932 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a662bb1b-c01e-483d-9a65-f50fa0a8852f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054664 Oct 03 11:41:21.367457 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3678/7688] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:41:21 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:22.380401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:22.382826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:22.390123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:22.390627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:22.391199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:22.391918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:22.392383 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:22.392852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:22.424109 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5281e2c6-6fc8-4584-8b15-582aff7a0a7d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048279 Oct 03 11:41:22.424690 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4011/7689] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:41:22 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:23.436873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:23.439766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:23.446784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:23.447269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:23.447762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:23.448467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:23.448953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:23.449385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:23.482170 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-129169ad-c904-4485-9f39-cb36b2a1c0e6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049275 Oct 03 11:41:23.482747 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3679/7690] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:41:23 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:24.495220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:24.497474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:24.504906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:24.505405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:24.505861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:24.506578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:24.507047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:24.507488 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:24.537889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e35567fe-3b2c-4010-bf83-339b6f40c354 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046696 Oct 03 11:41:24.538470 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4012/7691] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:41:24 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:25.550491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:25.552985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:25.560187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:25.560668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:25.561142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:25.561828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:25.562297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:25.562719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:25.594452 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3eccc6b5-8d48-447e-9253-e968b19f28e4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Oct 03 11:41:25.595034 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3680/7692] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:41:25 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:26.607018 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:26.609276 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:26.616162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:26.616656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:26.617205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:26.617906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:26.618370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:26.618809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:26.651347 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d3087cae-426b-498d-bfcd-ba0b7f8468ff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048391 Oct 03 11:41:26.651933 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4013/7693] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:41:26 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 11:41:26.662946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:26.663438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:26.670356 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:26.670835 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:26.671270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:26.672013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:26.672468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:26.672934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:26.754119 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] HTTP exception thrown: Instance 7fa09448-854c-473b-935e-5f29a40d2986 is not attached to volume 645505fb-fdef-4d97-a1ee-16200ad91440 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Request method failure captured: Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments/645505fb-fdef-4d97-a1ee-16200ad91440 HTTP/1.1 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOspD3SBoO9YM4zudl6qYxfl8YmYz_HOvoeH6yY_VYYKQeTcpD1jL5cvT7K8LnsVqh9cEZaU-JHtkAifsDmX3_MROEhJxEV-XNr9R0b5P5wsa-CNgbZQpr2AoVn6Oz0YCdKN_EkexrNHyisUZOUBrkiKOlQNiEvYb1hFUy1nIxn0_phE Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979b490475f4448bb039208a936602f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979b490475f4448bb039208a936602f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}] Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f7cc375731484aacb981f98f35d4b5d2 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 7fa09448-854c-473b-935e-5f29a40d2986 is not attached to volume 645505fb-fdef-4d97-a1ee-16200ad91440 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': '7fa09448-854c-473b-935e-5f29a40d2986', 'id': '645505fb-fdef-4d97-a1ee-16200ad91440'} Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 645505fb-fdef-4d97-a1ee-16200ad91440. Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa09448-854c-473b-935e-5f29a40d2986 is not attached to volume 645505fb-fdef-4d97-a1ee-16200ad91440 Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:41:26.760790 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:41:26.766057 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:41:26.766057 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:41:26.766057 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa09448-854c-473b-935e-5f29a40d2986 is not attached to volume 645505fb-fdef-4d97-a1ee-16200ad91440 Oct 03 11:41:26.766057 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:26.766057 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Returning 404 to user: Instance 7fa09448-854c-473b-935e-5f29a40d2986 is not attached to volume 645505fb-fdef-4d97-a1ee-16200ad91440 {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:41:26.766057 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c720c2f-078b-41ea-b146-e897af7562bb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments/645505fb-fdef-4d97-a1ee-16200ad91440" status: 404 len: 154 microversion: 2.1 time: 0.103306 Oct 03 11:41:26.766057 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3681/7694] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:41:26 2022] DELETE /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986/os-volume_attachments/645505fb-fdef-4d97-a1ee-16200ad91440 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:41:30.118282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:30.118864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:30.125498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:30.126017 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:30.126472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:30.127186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:30.127670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:30.128191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:30.157397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:41:30.253217 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1d7bfd16-c409-4002-a470-70cc77d57970 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 204 len: 0 microversion: 2.1 time: 0.138508 Oct 03 11:41:30.253974 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4014/7695] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:41:30 2022] DELETE /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:41:30.262258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:30.263083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:30.271358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:30.271843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:30.272286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:30.273084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:30.273622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:30.274107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:30.410069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:30.418162 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ff75f89c-201f-4cce-83b1-fe96956e8f38 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1560 microversion: 2.1 time: 0.159833 Oct 03 11:41:30.418832 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3682/7696] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:30 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:31.442945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:31.443667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:31.450682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:31.451188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:31.451648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:31.452371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:31.452917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:31.454128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:31.589722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:31.597539 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e21793c5-194b-4052-895b-50e71b289fff tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1560 microversion: 2.1 time: 0.158972 Oct 03 11:41:31.598115 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4015/7697] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:31 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:32.451481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c111a2e6-54c4-40b1-b54f-55d53041c71e req-fc6e9849-5593-4670-8fef-8c1d4f942b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa09448-854c-473b-935e-5f29a40d2986", "name": "network-vif-deleted", "tag": "af08fc46-ebd0-4e0a-8a3a-19b19975c8e1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:32.462568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c111a2e6-54c4-40b1-b54f-55d53041c71e req-fc6e9849-5593-4670-8fef-8c1d4f942b08 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:32.463054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c111a2e6-54c4-40b1-b54f-55d53041c71e req-fc6e9849-5593-4670-8fef-8c1d4f942b08 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:32.463492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c111a2e6-54c4-40b1-b54f-55d53041c71e req-fc6e9849-5593-4670-8fef-8c1d4f942b08 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:32.476482 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c111a2e6-54c4-40b1-b54f-55d53041c71e req-fc6e9849-5593-4670-8fef-8c1d4f942b08 service nova] Creating event network-vif-deleted:af08fc46-ebd0-4e0a-8a3a-19b19975c8e1 for instance 7fa09448-854c-473b-935e-5f29a40d2986 on n-h1-858383-3 Oct 03 11:41:32.483174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c111a2e6-54c4-40b1-b54f-55d53041c71e req-fc6e9849-5593-4670-8fef-8c1d4f942b08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Oct 03 11:41:32.483792 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3683/7698] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:32.620793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:32.621430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:32.628964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:32.629474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:32.629920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:32.630641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:32.631112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:32.631554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:32.664886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:32.665322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:32.665777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:32.666253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lazy-loading 'fault' on Instance uuid 7fa09448-854c-473b-935e-5f29a40d2986 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:41:32.711630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:32.720007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39d6d64f-4e3c-477a-bc01-43dc8e8131e7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 200 len: 1352 microversion: 2.1 time: 0.103263 Oct 03 11:41:32.720591 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4016/7699] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:32 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:33.745040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:33.745741 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 7fa09448-854c-473b-935e-5f29a40d2986] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:33.751979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:33.752405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:33.752875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:33.753565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:33.754021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:33.754449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:33.770422 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] HTTP exception thrown: Instance 7fa09448-854c-473b-935e-5f29a40d2986 could not be found. Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Request method failure captured: Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 HTTP/1.1 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOspD3SBoO9YM4zudl6qYxfl8YmYz_HOvoeH6yY_VYYKQeTcpD1jL5cvT7K8LnsVqh9cEZaU-JHtkAifsDmX3_MROEhJxEV-XNr9R0b5P5wsa-CNgbZQpr2AoVn6Oz0YCdKN_EkexrNHyisUZOUBrkiKOlQNiEvYb1hFUy1nIxn0_phE Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979b490475f4448bb039208a936602f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979b490475f4448bb039208a936602f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}] Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f7cc375731484aacb981f98f35d4b5d2 Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 7fa09448-854c-473b-935e-5f29a40d2986 could not be found. Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '7fa09448-854c-473b-935e-5f29a40d2986'} Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa09448-854c-473b-935e-5f29a40d2986 could not be found. Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa09448-854c-473b-935e-5f29a40d2986 could not be found. Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:33.772059 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa09448-854c-473b-935e-5f29a40d2986 could not be found. Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Returning 404 to user: Instance 7fa09448-854c-473b-935e-5f29a40d2986 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-39c0d7ef-c40b-47ef-b7dd-77b048b8ace6 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986" status: 404 len: 111 microversion: 2.1 time: 0.033611 Oct 03 11:41:33.776194 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3684/7700] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:33 2022] GET /compute/v2.1/servers/7fa09448-854c-473b-935e-5f29a40d2986 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:41:33.782978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c44431dc-22aa-41e0-b996-d877416edfcb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '.version_select at 0x7f074eb049d0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:33.804106 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c44431dc-22aa-41e0-b996-d877416edfcb tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-283876371" status: 202 len: 0 microversion: 2.1 time: 0.025644 Oct 03 11:41:33.804835 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4017/7701] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Oct 3 11:41:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-283876371 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:41:33.820916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5aaddd7c-38f4-44c5-89fc-81bef7553177 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: .version_select at 0x7f074e4c0310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1768328441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOqtb5vfZa6+RYx5AzPlBCrXADwPM0YMKqPEFijAE6J1Bik/3qDS4Qo4RU5BReKuj9xOt2VKWWy6qMrTzP48GhEsEPz72cvqzZ8jBVzS+vCYzsFFTtCnjn+vq3g+OxMFg=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:33.836714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5aaddd7c-38f4-44c5-89fc-81bef7553177 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for project 979b490475f4448bb039208a936602f9. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:41:33.841970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-5aaddd7c-38f4-44c5-89fc-81bef7553177 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for user f7cc375731484aacb981f98f35d4b5d2 and project 979b490475f4448bb039208a936602f9. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:41:33.855562 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5aaddd7c-38f4-44c5-89fc-81bef7553177 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:41:34.864160 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [None req-5aaddd7c-38f4-44c5-89fc-81bef7553177 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 49310. Oct 03 11:41:34.880382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5aaddd7c-38f4-44c5-89fc-81bef7553177 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.063345 Oct 03 11:41:34.881021 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3685/7702] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:41:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:41:34.939902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1102897660", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1768328441", "networks": [{"uuid": "04156fc7-276a-46d6-a456-f86e14ff31ce"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:34.994040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] validate_networks() for [('04156fc7-276a-46d6-a456-f86e14ff31ce', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:41:35.379707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:41:35.380190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:41:35.380714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:41:35.381171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:41:35.381590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:41:35.391186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:35.391674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:35.392121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:35.392891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:35.393356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:35.393824 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:35.412501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for project 979b490475f4448bb039208a936602f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:41:35.421382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for user f7cc375731484aacb981f98f35d4b5d2 and project 979b490475f4448bb039208a936602f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:41:35.437460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:41:35.440110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:41:35.489201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f803f315-8cdd-4d00-9b3b-abcd0b96a0c8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553658 Oct 03 11:41:35.490022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4018/7703] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:41:35.502708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9fe637cc-5f76-4d11-83d3-734507dc4fb4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:35.503547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9fe637cc-5f76-4d11-83d3-734507dc4fb4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:35.558772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9fe637cc-5f76-4d11-83d3-734507dc4fb4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:35.566675 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9fe637cc-5f76-4d11-83d3-734507dc4fb4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1263 microversion: 2.1 time: 0.069483 Oct 03 11:41:35.567364 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3686/7704] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:35 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:36.592673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:36.593412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:36.601384 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:36.601883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:36.602634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:36.603361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:36.603828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:36.604456 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:36.680638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:36.689892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dcf22354-f17f-4036-8ac1-b086969f498f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1323 microversion: 2.1 time: 0.103964 Oct 03 11:41:36.690775 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4019/7705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:36 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1323 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:37.714443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:37.715132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:37.722662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:37.723157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:37.723780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:37.724551 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:37.725029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:37.725453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:37.940750 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:37.948859 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8e3c00a6-7e39-4e95-b805-5503c9e6bc34 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1363 microversion: 2.1 time: 0.238454 Oct 03 11:41:37.949530 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3687/7706] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:37 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:41:38.057741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ea2c57ca-0d02-431a-81e7-ad5508b0ed7b req-f69b0d84-d78b-42c8-a468-5a2e00a04f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b328fcf-d173-4324-aa15-f040c2480fd3", "tag": "54a77601-c87a-482d-9e1e-ae3ad57c1829"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:38.070114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ea2c57ca-0d02-431a-81e7-ad5508b0ed7b req-f69b0d84-d78b-42c8-a468-5a2e00a04f32 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:38.070608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ea2c57ca-0d02-431a-81e7-ad5508b0ed7b req-f69b0d84-d78b-42c8-a468-5a2e00a04f32 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:38.071056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ea2c57ca-0d02-431a-81e7-ad5508b0ed7b req-f69b0d84-d78b-42c8-a468-5a2e00a04f32 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:38.082775 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ea2c57ca-0d02-431a-81e7-ad5508b0ed7b req-f69b0d84-d78b-42c8-a468-5a2e00a04f32 service nova] Creating event network-changed:54a77601-c87a-482d-9e1e-ae3ad57c1829 for instance 5b328fcf-d173-4324-aa15-f040c2480fd3 on n-h1-858383-3 Oct 03 11:41:38.087960 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ea2c57ca-0d02-431a-81e7-ad5508b0ed7b req-f69b0d84-d78b-42c8-a468-5a2e00a04f32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034618 Oct 03 11:41:38.089163 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4020/7707] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:38.973085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:38.973642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:38.980601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:38.981123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:38.981570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:38.982276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:38.982736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:38.983164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:39.119660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:39.127949 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6dfb1227-2794-4c8f-bd11-5fc88dc94156 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1363 microversion: 2.1 time: 0.158970 Oct 03 11:41:39.128526 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3688/7708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:38 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:40.152124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:40.152883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:40.159168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:40.159674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:40.160130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:40.160877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:40.161436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:40.161893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:40.294233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:40.302404 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d3ce8a41-50e6-4355-9215-ab6e927b1661 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1363 microversion: 2.1 time: 0.155082 Oct 03 11:41:40.302988 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4021/7709] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:40 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:41.325988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:41.326622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:41.334217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:41.334701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:41.335133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:41.335818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:41.336267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:41.336688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:41.476595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:41.484376 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a55cfea8-5f28-40fd-8050-d88e14bcd928 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1363 microversion: 2.1 time: 0.162300 Oct 03 11:41:41.484976 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3689/7710] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:41 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:42.507108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:42.507857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:42.514610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:42.515099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:42.515547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:42.516249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:42.516708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:42.517167 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:42.651867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:42.660147 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7481e985-720c-428d-81cb-ccca3f1ee391 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1363 microversion: 2.1 time: 0.157057 Oct 03 11:41:42.660729 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4022/7711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:42 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:43.684079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:43.684819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:43.692972 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:43.693470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:43.693905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:43.694615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:43.695075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:43.695501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:43.827329 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:43.835782 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0b22ff66-7aaf-4e13-8a0c-b04c753f6bed tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1363 microversion: 2.1 time: 0.155739 Oct 03 11:41:43.836358 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3690/7712] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:43 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:43.859762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-269ae894-9c03-4cea-8516-3f45ef14ae64 req-ef9891df-938a-448d-8207-69aeabeef296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b328fcf-d173-4324-aa15-f040c2480fd3", "name": "network-vif-plugged", "status": "completed", "tag": "54a77601-c87a-482d-9e1e-ae3ad57c1829"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:43.872752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-269ae894-9c03-4cea-8516-3f45ef14ae64 req-ef9891df-938a-448d-8207-69aeabeef296 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:43.873290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-269ae894-9c03-4cea-8516-3f45ef14ae64 req-ef9891df-938a-448d-8207-69aeabeef296 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:43.873749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-269ae894-9c03-4cea-8516-3f45ef14ae64 req-ef9891df-938a-448d-8207-69aeabeef296 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:43.886413 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-269ae894-9c03-4cea-8516-3f45ef14ae64 req-ef9891df-938a-448d-8207-69aeabeef296 service nova] Creating event network-vif-plugged:54a77601-c87a-482d-9e1e-ae3ad57c1829 for instance 5b328fcf-d173-4324-aa15-f040c2480fd3 on n-h1-858383-3 Oct 03 11:41:43.892025 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-269ae894-9c03-4cea-8516-3f45ef14ae64 req-ef9891df-938a-448d-8207-69aeabeef296 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036539 Oct 03 11:41:43.892637 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4023/7713] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:41:44.858576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:44.859140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:44.865971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:44.866459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:44.866945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:44.867629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:44.868089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:44.868522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:45.000495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:45.008236 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cd0dc4a-08d2-4639-8b87-c6efbb8cd80c tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1363 microversion: 2.1 time: 0.153727 Oct 03 11:41:45.008816 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3691/7714] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:44 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:46.033531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:46.034279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:46.037079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:46.037760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:46.044247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:46.044726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:46.045208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:46.045921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:46.046421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:46.046866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:46.179149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:46.187014 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17a89690-7380-4ad2-9ee0-1c659020db10 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1555 microversion: 2.1 time: 0.159317 Oct 03 11:41:46.188195 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4024/7715] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:46 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:46.210484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:46.211176 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:46.213255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:46.219589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:46.220078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:46.220522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:46.221266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:46.221726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:46.222155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:46.356512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:41:46.364306 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-05615b3d-d572-42f5-91e7-b6232fb40a62 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1555 microversion: 2.1 time: 0.157710 Oct 03 11:41:46.364929 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3692/7716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:41:46 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:41:47.867959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9893383b-3138-4a80-aeae-4b3483087286"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:41:47.870432 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:47.877785 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:47.878284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:47.878739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:47.879452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:47.879919 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:47.880360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:48.128641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:48.146802 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5db279a6-91a0-474e-9bbd-22146dee7360 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282668 Oct 03 11:41:48.147563 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4025/7717] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:41:47 2022] POST /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:41:59.937748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:41:59.938278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:41:59.941655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:59.943097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=70 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:41:59.949301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:59.949788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:59.950227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:41:59.950922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:41:59.951382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:41:59.951812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:00.033281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lazy-loading 'services' on Instance uuid 5b328fcf-d173-4324-aa15-f040c2480fd3 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:42:00.105151 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d19bdf2e-6e0f-43ce-9c4d-7d65d06aafb3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments/9893383b-3138-4a80-aeae-4b3483087286" status: 202 len: 0 microversion: 2.1 time: 0.171171 Oct 03 11:42:00.105770 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3693/7718] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:41:59 2022] DELETE /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments/9893383b-3138-4a80-aeae-4b3483087286 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:42:00.112892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:00.114200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:00.118662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:00.121127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:00.133574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:00.134088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:00.134548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:00.135274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:00.135935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:00.136382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:00.168396 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d6f03c29-971f-4246-b541-7e4b7760a06f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057918 Oct 03 11:42:00.169033 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4026/7719] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:00 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:01.182821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:01.185559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:01.193500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:01.193992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:01.194438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:01.195161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:01.195614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:01.196071 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:01.228395 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0ca055c1-d0ac-44b5-b4f7-08336000cfaa tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050148 Oct 03 11:42:01.229008 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3694/7720] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:01 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:02.240181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:02.242504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:02.249770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:02.250280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:02.250738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:02.251479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:02.251953 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:02.252400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:02.286127 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38886907-89b3-4b10-b8b6-7dff8492677f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049441 Oct 03 11:42:02.286739 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4027/7721] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:02 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:03.303624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:03.307810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:03.314541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:03.315018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:03.315631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:03.316515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:03.317739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:03.318165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:03.349140 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db06928a-cb3b-4ba8-af9e-5c382fe93cf9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053406 Oct 03 11:42:03.349608 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3695/7722] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:03 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:04.361602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:04.364911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:04.371557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:04.372063 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:04.372522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:04.373274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:04.373749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:04.374192 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:04.405279 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c1e12b6-d69d-4076-84d1-df377b7929a9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047598 Oct 03 11:42:04.405859 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4028/7723] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:04 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:05.418374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:05.420523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:05.427677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:05.428167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:05.428611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:05.429331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:05.429787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:05.430214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:05.459856 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5e683990-fb31-4305-83b8-f304a1302908 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045506 Oct 03 11:42:05.460412 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3696/7724] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:05 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 11:42:05.471298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:05.471817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:05.479636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:05.480131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:05.480579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:05.481698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:05.482162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:05.482608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:05.559544 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] HTTP exception thrown: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 is not attached to volume 9893383b-3138-4a80-aeae-4b3483087286 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Request method failure captured: Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: request: DELETE /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments/9893383b-3138-4a80-aeae-4b3483087286 HTTP/1.1 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOspD3SBoO9YM4zudl6qYxfl8YmYz_HOvoeH6yY_VYYKQeTcpD1jL5cvT7K8LnsVqh9cEZaU-JHtkAifsDmX3_MROEhJxEV-XNr9R0b5P5wsa-CNgbZQpr2AoVn6Oz0YCdKN_EkexrNHyisUZOUBrkiKOlQNiEvYb1hFUy1nIxn0_phE Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979b490475f4448bb039208a936602f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979b490475f4448bb039208a936602f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}] Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: f7cc375731484aacb981f98f35d4b5d2 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 is not attached to volume 9893383b-3138-4a80-aeae-4b3483087286 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'server_id': '5b328fcf-d173-4324-aa15-f040c2480fd3', 'id': '9893383b-3138-4a80-aeae-4b3483087286'} Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9893383b-3138-4a80-aeae-4b3483087286. Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 is not attached to volume 9893383b-3138-4a80-aeae-4b3483087286 Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:05.561678 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:05.566019 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:42:05.566019 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:42:05.566019 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 is not attached to volume 9893383b-3138-4a80-aeae-4b3483087286 Oct 03 11:42:05.566019 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:05.566019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Returning 404 to user: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 is not attached to volume 9893383b-3138-4a80-aeae-4b3483087286 {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:42:05.566019 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4fdcb7d3-437b-4ea1-a582-539eb873553d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments/9893383b-3138-4a80-aeae-4b3483087286" status: 404 len: 154 microversion: 2.1 time: 0.096181 Oct 03 11:42:05.566019 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4029/7725] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:42:05 2022] DELETE /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3/os-volume_attachments/9893383b-3138-4a80-aeae-4b3483087286 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:42:08.918495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:08.919144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:08.926215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:08.927752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:08.928104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:08.928775 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:08.929288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:08.929714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:08.957479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:42:09.039179 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d9862d53-7b64-4896-9984-59f354d82adc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 204 len: 0 microversion: 2.1 time: 0.124351 Oct 03 11:42:09.039958 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3697/7726] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:42:08 2022] DELETE /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:42:09.048441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:09.049200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:09.057606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:09.058107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:09.058555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:09.059268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:09.059834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:09.060275 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:09.198888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:09.206874 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-074fe766-5a81-45a2-99d9-b530fb9b2c35 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1561 microversion: 2.1 time: 0.162220 Oct 03 11:42:09.207381 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4030/7727] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:09 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:42:10.231291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:10.231982 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:10.240233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:10.240721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:10.241179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:10.241870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:10.242318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:10.242739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:10.373843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:10.381679 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-efc1a03c-5330-4a5a-8ce1-4118960521b7 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1561 microversion: 2.1 time: 0.154626 Oct 03 11:42:10.382252 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3698/7728] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:10 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:11.241853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-765ab579-ec86-4dbb-9901-0c90954281bb req-30bebb9f-e7af-4a05-9a8a-eb7c20e690dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b328fcf-d173-4324-aa15-f040c2480fd3", "name": "network-vif-deleted", "tag": "54a77601-c87a-482d-9e1e-ae3ad57c1829"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:42:11.253483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-765ab579-ec86-4dbb-9901-0c90954281bb req-30bebb9f-e7af-4a05-9a8a-eb7c20e690dd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:11.254363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-765ab579-ec86-4dbb-9901-0c90954281bb req-30bebb9f-e7af-4a05-9a8a-eb7c20e690dd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:11.255052 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-765ab579-ec86-4dbb-9901-0c90954281bb req-30bebb9f-e7af-4a05-9a8a-eb7c20e690dd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:11.267647 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-765ab579-ec86-4dbb-9901-0c90954281bb req-30bebb9f-e7af-4a05-9a8a-eb7c20e690dd service nova] Creating event network-vif-deleted:54a77601-c87a-482d-9e1e-ae3ad57c1829 for instance 5b328fcf-d173-4324-aa15-f040c2480fd3 on n-h1-858383-3 Oct 03 11:42:11.273751 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-765ab579-ec86-4dbb-9901-0c90954281bb req-30bebb9f-e7af-4a05-9a8a-eb7c20e690dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035457 Oct 03 11:42:11.274474 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4031/7729] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:11.405552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:11.406222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:11.413789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:11.414276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:11.414748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:11.415453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:11.415908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:11.416336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:11.448245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:11.448683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:11.449146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:11.449599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lazy-loading 'fault' on Instance uuid 5b328fcf-d173-4324-aa15-f040c2480fd3 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:42:11.492419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:11.500267 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea75db1f-b46d-42aa-b38d-24767331b85e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 200 len: 1353 microversion: 2.1 time: 0.098842 Oct 03 11:42:11.500854 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3699/7730] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:11 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:12.525718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:12.526463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: 5b328fcf-d173-4324-aa15-f040c2480fd3] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:12.532905 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:12.533463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:12.533965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:12.534670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:12.535134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:12.535571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:12.549411 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] HTTP exception thrown: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 could not be found. Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Request method failure captured: Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 HTTP/1.1 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOspD3SBoO9YM4zudl6qYxfl8YmYz_HOvoeH6yY_VYYKQeTcpD1jL5cvT7K8LnsVqh9cEZaU-JHtkAifsDmX3_MROEhJxEV-XNr9R0b5P5wsa-CNgbZQpr2AoVn6Oz0YCdKN_EkexrNHyisUZOUBrkiKOlQNiEvYb1hFUy1nIxn0_phE Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979b490475f4448bb039208a936602f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979b490475f4448bb039208a936602f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}] Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: f7cc375731484aacb981f98f35d4b5d2 Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 could not be found. Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '5b328fcf-d173-4324-aa15-f040c2480fd3'} Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 could not be found. Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 could not be found. Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:12.551049 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 could not be found. Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Returning 404 to user: Instance 5b328fcf-d173-4324-aa15-f040c2480fd3 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-31ddc688-a138-4d7d-b6db-6a640614b4c2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3" status: 404 len: 111 microversion: 2.1 time: 0.032332 Oct 03 11:42:12.556529 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4032/7731] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:12 2022] GET /compute/v2.1/servers/5b328fcf-d173-4324-aa15-f040c2480fd3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:42:12.562136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6daaa120-c33a-4104-8aa5-c294abcc6ab3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '.version_select at 0x7f074dfedaf0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:12.582326 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6daaa120-c33a-4104-8aa5-c294abcc6ab3 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1768328441" status: 202 len: 0 microversion: 2.1 time: 0.023926 Oct 03 11:42:12.582910 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3700/7732] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 3 11:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1768328441 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:42:12.605749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-17044b0e-68e6-41c4-883b-ec0a6c290869 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: .version_select at 0x7f074e218430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1727773433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+GG4POlbVY9C6nA+ovBkREYWCos5yGToQIKqGOx3CUapG8t3LAUHRGV/52LRydbbevlldSeST3mvK9TOZdWNzzFE222gQpDaM8Cx0Fi4ouv+1r31BIpVBb/A2QjPCjaQ=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:42:12.622438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-17044b0e-68e6-41c4-883b-ec0a6c290869 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for project 979b490475f4448bb039208a936602f9. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:42:12.631139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-17044b0e-68e6-41c4-883b-ec0a6c290869 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for user f7cc375731484aacb981f98f35d4b5d2 and project 979b490475f4448bb039208a936602f9. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:42:12.654299 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-17044b0e-68e6-41c4-883b-ec0a6c290869 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.057608 Oct 03 11:42:12.654913 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4033/7733] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:42:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:12.704864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-871401501", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1727773433", "networks": [{"uuid": "04156fc7-276a-46d6-a456-f86e14ff31ce"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:42:12.760206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] validate_networks() for [('04156fc7-276a-46d6-a456-f86e14ff31ce', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:42:13.137646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:42:13.138111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:42:13.138629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:42:13.139037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:42:13.139449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:42:13.149091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:13.149571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:13.150010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:13.150729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:13.151183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:13.151608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:13.170333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for project 979b490475f4448bb039208a936602f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:42:13.175472 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Getting quotas for user f7cc375731484aacb981f98f35d4b5d2 and project 979b490475f4448bb039208a936602f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:42:13.189447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:42:13.191956 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:42:13.239668 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c108c6d8-821e-475d-ac72-c66feec1f5cc tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538890 Oct 03 11:42:13.240357 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3701/7734] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:42:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:42:13.252569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-526237ad-5433-41f5-8922-e6ebfecbb56f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:13.253327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-526237ad-5433-41f5-8922-e6ebfecbb56f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:13.310637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-526237ad-5433-41f5-8922-e6ebfecbb56f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:13.323026 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-526237ad-5433-41f5-8922-e6ebfecbb56f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1262 microversion: 2.1 time: 0.074508 Oct 03 11:42:13.323635 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4034/7735] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:13 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:14.346494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:14.347126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:14.356120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:14.356652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:14.357129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:14.358053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:14.358572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:14.359009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:14.432633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:14.440510 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e5bf6001-b469-41df-9368-38616d8b6d1a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1332 microversion: 2.1 time: 0.098418 Oct 03 11:42:14.441110 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3702/7736] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:14 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:42:15.464799 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:15.465530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:15.472596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:15.473131 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:15.473582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:15.474443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:15.474914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:15.475494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:15.611062 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:15.620619 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-05729c8c-3668-489d-9edc-430af177034f tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1362 microversion: 2.1 time: 0.160743 Oct 03 11:42:15.621425 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4035/7737] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:15 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:15.751783 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-75b0b676-d63b-4a26-8d1b-47748f2960a1 req-a2ca999c-57ec-44eb-9514-b20897c211a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9d6161-cab0-4482-be73-6d001ab5de71", "tag": "775c16cb-ed9e-4196-8e4a-8f0c9555ce32"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:42:15.764978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-75b0b676-d63b-4a26-8d1b-47748f2960a1 req-a2ca999c-57ec-44eb-9514-b20897c211a4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:15.765474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-75b0b676-d63b-4a26-8d1b-47748f2960a1 req-a2ca999c-57ec-44eb-9514-b20897c211a4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:15.765903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-75b0b676-d63b-4a26-8d1b-47748f2960a1 req-a2ca999c-57ec-44eb-9514-b20897c211a4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:15.787146 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-75b0b676-d63b-4a26-8d1b-47748f2960a1 req-a2ca999c-57ec-44eb-9514-b20897c211a4 service nova] Creating event network-changed:775c16cb-ed9e-4196-8e4a-8f0c9555ce32 for instance ba9d6161-cab0-4482-be73-6d001ab5de71 on n-h1-858383-3 Oct 03 11:42:15.793356 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-75b0b676-d63b-4a26-8d1b-47748f2960a1 req-a2ca999c-57ec-44eb-9514-b20897c211a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046099 Oct 03 11:42:15.794073 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3703/7738] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:42:16.644689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:16.645361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:16.652791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:16.653317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:16.653776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:16.654498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:16.654969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:16.655417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:16.790708 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:16.798507 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b0f5796-2e77-49df-a916-c56424b3317d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1362 microversion: 2.1 time: 0.157886 Oct 03 11:42:16.799391 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4036/7739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:16 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:17.822607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:17.823226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:17.830774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:17.831402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:17.831854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:17.832628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:17.833136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:17.833569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:17.966263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:17.973981 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-240ee97a-e7b5-45ae-b891-aa305bfbb85b tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1362 microversion: 2.1 time: 0.155743 Oct 03 11:42:17.974549 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3704/7740] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:17 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:18.998007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:18.999253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:19.006065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:19.006561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:19.007013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:19.007794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:19.008320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:19.008698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:19.141182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:19.149387 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-62097a26-466a-49e7-b825-0e8446074ab8 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1362 microversion: 2.1 time: 0.155205 Oct 03 11:42:19.149973 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4037/7741] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:18 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:20.172261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:20.172903 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:20.180152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:20.180649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:20.181134 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:20.181840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:20.182304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:20.182734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:20.321719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:20.329429 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8cf78933-8e1a-447d-9884-d687241c5512 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1362 microversion: 2.1 time: 0.161050 Oct 03 11:42:20.330017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3705/7742] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:20 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:21.353945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:21.354573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:21.361692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:21.362209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:21.362668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:21.363400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:21.363876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:21.364328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:21.506977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:21.515313 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e992477f-cf10-43cd-89ed-365503037786 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1362 microversion: 2.1 time: 0.165566 Oct 03 11:42:21.515941 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4038/7743] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:21 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:22.066320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-442e34fb-0d0b-4def-a16f-094cfa6fc707 req-e9ea9a0a-6df3-4fa3-aac2-0577cd00302a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9d6161-cab0-4482-be73-6d001ab5de71", "name": "network-vif-plugged", "status": "completed", "tag": "775c16cb-ed9e-4196-8e4a-8f0c9555ce32"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:42:22.077642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-442e34fb-0d0b-4def-a16f-094cfa6fc707 req-e9ea9a0a-6df3-4fa3-aac2-0577cd00302a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:22.078144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-442e34fb-0d0b-4def-a16f-094cfa6fc707 req-e9ea9a0a-6df3-4fa3-aac2-0577cd00302a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:22.078607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-442e34fb-0d0b-4def-a16f-094cfa6fc707 req-e9ea9a0a-6df3-4fa3-aac2-0577cd00302a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:22.090575 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-442e34fb-0d0b-4def-a16f-094cfa6fc707 req-e9ea9a0a-6df3-4fa3-aac2-0577cd00302a service nova] Creating event network-vif-plugged:775c16cb-ed9e-4196-8e4a-8f0c9555ce32 for instance ba9d6161-cab0-4482-be73-6d001ab5de71 on n-h1-858383-3 Oct 03 11:42:22.095467 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-442e34fb-0d0b-4def-a16f-094cfa6fc707 req-e9ea9a0a-6df3-4fa3-aac2-0577cd00302a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032863 Oct 03 11:42:22.096256 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3706/7744] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:22.539462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:22.540090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:22.547104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:22.547603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:22.548053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:22.548757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:22.549247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:22.549688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:22.685581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:22.693422 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d674c7ba-954c-4142-8921-879be82c7a16 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1362 microversion: 2.1 time: 0.158482 Oct 03 11:42:22.693993 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4039/7745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:22 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:23.714978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:23.715751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:23.719764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:23.720501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:23.728183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:23.728676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:23.729143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:23.729850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:23.730309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:23.730744 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:23.869220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:23.877006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8faf9c1e-4054-4667-ba89-889f3ba34de2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1554 microversion: 2.1 time: 0.163920 Oct 03 11:42:23.877578 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3707/7746] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:23 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:23.899699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:23.900684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:23.902372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:23.908826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:23.909338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:23.909801 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:23.910556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:23.911027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:23.911479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:24.047003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:24.055276 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-244d3762-8f27-4303-9da5-f3449b98ac41 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1554 microversion: 2.1 time: 0.160033 Oct 03 11:42:24.055875 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4040/7747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:23 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:25.567195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da31dc97-da41-4f2f-a413-21dce6b9ea1d"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:42:25.569571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:25.576665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:25.577181 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:25.577610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:25.578303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:25.578753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:25.579191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:25.826577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:25.846285 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-92426a7b-b059-4003-995d-c18aa2cdaced tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "POST /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282897 Oct 03 11:42:25.847229 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3708/7748] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:42:25 2022] POST /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:36.595263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:36.595831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:36.598374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:36.599088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=70 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:36.605515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:36.606010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:36.606462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:36.607165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:36.607630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:36.608072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:36.689082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lazy-loading 'services' on Instance uuid ba9d6161-cab0-4482-be73-6d001ab5de71 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:42:36.758464 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54f9c47d-4426-41b9-a466-5557c93d261e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments/da31dc97-da41-4f2f-a413-21dce6b9ea1d" status: 202 len: 0 microversion: 2.1 time: 0.166962 Oct 03 11:42:36.759061 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4041/7749] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:42:36 2022] DELETE /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments/da31dc97-da41-4f2f-a413-21dce6b9ea1d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:42:36.765804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:36.766576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:42:36.770794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:36.773151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:36.781314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:36.781804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:36.782238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:36.782941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:36.783396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:36.783824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:36.816749 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc77dc9b-47ea-4642-bb23-605db92d2cde tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052845 Oct 03 11:42:36.817383 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3709/7750] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:36 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:37.831117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:37.833550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:37.839915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:37.840444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:37.840926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:37.841635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:37.842100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:37.842539 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:37.874044 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f3aa627-6101-4b24-952d-7b0e6355c614 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048215 Oct 03 11:42:37.874619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4042/7751] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:37 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:38.887336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:38.889498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:38.896648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:38.897315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:38.897764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:38.898471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:38.898930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:38.899359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:38.931512 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11c1a4f6-27a3-4516-bae6-e92e50b136f2 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048419 Oct 03 11:42:38.932095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3710/7752] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:38 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:39.944088 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:39.946272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:39.953709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:39.954207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:39.954663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:39.955376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:39.955845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:39.956286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:39.987100 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0e2f39f3-3ffb-41bc-b8cc-f2c33917e93a tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047067 Oct 03 11:42:39.987688 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4043/7753] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:39 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:41.000282 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:41.002525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:41.009965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:41.010448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:41.010882 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:41.011574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:41.012019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:41.012438 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:41.044702 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4369a785-372d-45fd-b816-ec26de7c1134 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048411 Oct 03 11:42:41.045289 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3711/7754] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:40 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:42.058134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:42.060332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:42.066944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:42.067469 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:42.067926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:42.068633 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:42.069132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:42.069567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:42.098502 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8cbcc6b3-11c8-403e-8564-c7abf916d046 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044938 Oct 03 11:42:42.099064 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4044/7755] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:42:42 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 11:42:42.111526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:42.112035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:42.119385 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:42.119872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:42.120319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:42.121035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:42.121490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:42.121920 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:42.197479 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] HTTP exception thrown: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 is not attached to volume da31dc97-da41-4f2f-a413-21dce6b9ea1d Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Request method failure captured: Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments/da31dc97-da41-4f2f-a413-21dce6b9ea1d HTTP/1.1 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOspD3SBoO9YM4zudl6qYxfl8YmYz_HOvoeH6yY_VYYKQeTcpD1jL5cvT7K8LnsVqh9cEZaU-JHtkAifsDmX3_MROEhJxEV-XNr9R0b5P5wsa-CNgbZQpr2AoVn6Oz0YCdKN_EkexrNHyisUZOUBrkiKOlQNiEvYb1hFUy1nIxn0_phE Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979b490475f4448bb039208a936602f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979b490475f4448bb039208a936602f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}] Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f7cc375731484aacb981f98f35d4b5d2 Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 is not attached to volume da31dc97-da41-4f2f-a413-21dce6b9ea1d Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': 'ba9d6161-cab0-4482-be73-6d001ab5de71', 'id': 'da31dc97-da41-4f2f-a413-21dce6b9ea1d'} Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id da31dc97-da41-4f2f-a413-21dce6b9ea1d. Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 is not attached to volume da31dc97-da41-4f2f-a413-21dce6b9ea1d Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:42.199091 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:42.203378 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:42:42.203378 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:42:42.203378 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 is not attached to volume da31dc97-da41-4f2f-a413-21dce6b9ea1d Oct 03 11:42:42.203378 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:42.203378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Returning 404 to user: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 is not attached to volume da31dc97-da41-4f2f-a413-21dce6b9ea1d {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:42:42.203378 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c087d66c-e192-4d5d-93bd-51427604ee63 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments/da31dc97-da41-4f2f-a413-21dce6b9ea1d" status: 404 len: 154 microversion: 2.1 time: 0.093033 Oct 03 11:42:42.203378 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3712/7756] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:42:42 2022] DELETE /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71/os-volume_attachments/da31dc97-da41-4f2f-a413-21dce6b9ea1d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:42:45.551870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:45.552433 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:45.560425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:45.560988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:45.561650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:45.562379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:45.562847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:45.563286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:45.591694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:42:45.681462 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad69c710-a00f-4956-8b6a-d3f12021781d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 204 len: 0 microversion: 2.1 time: 0.133218 Oct 03 11:42:45.682432 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4045/7757] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:42:45 2022] DELETE /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:42:45.692430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:45.693948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:45.701702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:45.702372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:45.702819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:45.703596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:45.704053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:45.704492 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:45.841733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:45.849740 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-62211081-2cde-4861-ae25-257c5bafa2d9 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1560 microversion: 2.1 time: 0.162813 Oct 03 11:42:45.850309 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3713/7758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:45 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:46.874941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:46.875587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:46.882607 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:46.883110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:46.883571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:46.884286 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:46.884761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:46.885237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:47.023314 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:47.031609 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-919483cb-fb0c-4844-bf5f-d1aedcd6c9c4 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1560 microversion: 2.1 time: 0.161104 Oct 03 11:42:47.032510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4046/7759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:46 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:47.983124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-9262eab5-01bd-4b23-bd9d-93857400e57e req-80cec263-9a3a-4184-9ad4-844a92476d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9d6161-cab0-4482-be73-6d001ab5de71", "name": "network-vif-deleted", "tag": "775c16cb-ed9e-4196-8e4a-8f0c9555ce32"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:42:47.995100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9262eab5-01bd-4b23-bd9d-93857400e57e req-80cec263-9a3a-4184-9ad4-844a92476d15 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:47.995680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9262eab5-01bd-4b23-bd9d-93857400e57e req-80cec263-9a3a-4184-9ad4-844a92476d15 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:47.996183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-9262eab5-01bd-4b23-bd9d-93857400e57e req-80cec263-9a3a-4184-9ad4-844a92476d15 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:48.008378 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-9262eab5-01bd-4b23-bd9d-93857400e57e req-80cec263-9a3a-4184-9ad4-844a92476d15 service nova] Creating event network-vif-deleted:775c16cb-ed9e-4196-8e4a-8f0c9555ce32 for instance ba9d6161-cab0-4482-be73-6d001ab5de71 on n-h1-858383-3 Oct 03 11:42:48.013964 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-9262eab5-01bd-4b23-bd9d-93857400e57e req-80cec263-9a3a-4184-9ad4-844a92476d15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035081 Oct 03 11:42:48.014699 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3714/7760] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:42:48.061707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:48.062367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:48.070303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:48.070925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:48.071475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:48.072307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:48.073046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:48.073677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:48.148007 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cc375731484aacb981f98f35d4b5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979b490475f4448bb039208a936602f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:42:48.157505 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a40e0a5-1e14-4af0-bfde-891bfc4a7b5e tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 200 len: 1347 microversion: 2.1 time: 0.105674 Oct 03 11:42:48.158132 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4047/7761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:48 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 1347 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:42:49.183937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:49.184629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] [instance: ba9d6161-cab0-4482-be73-6d001ab5de71] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:42:49.191053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:49.191540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:49.191983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:49.192730 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:42:49.193208 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:42:49.193637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:42:49.207287 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] HTTP exception thrown: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 could not be found. Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Request method failure captured: Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 HTTP/1.1 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOspD3SBoO9YM4zudl6qYxfl8YmYz_HOvoeH6yY_VYYKQeTcpD1jL5cvT7K8LnsVqh9cEZaU-JHtkAifsDmX3_MROEhJxEV-XNr9R0b5P5wsa-CNgbZQpr2AoVn6Oz0YCdKN_EkexrNHyisUZOUBrkiKOlQNiEvYb1hFUy1nIxn0_phE Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979b490475f4448bb039208a936602f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979b490475f4448bb039208a936602f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979b490475f4448bb039208a936602f9"}]}] Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 979b490475f4448bb039208a936602f9 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2006723794 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: f7cc375731484aacb981f98f35d4b5d2 Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestEncryptedCinderVolumes-2006723794-project Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 could not be found. Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': 'ba9d6161-cab0-4482-be73-6d001ab5de71'} Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 could not be found. Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 could not be found. Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:49.209088 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 could not be found. Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Returning 404 to user: Instance ba9d6161-cab0-4482-be73-6d001ab5de71 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-92c27043-554d-4806-ac54-33bfe1e0d078 tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71" status: 404 len: 111 microversion: 2.1 time: 0.032986 Oct 03 11:42:49.214256 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3715/7762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:42:49 2022] GET /compute/v2.1/servers/ba9d6161-cab0-4482-be73-6d001ab5de71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:42:49.219377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80ed53e3-2505-455a-a899-045b9971357d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] Calling method '.version_select at 0x7f074eb1c4c0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:42:49.240375 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80ed53e3-2505-455a-a899-045b9971357d tempest-TestEncryptedCinderVolumes-2006723794 tempest-TestEncryptedCinderVolumes-2006723794-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1727773433" status: 202 len: 0 microversion: 2.1 time: 0.024679 Oct 03 11:42:49.240995 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4048/7763] 10.222.0.27 () {58 vars in 1278 bytes} [Mon Oct 3 11:42:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1727773433 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:43:16.413738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-37003f03-72fb-4239-bfc9-6b2b91464abd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'create', calling method: .version_select at 0x7f074e00adc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1521547484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiSIEqNOWfdzVH4aACCpQD6bXdrt+ZdgQvJLwpPyA4TADZ4YfajDtVm2cw3pIWKLs4HSwlsG4GuJFy5Ul9fbmN/xOQzlb0oO4rDmia9WIYZ1NpBcnDnQ8cHcucNl/DYsA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:16.419613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=14 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:16.420271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=34 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:16.432578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-37003f03-72fb-4239-bfc9-6b2b91464abd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:43:16.437787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-37003f03-72fb-4239-bfc9-6b2b91464abd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for user 07954b6cb06740e88a591f8e196a88eb and project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:43:16.461965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-37003f03-72fb-4239-bfc9-6b2b91464abd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052841 Oct 03 11:43:16.462568 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3716/7764] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:43:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:43:16.510489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:16.511243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:16.515248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1085111685", "imageRef": "58aa98f5-1c8d-4a09-a097-4af28da36036", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1521547484", "networks": [{"uuid": "24a0f8d6-e5ea-4074-8e36-74731a0d6454"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:16.576623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] validate_networks() for [('24a0f8d6-e5ea-4074-8e36-74731a0d6454', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:43:17.059233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:43:17.059675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:43:17.060160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:43:17.060582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:43:17.061067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:43:17.070162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:17.070682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:17.071168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:17.071914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:17.072382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:17.072847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:17.092894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:43:17.098029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for user 07954b6cb06740e88a591f8e196a88eb and project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:43:17.110813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:43:17.113101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58aa98f5-1c8d-4a09-a097-4af28da36036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:43:17.157339 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bdcd29da-40ae-4e65-8b16-e7e4b3ee5b1b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649513 Oct 03 11:43:17.158153 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4049/7765] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:43:17.169573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a07af28-3217-4766-8c8a-d06f825c46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:17.170186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a07af28-3217-4766-8c8a-d06f825c46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:17.225652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5a07af28-3217-4766-8c8a-d06f825c46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:17.237662 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a07af28-3217-4766-8c8a-d06f825c46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1259 microversion: 2.1 time: 0.071912 Oct 03 11:43:17.238310 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3717/7766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:17 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:18.265642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:18.267084 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:18.275981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:18.276493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:18.277121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:18.277879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:18.278524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:18.279258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:18.345024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:18.356677 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6a6df8f-b5d3-4539-9e0f-2a2321c5ed97 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1329 microversion: 2.1 time: 0.095134 Oct 03 11:43:18.361675 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4050/7767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:18 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:19.384444 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:19.385214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:19.392225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:19.392968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:19.393414 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:19.394210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:19.394842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:19.395405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:19.589299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:19.600097 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ec75cfa5-d864-4aa8-9de5-15c7a617c90f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.219387 Oct 03 11:43:19.602596 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3718/7768] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:19 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:20.627123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:20.628379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:20.637305 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:20.638224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:20.638962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:20.640057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:20.640951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:20.641723 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:20.798102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:20.814771 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0264b61c-f021-472a-9eea-82859aad33c3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.191859 Oct 03 11:43:20.816272 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4051/7769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:20 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:21.847987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:21.848796 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:21.856552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:21.857069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:21.857512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:21.858210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:21.858799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:21.859234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:22.019857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:22.028033 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c4a81da9-0b94-411a-a60b-d19d8c16524a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.183916 Oct 03 11:43:22.028648 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3719/7770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:21 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:23.052278 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:23.052932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:23.061073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:23.061865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:23.062394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:23.063189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:23.063831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:23.064459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:23.205162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:23.216283 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f9daaed6-8735-4369-8672-3d13162e1351 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.167681 Oct 03 11:43:23.232005 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4052/7771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:23 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:24.239593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:24.240271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:24.247103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:24.247595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:24.248039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:24.248736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:24.249228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:24.249694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:24.397872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:24.406501 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33f6c215-d672-4a94-9899-df13e4fd41fe tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.170795 Oct 03 11:43:24.407086 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3720/7772] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:24 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:25.429602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:25.430288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:25.437228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:25.437730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:25.438188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:25.438908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:25.439382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:25.439831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:25.573184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:25.582902 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2a5d26a9-bdf2-4ee1-90bc-fb425d04f96e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.157514 Oct 03 11:43:25.583547 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4053/7773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:25 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:26.606962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:26.607571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:26.614719 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:26.615200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:26.615650 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:26.616340 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:26.616822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:26.617254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:26.748182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:26.756498 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0d30d429-3065-49d5-abbc-cdb68258e63b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.153979 Oct 03 11:43:26.757113 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3721/7774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:26 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:27.779749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:27.780377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:27.782735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:27.783586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:27.789543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:27.790036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:27.790487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:27.791196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:27.791657 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:27.792095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:27.920462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:27.928687 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8578c375-1534-4665-94a3-84fab0b3bbf6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.152788 Oct 03 11:43:27.929291 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4054/7775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:27 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:28.952578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:28.953325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:28.955167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:28.961289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:28.962901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:28.962901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:28.963609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:28.964083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:28.964514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:29.101573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:29.109210 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fa760ddf-4209-4d4c-95be-660e3bcb3ddb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.160908 Oct 03 11:43:29.109785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3722/7776] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:28 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:30.133725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:30.134370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:30.141244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:30.141742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:30.142195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:30.142903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:30.143373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:30.143822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:30.271166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:30.278941 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-de4bb779-62f2-468e-a625-c1e2595e360e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.149191 Oct 03 11:43:30.279520 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4055/7777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:30 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:31.302410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:31.303880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:31.311710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:31.312204 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:31.312646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:31.313382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:31.313842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:31.314272 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:31.518753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:31.526507 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f6d8313e-2959-467c-b278-97d6e80be29e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.228090 Oct 03 11:43:31.527086 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3723/7778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:31 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:31.598325 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4437c9d7-b7d2-486a-a697-cc3cf5bf165e req-26ff939e-1b15-4cd9-bf0e-98a315d06cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312d205d-e2ed-4c43-9e2e-30dbb71cf325", "tag": "e29dead2-0131-4649-99c8-45332d5cbfd1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:31.610380 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4437c9d7-b7d2-486a-a697-cc3cf5bf165e req-26ff939e-1b15-4cd9-bf0e-98a315d06cf9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:31.612046 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4437c9d7-b7d2-486a-a697-cc3cf5bf165e req-26ff939e-1b15-4cd9-bf0e-98a315d06cf9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:31.612589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4437c9d7-b7d2-486a-a697-cc3cf5bf165e req-26ff939e-1b15-4cd9-bf0e-98a315d06cf9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:31.625180 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4437c9d7-b7d2-486a-a697-cc3cf5bf165e req-26ff939e-1b15-4cd9-bf0e-98a315d06cf9 service nova] Creating event network-changed:e29dead2-0131-4649-99c8-45332d5cbfd1 for instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 on n-h1-858383-3 Oct 03 11:43:31.630366 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4437c9d7-b7d2-486a-a697-cc3cf5bf165e req-26ff939e-1b15-4cd9-bf0e-98a315d06cf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036992 Oct 03 11:43:31.631338 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4056/7779] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:43:32.549261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:32.549886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:32.557560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:32.558049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:32.558508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:32.559184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:32.559640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:32.560068 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:32.829858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:32.838040 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94782183-9209-4782-81b1-51a2cfbbbd22 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.292686 Oct 03 11:43:32.838609 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3724/7780] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:32 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:33.861965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:33.862960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:33.871109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:33.871612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:33.872065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:33.872949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:33.873447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:33.873893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:34.006357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:34.014642 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-087bacb6-e238-40ca-bb7c-a6b0b372b27a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.156989 Oct 03 11:43:34.015215 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4057/7781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:33 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:35.037488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:35.038696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:35.045560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:35.046044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:35.046477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:35.047171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:35.047626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:35.048049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:35.180053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:35.188511 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72ff8c5f-97a0-4c03-9afb-2d4c4255b871 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.155036 Oct 03 11:43:35.189108 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3725/7782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:35 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:36.212844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:36.213445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:36.221050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:36.221559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:36.222060 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:36.222787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:36.223409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:36.223951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:36.419407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:36.427850 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c9f07a3a-e8e7-4592-9b67-b6cc14912284 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.219469 Oct 03 11:43:36.429239 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4058/7783] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:36 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:36.527194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-25aa1ae1-7796-4851-a3f8-b038fb359cb1 req-8c0417a4-34f0-49a3-a96f-3f918e56d021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312d205d-e2ed-4c43-9e2e-30dbb71cf325", "name": "network-vif-plugged", "status": "completed", "tag": "e29dead2-0131-4649-99c8-45332d5cbfd1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:36.538189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-25aa1ae1-7796-4851-a3f8-b038fb359cb1 req-8c0417a4-34f0-49a3-a96f-3f918e56d021 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:36.539469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-25aa1ae1-7796-4851-a3f8-b038fb359cb1 req-8c0417a4-34f0-49a3-a96f-3f918e56d021 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:36.539944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-25aa1ae1-7796-4851-a3f8-b038fb359cb1 req-8c0417a4-34f0-49a3-a96f-3f918e56d021 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:36.551561 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-25aa1ae1-7796-4851-a3f8-b038fb359cb1 req-8c0417a4-34f0-49a3-a96f-3f918e56d021 service nova] Creating event network-vif-plugged:e29dead2-0131-4649-99c8-45332d5cbfd1 for instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 on n-h1-858383-3 Oct 03 11:43:36.558182 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-25aa1ae1-7796-4851-a3f8-b038fb359cb1 req-8c0417a4-34f0-49a3-a96f-3f918e56d021 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034254 Oct 03 11:43:36.558797 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3726/7784] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:43:37.451393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:37.452030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:37.459245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:37.459750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:37.460205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:37.460969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:37.461445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:37.462438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:37.601734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:37.610041 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-943efab2-c8de-4d61-82f3-954b3ba3d4f7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1359 microversion: 2.1 time: 0.162614 Oct 03 11:43:37.610598 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4059/7785] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:37 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:38.633494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:38.634358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:38.642102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:38.642586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:38.643021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:38.643777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:38.644229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:38.644657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:38.778324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:38.785972 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4ce2bab3-12af-4987-bb7d-328caa1a035a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1549 microversion: 2.1 time: 0.156799 Oct 03 11:43:38.786538 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3727/7786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:38 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:38.808987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:38.809625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:38.816701 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:38.817238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:38.817696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:38.818415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:38.818891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:38.819339 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:38.959026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:38.966993 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-acc85d89-a51e-4823-bbf3-7cbbb98b32c7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1549 microversion: 2.1 time: 0.162086 Oct 03 11:43:38.967608 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4060/7787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:38 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:38.989014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:38.993669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:38.994437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Searching by: {'deleted': False, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb'} {{(pid=122270) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 11:43:39.000811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:39.001288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:39.001717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:39.002432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:39.002879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:39.003299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:39.028432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.multi_cell_list [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 11:43:39.055971 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d3a3fbb5-f294-448d-a6d3-6d0c9f3f06b3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070834 Oct 03 11:43:39.056553 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3728/7788] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 11:43:38 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:43:39.068958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:39.069581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:39.075619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:39.076112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:39.076561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:39.077292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:39.077757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:39.078193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:39.209140 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:39.217679 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28d6d621-e47a-49fa-862b-96c94d593bf4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1549 microversion: 2.1 time: 0.152670 Oct 03 11:43:39.218268 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4061/7789] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:39 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:40.962479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5778d20-b96d-47f7-984e-c7c5f4116032"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:40.965334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:40.972615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:40.973113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:40.973544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:40.974235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:40.974684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:40.975104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:41.230562 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aebbfd89-bc4a-4ef8-a86a-3e97707c3b78 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271831 Oct 03 11:43:41.231188 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3729/7790] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:43:40 2022] POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:43:55.353256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:55.354684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:55.358132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:55.358800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=70 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:55.365356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:55.365852 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:55.366300 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:55.367032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:55.367570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:55.368068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:55.505250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:55.513889 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1a20d478-a368-4708-ba72-b2946a37ebd0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1595 microversion: 2.1 time: 0.165444 Oct 03 11:43:55.514464 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4062/7791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:55 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1595 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:57.176536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:57.177708 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:57.178848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:43:57.254205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-671bc1cd-8aba-41fb-b8ab-c260704886f4 req-183fbd5b-db28-479d-ade9-9e2d1893a584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312d205d-e2ed-4c43-9e2e-30dbb71cf325", "tag": "e29dead2-0131-4649-99c8-45332d5cbfd1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:57.264174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-671bc1cd-8aba-41fb-b8ab-c260704886f4 req-183fbd5b-db28-479d-ade9-9e2d1893a584 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:57.264589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-671bc1cd-8aba-41fb-b8ab-c260704886f4 req-183fbd5b-db28-479d-ade9-9e2d1893a584 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:57.265061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-671bc1cd-8aba-41fb-b8ab-c260704886f4 req-183fbd5b-db28-479d-ade9-9e2d1893a584 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:57.277046 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-671bc1cd-8aba-41fb-b8ab-c260704886f4 req-183fbd5b-db28-479d-ade9-9e2d1893a584 service nova] Creating event network-changed:e29dead2-0131-4649-99c8-45332d5cbfd1 for instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 on n-h1-858383-3 Oct 03 11:43:57.282161 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-671bc1cd-8aba-41fb-b8ab-c260704886f4 req-183fbd5b-db28-479d-ade9-9e2d1893a584 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107392 Oct 03 11:43:57.283173 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3730/7792] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:43:58.203497 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1798668007"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:58.204076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:58.211201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:58.211716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:58.212189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:58.212948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:58.213423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:58.213869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:58.351240 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.network.security_group_api [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Adding security group 6cabd699-ec64-4e13-9939-2232d599eb01 to port e29dead2-0131-4649-99c8-45332d5cbfd1 Oct 03 11:43:58.976592 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3ba416cc-513e-452b-a2ed-61e6d6ce2b58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action" status: 202 len: 0 microversion: 2.1 time: 0.777041 Oct 03 11:43:58.977471 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4063/7793] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:43:58 2022] POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 11:43:58.986977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:43:58.987683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:43:58.994494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:58.995288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:58.995739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:58.997359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:58.997856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:58.998322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:59.166751 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:43:59.177314 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-127c9566-8305-48d9-9168-8d42a5a9b5b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1761 microversion: 2.1 time: 0.195197 Oct 03 11:43:59.177865 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3731/7794] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:43:58 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1761 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:43:59.299009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7b01665b-3e09-446e-8b80-38cbc11e5f37 req-597f569f-ae94-4b86-99c0-dbcace93eef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312d205d-e2ed-4c43-9e2e-30dbb71cf325", "tag": "e29dead2-0131-4649-99c8-45332d5cbfd1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:43:59.309750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7b01665b-3e09-446e-8b80-38cbc11e5f37 req-597f569f-ae94-4b86-99c0-dbcace93eef2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:43:59.310247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7b01665b-3e09-446e-8b80-38cbc11e5f37 req-597f569f-ae94-4b86-99c0-dbcace93eef2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:43:59.310698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7b01665b-3e09-446e-8b80-38cbc11e5f37 req-597f569f-ae94-4b86-99c0-dbcace93eef2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:43:59.324013 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7b01665b-3e09-446e-8b80-38cbc11e5f37 req-597f569f-ae94-4b86-99c0-dbcace93eef2 service nova] Creating event network-changed:e29dead2-0131-4649-99c8-45332d5cbfd1 for instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 on n-h1-858383-3 Oct 03 11:43:59.329414 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7b01665b-3e09-446e-8b80-38cbc11e5f37 req-597f569f-ae94-4b86-99c0-dbcace93eef2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035116 Oct 03 11:43:59.330033 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4064/7795] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:46:20.576232 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 11:46:20.577175 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 11:46:20.577905 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:46:20.579762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:46:20.580633 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:46:20.581073 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action (ip 10.222.0.27) !!! Oct 03 11:46:20.583838 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:46:20.583969 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action (ip 10.222.0.27) !!! Oct 03 11:46:20.595800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:46:20.598699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:46:20.613030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:20.613538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:20.613978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:20.614669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:20.615121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:20.615546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:20.686600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d0b9180f-b59c-43a7-850f-b8bd87556a06 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action" status: 202 len: 0 microversion: 2.1 time: 0.112920 Oct 03 11:46:20.690414 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3732/7796] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:46:20 2022] POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:46:20.694520 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:46:20.695348 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:46:20.695927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:46:20.696681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:46:20.698244 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:46:20.698369 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 (ip 10.222.0.27) !!! Oct 03 11:46:20.700147 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:46:20.700283 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 (ip 10.222.0.27) !!! Oct 03 11:46:20.718958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:46:20.719692 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:46:20.726635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:20.727130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:20.727581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:20.728287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:20.728757 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:20.729313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:20.877358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:46:20.888641 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df172eb6-1981-453b-8ad0-6ff290df2afd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1763 microversion: 2.1 time: 0.195836 Oct 03 11:46:20.889537 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4065/7797] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:46:20 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1763 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:46:21.915565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:46:21.916175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:46:21.927858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:21.928364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:21.928878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:21.929590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:21.930095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:21.930863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:21.933892 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50008. Oct 03 11:46:21.941004 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50006. Oct 03 11:46:22.091236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:46:22.099418 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-372671eb-582e-48b9-ad9f-7a7164b9aab0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1768 microversion: 2.1 time: 0.190119 Oct 03 11:46:22.099988 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3733/7798] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:46:21 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1768 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:46:23.123317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:46:23.123944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:46:23.133094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:23.133586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:23.134033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:23.134734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:46:23.135195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:46:23.135629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:46:23.143367 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50012. Oct 03 11:46:23.154185 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50014. Oct 03 11:46:23.289537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:46:23.297666 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-430bab41-8edb-4b32-a854-b7eb9e64348a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1761 microversion: 2.1 time: 0.178246 Oct 03 11:46:23.298460 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4066/7799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:46:23 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1761 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:48:07.277907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:07.280581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:07.334861 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1798668007"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:07.335411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:07.341570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:07.342058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:07.342498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:07.343191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:07.343651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:07.344086 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:07.475009 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.network.security_group_api [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Removing security group 6cabd699-ec64-4e13-9939-2232d599eb01 from port e29dead2-0131-4649-99c8-45332d5cbfd1 Oct 03 11:48:07.792476 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bf29c2b4-83db-4388-8e65-2afafd29abb4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action" status: 202 len: 0 microversion: 2.1 time: 0.516598 Oct 03 11:48:07.793144 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3734/7800] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:48:07 2022] POST /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:48:07.800125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:07.800918 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:07.801977 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:48:07.802117 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 11:48:07.876097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-592a63bc-14f5-468b-9393-0225eb849bc9 req-2675c93e-6488-485b-9db1-a5128dcfc06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312d205d-e2ed-4c43-9e2e-30dbb71cf325", "tag": "e29dead2-0131-4649-99c8-45332d5cbfd1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:07.889718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-592a63bc-14f5-468b-9393-0225eb849bc9 req-2675c93e-6488-485b-9db1-a5128dcfc06f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:07.891224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-592a63bc-14f5-468b-9393-0225eb849bc9 req-2675c93e-6488-485b-9db1-a5128dcfc06f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:07.891614 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-592a63bc-14f5-468b-9393-0225eb849bc9 req-2675c93e-6488-485b-9db1-a5128dcfc06f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:07.912307 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-592a63bc-14f5-468b-9393-0225eb849bc9 req-2675c93e-6488-485b-9db1-a5128dcfc06f service nova] Creating event network-changed:e29dead2-0131-4649-99c8-45332d5cbfd1 for instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 on n-h1-858383-3 Oct 03 11:48:07.929757 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-592a63bc-14f5-468b-9393-0225eb849bc9 req-2675c93e-6488-485b-9db1-a5128dcfc06f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131243 Oct 03 11:48:07.930641 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4067/7801] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:08.965642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-04de2077-c9d2-48f3-93ab-82469aa163cb req-8840a454-8fba-443a-9184-f804dd8e6f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312d205d-e2ed-4c43-9e2e-30dbb71cf325", "tag": "e29dead2-0131-4649-99c8-45332d5cbfd1"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:08.976519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-04de2077-c9d2-48f3-93ab-82469aa163cb req-8840a454-8fba-443a-9184-f804dd8e6f4e service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:08.977143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-04de2077-c9d2-48f3-93ab-82469aa163cb req-8840a454-8fba-443a-9184-f804dd8e6f4e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:08.977679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-04de2077-c9d2-48f3-93ab-82469aa163cb req-8840a454-8fba-443a-9184-f804dd8e6f4e service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:08.991700 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-04de2077-c9d2-48f3-93ab-82469aa163cb req-8840a454-8fba-443a-9184-f804dd8e6f4e service nova] Creating event network-changed:e29dead2-0131-4649-99c8-45332d5cbfd1 for instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 on n-h1-858383-3 Oct 03 11:48:08.997447 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-04de2077-c9d2-48f3-93ab-82469aa163cb req-8840a454-8fba-443a-9184-f804dd8e6f4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036507 Oct 03 11:48:08.998264 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3735/7802] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:09.020648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:09.021511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:09.029964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:09.030523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:09.031045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:09.031960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:09.032499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:09.033033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:09.123367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lazy-loading 'services' on Instance uuid 312d205d-e2ed-4c43-9e2e-30dbb71cf325 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:48:09.206060 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-95187e42-b11c-485c-b6a3-db6d78234127 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments/d5778d20-b96d-47f7-984e-c7c5f4116032" status: 202 len: 0 microversion: 2.1 time: 0.189487 Oct 03 11:48:09.206886 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4068/7803] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:48:09 2022] DELETE /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments/d5778d20-b96d-47f7-984e-c7c5f4116032 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:48:09.216636 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:09.219299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:09.226734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:09.227285 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:09.227720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:09.228624 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:09.229250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:09.229832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:09.264325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71878590-a5e5-4cab-92c2-2d268a9ce888 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052776 Oct 03 11:48:09.264958 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3736/7804] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:48:09 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:10.279315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:10.281858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:10.288341 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:10.288865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:10.289318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:10.290021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:10.290482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:10.290916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:10.323058 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e5323796-4b3a-4c23-9fb0-3886227430b1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048907 Oct 03 11:48:10.323647 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4069/7805] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:48:10 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:11.336423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:11.338675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:11.345847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:11.346335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:11.346773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:11.347511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:11.347959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:11.348383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:11.382936 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0856feaf-68fe-49e4-96fe-9b5854fc3d88 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051132 Oct 03 11:48:11.383537 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3737/7806] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:48:11 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:12.396465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:12.398714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:12.405704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:12.406205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:12.406659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:12.407394 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:12.407868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:12.408307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:12.438471 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d1752db-36d1-4c0e-aaba-0b59d8b47df1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046561 Oct 03 11:48:12.439043 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4070/7807] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:48:12 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:48:13.450702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:13.452906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:13.460009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:13.460504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:13.460980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:13.461688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:13.462147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:13.462576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:13.500688 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2603e240-fff8-4723-a87e-447e96cce735 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054113 Oct 03 11:48:13.501528 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3738/7808] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:48:13 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:14.514030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:14.516574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:14.524101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:14.524597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:14.525079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:14.525796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:14.526262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:14.526704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:14.556056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b091564e-6f05-4f20-b708-b90112259f47 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046498 Oct 03 11:48:14.556623 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4071/7809] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:48:14 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 11:48:14.567474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:14.568017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:14.574983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:14.575471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:14.575908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:14.576612 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:14.577089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:14.577519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:14.655658 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] HTTP exception thrown: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 is not attached to volume d5778d20-b96d-47f7-984e-c7c5f4116032 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Request method failure captured: Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments/d5778d20-b96d-47f7-984e-c7c5f4116032 HTTP/1.1 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsrFOCQVftChjB83PNDjPbnEwWukskM4RpNA03wcWSE734op9l-T3esX8g3palk9jKkHMkf4JHfx56H-DjHwB20LxeKR6MmKVenOhVHdnCB35AMMV_ZUiH1XlIWYYHb1yk2fJBZuoTEgEytex0-vV0T-P1evIIelktm-sjJnYISq44E Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}] Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 07954b6cb06740e88a591f8e196a88eb Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 is not attached to volume d5778d20-b96d-47f7-984e-c7c5f4116032 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': '312d205d-e2ed-4c43-9e2e-30dbb71cf325', 'id': 'd5778d20-b96d-47f7-984e-c7c5f4116032'} Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d5778d20-b96d-47f7-984e-c7c5f4116032. Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 is not attached to volume d5778d20-b96d-47f7-984e-c7c5f4116032 Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:48:14.657322 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:48:14.662509 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:48:14.662509 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:48:14.662509 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 is not attached to volume d5778d20-b96d-47f7-984e-c7c5f4116032 Oct 03 11:48:14.662509 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:14.662509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Returning 404 to user: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 is not attached to volume d5778d20-b96d-47f7-984e-c7c5f4116032 {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:48:14.662509 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3afd86bd-4ba2-4425-a6cc-db88cc63f800 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments/d5778d20-b96d-47f7-984e-c7c5f4116032" status: 404 len: 154 microversion: 2.1 time: 0.095393 Oct 03 11:48:14.662509 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3739/7810] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:48:14 2022] DELETE /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325/os-volume_attachments/d5778d20-b96d-47f7-984e-c7c5f4116032 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:48:17.920689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:17.921259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:17.928683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:17.929205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:17.929972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:17.930724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:17.931137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:17.931579 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:17.960359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:48:18.050271 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-485fa59d-a4bc-4b81-97c2-dfa3210aa673 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 204 len: 0 microversion: 2.1 time: 0.133620 Oct 03 11:48:18.051148 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4072/7811] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:48:17 2022] DELETE /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:48:18.059657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:18.060273 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:18.072179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:18.073147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:18.073590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:18.074540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:18.074948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:18.075706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:18.216828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:18.224808 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-025cf84f-3a1c-4ff3-b513-b36786ca0e6a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1555 microversion: 2.1 time: 0.169080 Oct 03 11:48:18.225386 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3740/7812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:18 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:19.249234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:19.249957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:19.257698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:19.258195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:19.258650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:19.259359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:19.259827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:19.260270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:19.389796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:19.398104 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-94d01ed4-982f-4cab-b2e4-48fbc82b6a58 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1555 microversion: 2.1 time: 0.153232 Oct 03 11:48:19.398687 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4073/7813] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:19 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:20.421745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:20.422405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:20.430199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:20.430715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:20.431157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:20.431856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:20.432318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:20.432747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:20.638772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:20.648755 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b2f48bd9-09b0-4264-a794-0497e1cf0a0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 200 len: 1555 microversion: 2.1 time: 0.230391 Oct 03 11:48:20.649706 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3741/7814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:20 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:20.691777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-299e39a1-f82f-4bae-ab4e-58b70534b946 req-4ad483b2-4e1a-4700-b9fe-213681a161d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312d205d-e2ed-4c43-9e2e-30dbb71cf325", "name": "network-vif-deleted", "tag": "e29dead2-0131-4649-99c8-45332d5cbfd1"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:20.703080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-299e39a1-f82f-4bae-ab4e-58b70534b946 req-4ad483b2-4e1a-4700-b9fe-213681a161d0 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:20.703575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-299e39a1-f82f-4bae-ab4e-58b70534b946 req-4ad483b2-4e1a-4700-b9fe-213681a161d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:20.704024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-299e39a1-f82f-4bae-ab4e-58b70534b946 req-4ad483b2-4e1a-4700-b9fe-213681a161d0 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:20.715738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-299e39a1-f82f-4bae-ab4e-58b70534b946 req-4ad483b2-4e1a-4700-b9fe-213681a161d0 service nova] Creating event network-vif-deleted:e29dead2-0131-4649-99c8-45332d5cbfd1 for instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 on n-h1-858383-3 Oct 03 11:48:20.720902 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-299e39a1-f82f-4bae-ab4e-58b70534b946 req-4ad483b2-4e1a-4700-b9fe-213681a161d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032841 Oct 03 11:48:20.721532 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4074/7815] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:21.673843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:21.674363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 312d205d-e2ed-4c43-9e2e-30dbb71cf325] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:21.683378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:21.683878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:21.684652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:21.685694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:21.686161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:21.686595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:21.700995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] HTTP exception thrown: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 could not be found. Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Request method failure captured: Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 HTTP/1.1 Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsrFOCQVftChjB83PNDjPbnEwWukskM4RpNA03wcWSE734op9l-T3esX8g3palk9jKkHMkf4JHfx56H-DjHwB20LxeKR6MmKVenOhVHdnCB35AMMV_ZUiH1XlIWYYHb1yk2fJBZuoTEgEytex0-vV0T-P1evIIelktm-sjJnYISq44E Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}] Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 07954b6cb06740e88a591f8e196a88eb Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 could not be found. Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '312d205d-e2ed-4c43-9e2e-30dbb71cf325'} Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 could not be found. Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 could not be found. Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:48:21.702924 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 could not be found. Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Returning 404 to user: Instance 312d205d-e2ed-4c43-9e2e-30dbb71cf325 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-10a63c67-c261-4f9a-94f8-9647afd9da61 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325" status: 404 len: 111 microversion: 2.1 time: 0.034515 Oct 03 11:48:21.707113 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3742/7816] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:21 2022] GET /compute/v2.1/servers/312d205d-e2ed-4c43-9e2e-30dbb71cf325 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:48:21.715166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fff18915-df0c-4e68-9abf-7c5a451d7202 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '.version_select at 0x7f074f1e7430>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:21.738796 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fff18915-df0c-4e68-9abf-7c5a451d7202 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1521547484" status: 202 len: 0 microversion: 2.1 time: 0.028547 Oct 03 11:48:21.739429 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4075/7817] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 11:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1521547484 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:48:31.022119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd327d32-73b1-41f3-8d94-70b589558794 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'create', calling method: .version_select at 0x7f07573e3430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1914633277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaRlJSxPcUfNaWCfLVwMkiwPeb5q6MAx7G+Dmb5nDwO9zGyz+H7K1sGEaVkFePFhoaZET2DUQAz+xeWyx75lebL0r3NJ2UxwFQhv7qJq5zKulmgq4XSO+4sWIX4uUbRrQ=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:31.037791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fd327d32-73b1-41f3-8d94-70b589558794 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:48:31.042890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-fd327d32-73b1-41f3-8d94-70b589558794 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for user 07954b6cb06740e88a591f8e196a88eb and project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:48:31.070924 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd327d32-73b1-41f3-8d94-70b589558794 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052732 Oct 03 11:48:31.071519 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3743/7818] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:48:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:31.120145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:31.124326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1027539085", "imageRef": "d15e560e-6110-41b0-bbc3-08cecd2ae5e6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1914633277", "networks": [{"uuid": "24a0f8d6-e5ea-4074-8e36-74731a0d6454"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:31.177257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] validate_networks() for [('24a0f8d6-e5ea-4074-8e36-74731a0d6454', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:48:31.606387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:48:31.606834 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:48:31.607327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:48:31.607754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:48:31.608184 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:48:31.617119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:31.617619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:31.618073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:31.618822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:31.619316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:31.619764 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:31.641029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:48:31.646830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Getting quotas for user 07954b6cb06740e88a591f8e196a88eb and project b27d5a0ecefb4dc19fe42d2d92fb17cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:48:31.659877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:48:31.662213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d15e560e-6110-41b0-bbc3-08cecd2ae5e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:48:31.709747 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-84bde126-b1aa-40f1-b5c9-96cff2509223 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591416 Oct 03 11:48:31.710415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4076/7819] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:48:31.718393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=44 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:31.722542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d5012faf-3f7c-4e07-b472-834d597b820b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:31.723188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d5012faf-3f7c-4e07-b472-834d597b820b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:31.781417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d5012faf-3f7c-4e07-b472-834d597b820b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:31.790231 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d5012faf-3f7c-4e07-b472-834d597b820b tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1259 microversion: 2.1 time: 0.072644 Oct 03 11:48:31.790789 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3744/7820] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:31 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:32.813292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-96004e7e-fe1a-4ce4-8ce2-8d4379feda1a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:32.813974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-96004e7e-fe1a-4ce4-8ce2-8d4379feda1a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:32.868244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-96004e7e-fe1a-4ce4-8ce2-8d4379feda1a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:32.875201 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-96004e7e-fe1a-4ce4-8ce2-8d4379feda1a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1259 microversion: 2.1 time: 0.066699 Oct 03 11:48:32.875769 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4077/7821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:32 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:33.897896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a4f2165-6361-420e-a93c-d1524a643db1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:33.898593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a4f2165-6361-420e-a93c-d1524a643db1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:34.023784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a4f2165-6361-420e-a93c-d1524a643db1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:34.031240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a4f2165-6361-420e-a93c-d1524a643db1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1259 microversion: 2.1 time: 0.137275 Oct 03 11:48:34.031815 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3745/7822] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:33 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:35.055477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d4f49d6e-20c3-4b12-b721-a96f5d74e020 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:35.056142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d4f49d6e-20c3-4b12-b721-a96f5d74e020 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:35.112446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d4f49d6e-20c3-4b12-b721-a96f5d74e020 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:35.119423 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d4f49d6e-20c3-4b12-b721-a96f5d74e020 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1259 microversion: 2.1 time: 0.068047 Oct 03 11:48:35.119999 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4078/7823] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:35 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:36.143350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:36.144045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:36.152588 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:36.153124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:36.153568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:36.154274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:36.154735 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:36.155165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:36.219332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:36.230927 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4f1b0a88-1793-495f-a2c9-2bb91074db39 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1263 microversion: 2.1 time: 0.091537 Oct 03 11:48:36.231514 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3746/7824] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:36 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:37.255572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:37.257297 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:37.266207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:37.267120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:37.267766 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:37.268675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:37.269900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:37.270538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:37.489268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:37.501896 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ac3ed434-f264-4c24-bd29-b1624f2ea8b4 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1317 microversion: 2.1 time: 0.250638 Oct 03 11:48:37.502776 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4079/7825] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:37 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:38.531117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:38.532590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:38.540408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:38.542734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:38.543382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:38.543900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:38.544695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:38.545252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:38.545762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:38.704604 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:38.712627 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3623f0d0-6d2b-4ad7-b397-1bdeb25bd28e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.185591 Oct 03 11:48:38.713225 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3747/7826] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:38 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:39.735661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:39.736288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:39.739182 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:39.744639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:39.745280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:39.745729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:39.746481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:39.746950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:39.747407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:39.904229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:39.912271 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e9f3c60-3924-454f-87f2-4b4eb2183944 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.180464 Oct 03 11:48:39.912892 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4080/7827] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:39 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:40.936794 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:40.937364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:40.944299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:40.944808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:40.945256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:40.945959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:40.946416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:40.946848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:41.097242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:41.106369 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea73bb8c-0f75-42f6-8009-c249e819defb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.173639 Oct 03 11:48:41.106957 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3748/7828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:40 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:42.130644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:42.132368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:42.139428 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:42.143608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:42.144693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:42.145321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:42.146119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:42.146668 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:42.147181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:42.298109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:42.306673 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6532c22e-1768-4296-adbd-0ff2a2104a9c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.180872 Oct 03 11:48:42.317121 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4081/7829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:42 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:43.333740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:43.335582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:43.346216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:43.346822 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:43.347344 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:43.348706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:43.349256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:43.349755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:43.511973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:43.520360 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c571e5da-1124-4de5-8225-63081c90f8f3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.192793 Oct 03 11:48:43.521269 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3749/7830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:43 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:44.544411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:44.545160 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:44.552124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:44.552627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:44.553111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:44.553822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:44.554292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:44.554993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:44.685308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:44.693075 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-38bc3b0d-bb58-4062-9e9d-63ecf38b51d1 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.152658 Oct 03 11:48:44.693654 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4082/7831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:44 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:45.716255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:45.716930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:45.718797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:45.725490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:45.725911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:45.726346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:45.727035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:45.727484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:45.727906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:45.853999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:45.861658 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1ce82722-6b8a-45ed-a7eb-f850a1682722 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.149257 Oct 03 11:48:45.862234 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3750/7832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:45 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:46.885487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:46.886097 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:46.887962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:48:46.894534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:46.895038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:46.895495 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:46.896213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:46.896686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:46.897155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:47.031319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:47.039868 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7996b274-3334-46a8-b2a5-2ce94d2ddbe8 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.158285 Oct 03 11:48:47.040456 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4083/7833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:46 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:47.804210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-02d714f6-623e-4eab-a534-07d86b525524 req-93b8c3cf-693c-46d7-9499-3fa4d19893fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a1b42a-8814-4dca-a50a-b285bea8f750", "tag": "815a20eb-5d50-4f07-b8af-5e343e7ab703"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:47.815124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-02d714f6-623e-4eab-a534-07d86b525524 req-93b8c3cf-693c-46d7-9499-3fa4d19893fc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:47.815608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-02d714f6-623e-4eab-a534-07d86b525524 req-93b8c3cf-693c-46d7-9499-3fa4d19893fc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:47.816646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-02d714f6-623e-4eab-a534-07d86b525524 req-93b8c3cf-693c-46d7-9499-3fa4d19893fc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:47.828423 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-02d714f6-623e-4eab-a534-07d86b525524 req-93b8c3cf-693c-46d7-9499-3fa4d19893fc service nova] Creating event network-changed:815a20eb-5d50-4f07-b8af-5e343e7ab703 for instance 87a1b42a-8814-4dca-a50a-b285bea8f750 on n-h1-858383-3 Oct 03 11:48:47.834226 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-02d714f6-623e-4eab-a534-07d86b525524 req-93b8c3cf-693c-46d7-9499-3fa4d19893fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033752 Oct 03 11:48:47.834825 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3751/7834] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:48:48.063700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:48.064347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:48.071732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:48.072229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:48.072677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:48.073420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:48.073888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:48.074324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:48.219504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:48.228314 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca69d0fb-6ba9-4ec9-9c0d-3c56bccd7ad3 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.168564 Oct 03 11:48:48.228990 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4084/7835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:48 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:49.252507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:49.253250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:49.261147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:49.261631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:49.262073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:49.262772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:49.263232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:49.263660 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:49.393377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:49.400951 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f57247c1-d2d9-4ca1-b464-df6e29176607 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.152664 Oct 03 11:48:49.401517 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3752/7836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:49 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:50.424112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:50.424746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:50.434647 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:50.435155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:50.435618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:50.436348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:50.436853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:50.437304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:50.579750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:50.587723 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-37d5287d-5e5f-40d6-923e-a0c6fe893265 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.167503 Oct 03 11:48:50.588316 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4085/7837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:50 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:51.612360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:51.613006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:51.619877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:51.620366 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:51.620843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:51.621544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:51.622005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:51.622435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:51.754967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:51.762800 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-49a9601f-8eac-43cf-9e43-d595a6ced089 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.154296 Oct 03 11:48:51.763363 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3753/7838] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:51 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:52.787143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:52.787759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:52.795020 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:52.795643 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:52.796124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:52.796915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:52.797501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:52.797928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:52.931482 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:52.939318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a3add4fb-5004-403f-9e62-f65888dbfc32 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.156698 Oct 03 11:48:52.939905 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4086/7839] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:52 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:53.963107 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:53.963867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:53.970012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:53.970494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:53.970938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:53.971637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:53.972100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:53.973066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:54.112678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:54.121403 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-450454fa-f1b9-4c9d-bf86-2ffc471015bb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.162469 Oct 03 11:48:54.121988 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3754/7840] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:53 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:54.262089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e15e9809-2c6a-4589-ae30-404aff1a383b req-1450ae69-1645-48c7-b22b-6c96f16d808d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a1b42a-8814-4dca-a50a-b285bea8f750", "name": "network-vif-plugged", "status": "completed", "tag": "815a20eb-5d50-4f07-b8af-5e343e7ab703"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:54.273425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e15e9809-2c6a-4589-ae30-404aff1a383b req-1450ae69-1645-48c7-b22b-6c96f16d808d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:54.273932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e15e9809-2c6a-4589-ae30-404aff1a383b req-1450ae69-1645-48c7-b22b-6c96f16d808d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:54.274370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e15e9809-2c6a-4589-ae30-404aff1a383b req-1450ae69-1645-48c7-b22b-6c96f16d808d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:54.286989 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e15e9809-2c6a-4589-ae30-404aff1a383b req-1450ae69-1645-48c7-b22b-6c96f16d808d service nova] Creating event network-vif-plugged:815a20eb-5d50-4f07-b8af-5e343e7ab703 for instance 87a1b42a-8814-4dca-a50a-b285bea8f750 on n-h1-858383-3 Oct 03 11:48:54.292575 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e15e9809-2c6a-4589-ae30-404aff1a383b req-1450ae69-1645-48c7-b22b-6c96f16d808d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088933 Oct 03 11:48:54.293245 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4087/7841] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:55.143623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:55.144881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:55.151902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:55.152383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:55.152843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:55.153538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:55.153993 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:55.154416 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:55.286525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:55.294303 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-416a799a-69c0-4848-ba24-5f09cae49567 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1359 microversion: 2.1 time: 0.154586 Oct 03 11:48:55.294861 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3755/7842] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:55 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:56.319736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:56.320455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:56.327806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.328309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.328783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.329501 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.329970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.330412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.466154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:56.474098 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-619129f2-b602-42c6-85bb-6148342dfd7c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1550 microversion: 2.1 time: 0.160221 Oct 03 11:48:56.474667 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4088/7843] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:56 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:56.496666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:56.497315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:56.504704 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.505231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.505679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.506376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.506836 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.507268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.639407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:56.647162 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c08e291f-e800-4969-a8cb-444dbdd91b0e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1550 microversion: 2.1 time: 0.154336 Oct 03 11:48:56.647737 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3756/7844] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:56 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:56.668656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:56.673546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:56.674328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Searching by: {'deleted': False, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb'} {{(pid=122269) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 11:48:56.680418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.680957 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.681407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.682143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.682617 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.683050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.708091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.multi_cell_list [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122269) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 11:48:56.734511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f1c0425-1df9-4bcf-9072-d0e3b0ae843f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069747 Oct 03 11:48:56.735099 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4089/7845] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Oct 3 11:48:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:48:56.747402 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:48:56.748012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:56.754179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.755168 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.755616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.756305 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:56.756759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:56.757215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:56.887839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:48:56.895578 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0d3c3145-cff9-416e-9b7e-7b2666659f41 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1550 microversion: 2.1 time: 0.152108 Oct 03 11:48:56.896146 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3757/7846] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:48:56 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:48:58.416094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5ef4679-3ca3-4d97-a17e-8583a517b596"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:48:58.418513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:48:58.425533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:58.426659 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:58.427113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:58.427818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:48:58.428283 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:48:58.428722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:48:58.691089 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e5ca1433-dd8a-4354-863d-caa8cc1a07a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278790 Oct 03 11:48:58.691741 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4090/7847] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Oct 3 11:48:58 2022] POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:49:10.644333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:49:10.646065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:49:10.650843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=21 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:49:10.651686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=68 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:49:10.658228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:10.658695 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:10.659133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:10.659828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:10.660279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:10.660700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:10.793314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:49:10.801554 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-671957ca-17fc-40ce-af4c-28bb9fbf6de2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1596 microversion: 2.1 time: 0.162285 Oct 03 11:49:10.802135 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3758/7848] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:49:10 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1596 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:49:12.666599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-6bc85682-919f-46ca-8804-d51bd4f135f4 req-087fbcab-7418-465d-99f0-f511e2b5e175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a1b42a-8814-4dca-a50a-b285bea8f750", "tag": "815a20eb-5d50-4f07-b8af-5e343e7ab703"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:49:12.674059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:49:12.675100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=21 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:49:12.675920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:49:12.681813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6bc85682-919f-46ca-8804-d51bd4f135f4 req-087fbcab-7418-465d-99f0-f511e2b5e175 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:12.682612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6bc85682-919f-46ca-8804-d51bd4f135f4 req-087fbcab-7418-465d-99f0-f511e2b5e175 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:12.683307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-6bc85682-919f-46ca-8804-d51bd4f135f4 req-087fbcab-7418-465d-99f0-f511e2b5e175 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:12.697040 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-6bc85682-919f-46ca-8804-d51bd4f135f4 req-087fbcab-7418-465d-99f0-f511e2b5e175 service nova] Creating event network-changed:815a20eb-5d50-4f07-b8af-5e343e7ab703 for instance 87a1b42a-8814-4dca-a50a-b285bea8f750 on n-h1-858383-3 Oct 03 11:49:12.702232 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-6bc85682-919f-46ca-8804-d51bd4f135f4 req-087fbcab-7418-465d-99f0-f511e2b5e175 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040569 Oct 03 11:49:12.702844 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4091/7849] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:49:13.725151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1038791491"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:49:13.725790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:49:13.733303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:13.733847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:13.734198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:13.735119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:13.735598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:13.736033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:13.871230 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.network.security_group_api [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Adding security group 3aad60cc-c7c0-48cd-a38a-87dfb970664e to port 815a20eb-5d50-4f07-b8af-5e343e7ab703 Oct 03 11:49:14.193818 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e86875a5-487b-454a-a0b7-5e58dcfe3628 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/action" status: 202 len: 0 microversion: 2.1 time: 0.472871 Oct 03 11:49:14.194471 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3759/7850] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:49:13 2022] POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:49:14.212545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:49:14.214279 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:49:14.222739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:14.223277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:14.223733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:14.224513 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:14.225386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:14.225883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:14.390086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:49:14.400318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f965a32-c522-4cc0-ade7-48caf894ea2c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1761 microversion: 2.1 time: 0.201155 Oct 03 11:49:14.416839 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4092/7851] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:49:14 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1761 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:49:14.717150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-51ca1a9f-35a7-4b21-9534-b747186758bd req-e9ef6dd7-3cc2-4a71-8f5c-79cb7c868e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a1b42a-8814-4dca-a50a-b285bea8f750", "tag": "815a20eb-5d50-4f07-b8af-5e343e7ab703"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:49:14.727447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-51ca1a9f-35a7-4b21-9534-b747186758bd req-e9ef6dd7-3cc2-4a71-8f5c-79cb7c868e70 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:49:14.728109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-51ca1a9f-35a7-4b21-9534-b747186758bd req-e9ef6dd7-3cc2-4a71-8f5c-79cb7c868e70 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:49:14.728345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-51ca1a9f-35a7-4b21-9534-b747186758bd req-e9ef6dd7-3cc2-4a71-8f5c-79cb7c868e70 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:49:14.740861 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-51ca1a9f-35a7-4b21-9534-b747186758bd req-e9ef6dd7-3cc2-4a71-8f5c-79cb7c868e70 service nova] Creating event network-changed:815a20eb-5d50-4f07-b8af-5e343e7ab703 for instance 87a1b42a-8814-4dca-a50a-b285bea8f750 on n-h1-858383-3 Oct 03 11:49:14.746418 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-51ca1a9f-35a7-4b21-9534-b747186758bd req-e9ef6dd7-3cc2-4a71-8f5c-79cb7c868e70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032891 Oct 03 11:49:14.747294 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3760/7852] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:50:11.908373 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:50:11.910674 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:11.912751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:50:11.914129 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:50:11.921002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:11.921492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:11.921941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:11.922653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:11.923120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:11.923553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:11.999503 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-13074cd9-509e-4152-94cf-7995e5a8eac9 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/action" status: 202 len: 0 microversion: 2.1 time: 0.095303 Oct 03 11:50:12.000187 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4093/7853] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:50:11 2022] POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:50:12.012646 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:50:12.013608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:50:12.014406 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:50:12.014610 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 (ip 10.222.0.27) !!! Oct 03 11:50:12.019984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:12.020694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:12.030150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:12.030640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:12.031087 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:12.031789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:12.032253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:12.032682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:12.267703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:12.277403 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6e3f767b-f42d-4b98-8c29-041bd2413b83 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1753 microversion: 2.1 time: 0.271295 Oct 03 11:50:12.278189 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3761/7854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:12 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1753 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:13.302330 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:13.303041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:13.310623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:13.311089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:13.311542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:13.312251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:13.312720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:13.313188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:13.462080 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:13.470575 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4a2abd09-1940-4535-a926-f7d1d2f06962 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.172518 Oct 03 11:50:13.471156 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4094/7855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:13 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:14.494607 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:14.495224 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:14.502583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:14.503072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:14.503513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:14.504211 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:14.504701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:14.505153 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:14.652106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:14.660253 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e2011224-3a7c-4e9a-b852-93ad660469fb tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.170221 Oct 03 11:50:14.660834 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3762/7856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:14 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:15.684334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:15.684982 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:15.692024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:15.692526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:15.693006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:15.693713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:15.694180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:15.694630 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:15.839696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:15.848274 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-46f17aae-4417-4bb8-92ea-ce7b86e51a1d tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.167860 Oct 03 11:50:15.848870 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4095/7857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:15 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:16.872831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:16.873396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:16.880437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:16.880961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:16.881407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:16.882114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:16.882571 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:16.883547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:17.033739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:17.041960 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fbf05fd4-76b1-46fe-8166-302c3359fbdd tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.173159 Oct 03 11:50:17.042541 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3763/7858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:16 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:18.066054 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:18.066683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:18.074277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:18.074777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:18.075233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:18.075942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:18.076412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:18.076891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:18.228003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:18.236353 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9d782175-79d7-498e-9110-bc6f88688805 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.174220 Oct 03 11:50:18.236980 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4096/7859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:18 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:19.260103 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:19.260810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:19.268195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:19.268683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:19.269182 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:19.269857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:19.270313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:19.270739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:19.418033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:19.426753 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43fdca85-1015-43c2-adb7-c9cbca28e1a7 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.171157 Oct 03 11:50:19.427356 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3764/7860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:19 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:20.451188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:20.451848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:20.459137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:20.459641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:20.460093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:20.461465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:20.461938 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:20.462385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:20.611138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:20.621518 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3d0614c-900a-4595-a5f6-65ac7fb5a6ea tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.174251 Oct 03 11:50:20.622419 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4097/7861] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:20 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:21.646740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:21.647382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:21.654374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:21.654792 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:21.655230 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:21.655918 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:21.656370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:21.656887 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:21.815499 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:21.824007 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dcf6b63c-3c15-492f-b1d5-f691a8f0b498 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.181196 Oct 03 11:50:21.824590 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3765/7862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:21 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:22.847793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:22.848347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:22.855901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:22.856399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:22.856981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:22.858050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:22.858865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:22.859429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:23.008550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:23.016936 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a5001c74-5c52-4a8b-9a19-639a1b456c54 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.173251 Oct 03 11:50:23.017530 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4098/7863] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:22 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:24.042519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:24.043175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:24.049692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:24.050178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:24.050610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:24.051310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:24.051760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:24.052187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:24.202278 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:24.211139 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ac6b9c2a-c784-40f2-80f6-2ed87f743d0f tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.174090 Oct 03 11:50:24.211722 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3766/7864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:24 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:25.244366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:25.245832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:25.253360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:25.253983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:25.254504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:25.255372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:25.255850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:25.256376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:25.418793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:25.427348 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-198d1f49-c8c0-4a25-883b-4add5d6792f2 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.188465 Oct 03 11:50:25.428000 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4099/7865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:25 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:26.452119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:26.452941 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:26.459788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:26.460294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:26.460722 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:26.461451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:26.461917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:26.462339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:26.618122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:26.627343 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e77a28e4-d8ef-4aa0-8664-e7532ac5ef1c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.179704 Oct 03 11:50:26.627925 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3767/7866] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:26 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:27.652695 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:27.653358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:27.660284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:27.660796 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:27.661277 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:27.661990 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:27.662458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:27.662899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:27.815122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:27.824855 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66222e38-b3af-451d-91f6-073fe4aeb780 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1758 microversion: 2.1 time: 0.177033 Oct 03 11:50:27.825436 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4100/7867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:27 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:50:28.850336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:50:28.850925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:50:28.857819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:28.858306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:28.858746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:28.859440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:50:28.859894 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:50:28.860324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:50:29.019841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:50:29.028549 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1af6122-7201-4d81-876c-b685c99a6886 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1761 microversion: 2.1 time: 0.182204 Oct 03 11:50:29.029162 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3768/7868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:50:28 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1761 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:51:32.370390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=16 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:51:32.371174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:51:32.375894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1038791491"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:51:32.376464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:32.385253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:32.389181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:32.389181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:32.389181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:32.389181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:32.389181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:32.524304 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.network.security_group_api [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Removing security group 3aad60cc-c7c0-48cd-a38a-87dfb970664e from port 815a20eb-5d50-4f07-b8af-5e343e7ab703 Oct 03 11:51:32.835436 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-825b85ca-7231-4f58-bb80-0b1fe9f75146 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/action" status: 202 len: 0 microversion: 2.1 time: 0.467029 Oct 03 11:51:32.836060 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4101/7869] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:51:32 2022] POST /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:51:32.846249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=16 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:51:32.847074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=48 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:51:32.915447 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b2b3e0dc-d9fc-43a8-908d-4542fb3cf007 req-b8361f55-02fe-4acc-8237-cb037bef5ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a1b42a-8814-4dca-a50a-b285bea8f750", "tag": "815a20eb-5d50-4f07-b8af-5e343e7ab703"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:51:32.936807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2b3e0dc-d9fc-43a8-908d-4542fb3cf007 req-b8361f55-02fe-4acc-8237-cb037bef5ca8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:32.937890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2b3e0dc-d9fc-43a8-908d-4542fb3cf007 req-b8361f55-02fe-4acc-8237-cb037bef5ca8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:32.938429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2b3e0dc-d9fc-43a8-908d-4542fb3cf007 req-b8361f55-02fe-4acc-8237-cb037bef5ca8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:32.950706 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b2b3e0dc-d9fc-43a8-908d-4542fb3cf007 req-b8361f55-02fe-4acc-8237-cb037bef5ca8 service nova] Creating event network-changed:815a20eb-5d50-4f07-b8af-5e343e7ab703 for instance 87a1b42a-8814-4dca-a50a-b285bea8f750 on n-h1-858383-3 Oct 03 11:51:32.959446 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b2b3e0dc-d9fc-43a8-908d-4542fb3cf007 req-b8361f55-02fe-4acc-8237-cb037bef5ca8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118051 Oct 03 11:51:32.959446 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3769/7870] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:51:34.580352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-19cbe27b-5891-4c34-baa5-b2f19ef0ea2a req-7e44958f-e490-4846-9620-09774f156f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a1b42a-8814-4dca-a50a-b285bea8f750", "tag": "815a20eb-5d50-4f07-b8af-5e343e7ab703"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:51:34.587454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:34.587963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:34.590734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-19cbe27b-5891-4c34-baa5-b2f19ef0ea2a req-7e44958f-e490-4846-9620-09774f156f5c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:34.591220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-19cbe27b-5891-4c34-baa5-b2f19ef0ea2a req-7e44958f-e490-4846-9620-09774f156f5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:34.591985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-19cbe27b-5891-4c34-baa5-b2f19ef0ea2a req-7e44958f-e490-4846-9620-09774f156f5c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:34.595306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:34.595803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:34.596249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:34.596992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:34.597457 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:34.597979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:34.603464 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-19cbe27b-5891-4c34-baa5-b2f19ef0ea2a req-7e44958f-e490-4846-9620-09774f156f5c service nova] Creating event network-changed:815a20eb-5d50-4f07-b8af-5e343e7ab703 for instance 87a1b42a-8814-4dca-a50a-b285bea8f750 on n-h1-858383-3 Oct 03 11:51:34.608348 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-19cbe27b-5891-4c34-baa5-b2f19ef0ea2a req-7e44958f-e490-4846-9620-09774f156f5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033112 Oct 03 11:51:34.612036 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3770/7871] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:51:34.686155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lazy-loading 'services' on Instance uuid 87a1b42a-8814-4dca-a50a-b285bea8f750 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:51:34.770748 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a80d3844-083e-49d8-9ea6-3b8e6ef0b00c tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments/a5ef4679-3ca3-4d97-a17e-8583a517b596" status: 202 len: 0 microversion: 2.1 time: 0.188555 Oct 03 11:51:34.772754 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4102/7872] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:51:34 2022] DELETE /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments/a5ef4679-3ca3-4d97-a17e-8583a517b596 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:51:34.788091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:34.791301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:34.799409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:34.800052 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:34.800693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:34.801513 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:34.802384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:34.802817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:34.847093 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0612ec03-271f-4e56-859c-b89508bbc3f5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069804 Oct 03 11:51:34.848002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3771/7873] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:51:34 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:51:35.860255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:35.862699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:35.869865 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:35.870361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:35.870810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:35.871516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:35.871978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:35.872415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:35.903872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-030c586b-3f51-4984-bd1c-aaa582d97f57 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047941 Oct 03 11:51:35.904451 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4103/7874] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:51:35 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:51:36.916656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:36.919045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:36.927825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:36.928583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:36.929050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:36.929758 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:36.930206 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:36.930625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:36.969240 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-32b5f665-2417-4a5a-abfc-aca3c92f831e tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057269 Oct 03 11:51:36.970074 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3772/7875] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:51:36 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:51:37.981739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:37.984085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:37.991783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:37.992288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:37.992743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:37.993494 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:37.993963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:37.994410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:38.024252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1795b1a6-e669-4031-9fe2-64ea9878d6a5 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046481 Oct 03 11:51:38.024851 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4104/7876] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:51:37 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:51:39.036799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:39.039002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:39.045818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:39.046304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:39.046743 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:39.047434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:39.047885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:39.048311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:39.080456 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-868aef00-f6d0-49b3-9750-6c51177019b6 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047640 Oct 03 11:51:39.081069 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3773/7877] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:51:39 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:51:40.093372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:40.095567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:40.103009 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:40.103510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:40.103963 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:40.104669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:40.105164 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:40.105606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:40.133710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f92d796-bb0f-4411-8d70-c5d9684a46ae tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044507 Oct 03 11:51:40.134283 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4105/7878] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Oct 3 11:51:40 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 11:51:40.144958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:40.145446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:40.152638 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:40.153151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:40.153593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:40.154286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:40.154738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:40.155167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:40.235523 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] HTTP exception thrown: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 is not attached to volume a5ef4679-3ca3-4d97-a17e-8583a517b596 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Request method failure captured: Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: request: DELETE /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments/a5ef4679-3ca3-4d97-a17e-8583a517b596 HTTP/1.1 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsrFOCQVftChjB83PNDjPbnEwWukskM4RpNA03wcWSE734op9l-T3esX8g3palk9jKkHMkf4JHfx56H-DjHwB20LxeKR6MmKVenOhVHdnCB35AMMV_ZUiH1XlIWYYHb1yk2fJBZuoTEgEytex0-vV0T-P1evIIelktm-sjJnYISq44E Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}] Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 07954b6cb06740e88a591f8e196a88eb Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 is not attached to volume a5ef4679-3ca3-4d97-a17e-8583a517b596 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'server_id': '87a1b42a-8814-4dca-a50a-b285bea8f750', 'id': 'a5ef4679-3ca3-4d97-a17e-8583a517b596'} Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a5ef4679-3ca3-4d97-a17e-8583a517b596. Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 is not attached to volume a5ef4679-3ca3-4d97-a17e-8583a517b596 Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:51:40.237227 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:51:40.242286 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:51:40.242286 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:51:40.242286 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 is not attached to volume a5ef4679-3ca3-4d97-a17e-8583a517b596 Oct 03 11:51:40.242286 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:40.242286 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Returning 404 to user: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 is not attached to volume a5ef4679-3ca3-4d97-a17e-8583a517b596 {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:51:40.242286 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc9f0274-0bde-4f6c-98bb-187b8be5114a tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments/a5ef4679-3ca3-4d97-a17e-8583a517b596" status: 404 len: 154 microversion: 2.1 time: 0.097742 Oct 03 11:51:40.242286 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3774/7879] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Oct 3 11:51:40 2022] DELETE /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750/os-volume_attachments/a5ef4679-3ca3-4d97-a17e-8583a517b596 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:51:43.492930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:43.493493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:43.500514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:43.501038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:43.501492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:43.502194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:43.502660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:43.503099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:43.529727 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:51:43.615471 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-64be7876-8353-4cf3-8082-dd38726b8b85 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 204 len: 0 microversion: 2.1 time: 0.124830 Oct 03 11:51:43.616605 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4106/7880] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:51:43 2022] DELETE /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:51:43.626524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:43.627264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:43.636959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:43.637450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:43.641782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:43.642559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:43.644291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:43.644734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:43.781149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:51:43.789070 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5620463-57f0-4b48-b6f5-9e319a739513 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1556 microversion: 2.1 time: 0.167828 Oct 03 11:51:43.789754 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3775/7881] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:51:43 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:51:44.813795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:44.814517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:44.822756 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:44.823255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:44.823718 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:44.824481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:44.824928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:44.825367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:44.953508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:51:44.963075 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-882f92d3-5fdc-479a-a54b-aa609190b7cf tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1556 microversion: 2.1 time: 0.153532 Oct 03 11:51:44.963619 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4107/7882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:51:44 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:51:45.986125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:45.986863 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:45.994015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:45.994510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:45.994953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:45.995661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:45.996125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:45.996559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:46.214205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07954b6cb06740e88a591f8e196a88eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27d5a0ecefb4dc19fe42d2d92fb17cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:51:46.222164 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48c8742e-1c23-4bf5-8b18-a294cfd70de0 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 200 len: 1556 microversion: 2.1 time: 0.239965 Oct 03 11:51:46.222742 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3776/7883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:51:45 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:51:46.245585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-90e72ddd-1a7d-407f-8bff-c318722f8e0c req-fe3f7df7-8195-4bdd-8804-1c843cc9afb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a1b42a-8814-4dca-a50a-b285bea8f750", "name": "network-vif-deleted", "tag": "815a20eb-5d50-4f07-b8af-5e343e7ab703"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:51:46.256904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-90e72ddd-1a7d-407f-8bff-c318722f8e0c req-fe3f7df7-8195-4bdd-8804-1c843cc9afb1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:46.257407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-90e72ddd-1a7d-407f-8bff-c318722f8e0c req-fe3f7df7-8195-4bdd-8804-1c843cc9afb1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:46.257859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-90e72ddd-1a7d-407f-8bff-c318722f8e0c req-fe3f7df7-8195-4bdd-8804-1c843cc9afb1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:46.269786 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-90e72ddd-1a7d-407f-8bff-c318722f8e0c req-fe3f7df7-8195-4bdd-8804-1c843cc9afb1 service nova] Creating event network-vif-deleted:815a20eb-5d50-4f07-b8af-5e343e7ab703 for instance 87a1b42a-8814-4dca-a50a-b285bea8f750 on n-h1-858383-3 Oct 03 11:51:46.275608 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-90e72ddd-1a7d-407f-8bff-c318722f8e0c req-fe3f7df7-8195-4bdd-8804-1c843cc9afb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034014 Oct 03 11:51:46.276217 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4108/7884] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:51:47.248557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:47.249220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [instance: 87a1b42a-8814-4dca-a50a-b285bea8f750] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:51:47.256529 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:47.257102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:47.257535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:47.258988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:51:47.259587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:51:47.260432 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:51:47.273839 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] HTTP exception thrown: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 could not be found. Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Request method failure captured: Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 HTTP/1.1 Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOsrFOCQVftChjB83PNDjPbnEwWukskM4RpNA03wcWSE734op9l-T3esX8g3palk9jKkHMkf4JHfx56H-DjHwB20LxeKR6MmKVenOhVHdnCB35AMMV_ZUiH1XlIWYYHb1yk2fJBZuoTEgEytex0-vV0T-P1evIIelktm-sjJnYISq44E Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b27d5a0ecefb4dc19fe42d2d92fb17cb"}]}] Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: b27d5a0ecefb4dc19fe42d2d92fb17cb Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestMinimumBasicScenario-371497786 Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 07954b6cb06740e88a591f8e196a88eb Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestMinimumBasicScenario-371497786-project Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 could not be found. Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '87a1b42a-8814-4dca-a50a-b285bea8f750'} Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 could not be found. Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 could not be found. Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:51:47.275630 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 could not be found. Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Returning 404 to user: Instance 87a1b42a-8814-4dca-a50a-b285bea8f750 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3e80a491-960f-410d-ad28-c1df1b256d15 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750" status: 404 len: 111 microversion: 2.1 time: 0.034251 Oct 03 11:51:47.280215 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3777/7885] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:51:47 2022] GET /compute/v2.1/servers/87a1b42a-8814-4dca-a50a-b285bea8f750 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:51:47.287039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-865cd353-385e-4552-80a9-182000d59f11 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] Calling method '.version_select at 0x7f074ea8a820>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:51:47.291602 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-865cd353-385e-4552-80a9-182000d59f11 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [a1154216-782c-479b-bce8-2deba5830e44] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:51:48.298910 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-865cd353-385e-4552-80a9-182000d59f11 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] [a1154216-782c-479b-bce8-2deba5830e44] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 50530. Oct 03 11:51:48.322223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-865cd353-385e-4552-80a9-182000d59f11 tempest-TestMinimumBasicScenario-371497786 tempest-TestMinimumBasicScenario-371497786-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1914633277" status: 202 len: 0 microversion: 2.1 time: 1.038452 Oct 03 11:51:48.324053 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4109/7886] 10.222.0.27 () {58 vars in 1272 bytes} [Mon Oct 3 11:51:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1914633277 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:51:57.489024 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:51:57.489565 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.27) !!! Oct 03 11:51:57.491388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=18 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:51:57.492131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=42 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:51:57.658234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-416c6067-ccd7-45ba-9e42-e9de6b06def6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: .version_select at 0x7f074e1e0700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1459273570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtRfGVNx/61cJ8+LviR94sdIo3n4ZXQldQ7U1qc4MQR30JEdthFZscF5ENv05A8M2cl5BOFTZPz6B/4QSQnOoLqJ6fROcaR9XqIugAQRQpF9nloQLAW5LiCZM5UJ5VKxA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:51:57.675114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-416c6067-ccd7-45ba-9e42-e9de6b06def6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:51:57.681265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-416c6067-ccd7-45ba-9e42-e9de6b06def6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:51:57.709757 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-416c6067-ccd7-45ba-9e42-e9de6b06def6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.225891 Oct 03 11:51:57.710353 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3778/7887] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:51:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:52:03.811065 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:52:03.811065 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:52:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 03 11:52:03.811065 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:52:03.816844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:52:03.818185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1336414763", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "2fa49364-84cd-4228-85ff-96372ab73d76"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1459273570", "security_groups": [{"name": "tempest-secgroup-smoke-162614620"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:52:03.997340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] validate_networks() for [('2fa49364-84cd-4228-85ff-96372ab73d76', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:52:04.418993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:52:04.419438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:52:04.419934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:52:04.420364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:52:04.420819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:52:04.431227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:04.431736 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:04.432201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:04.432975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:04.433451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:04.433901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:04.457699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:52:04.464120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:52:04.480846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:52:04.483367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:52:04.553548 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c1960757-2ed5-4cf9-b2ff-0433fa3022b3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730875 Oct 03 11:52:04.553548 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4110/7888] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:52:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:52:04.560408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ab706611-8846-49fd-8ff8-977bbd345f2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:04.561961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ab706611-8846-49fd-8ff8-977bbd345f2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:04.619177 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ab706611-8846-49fd-8ff8-977bbd345f2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:04.627459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ab706611-8846-49fd-8ff8-977bbd345f2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1267 microversion: 2.1 time: 0.071559 Oct 03 11:52:04.628164 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3779/7889] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:04 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:05.652290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6d1b1ea6-cabe-4663-a092-88201ff71d2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:05.653652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6d1b1ea6-cabe-4663-a092-88201ff71d2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:05.724315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6d1b1ea6-cabe-4663-a092-88201ff71d2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:05.736216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6d1b1ea6-cabe-4663-a092-88201ff71d2b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1267 microversion: 2.1 time: 0.088556 Oct 03 11:52:05.737008 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4111/7890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:05 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:06.761032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4dc42ead-0637-47bd-812e-1f7cf34aa1f9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:06.761659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4dc42ead-0637-47bd-812e-1f7cf34aa1f9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:06.819457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4dc42ead-0637-47bd-812e-1f7cf34aa1f9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:06.827059 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4dc42ead-0637-47bd-812e-1f7cf34aa1f9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1267 microversion: 2.1 time: 0.069987 Oct 03 11:52:06.828141 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3780/7891] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:06 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:07.850992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0c8f1281-e182-4027-8018-60fbdbc97b51 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:07.851548 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0c8f1281-e182-4027-8018-60fbdbc97b51 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:07.906418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0c8f1281-e182-4027-8018-60fbdbc97b51 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:07.916005 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0c8f1281-e182-4027-8018-60fbdbc97b51 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1267 microversion: 2.1 time: 0.069944 Oct 03 11:52:07.916588 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4112/7892] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:07 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:08.939170 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:08.939823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:08.947178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:08.947642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:08.948105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:08.948816 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:08.949281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:08.949711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:09.067469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:09.079713 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6cd9c150-b2a7-4cd3-b7da-05b8c1b5e549 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1325 microversion: 2.1 time: 0.144149 Oct 03 11:52:09.080971 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3781/7893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:08 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1325 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:10.105303 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:10.106585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:10.115189 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:10.115687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:10.116147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:10.116959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:10.117425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:10.117864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:10.256190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:10.264882 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2ae9d2c3-a52d-413b-a798-cd264c64b6a2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1392 microversion: 2.1 time: 0.163691 Oct 03 11:52:10.265589 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4113/7894] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:10 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:10.493602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-7e350a5d-7e75-4479-a4f2-0e3a29df12b4 req-56422489-1934-4fae-96e1-e1c24609ee6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4026cdcb-5e35-45a1-916e-a7f2f57b70ff", "tag": "0431a4b6-d561-4ac1-8222-1c9ab64a1036"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:52:10.505964 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7e350a5d-7e75-4479-a4f2-0e3a29df12b4 req-56422489-1934-4fae-96e1-e1c24609ee6c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:10.506452 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7e350a5d-7e75-4479-a4f2-0e3a29df12b4 req-56422489-1934-4fae-96e1-e1c24609ee6c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:10.506892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-7e350a5d-7e75-4479-a4f2-0e3a29df12b4 req-56422489-1934-4fae-96e1-e1c24609ee6c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:10.518610 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-7e350a5d-7e75-4479-a4f2-0e3a29df12b4 req-56422489-1934-4fae-96e1-e1c24609ee6c service nova] Creating event network-changed:0431a4b6-d561-4ac1-8222-1c9ab64a1036 for instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff on n-h1-858383-3 Oct 03 11:52:10.525504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-7e350a5d-7e75-4479-a4f2-0e3a29df12b4 req-56422489-1934-4fae-96e1-e1c24609ee6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037449 Oct 03 11:52:10.526143 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3782/7895] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:52:11.289106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:11.289803 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:11.296895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:11.297401 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:11.297881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:11.298601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:11.299069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:11.299509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:11.442558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:11.450545 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-19eddce8-8c09-4dd4-ac29-67266294412b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1392 microversion: 2.1 time: 0.166287 Oct 03 11:52:11.451139 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4114/7896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:11 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:52:12.474572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:12.475196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:12.482321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:12.482807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:12.483245 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:12.483952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:12.484403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:12.484854 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:12.624957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:12.633209 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53f7264d-833f-4449-bffa-2da4ee5be43c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1392 microversion: 2.1 time: 0.163508 Oct 03 11:52:12.633782 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3783/7897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:12 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:13.657626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:13.658257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:13.665895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:13.666396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:13.666851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:13.667568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:13.668034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:13.668477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:13.821863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:13.830166 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6045692c-5642-433d-b73b-d208a03247c8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1392 microversion: 2.1 time: 0.176325 Oct 03 11:52:13.830759 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4115/7898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:13 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:14.854599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:14.855169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:14.862016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:14.862510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:14.862945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:14.864234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:14.864691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:14.865147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:14.999694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:15.007703 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1c6bd3e8-602d-47d8-99e8-83fd6a98a2c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1392 microversion: 2.1 time: 0.157155 Oct 03 11:52:15.008283 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3784/7899] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:14 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:15.432071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7cc5b777-f744-434c-83f9-1a478af66a15 req-3450781a-da8d-4fcb-b33b-90ebfe969573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4026cdcb-5e35-45a1-916e-a7f2f57b70ff", "name": "network-vif-plugged", "status": "completed", "tag": "0431a4b6-d561-4ac1-8222-1c9ab64a1036"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:52:15.437375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:52:15.447991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cc5b777-f744-434c-83f9-1a478af66a15 req-3450781a-da8d-4fcb-b33b-90ebfe969573 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:15.448573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cc5b777-f744-434c-83f9-1a478af66a15 req-3450781a-da8d-4fcb-b33b-90ebfe969573 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:15.449212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7cc5b777-f744-434c-83f9-1a478af66a15 req-3450781a-da8d-4fcb-b33b-90ebfe969573 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:15.461616 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7cc5b777-f744-434c-83f9-1a478af66a15 req-3450781a-da8d-4fcb-b33b-90ebfe969573 service nova] Creating event network-vif-plugged:0431a4b6-d561-4ac1-8222-1c9ab64a1036 for instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff on n-h1-858383-3 Oct 03 11:52:15.467143 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7cc5b777-f744-434c-83f9-1a478af66a15 req-3450781a-da8d-4fcb-b33b-90ebfe969573 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039117 Oct 03 11:52:15.468794 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4116/7900] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:52:16.030051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:16.030670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:16.037855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:16.038357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:16.038803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:16.039506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:16.039974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:16.040407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:16.196782 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:16.204723 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99186549-59f9-49ea-9963-e39fa7e7623d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1392 microversion: 2.1 time: 0.178567 Oct 03 11:52:16.205332 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3785/7901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:16 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:17.232185 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:17.233483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:17.245699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:17.246517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:17.247048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:17.248302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:17.249195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:17.249964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:17.410613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:17.418782 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-36cfc7b5-731a-435f-bb14-60072f99f3d6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1564 microversion: 2.1 time: 0.194252 Oct 03 11:52:17.419374 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4117/7902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:17 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1564 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:17.442700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:17.443422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:17.445632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:52:17.451766 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:17.452251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:17.452690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:17.453407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:17.453855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:17.454276 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:17.599881 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:17.607850 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-81c19fc9-f0dd-4e35-b011-53c9970e1330 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1564 microversion: 2.1 time: 0.169711 Oct 03 11:52:17.608354 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3786/7903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:17 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:52:19.291370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:52:19.292098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:19.293514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-3b1a49b6-6a1d-4c1e-80fe-3726232a02eb req-333e0a88-e15f-4cb7-b1fd-fb5e18f2db80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4026cdcb-5e35-45a1-916e-a7f2f57b70ff", "tag": "0431a4b6-d561-4ac1-8222-1c9ab64a1036"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:52:19.295621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:52:19.302249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:19.303196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:19.303658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:19.304398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:19.305045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:19.305500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:19.306601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3b1a49b6-6a1d-4c1e-80fe-3726232a02eb req-333e0a88-e15f-4cb7-b1fd-fb5e18f2db80 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:19.307184 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3b1a49b6-6a1d-4c1e-80fe-3726232a02eb req-333e0a88-e15f-4cb7-b1fd-fb5e18f2db80 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:19.307990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-3b1a49b6-6a1d-4c1e-80fe-3726232a02eb req-333e0a88-e15f-4cb7-b1fd-fb5e18f2db80 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:19.320388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-3b1a49b6-6a1d-4c1e-80fe-3726232a02eb req-333e0a88-e15f-4cb7-b1fd-fb5e18f2db80 service nova] Creating event network-changed:0431a4b6-d561-4ac1-8222-1c9ab64a1036 for instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff on n-h1-858383-3 Oct 03 11:52:19.328896 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-3b1a49b6-6a1d-4c1e-80fe-3726232a02eb req-333e0a88-e15f-4cb7-b1fd-fb5e18f2db80 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039326 Oct 03 11:52:19.329597 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3787/7904] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:52:19.475832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:52:19.486562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e8465d8f-d3e6-42c4-bd4e-a57a600a432c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1564 microversion: 2.1 time: 0.199141 Oct 03 11:52:19.487470 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4118/7905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:52:19 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:52:52.816231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:52:52.818109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=34 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:52:52.822512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:52:52.824980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:52:52.832651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:52.833102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:52.834266 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:52.834846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:52:52.835308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:52:52.835733 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:52:52.905021 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d4d10b43-ca74-4535-badd-2cb07b035fa7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action" status: 200 len: 24562 microversion: 2.1 time: 0.090822 Oct 03 11:52:52.905669 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3788/7906] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:52:52 2022] POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action => generated 24562 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:53:31.993431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:53:31.994248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=34 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:53:31.998459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:31.999012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:32.006759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:32.007263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:32.007793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:32.008504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:32.009005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:32.009449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:32.075180 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e3341c02-79a6-4058-abea-018a40382f71 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action" status: 202 len: 0 microversion: 2.1 time: 0.083417 Oct 03 11:53:32.075853 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4119/7907] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:53:31 2022] POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:53:32.085289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:32.086625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:32.089700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:53:32.090495 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:53:32.095611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:32.096109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:32.096583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:32.097318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:32.097937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:32.098214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:32.233433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:32.242046 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aadb1ae5-f6ae-455f-a01f-e32f48a70c09 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1688 microversion: 2.1 time: 0.161522 Oct 03 11:53:32.242620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3789/7908] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:32 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:33.267774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:33.268527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:33.275744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:33.276250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:33.276707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:33.277453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:33.277923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:33.278369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:33.416464 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:33.424312 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-267edbc4-d0cd-4e49-8c4d-b54ec82cf3ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1668 microversion: 2.1 time: 0.161978 Oct 03 11:53:33.424906 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4120/7909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:33 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:34.523849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:34.526080 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:34.533689 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:34.534178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:34.534623 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:34.535324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:34.535784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:34.536218 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:34.602432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-82630e83-227a-4abf-95ff-d39760b24ded tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action" status: 200 len: 32638 microversion: 2.1 time: 0.082966 Oct 03 11:53:34.603355 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3790/7910] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:53:34 2022] POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action => generated 32638 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:53:34.615528 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:34.616087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:34.623099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:34.623582 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:34.624034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:34.624746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:34.625331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:34.625780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:34.692223 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-281fea2c-639c-43d7-b5a9-1e8ffaf9c36d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action" status: 202 len: 0 microversion: 2.1 time: 0.080022 Oct 03 11:53:34.692859 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4121/7911] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:53:34 2022] POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:53:34.701878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:34.702526 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:34.710568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:34.711058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:34.711524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:34.712228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:34.712691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:34.713160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:34.945658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:34.953352 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-20574d22-422f-4ece-ba43-355d7b06a4e1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1675 microversion: 2.1 time: 0.255847 Oct 03 11:53:34.953924 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3791/7912] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:34 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:35.979027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:35.979748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:35.985997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:35.986492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:35.986944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:35.987654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:35.988143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:35.988589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:36.129521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:36.137477 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1c296cb-0309-4f5f-b5ed-62f1b5fcc0aa tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1683 microversion: 2.1 time: 0.163516 Oct 03 11:53:36.137995 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4122/7913] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:35 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:36.231613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:36.233858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:36.241404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:36.241897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:36.242337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:36.243040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:36.243501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:36.243935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:36.305652 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3876b462-7814-4cdd-a93a-ab6bde148dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action" status: 200 len: 38446 microversion: 2.1 time: 0.077785 Oct 03 11:53:36.306593 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3792/7914] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:53:36 2022] POST /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff/action => generated 38446 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:53:37.308255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:37.308947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:37.315597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:37.316116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:37.316580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:37.317321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:37.317790 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:37.318234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:37.348951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:53:37.384966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-bbc6778d-06bd-4713-a3d6-5eb8b177ca13 req-ff00e70b-faef-43a1-b288-74667702cf30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4026cdcb-5e35-45a1-916e-a7f2f57b70ff", "tag": "0431a4b6-d561-4ac1-8222-1c9ab64a1036"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:37.398200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bbc6778d-06bd-4713-a3d6-5eb8b177ca13 req-ff00e70b-faef-43a1-b288-74667702cf30 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:37.398682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bbc6778d-06bd-4713-a3d6-5eb8b177ca13 req-ff00e70b-faef-43a1-b288-74667702cf30 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:37.399114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-bbc6778d-06bd-4713-a3d6-5eb8b177ca13 req-ff00e70b-faef-43a1-b288-74667702cf30 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:37.411109 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-bbc6778d-06bd-4713-a3d6-5eb8b177ca13 req-ff00e70b-faef-43a1-b288-74667702cf30 service nova] Creating event network-changed:0431a4b6-d561-4ac1-8222-1c9ab64a1036 for instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff on n-h1-858383-3 Oct 03 11:53:37.416953 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-bbc6778d-06bd-4713-a3d6-5eb8b177ca13 req-ff00e70b-faef-43a1-b288-74667702cf30 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116843 Oct 03 11:53:37.417569 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3793/7915] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:53:37.446713 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-565c53f6-8094-4ac7-b7ee-41b2585e2da2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 204 len: 0 microversion: 2.1 time: 0.149313 Oct 03 11:53:37.447417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4123/7916] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:53:37 2022] DELETE /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:53:37.457419 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:37.458847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:37.466615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:37.467250 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:37.467694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:37.468435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:37.469067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:37.469504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:37.494469 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:53:37.494715 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 11:53:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff (ip 10.222.0.27) !!! Oct 03 11:53:37.613186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:37.621323 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9716dc2b-77d4-473f-a46d-5967e2e7b87c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1689 microversion: 2.1 time: 0.169295 Oct 03 11:53:37.631160 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3794/7917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:37 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:38.649404 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:38.650122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:38.657050 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:38.657553 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:38.658092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:38.658812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:38.659281 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:38.659724 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:38.867244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:38.875225 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a794b6bd-bbbe-477e-b46a-e55984152a74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1689 microversion: 2.1 time: 0.230618 Oct 03 11:53:38.875745 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4124/7918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:38 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:39.735510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-63080aa6-be18-4ecb-a14e-50eae7e513f8 req-68ff7613-1552-4054-abfa-fe4621b39ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4026cdcb-5e35-45a1-916e-a7f2f57b70ff", "name": "network-vif-deleted", "tag": "0431a4b6-d561-4ac1-8222-1c9ab64a1036"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:39.754572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-63080aa6-be18-4ecb-a14e-50eae7e513f8 req-68ff7613-1552-4054-abfa-fe4621b39ea9 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:39.755069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-63080aa6-be18-4ecb-a14e-50eae7e513f8 req-68ff7613-1552-4054-abfa-fe4621b39ea9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:39.755510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-63080aa6-be18-4ecb-a14e-50eae7e513f8 req-68ff7613-1552-4054-abfa-fe4621b39ea9 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:39.766576 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-63080aa6-be18-4ecb-a14e-50eae7e513f8 req-68ff7613-1552-4054-abfa-fe4621b39ea9 service nova] Creating event network-vif-deleted:0431a4b6-d561-4ac1-8222-1c9ab64a1036 for instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff on n-h1-858383-3 Oct 03 11:53:39.771525 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-63080aa6-be18-4ecb-a14e-50eae7e513f8 req-68ff7613-1552-4054-abfa-fe4621b39ea9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039981 Oct 03 11:53:39.772146 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3795/7919] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:53:39.899069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:39.899754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:39.906927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:39.907437 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:39.907897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:39.908620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:39.909120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:39.909577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:39.944798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:39.945228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:39.945706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:39.946218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lazy-loading 'fault' on Instance uuid 4026cdcb-5e35-45a1-916e-a7f2f57b70ff {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:53:40.000941 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:40.008959 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fc73cbce-6895-43e9-939b-449f19db88fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 200 len: 1357 microversion: 2.1 time: 0.114057 Oct 03 11:53:40.009562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4125/7920] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:39 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 1357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:41.033872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:41.034596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 4026cdcb-5e35-45a1-916e-a7f2f57b70ff] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:41.040747 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:41.041255 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:41.041688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:41.042393 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:41.042846 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:41.043269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:41.057432 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] HTTP exception thrown: Instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff could not be found. Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Request method failure captured: Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff HTTP/1.1 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOszcAipcX3qydjowhVim8evWDRy9JRdCD6U-7-l5r4sl2rlhK5H-lZMruxue2w-3Yexy2wZ-xgmknO5EyoPdP3sTJxJRDuEE6a_PFXDfNU4bQhGfO1sLp9NTwjgXVN5wvWQ5L2UAoJj0RbB5wzAxe39_2aOH3LZ3cKmzR3ebCQ-b7r4 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}] Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2da248021bf744bcab832e3de472cf10 Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff could not be found. Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '4026cdcb-5e35-45a1-916e-a7f2f57b70ff'} Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff could not be found. Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff could not be found. Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:53:41.059037 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff could not be found. Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Returning 404 to user: Instance 4026cdcb-5e35-45a1-916e-a7f2f57b70ff could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a476f332-f1b3-4f29-b6d2-9b823d2ced03 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff" status: 404 len: 111 microversion: 2.1 time: 0.031659 Oct 03 11:53:41.064325 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3796/7921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:41 2022] GET /compute/v2.1/servers/4026cdcb-5e35-45a1-916e-a7f2f57b70ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:53:44.364333 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2efa5233-c2d7-4c09-96bd-6c376fb568bf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '.version_select at 0x7f074f6a31f0>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:44.388386 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2efa5233-c2d7-4c09-96bd-6c376fb568bf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1459273570" status: 202 len: 0 microversion: 2.1 time: 0.027691 Oct 03 11:53:44.389254 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4126/7922] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 3 11:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1459273570 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:53:44.417026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-91e68699-e6bf-433d-bcda-308ff00f8a0b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: .version_select at 0x7f074f74ee50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1781989212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu2n07UFqamldOXOf6X3FfRJbtyTp5FqVWSmaU5un+1iSn9Y9XN6c4r/4LLRXbEYGTfv+lX8gbcYBgqps+lTd6XdrFol9qUqYlCFFRWPHuI2nR0zJRTCm5Ek+LZyTc8lA=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:44.433828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-91e68699-e6bf-433d-bcda-308ff00f8a0b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:53:44.439795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-91e68699-e6bf-433d-bcda-308ff00f8a0b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:53:44.463843 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-91e68699-e6bf-433d-bcda-308ff00f8a0b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051435 Oct 03 11:53:44.464454 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3797/7923] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:53:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:53:50.281093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:53:50.285920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1469477205", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "a9748ee7-213d-4590-89de-4acd076299cb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1781989212", "security_groups": [{"name": "tempest-secgroup-smoke-1924939885"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:50.421051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] validate_networks() for [('a9748ee7-213d-4590-89de-4acd076299cb', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:53:50.903825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:53:50.904273 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:53:50.904761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:53:50.905226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:53:50.908039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:53:50.919111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:50.919613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:50.920298 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:50.921285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:50.921969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:50.922678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:50.945568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:53:50.951360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:53:50.966220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:53:50.968915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:53:51.022822 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-006d1661-4387-459e-a463-0c05c905bd42 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742677 Oct 03 11:53:51.029280 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4127/7924] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:53:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:53:51.036015 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2533acec-cc5b-42a3-a33f-71fda3d60302 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:51.037362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2533acec-cc5b-42a3-a33f-71fda3d60302 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:51.061896 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=32 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:53:51.100051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2533acec-cc5b-42a3-a33f-71fda3d60302 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:51.109500 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2533acec-cc5b-42a3-a33f-71fda3d60302 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1267 microversion: 2.1 time: 0.078763 Oct 03 11:53:51.110658 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3798/7925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:51 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:52.136821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:52.137468 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:52.146320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:52.147242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:52.149083 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:52.150301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:52.152186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:52.152965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:52.261899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:52.279456 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cea5da5e-d4bd-44d5-a5f3-4b172059555a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1319 microversion: 2.1 time: 0.147483 Oct 03 11:53:52.280118 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4128/7926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:52 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:53.309591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:53.310445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:53.323115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:53.323754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:53.324394 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:53.325146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:53.325606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:53.326035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:53.509142 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:53.517075 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e2db5ac-f8d8-4db9-ae18-0d022c250079 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.212008 Oct 03 11:53:53.517665 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3799/7927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:53 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:53.914758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-5ac136b0-b3cf-4d7f-9326-368f8b547428 req-7cf0ee05-334a-4419-9794-d1f020bc0954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4a964d-b7ab-467f-9991-c6b099a20efc", "tag": "d2ea3e64-f782-4821-a4d2-496e0aa6229b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:53:53.934399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5ac136b0-b3cf-4d7f-9326-368f8b547428 req-7cf0ee05-334a-4419-9794-d1f020bc0954 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:53.937100 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5ac136b0-b3cf-4d7f-9326-368f8b547428 req-7cf0ee05-334a-4419-9794-d1f020bc0954 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:53.937356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-5ac136b0-b3cf-4d7f-9326-368f8b547428 req-7cf0ee05-334a-4419-9794-d1f020bc0954 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:53.951011 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-5ac136b0-b3cf-4d7f-9326-368f8b547428 req-7cf0ee05-334a-4419-9794-d1f020bc0954 service nova] Creating event network-changed:d2ea3e64-f782-4821-a4d2-496e0aa6229b for instance da4a964d-b7ab-467f-9991-c6b099a20efc on n-h1-858383-3 Oct 03 11:53:53.956957 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-5ac136b0-b3cf-4d7f-9326-368f8b547428 req-7cf0ee05-334a-4419-9794-d1f020bc0954 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048403 Oct 03 11:53:53.957575 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4129/7928] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:53:54.542252 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:54.542867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:54.549757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:54.550246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:54.550686 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:54.551391 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:54.551848 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:54.552277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:54.685899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:54.693834 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-db42431a-6b8f-4a0b-8060-7661e17db705 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.155764 Oct 03 11:53:54.694412 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3800/7929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:54 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:55.718367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:55.719086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:55.726353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:55.726856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:55.727319 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:55.728036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:55.728504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:55.728983 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:55.863251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:55.870970 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e001e928-f6b1-4ea6-97ea-e3b651a54271 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.156923 Oct 03 11:53:55.871553 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4130/7930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:55 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:56.893456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:56.894818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:56.901913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:56.902409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:56.902883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:56.903601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:56.904059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:56.904490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:57.043357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:57.051249 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-302f9f9c-6118-4ab3-b3f1-ddeab5bb07f5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.161713 Oct 03 11:53:57.051867 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3801/7931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:56 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:58.080364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:58.081071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:58.088632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:58.089177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:58.089642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:58.090371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:58.090846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:58.091295 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:58.247121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:58.256249 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8276d780-53ce-44a0-b7b1-5e8019ca286f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.180141 Oct 03 11:53:58.257292 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4131/7932] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:58 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:53:59.281724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:53:59.282374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:53:59.289336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:59.289828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:59.290269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:59.290967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:53:59.291428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:53:59.291860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:53:59.426448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:53:59.434390 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9fea7928-9083-4aa8-ae44-579b805f2b3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.156610 Oct 03 11:53:59.434963 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3802/7933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:53:59 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:54:00.458958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:54:00.459537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:54:00.466575 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:00.467085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:00.467543 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:00.468261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:00.468730 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:00.469197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:00.615846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:54:00.624951 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-acf99bba-efa3-4b13-b216-2741aa9d2fe0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.171075 Oct 03 11:54:00.625835 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4132/7934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:54:00 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:54:01.649665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:54:01.651183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:54:01.658277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:54:01.661425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:01.662151 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:01.662938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:01.663880 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:01.664752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:01.665449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:01.767820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:54:01.769243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:54:01.826679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:54:01.835035 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16a6e9b3-52c7-466c-87bb-f07fcb1e9f74 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.191013 Oct 03 11:54:01.835687 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3803/7935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:54:01 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:54:01.854067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-e7fd9fb6-43ac-4bb5-a5aa-88749d30b214 req-589e1950-8b89-4560-b015-4c966d5b790c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4a964d-b7ab-467f-9991-c6b099a20efc", "name": "network-vif-plugged", "status": "completed", "tag": "d2ea3e64-f782-4821-a4d2-496e0aa6229b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:54:01.864363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e7fd9fb6-43ac-4bb5-a5aa-88749d30b214 req-589e1950-8b89-4560-b015-4c966d5b790c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:01.864888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e7fd9fb6-43ac-4bb5-a5aa-88749d30b214 req-589e1950-8b89-4560-b015-4c966d5b790c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:01.865342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-e7fd9fb6-43ac-4bb5-a5aa-88749d30b214 req-589e1950-8b89-4560-b015-4c966d5b790c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:01.876296 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-e7fd9fb6-43ac-4bb5-a5aa-88749d30b214 req-589e1950-8b89-4560-b015-4c966d5b790c service nova] Creating event network-vif-plugged:d2ea3e64-f782-4821-a4d2-496e0aa6229b for instance da4a964d-b7ab-467f-9991-c6b099a20efc on n-h1-858383-3 Oct 03 11:54:01.881820 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-e7fd9fb6-43ac-4bb5-a5aa-88749d30b214 req-589e1950-8b89-4560-b015-4c966d5b790c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118907 Oct 03 11:54:01.882245 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4133/7936] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:54:02.858466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:54:02.859072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:54:02.861712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:54:02.866980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:02.867470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:02.867910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:02.868602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:02.869094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:02.869524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:03.006833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:54:03.014556 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-22d37c92-8bda-4a18-b2d6-38559f8ca202 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1393 microversion: 2.1 time: 0.159992 Oct 03 11:54:03.015127 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3804/7937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:54:02 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:54:04.039379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:54:04.040091 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:54:04.042107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:54:04.047634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:04.048132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:04.048583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:04.049310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:04.049776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:04.050214 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:04.191187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:54:04.199452 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3498e343-1378-41b9-958a-1e941aca2943 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1565 microversion: 2.1 time: 0.165161 Oct 03 11:54:04.200045 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4134/7938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:54:04 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:54:04.221628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:54:04.222240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:54:04.229156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:04.229645 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:04.230085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:04.230780 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:04.231234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:04.231666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:04.370046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:54:04.377862 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-af9375a0-ca46-4c90-9205-fe3010c1f5eb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1565 microversion: 2.1 time: 0.160062 Oct 03 11:54:04.379026 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3805/7939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:54:04 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:54:06.232075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:54:06.238210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-8a250d91-4d54-48f2-b030-a88d7a25ede3 req-7131a2bf-3754-40fe-81f0-7d91be051960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4a964d-b7ab-467f-9991-c6b099a20efc", "tag": "d2ea3e64-f782-4821-a4d2-496e0aa6229b"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:54:06.240952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:54:06.248486 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:06.249069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:06.249531 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:06.250264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:06.250735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:06.251179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:06.253289 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8a250d91-4d54-48f2-b030-a88d7a25ede3 req-7131a2bf-3754-40fe-81f0-7d91be051960 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:06.253790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8a250d91-4d54-48f2-b030-a88d7a25ede3 req-7131a2bf-3754-40fe-81f0-7d91be051960 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:06.254231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-8a250d91-4d54-48f2-b030-a88d7a25ede3 req-7131a2bf-3754-40fe-81f0-7d91be051960 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:06.266016 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-8a250d91-4d54-48f2-b030-a88d7a25ede3 req-7131a2bf-3754-40fe-81f0-7d91be051960 service nova] Creating event network-changed:d2ea3e64-f782-4821-a4d2-496e0aa6229b for instance da4a964d-b7ab-467f-9991-c6b099a20efc on n-h1-858383-3 Oct 03 11:54:06.271163 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-8a250d91-4d54-48f2-b030-a88d7a25ede3 req-7131a2bf-3754-40fe-81f0-7d91be051960 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037099 Oct 03 11:54:06.272120 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3806/7940] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:54:06.468972 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:54:06.479459 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-18c3d0cb-7e19-4219-bf3a-24d6da752adf tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1565 microversion: 2.1 time: 0.251262 Oct 03 11:54:06.487555 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4135/7941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:54:06 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:54:37.782475 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=5 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:54:37.783616 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=44 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:54:37.788978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:54:37.791238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:54:37.800186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:37.800663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:37.801124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:37.802202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:54:37.803200 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:54:37.803870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:54:37.872014 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7e130a9a-21fa-4dcd-a883-64a85415c662 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc/action" status: 200 len: 24569 microversion: 2.1 time: 0.092767 Oct 03 11:54:37.872586 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3807/7942] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:54:37 2022] POST /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:55:16.860747 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:55:16.861467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=42 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:55:16.865754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:55:16.868039 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:16.874863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:16.875364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:16.876451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:16.877190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:16.877661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:16.878105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:16.950458 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3e644604-7bca-4aa1-84ba-2366e444a840 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc/action" status: 202 len: 0 microversion: 2.1 time: 0.091950 Oct 03 11:55:16.951130 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4136/7943] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:55:16 2022] POST /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:55:16.960212 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:16.960946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:16.963670 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:55:16.964347 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:55:16.971365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:16.971858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:16.972301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:16.973036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:16.973536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:16.973965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:17.112110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:17.120209 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-960d399a-1423-4220-939b-39c55cfa961c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1675 microversion: 2.1 time: 0.164187 Oct 03 11:55:17.120811 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3808/7944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:16 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:18.145626 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:18.146264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:18.152670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:18.153208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:18.153661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:18.154374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:18.154848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:18.155289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:18.290921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:18.299409 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-acc97910-61ad-4234-a391-b0f4b74e0b04 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.159274 Oct 03 11:55:18.300003 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4137/7945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:18 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:55:19.323525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:19.324178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:19.333009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:19.333494 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:19.333934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:19.334632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:19.335094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:19.335523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:19.472118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:19.479920 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0fcf3b0c-37d1-4853-8893-84d5a0e9b646 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.160381 Oct 03 11:55:19.480489 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3809/7946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:19 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:20.502991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:20.503640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:20.510577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:20.511072 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:20.511519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:20.512221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:20.512683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:20.513148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:20.650843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:20.658904 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0299844c-80e1-471d-a536-ba4bdcc6211d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.160394 Oct 03 11:55:20.659495 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4138/7947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:20 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:21.683254 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:21.683788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:21.691059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:21.691538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:21.691971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:21.692661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:21.693138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:21.693563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:21.833925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:21.841713 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6f601662-d1e7-4f64-bfdb-e1127729b33a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.162422 Oct 03 11:55:21.842307 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3810/7948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:21 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:55:22.867180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:22.867987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:22.877398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:22.877398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:22.877398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:22.877398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:22.877398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:22.878003 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:23.021926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:23.029824 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1bd0687-b385-4cc9-aca3-b3d0ad622cc7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.166787 Oct 03 11:55:23.030407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4139/7949] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:22 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:24.054147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:24.054787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:24.062193 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:24.062692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:24.063755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:24.064456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:24.064952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:24.065382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:24.200120 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:24.207881 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c97c4a56-e635-4b93-acbf-8e265e1ea5f2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.158065 Oct 03 11:55:24.208454 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3811/7950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:24 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:25.231322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:25.231952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:25.239101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:25.239602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:25.240056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:25.240789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:25.241344 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:25.241770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:25.374806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:25.383559 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9c4fcd4d-ea98-4f59-bb99-be1a14048886 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.156149 Oct 03 11:55:25.384175 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4140/7951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:25 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:26.408180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:26.408808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:26.415615 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:26.416095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:26.416530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:26.417256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:26.417709 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:26.418126 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:26.549234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:26.557387 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-06201298-191d-41df-9684-ca2591114c0f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.153763 Oct 03 11:55:26.557964 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3812/7952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:26 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:27.581875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:27.582500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:27.589601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:27.590116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:27.590550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:27.591255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:27.591748 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:27.592191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:27.730199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:27.738838 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b5a62d82-6ec1-47da-a9d5-7d48f19a1162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1680 microversion: 2.1 time: 0.161571 Oct 03 11:55:27.739423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4141/7953] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:27 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:55:28.763079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:55:28.763688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:55:28.771525 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:28.772005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:28.772439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:28.773161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:55:28.773912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:55:28.774346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:55:28.910764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:55:28.918522 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42e59a25-2389-4c70-a139-cbedec08fd75 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1683 microversion: 2.1 time: 0.159395 Oct 03 11:55:28.919095 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3813/7954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:55:28 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:01.145117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:01.147274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:01.149475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:01.150155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:01.156033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:01.156534 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:01.157038 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:01.157760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:01.158229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:01.158671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:01.234520 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4b0da44d-1951-43ab-be7a-6c645aedb232 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc/action" status: 200 len: 69039 microversion: 2.1 time: 0.092900 Oct 03 11:56:01.235238 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4142/7955] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:56:01 2022] POST /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc/action => generated 69039 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:56:18.392248 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-597b1fc6-9875-411e-a4c2-862790babad3 req-b0b0a618-55f4-4561-b53e-123a376004b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4a964d-b7ab-467f-9991-c6b099a20efc", "tag": "d2ea3e64-f782-4821-a4d2-496e0aa6229b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:18.395856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:18.396388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:18.398755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:18.399988 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=36 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:18.409403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:18.409893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:18.410348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:18.411038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:18.411490 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:18.411911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:18.416213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:18.417381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:18.427264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-597b1fc6-9875-411e-a4c2-862790babad3 req-b0b0a618-55f4-4561-b53e-123a376004b5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:18.427673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-597b1fc6-9875-411e-a4c2-862790babad3 req-b0b0a618-55f4-4561-b53e-123a376004b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:18.428382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-597b1fc6-9875-411e-a4c2-862790babad3 req-b0b0a618-55f4-4561-b53e-123a376004b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:18.440840 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-597b1fc6-9875-411e-a4c2-862790babad3 req-b0b0a618-55f4-4561-b53e-123a376004b5 service nova] Creating event network-changed:d2ea3e64-f782-4821-a4d2-496e0aa6229b for instance da4a964d-b7ab-467f-9991-c6b099a20efc on n-h1-858383-3 Oct 03 11:56:18.443917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:56:18.446202 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-597b1fc6-9875-411e-a4c2-862790babad3 req-b0b0a618-55f4-4561-b53e-123a376004b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058529 Oct 03 11:56:18.447154 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4143/7956] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:56:18.543594 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-607478b1-70ae-4999-8d61-1a0e87e2e66b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 204 len: 0 microversion: 2.1 time: 0.158366 Oct 03 11:56:18.548584 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3814/7957] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:56:18 2022] DELETE /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:56:18.554294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:18.555015 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:18.563610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:18.564201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:18.564734 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:18.565393 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:18.565859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:18.566293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:18.709171 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:18.717285 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-41b4356d-fdcd-43b9-aa4f-c7aec5b04b27 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1689 microversion: 2.1 time: 0.167598 Oct 03 11:56:18.717915 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4144/7958] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:18 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:56:19.743740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:19.744441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:19.751829 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:19.752445 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:19.752997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:19.753688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:19.754152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:19.754561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:19.902663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:19.910943 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dafb4747-6b96-4b89-bae5-5a12f7040ac7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1689 microversion: 2.1 time: 0.171539 Oct 03 11:56:19.912081 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3815/7959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:19 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:20.878355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-4394c7ab-63a2-452f-9afa-2b3aff446724 req-a1c9c4d7-6168-484a-b67c-c5a7e7148afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4a964d-b7ab-467f-9991-c6b099a20efc", "name": "network-vif-deleted", "tag": "d2ea3e64-f782-4821-a4d2-496e0aa6229b"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:20.889075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4394c7ab-63a2-452f-9afa-2b3aff446724 req-a1c9c4d7-6168-484a-b67c-c5a7e7148afd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:20.889596 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4394c7ab-63a2-452f-9afa-2b3aff446724 req-a1c9c4d7-6168-484a-b67c-c5a7e7148afd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:20.890545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-4394c7ab-63a2-452f-9afa-2b3aff446724 req-a1c9c4d7-6168-484a-b67c-c5a7e7148afd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:20.905182 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-4394c7ab-63a2-452f-9afa-2b3aff446724 req-a1c9c4d7-6168-484a-b67c-c5a7e7148afd service nova] Creating event network-vif-deleted:d2ea3e64-f782-4821-a4d2-496e0aa6229b for instance da4a964d-b7ab-467f-9991-c6b099a20efc on n-h1-858383-3 Oct 03 11:56:20.910335 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-4394c7ab-63a2-452f-9afa-2b3aff446724 req-a1c9c4d7-6168-484a-b67c-c5a7e7148afd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Oct 03 11:56:20.910944 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4145/7960] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:56:20.934628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:20.935337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:20.942927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:20.943436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:20.943869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:20.945157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:20.945157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:20.945501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:21.021772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:21.029682 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9e3cf858-9b99-4d3d-8bc7-83da6246ae86 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 200 len: 1352 microversion: 2.1 time: 0.099041 Oct 03 11:56:21.030306 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3816/7961] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:20 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:22.055117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:22.055833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: da4a964d-b7ab-467f-9991-c6b099a20efc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:22.062679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:22.063170 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:22.063618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:22.064320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:22.064809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:22.065236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:22.078920 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] HTTP exception thrown: Instance da4a964d-b7ab-467f-9991-c6b099a20efc could not be found. Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Request method failure captured: Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc HTTP/1.1 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOszcAipcX3qydjowhVim8evWDRy9JRdCD6U-7-l5r4sl2rlhK5H-lZMruxue2w-3Yexy2wZ-xgmknO5EyoPdP3sTJxJRDuEE6a_PFXDfNU4bQhGfO1sLp9NTwjgXVN5wvWQ5L2UAoJj0RbB5wzAxe39_2aOH3LZ3cKmzR3ebCQ-b7r4 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}] Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2da248021bf744bcab832e3de472cf10 Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance da4a964d-b7ab-467f-9991-c6b099a20efc could not be found. Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': 'da4a964d-b7ab-467f-9991-c6b099a20efc'} Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4a964d-b7ab-467f-9991-c6b099a20efc could not be found. Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4a964d-b7ab-467f-9991-c6b099a20efc could not be found. Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:56:22.080572 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4a964d-b7ab-467f-9991-c6b099a20efc could not be found. Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Returning 404 to user: Instance da4a964d-b7ab-467f-9991-c6b099a20efc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9991c046-7f65-4dab-ae23-b2cb1ba7ad7a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc" status: 404 len: 111 microversion: 2.1 time: 0.032278 Oct 03 11:56:22.085958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4146/7962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:22 2022] GET /compute/v2.1/servers/da4a964d-b7ab-467f-9991-c6b099a20efc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:56:25.438777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-36ba5953-71ba-4cd9-97d5-bf10250041fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '.version_select at 0x7f074e00ad30>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:25.444587 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36ba5953-71ba-4cd9-97d5-bf10250041fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:56:26.451509 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [None req-36ba5953-71ba-4cd9-97d5-bf10250041fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [e1434c81-eed4-4d1e-86d2-f636ca0db287] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 51068. Oct 03 11:56:26.471027 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-36ba5953-71ba-4cd9-97d5-bf10250041fb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781989212" status: 202 len: 0 microversion: 2.1 time: 1.036523 Oct 03 11:56:26.471620 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3817/7963] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 3 11:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781989212 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:56:26.501503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-854a1078-3228-4f55-8cc9-afddc40ee5ca tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: .version_select at 0x7f074ec18820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1990686575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmvVDa+WQJlt/z5dt8lmFn605+WCKZp682YWl1L4w9ASvoYMEKs/Y8ZwzwOUHjOUgMs5X2+ct7nCPpIoe7Kuhlp4iwh1g8v6kM9cuQM+aAItBYeGliUzog08C81vBM3Cg=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:26.517566 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-854a1078-3228-4f55-8cc9-afddc40ee5ca tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:56:26.523618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-854a1078-3228-4f55-8cc9-afddc40ee5ca tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:56:26.537184 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-854a1078-3228-4f55-8cc9-afddc40ee5ca tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [a1154216-782c-479b-bce8-2deba5830e44] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 11:56:27.545054 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-854a1078-3228-4f55-8cc9-afddc40ee5ca tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [a1154216-782c-479b-bce8-2deba5830e44] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 51072. Oct 03 11:56:27.561535 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-854a1078-3228-4f55-8cc9-afddc40ee5ca tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.064785 Oct 03 11:56:27.562151 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4147/7964] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:56:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:56:33.139451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-805615373", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "c0b73dd4-1547-4feb-8424-eaf10c6ab8e3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1990686575", "security_groups": [{"name": "tempest-secgroup-smoke-1286228176"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:33.150262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:33.273673 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] validate_networks() for [('c0b73dd4-1547-4feb-8424-eaf10c6ab8e3', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:56:33.773226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:56:33.773724 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:56:33.774195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:56:33.774659 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:56:33.775097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:56:33.785002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:33.785511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:33.785946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:33.786668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:33.787121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:33.787541 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:33.806642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:56:33.812064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:56:33.825942 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:56:33.829063 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:56:33.878372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-39b38294-6d3d-4465-8661-fecdda8cedc9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742885 Oct 03 11:56:33.888342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:33.893449 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3818/7965] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:56:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:56:33.893634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-06d51c89-e284-4e75-8627-614072307da0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:33.894067 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-06d51c89-e284-4e75-8627-614072307da0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:33.949705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-06d51c89-e284-4e75-8627-614072307da0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:33.957540 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-06d51c89-e284-4e75-8627-614072307da0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1266 microversion: 2.1 time: 0.070935 Oct 03 11:56:33.958135 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4148/7966] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:33 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:34.980651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2ac1a3b1-e99b-4580-9b96-b1d186b8c2fc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:34.981833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2ac1a3b1-e99b-4580-9b96-b1d186b8c2fc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:35.041059 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2ac1a3b1-e99b-4580-9b96-b1d186b8c2fc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:35.049821 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2ac1a3b1-e99b-4580-9b96-b1d186b8c2fc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1266 microversion: 2.1 time: 0.073023 Oct 03 11:56:35.050564 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3819/7967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:34 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:36.083515 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66172d6d-93f5-499b-92bd-dda27e0a7ec8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:36.085284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66172d6d-93f5-499b-92bd-dda27e0a7ec8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:36.147533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66172d6d-93f5-499b-92bd-dda27e0a7ec8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:36.154576 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66172d6d-93f5-499b-92bd-dda27e0a7ec8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1266 microversion: 2.1 time: 0.076641 Oct 03 11:56:36.155934 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4149/7968] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:36 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:56:37.178075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:37.178685 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:37.185573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:37.186662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:37.187209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:37.187855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:37.188306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:37.188727 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:37.253898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:37.261915 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ea771592-2dda-4d86-8d71-e268dfa07bcc tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1324 microversion: 2.1 time: 0.087850 Oct 03 11:56:37.262703 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3820/7969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:37 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1324 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:56:38.285947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:38.286731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:38.294886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:38.296002 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:38.296504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:38.297288 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:38.297765 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:38.298204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:38.531235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:38.539140 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-45b41717-08fe-438a-bc3f-ea0d3c776dc8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1392 microversion: 2.1 time: 0.257473 Oct 03 11:56:38.539823 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4150/7970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:38 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:38.748871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b136110c-59e8-4889-83b3-4d66a07d736e req-90688142-0f8f-4098-8063-633e911df55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439d041b-96c0-4235-b4d4-82c4ce120480", "tag": "d6314037-903f-477e-a2e8-17888784a6b2"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:38.763501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b136110c-59e8-4889-83b3-4d66a07d736e req-90688142-0f8f-4098-8063-633e911df55f service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:38.764079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b136110c-59e8-4889-83b3-4d66a07d736e req-90688142-0f8f-4098-8063-633e911df55f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:38.764582 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b136110c-59e8-4889-83b3-4d66a07d736e req-90688142-0f8f-4098-8063-633e911df55f service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:38.775708 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b136110c-59e8-4889-83b3-4d66a07d736e req-90688142-0f8f-4098-8063-633e911df55f service nova] Creating event network-changed:d6314037-903f-477e-a2e8-17888784a6b2 for instance 439d041b-96c0-4235-b4d4-82c4ce120480 on n-h1-858383-3 Oct 03 11:56:38.781569 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b136110c-59e8-4889-83b3-4d66a07d736e req-90688142-0f8f-4098-8063-633e911df55f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101849 Oct 03 11:56:38.782183 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3821/7971] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:56:39.563070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:39.563699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:39.571423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:39.571962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:39.572417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:39.573168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:39.573640 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:39.574085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:39.710797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:39.718633 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0186806-9f94-4892-b1e9-90e1ca2be7f8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1392 microversion: 2.1 time: 0.160057 Oct 03 11:56:39.719217 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4151/7972] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:39 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:40.742651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:40.743355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:40.749813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:40.750295 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:40.750732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:40.751428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:40.751888 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:40.752316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:40.885167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:40.893492 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2497e467-128b-496f-9bb5-876f607e56c4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1392 microversion: 2.1 time: 0.155930 Oct 03 11:56:40.894078 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3822/7973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:40 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:41.917057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:41.917839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:41.924324 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:41.924861 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:41.925312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:41.926244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:41.926715 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:41.927155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:42.065760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:42.073602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b18ebaac-a0fe-4265-aa2e-65061ae33bdd tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1392 microversion: 2.1 time: 0.160713 Oct 03 11:56:42.074183 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4152/7974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:41 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:43.096162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:43.096899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:43.103949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:43.104436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:43.104901 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:43.105599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:43.106111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:43.106537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:43.240560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:43.248920 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fcd385aa-41b6-4898-85c1-206dd7a7df3d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1392 microversion: 2.1 time: 0.156663 Oct 03 11:56:43.249510 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3823/7975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:43 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:44.272270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:44.272848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:44.280338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:44.280866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:44.281315 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:44.282043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:44.282508 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:44.282942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:44.415175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:44.423185 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-03406a63-a232-4dd6-be7e-a759eda924b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1392 microversion: 2.1 time: 0.154912 Oct 03 11:56:44.423759 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4153/7976] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:44 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:44.838186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-1cdeeff8-8c75-4ef7-a268-18fbc50d7aa4 req-b0e33a82-a8f7-4c1d-bc5e-bfb5855446ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439d041b-96c0-4235-b4d4-82c4ce120480", "name": "network-vif-plugged", "status": "completed", "tag": "d6314037-903f-477e-a2e8-17888784a6b2"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:44.843937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:44.851284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1cdeeff8-8c75-4ef7-a268-18fbc50d7aa4 req-b0e33a82-a8f7-4c1d-bc5e-bfb5855446ee service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:44.851778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1cdeeff8-8c75-4ef7-a268-18fbc50d7aa4 req-b0e33a82-a8f7-4c1d-bc5e-bfb5855446ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:44.852221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-1cdeeff8-8c75-4ef7-a268-18fbc50d7aa4 req-b0e33a82-a8f7-4c1d-bc5e-bfb5855446ee service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:44.864342 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-1cdeeff8-8c75-4ef7-a268-18fbc50d7aa4 req-b0e33a82-a8f7-4c1d-bc5e-bfb5855446ee service nova] Creating event network-vif-plugged:d6314037-903f-477e-a2e8-17888784a6b2 for instance 439d041b-96c0-4235-b4d4-82c4ce120480 on n-h1-858383-3 Oct 03 11:56:44.869372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-1cdeeff8-8c75-4ef7-a268-18fbc50d7aa4 req-b0e33a82-a8f7-4c1d-bc5e-bfb5855446ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034968 Oct 03 11:56:44.870193 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3824/7977] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:56:45.449693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:45.450798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:45.459879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:45.460372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:45.460847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:45.461560 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:45.462023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:45.462460 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:45.602098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:45.610857 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d0a48533-1878-44eb-8397-759da34faa99 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1392 microversion: 2.1 time: 0.168283 Oct 03 11:56:45.611460 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4154/7978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:45 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:46.631533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=8 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:46.636524 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:46.637253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:46.643658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:46.644140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:46.644581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:46.645303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:46.645759 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:46.646186 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:46.788657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:46.797258 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-472cfcd9-7512-42ec-b388-a0f951c7eef9 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1565 microversion: 2.1 time: 0.166611 Oct 03 11:56:46.797852 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3825/7979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:46 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:46.820267 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:46.820955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:46.822813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:46.829358 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:46.829787 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:46.830238 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:46.830951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:46.831418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:46.831859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:46.961812 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:46.970132 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c0041c52-ee99-45a3-8960-5fc9c340a34b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1565 microversion: 2.1 time: 0.153796 Oct 03 11:56:46.970702 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4155/7980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:46 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:56:48.592984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:56:48.593833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:56:48.596550 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:48.599019 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-b39ac38b-3219-44b7-a9e0-749f80d485e0 req-35f7dfd9-877f-4773-9c15-1470b96a8e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439d041b-96c0-4235-b4d4-82c4ce120480", "tag": "d6314037-903f-477e-a2e8-17888784a6b2"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:56:48.601510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:48.602010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:48.602449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:48.603150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:48.604017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:48.604933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:48.606879 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:56:48.612424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b39ac38b-3219-44b7-a9e0-749f80d485e0 req-35f7dfd9-877f-4773-9c15-1470b96a8e49 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:56:48.612986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b39ac38b-3219-44b7-a9e0-749f80d485e0 req-35f7dfd9-877f-4773-9c15-1470b96a8e49 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:56:48.613431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-b39ac38b-3219-44b7-a9e0-749f80d485e0 req-35f7dfd9-877f-4773-9c15-1470b96a8e49 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:56:48.627160 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-b39ac38b-3219-44b7-a9e0-749f80d485e0 req-35f7dfd9-877f-4773-9c15-1470b96a8e49 service nova] Creating event network-changed:d6314037-903f-477e-a2e8-17888784a6b2 for instance 439d041b-96c0-4235-b4d4-82c4ce120480 on n-h1-858383-3 Oct 03 11:56:48.633720 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-b39ac38b-3219-44b7-a9e0-749f80d485e0 req-35f7dfd9-877f-4773-9c15-1470b96a8e49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038605 Oct 03 11:56:48.634759 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4156/7981] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:56:48.758809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:56:48.767769 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e16f855c-0eb8-4a64-9910-580c88f2ef8c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1565 microversion: 2.1 time: 0.178988 Oct 03 11:56:48.782886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3826/7982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:56:48 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:57:22.072055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=38 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:57:22.072974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:57:22.074261 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 11:57:22.074391 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 11:57:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action (ip 10.222.0.27) !!! Oct 03 11:57:22.129221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:57:22.131590 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:57:22.139520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:57:22.140016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:57:22.140465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:57:22.141202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:57:22.141665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:57:22.142102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:57:22.209039 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ce1fbba9-ca59-4421-8986-38928358b797 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action" status: 200 len: 24555 microversion: 2.1 time: 0.138901 Oct 03 11:57:22.209696 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4157/7983] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:57:22 2022] POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action => generated 24555 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:58:00.972756 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:58:00.973531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=36 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:58:00.978609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:58:00.981154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:00.989417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:00.989904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:00.990337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:00.991029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:00.991481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:00.991902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:01.033178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:01.039318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Old instance type m1.heat2, new instance type m1.heat {{(pid=122270) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 11:58:01.045950 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:58:01.046377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:58:01.046885 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:58:01.047293 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:58:01.047705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:58:01.112023 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3831d5dc-b1be-4fce-8fe2-c24fb5f920ed tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action" status: 202 len: 0 microversion: 2.1 time: 0.141136 Oct 03 11:58:01.116029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3827/7984] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:58:00 2022] POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:58:01.126451 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:01.127175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:01.129292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:58:01.129961 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:58:01.142308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:01.142806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:01.143299 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:01.143958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:01.144421 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:01.145356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:01.289352 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:01.297639 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-496542da-f663-4a09-8e67-5aa44552bec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1693 microversion: 2.1 time: 0.179896 Oct 03 11:58:01.298252 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4158/7985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:01 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:02.326763 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:02.327396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:02.334694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:02.335202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:02.335657 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:02.336382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:02.336872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:02.337314 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:02.481675 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:02.489870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-132931b9-9649-423b-a5ab-96c3e36ef952 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1693 microversion: 2.1 time: 0.168659 Oct 03 11:58:02.490740 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3828/7986] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:02 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:03.516165 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:03.516819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:03.524087 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:03.524901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:03.525360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:03.526075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:03.526880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:03.527541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:03.663310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:03.671101 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e6eeb0c-62e6-49dc-bf7f-903a50a7154e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1693 microversion: 2.1 time: 0.159669 Oct 03 11:58:03.671677 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4159/7987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:03 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:04.695000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:04.695606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:04.703064 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:04.703538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:04.703970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:04.704654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:04.705138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:04.705560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:04.838077 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:04.846425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4947ffae-6bea-4c11-95b8-7d5bd5b6c775 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.155317 Oct 03 11:58:04.847009 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3829/7988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:04 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:05.870249 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:05.870804 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:05.877710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:05.878212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:05.878673 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:05.879385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:05.879860 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:05.880304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:06.024119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:06.032511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7f195583-17ee-4727-a9e4-d64210a0b27c tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.166356 Oct 03 11:58:06.033119 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4160/7989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:05 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:07.055984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:07.056590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:07.063969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:07.064449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:07.064908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:07.065601 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:07.066049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:07.066471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:07.199216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:07.207425 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f1a0d033-f6be-40a8-b310-cb3d9d0e1c11 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.155925 Oct 03 11:58:07.208004 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3830/7990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:07 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:08.231493 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:08.232116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:08.239179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:08.239678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:08.240135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:08.240873 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:08.241342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:08.241810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:08.375152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:08.383001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4776d052-7147-4299-82d1-1f0cfa479678 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.155432 Oct 03 11:58:08.383577 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4161/7991] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:08 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:09.406985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:09.407591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:09.414379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:09.414856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:09.415288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:09.415966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:09.416417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:09.416860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:09.547997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:09.556068 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11708241-42b0-4134-84fd-b39ea5bfeefe tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.153581 Oct 03 11:58:09.556646 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3831/7992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:09 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:10.580152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:10.580789 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:10.587851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:10.588348 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:10.588822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:10.589532 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:10.590001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:10.590442 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:10.723722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:10.731431 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ba9addd6-7566-4f91-94a4-5d79524ed960 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.155816 Oct 03 11:58:10.732004 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4162/7993] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:10 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:11.831777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:11.832321 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:11.839320 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:11.839804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:11.840243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:11.840967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:11.841429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:11.841907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:11.975932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:11.984590 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f84f45b0-55a2-41d9-8ca4-c0e4fed8cc3e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.156566 Oct 03 11:58:11.985619 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3832/7994] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:11 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:13.009179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:13.009791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:13.017068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:13.017576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:13.018027 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:13.018745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:13.019215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:13.019663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:13.153013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:13.160627 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6e93b0de-0c1b-4dc5-94e2-baec7f3e5828 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.155626 Oct 03 11:58:13.161219 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4163/7995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:13 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:14.183799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:14.184503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:14.191967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:14.192464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:14.192939 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:14.193644 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:14.194102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:14.194532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:14.322921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:14.330590 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78a340d9-af41-4d42-b6d9-6f9dc27f445a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.150747 Oct 03 11:58:14.331164 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3833/7996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:14 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:15.355985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:15.356645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:15.363670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:15.364210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:15.364666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:15.365408 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:15.365881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:15.366327 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:15.498402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:15.506195 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cadd9b7f-cc00-46f0-aea8-1eb20eb7cd67 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1698 microversion: 2.1 time: 0.154210 Oct 03 11:58:15.506774 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4164/7997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:15 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:16.529265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:16.530016 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:16.537147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:16.537717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:16.538233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:16.539012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:16.539552 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:16.540072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:16.948136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:16.956297 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3ea73050-281a-4cab-94e1-b4ba6d018407 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1697 microversion: 2.1 time: 0.431604 Oct 03 11:58:16.956897 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3834/7998] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:16 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1697 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:17.980098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:17.980720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:17.987641 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:17.988135 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:17.988587 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:17.989326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:17.989793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:17.990226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:18.122732 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:18.130521 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7b351660-125c-4266-bfb1-e091a993b902 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1695 microversion: 2.1 time: 0.154358 Oct 03 11:58:18.131098 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4165/7999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:17 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:19.095129 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-0a40d57b-b638-459e-9a5e-0c8d431b174f req-aa99932d-1f41-4b76-9c4d-c7871c97b652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439d041b-96c0-4235-b4d4-82c4ce120480", "name": "network-vif-unplugged", "status": "completed", "tag": "d6314037-903f-477e-a2e8-17888784a6b2"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:58:19.106017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0a40d57b-b638-459e-9a5e-0c8d431b174f req-aa99932d-1f41-4b76-9c4d-c7871c97b652 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:19.106508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0a40d57b-b638-459e-9a5e-0c8d431b174f req-aa99932d-1f41-4b76-9c4d-c7871c97b652 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:19.107628 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-0a40d57b-b638-459e-9a5e-0c8d431b174f req-aa99932d-1f41-4b76-9c4d-c7871c97b652 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:19.121748 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-0a40d57b-b638-459e-9a5e-0c8d431b174f req-aa99932d-1f41-4b76-9c4d-c7871c97b652 service nova] Creating event network-vif-unplugged:d6314037-903f-477e-a2e8-17888784a6b2 for instance 439d041b-96c0-4235-b4d4-82c4ce120480 on n-h1-858383-3 Oct 03 11:58:19.127290 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [req-0a40d57b-b638-459e-9a5e-0c8d431b174f req-aa99932d-1f41-4b76-9c4d-c7871c97b652 service nova] Instance 439d041b-96c0-4235-b4d4-82c4ce120480 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-3'} {{(pid=122270) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Oct 03 11:58:19.134064 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-0a40d57b-b638-459e-9a5e-0c8d431b174f req-aa99932d-1f41-4b76-9c4d-c7871c97b652 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043144 Oct 03 11:58:19.134674 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3835/8000] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:58:19.155593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:19.156242 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:19.163265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:19.163762 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:19.164207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:19.164940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:19.165406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:19.165869 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:19.305246 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:19.312974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd7d9ea8-dc9f-47d6-a5db-f1febff88d38 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1695 microversion: 2.1 time: 0.161875 Oct 03 11:58:19.313559 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4166/8001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:19 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:20.337269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:20.338736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:20.346443 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.346948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.347379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:20.348298 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.348954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.349388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:20.486150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:20.494461 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b7413fc5-12cd-48a4-a175-b37123aa1966 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1692 microversion: 2.1 time: 0.161810 Oct 03 11:58:20.495047 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3836/8002] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:20 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:20.517354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:58:20.517916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:20.524725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.525253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.525704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:20.526409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.526877 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.527318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:20.586140 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a77ea2f5-9593-43ee-a3f9-9f63fbbf7b0d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action" status: 204 len: 0 microversion: 2.1 time: 0.072679 Oct 03 11:58:20.586980 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4167/8003] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:58:20 2022] POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:58:20.595587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:20.596131 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:20.602221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.602712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.603162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:20.603935 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.604379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.604833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:20.748326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:20.756218 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0dc453c5-f335-402d-9382-3189a6c86898 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1692 microversion: 2.1 time: 0.165175 Oct 03 11:58:20.756817 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3837/8004] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:20 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:20.781892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:20.782656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:20.790911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.791467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.792292 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:20.793142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:20.793616 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:20.794066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:21.011813 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:21.020928 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-32aa79ae-e968-4cb2-8645-be537482ff9a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1692 microversion: 2.1 time: 0.245410 Oct 03 11:58:21.021834 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4168/8005] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:20 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1692 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:22.046512 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:58:22.047703 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:22.054893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:22.055311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:22.055810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:22.056517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:22.057014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:22.057440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:22.188968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:58:22.196799 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-244c9283-610b-4644-90ad-b80490d99c33 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1684 microversion: 2.1 time: 0.155007 Oct 03 11:58:22.197375 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3838/8006] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:58:22 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:58:23.177648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-c6eb96cd-8e27-4a6c-84f0-326ad4b4cb0f req-0c90234b-7b4a-48ae-bdf9-c71df51a6916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439d041b-96c0-4235-b4d4-82c4ce120480", "name": "network-vif-plugged", "status": "completed", "tag": "d6314037-903f-477e-a2e8-17888784a6b2"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:58:23.189023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6eb96cd-8e27-4a6c-84f0-326ad4b4cb0f req-0c90234b-7b4a-48ae-bdf9-c71df51a6916 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:23.189524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6eb96cd-8e27-4a6c-84f0-326ad4b4cb0f req-0c90234b-7b4a-48ae-bdf9-c71df51a6916 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:23.190068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-c6eb96cd-8e27-4a6c-84f0-326ad4b4cb0f req-0c90234b-7b4a-48ae-bdf9-c71df51a6916 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:23.202388 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-c6eb96cd-8e27-4a6c-84f0-326ad4b4cb0f req-0c90234b-7b4a-48ae-bdf9-c71df51a6916 service nova] Creating event network-vif-plugged:d6314037-903f-477e-a2e8-17888784a6b2 for instance 439d041b-96c0-4235-b4d4-82c4ce120480 on n-h1-858383-3 Oct 03 11:58:23.207789 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-c6eb96cd-8e27-4a6c-84f0-326ad4b4cb0f req-0c90234b-7b4a-48ae-bdf9-c71df51a6916 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033845 Oct 03 11:58:23.208546 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4169/8007] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:58:54.412732 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:58:54.414862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:58:54.417055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=28 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:58:54.417725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:58:54.424196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:54.424682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:54.425167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:54.425864 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:58:54.426324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:58:54.426755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:58:54.496477 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0e2f589e-e576-4a0b-b607-0cf24da6ebf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action" status: 200 len: 24575 microversion: 2.1 time: 0.087920 Oct 03 11:58:54.497418 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3839/8008] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 11:58:54 2022] POST /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480/action => generated 24575 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 11:59:18.268392 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=24 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:18.269631 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:18.274555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:18.275980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:18.278741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:18.279403 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:18.300595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:18.301133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:18.301581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:18.302304 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:18.302769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:18.303210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:18.333241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 11:59:18.362399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ec7eee05-9126-4f7c-9b38-05e92027a7db req-76ab3568-d8da-48dc-adbf-eff974c00f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439d041b-96c0-4235-b4d4-82c4ce120480", "tag": "d6314037-903f-477e-a2e8-17888784a6b2"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:59:18.374161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ec7eee05-9126-4f7c-9b38-05e92027a7db req-76ab3568-d8da-48dc-adbf-eff974c00f4c service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:18.374641 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ec7eee05-9126-4f7c-9b38-05e92027a7db req-76ab3568-d8da-48dc-adbf-eff974c00f4c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:18.375069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ec7eee05-9126-4f7c-9b38-05e92027a7db req-76ab3568-d8da-48dc-adbf-eff974c00f4c service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:18.387285 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ec7eee05-9126-4f7c-9b38-05e92027a7db req-76ab3568-d8da-48dc-adbf-eff974c00f4c service nova] Creating event network-changed:d6314037-903f-477e-a2e8-17888784a6b2 for instance 439d041b-96c0-4235-b4d4-82c4ce120480 on n-h1-858383-3 Oct 03 11:59:18.393280 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ec7eee05-9126-4f7c-9b38-05e92027a7db req-76ab3568-d8da-48dc-adbf-eff974c00f4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124446 Oct 03 11:59:18.394700 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3840/8009] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:59:18.417037 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d806e0a3-fcdf-43b0-87e3-579591be0346 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 204 len: 0 microversion: 2.1 time: 0.151020 Oct 03 11:59:18.417632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4170/8010] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 11:59:18 2022] DELETE /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 11:59:18.428114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:18.429387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:18.436306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:18.437256 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:18.437702 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:18.438421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:18.439687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:18.440127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:18.637812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:18.645738 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b221345-9c08-4a0d-ba93-2fda28d5b988 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1690 microversion: 2.1 time: 0.223287 Oct 03 11:59:18.646448 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3841/8011] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:18 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:19.671375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:19.672095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:19.680123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:19.680702 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:19.681183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:19.681893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:19.682354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:19.682922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:19.916168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:19.923977 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3f498dae-599e-473c-9e4f-c1cc6b690db6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1690 microversion: 2.1 time: 0.257079 Oct 03 11:59:19.924559 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4171/8012] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:19 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1690 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:20.464106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-47365473-6e42-4357-9f25-322d81b621d1 req-e50ef0e9-7d70-4500-a69b-c5d6b0dc4b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439d041b-96c0-4235-b4d4-82c4ce120480", "name": "network-vif-deleted", "tag": "d6314037-903f-477e-a2e8-17888784a6b2"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:59:20.475580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-47365473-6e42-4357-9f25-322d81b621d1 req-e50ef0e9-7d70-4500-a69b-c5d6b0dc4b25 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:20.476174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-47365473-6e42-4357-9f25-322d81b621d1 req-e50ef0e9-7d70-4500-a69b-c5d6b0dc4b25 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:20.476678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-47365473-6e42-4357-9f25-322d81b621d1 req-e50ef0e9-7d70-4500-a69b-c5d6b0dc4b25 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:20.489028 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-47365473-6e42-4357-9f25-322d81b621d1 req-e50ef0e9-7d70-4500-a69b-c5d6b0dc4b25 service nova] Creating event network-vif-deleted:d6314037-903f-477e-a2e8-17888784a6b2 for instance 439d041b-96c0-4235-b4d4-82c4ce120480 on n-h1-858383-3 Oct 03 11:59:20.494070 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-47365473-6e42-4357-9f25-322d81b621d1 req-e50ef0e9-7d70-4500-a69b-c5d6b0dc4b25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Oct 03 11:59:20.494895 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3842/8013] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:59:20.948264 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:20.948929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:20.956517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:20.957047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:20.957502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:20.958215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:20.958681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:20.959121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:20.994149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:20.994563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:20.995012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:20.995475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lazy-loading 'fault' on Instance uuid 439d041b-96c0-4235-b4d4-82c4ce120480 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 11:59:21.044181 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:21.051579 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c326b092-ca11-4529-8613-bd8008c77bd7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 200 len: 1356 microversion: 2.1 time: 0.107194 Oct 03 11:59:21.052154 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4172/8014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:20 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 11:59:22.077489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:22.078265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 439d041b-96c0-4235-b4d4-82c4ce120480] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:22.085132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:22.085611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:22.086044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:22.086734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:22.087188 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:22.087725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:22.101772 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] HTTP exception thrown: Instance 439d041b-96c0-4235-b4d4-82c4ce120480 could not be found. Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Request method failure captured: Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 HTTP/1.1 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOszcAipcX3qydjowhVim8evWDRy9JRdCD6U-7-l5r4sl2rlhK5H-lZMruxue2w-3Yexy2wZ-xgmknO5EyoPdP3sTJxJRDuEE6a_PFXDfNU4bQhGfO1sLp9NTwjgXVN5wvWQ5L2UAoJj0RbB5wzAxe39_2aOH3LZ3cKmzR3ebCQ-b7r4 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}] Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 2da248021bf744bcab832e3de472cf10 Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 439d041b-96c0-4235-b4d4-82c4ce120480 could not be found. Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '439d041b-96c0-4235-b4d4-82c4ce120480'} Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439d041b-96c0-4235-b4d4-82c4ce120480 could not be found. Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439d041b-96c0-4235-b4d4-82c4ce120480 could not be found. Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 11:59:22.103483 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439d041b-96c0-4235-b4d4-82c4ce120480 could not be found. Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Returning 404 to user: Instance 439d041b-96c0-4235-b4d4-82c4ce120480 could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-acbb0adf-693e-4e60-ad8a-3f6268c2a6e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480" status: 404 len: 111 microversion: 2.1 time: 0.032573 Oct 03 11:59:22.108757 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3843/8015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:22 2022] GET /compute/v2.1/servers/439d041b-96c0-4235-b4d4-82c4ce120480 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 11:59:25.460116 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-08af245a-df3a-4880-9dfe-f849ed6bd3be tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '.version_select at 0x7f074e078700>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:25.485319 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-08af245a-df3a-4880-9dfe-f849ed6bd3be tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1990686575" status: 202 len: 0 microversion: 2.1 time: 0.029628 Oct 03 11:59:25.485934 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4173/8016] 10.222.0.27 () {58 vars in 1284 bytes} [Mon Oct 3 11:59:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1990686575 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 11:59:25.514082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f33083d-2079-4f99-9d5e-42a1d9429c7d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: .version_select at 0x7f07574c5c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-745490409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCRagxB3YhU1cZQW/r+zZWX+CnO779cAkocEbXPttsrtPIYPqSnq9RQnlUzXmWqRNY2PUIzFC12poPHjxPdxHBykXOx7CpiHDBFLAw9VGUFjrABPq41be0AcqGQBE5Cog=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:59:25.531633 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7f33083d-2079-4f99-9d5e-42a1d9429c7d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:59:25.536731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-7f33083d-2079-4f99-9d5e-42a1d9429c7d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:59:25.559849 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f33083d-2079-4f99-9d5e-42a1d9429c7d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049637 Oct 03 11:59:25.560443 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3844/8017] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 11:59:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:59:31.106191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:31.111044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1662528572", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "c834611e-888b-4ba5-9f67-3828f955e8fd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-745490409", "security_groups": [{"name": "tempest-secgroup-smoke-618327844"}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:59:31.229847 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] validate_networks() for [('c834611e-888b-4ba5-9f67-3828f955e8fd', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 11:59:31.737893 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 11:59:31.738342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 11:59:31.738836 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 11:59:31.739293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 11:59:31.739904 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 11:59:31.751845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:31.752519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:31.753040 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:31.753810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:31.754284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:31.754731 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:31.776104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 11:59:31.784294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 11:59:31.798856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 11:59:31.801293 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 11:59:31.853515 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-658bc071-f4f0-4df1-b948-0048954f8b70 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749074 Oct 03 11:59:31.861126 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4174/8018] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 11:59:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 11:59:31.867239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f2aff6da-5577-4731-a0a9-545d540a44e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:31.867858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f2aff6da-5577-4731-a0a9-545d540a44e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:31.932620 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f2aff6da-5577-4731-a0a9-545d540a44e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:31.941281 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f2aff6da-5577-4731-a0a9-545d540a44e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1266 microversion: 2.1 time: 0.078343 Oct 03 11:59:31.943249 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3845/8019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:31 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:32.966115 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:32.967363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:32.974649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:32.975198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:32.975650 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:32.976362 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:32.976850 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:32.977289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:33.082520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:33.098806 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-66a250b0-80a6-4d64-832b-5f348c1823ea tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1318 microversion: 2.1 time: 0.137312 Oct 03 11:59:33.105038 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4175/8020] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:32 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:34.121850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:34.122684 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:34.124785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:34.133655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:34.137966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:34.138740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:34.139697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:34.140364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:34.141480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:34.335362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:34.343777 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-33316c37-9163-4eae-8eb6-555c863ecbe4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.225939 Oct 03 11:59:34.344372 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3846/8021] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:34 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:34.629149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-075a6a89-d6d2-4c01-b988-d0b698d12dfd req-875a77de-72a0-4745-bb17-9a8229d6bf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d229172-13d2-4d9f-815e-10ff20f33d60", "tag": "95732f90-71c8-4482-8348-13bbbace8f80"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:59:34.639977 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-075a6a89-d6d2-4c01-b988-d0b698d12dfd req-875a77de-72a0-4745-bb17-9a8229d6bf59 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:34.640726 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-075a6a89-d6d2-4c01-b988-d0b698d12dfd req-875a77de-72a0-4745-bb17-9a8229d6bf59 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:34.641429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-075a6a89-d6d2-4c01-b988-d0b698d12dfd req-875a77de-72a0-4745-bb17-9a8229d6bf59 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:34.653035 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-075a6a89-d6d2-4c01-b988-d0b698d12dfd req-875a77de-72a0-4745-bb17-9a8229d6bf59 service nova] Creating event network-changed:95732f90-71c8-4482-8348-13bbbace8f80 for instance 5d229172-13d2-4d9f-815e-10ff20f33d60 on n-h1-858383-3 Oct 03 11:59:34.658520 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-075a6a89-d6d2-4c01-b988-d0b698d12dfd req-875a77de-72a0-4745-bb17-9a8229d6bf59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033172 Oct 03 11:59:34.659127 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4176/8022] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:59:35.366779 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:35.367369 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:35.374121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:35.374600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:35.375038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:35.376236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:35.376690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:35.377144 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:35.507787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:35.515600 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8c2b01c4-0b2d-4945-9364-5afdf03a2e88 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.152738 Oct 03 11:59:35.516178 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3847/8023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:35 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:36.539966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:36.540601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:36.547839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:36.548334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:36.548823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:36.549551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:36.550000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:36.550439 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:36.680114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:36.687974 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e189696f-1ecc-4bfb-8bb7-12506520baac tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.152404 Oct 03 11:59:36.689094 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4177/8024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:36 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:37.711280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:37.711819 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:37.718699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:37.719189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:37.719630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:37.720328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:37.720812 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:37.721246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:38.105596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:38.113732 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cad18905-920f-4629-bfd2-5997761306bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.406478 Oct 03 11:59:38.114322 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3848/8025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:37 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:39.137853 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:39.138481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:39.145420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:39.145917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:39.146370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:39.147081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:39.147552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:39.147991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:39.276920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:39.285150 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ec611c69-fa01-4b4b-bd13-3f511e4d79e8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.151256 Oct 03 11:59:39.285660 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4178/8026] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:39 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:40.307739 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:40.308345 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:40.315872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:40.316354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:40.316873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:40.317569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:40.318024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:40.318446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:40.452330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:40.460188 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c372fbc0-2e79-427e-b530-cb286d8e8289 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.156570 Oct 03 11:59:40.460816 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3849/8027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:40 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:41.483936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:41.484568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:41.491916 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:41.492427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:41.493026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:41.493669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:41.494138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:41.494720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:41.638524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:41.651318 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d2a20b50-84c5-41a8-a654-d786357d3bf2 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.171299 Oct 03 11:59:41.652466 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4179/8028] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:41 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:41.687500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-fa40ebc8-7da6-4cf2-be5c-e1c298d52707 req-77e80792-5d1a-4d5e-90d7-464d1553d860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d229172-13d2-4d9f-815e-10ff20f33d60", "name": "network-vif-plugged", "status": "completed", "tag": "95732f90-71c8-4482-8348-13bbbace8f80"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:59:41.697785 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa40ebc8-7da6-4cf2-be5c-e1c298d52707 req-77e80792-5d1a-4d5e-90d7-464d1553d860 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:41.698267 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa40ebc8-7da6-4cf2-be5c-e1c298d52707 req-77e80792-5d1a-4d5e-90d7-464d1553d860 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:41.698697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-fa40ebc8-7da6-4cf2-be5c-e1c298d52707 req-77e80792-5d1a-4d5e-90d7-464d1553d860 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:41.709361 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-fa40ebc8-7da6-4cf2-be5c-e1c298d52707 req-77e80792-5d1a-4d5e-90d7-464d1553d860 service nova] Creating event network-vif-plugged:95732f90-71c8-4482-8348-13bbbace8f80 for instance 5d229172-13d2-4d9f-815e-10ff20f33d60 on n-h1-858383-3 Oct 03 11:59:41.714394 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-fa40ebc8-7da6-4cf2-be5c-e1c298d52707 req-77e80792-5d1a-4d5e-90d7-464d1553d860 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099592 Oct 03 11:59:41.715035 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3850/8029] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 11:59:42.675738 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:42.676356 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:42.678331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:42.679459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:42.685884 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:42.686377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:42.687308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:42.687720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:42.689200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:42.689677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:42.829031 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:42.836649 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3279f8cb-437d-450c-bbff-3e33698a883e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1391 microversion: 2.1 time: 0.165324 Oct 03 11:59:42.837264 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4180/8030] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:42 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:43.859249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 11:59:43.864319 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:43.865056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:43.871456 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:43.871936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:43.872371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:43.873088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:43.873548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:43.873970 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:44.003332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:44.010987 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65751d18-d465-4809-8e76-888ee30a0ff8 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1563 microversion: 2.1 time: 0.152817 Oct 03 11:59:44.011547 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3851/8031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:43 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:44.033955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:44.034586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:44.041452 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:44.041950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:44.042400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:44.043109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:44.043574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:44.044013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:44.177458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:44.185487 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2dda4f1a-56cd-4716-a068-1f93cf5f7f9d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1563 microversion: 2.1 time: 0.156075 Oct 03 11:59:44.186067 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4181/8032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:44 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 11:59:46.002350 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 11:59:46.003003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 11:59:46.005686 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fafdf707-34e5-4835-9312-b25c9a1f57e7 req-87536a48-5d95-4f54-929e-3b635a3126b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d229172-13d2-4d9f-815e-10ff20f33d60", "tag": "95732f90-71c8-4482-8348-13bbbace8f80"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 11:59:46.010754 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:46.011242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:46.011886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:46.012598 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:46.013079 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:46.013517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:46.016882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fafdf707-34e5-4835-9312-b25c9a1f57e7 req-87536a48-5d95-4f54-929e-3b635a3126b8 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 11:59:46.017563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fafdf707-34e5-4835-9312-b25c9a1f57e7 req-87536a48-5d95-4f54-929e-3b635a3126b8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 11:59:46.018001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fafdf707-34e5-4835-9312-b25c9a1f57e7 req-87536a48-5d95-4f54-929e-3b635a3126b8 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 11:59:46.029441 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fafdf707-34e5-4835-9312-b25c9a1f57e7 req-87536a48-5d95-4f54-929e-3b635a3126b8 service nova] Creating event network-changed:95732f90-71c8-4482-8348-13bbbace8f80 for instance 5d229172-13d2-4d9f-815e-10ff20f33d60 on n-h1-858383-3 Oct 03 11:59:46.035265 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fafdf707-34e5-4835-9312-b25c9a1f57e7 req-87536a48-5d95-4f54-929e-3b635a3126b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034622 Oct 03 11:59:46.036447 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4182/8033] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 11:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 11:59:46.232359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 11:59:46.241097 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f11e907c-9a72-4a60-b78a-84f2ea26bfee tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1563 microversion: 2.1 time: 0.243042 Oct 03 11:59:46.241794 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3852/8034] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 11:59:45 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:19.527041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:00:19.529371 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:19.531561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:00:19.532228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=42 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:00:19.538480 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:19.538979 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:19.539441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:19.540151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:19.540618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:19.541093 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:19.608731 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0f3e501d-a746-48d3-8ecc-6d66aa2a66b0 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action" status: 200 len: 24575 microversion: 2.1 time: 0.086396 Oct 03 12:00:19.609522 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4183/8035] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:00:19 2022] POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action => generated 24575 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:00:50.028746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:00:50.029546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=38 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:00:50.034121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-421493d4-2d90-4e05-9197-352ae697a78f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:00:50.041847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421493d4-2d90-4e05-9197-352ae697a78f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:50.042401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421493d4-2d90-4e05-9197-352ae697a78f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:50.042847 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-421493d4-2d90-4e05-9197-352ae697a78f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:50.065237 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-421493d4-2d90-4e05-9197-352ae697a78f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Going to try to stop instance {{(pid=122270) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 12:00:50.105805 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-421493d4-2d90-4e05-9197-352ae697a78f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action" status: 202 len: 0 microversion: 2.1 time: 0.078685 Oct 03 12:00:50.106397 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3853/8036] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:00:50 2022] POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:00:50.115370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:50.116235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:50.118863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:00:50.119656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:00:50.125453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:50.125960 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:50.126424 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:50.127152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:50.127625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:50.128075 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:50.542198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:50.550107 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b56936b7-87d2-492a-be1d-7558e0db9e49 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.439062 Oct 03 12:00:50.550679 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4184/8037] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:50 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:51.578497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:51.580047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:51.586334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:51.586820 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:51.587262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:51.587954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:51.588408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:51.588857 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:51.720874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:51.729022 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4a16acaf-11f7-4494-9789-408fbbf80a14 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.156331 Oct 03 12:00:51.729582 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3854/8038] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:51 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:52.753086 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:52.753711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:52.761629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:52.762127 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:52.762581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:52.763282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:52.763750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:52.764194 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:52.895334 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:52.903570 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-80e52152-d058-4bef-a499-a0518eb229ab tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.154529 Oct 03 12:00:52.904145 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4185/8039] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:52 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:53.927804 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:53.928364 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:53.935301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:53.935784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:53.936220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:53.936951 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:53.937409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:53.937841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:54.070074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:54.077769 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb8a37db-b956-4982-adac-06f10ac5676f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.154237 Oct 03 12:00:54.078333 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3855/8040] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:53 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:55.101147 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:55.101752 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:55.108066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:55.108558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:55.109042 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:55.109746 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:55.110212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:55.110649 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:55.240102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:55.250197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54e8b86d-d763-4fd1-99bd-1fb77c64a22b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.152879 Oct 03 12:00:55.250812 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4186/8041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:55 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:56.274860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:56.275479 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:56.282425 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:56.282922 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:56.283371 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:56.284074 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:56.284537 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:56.285006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:56.414323 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:56.422064 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-388c105f-390a-44b1-901d-cef27c7e9b40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.151793 Oct 03 12:00:56.422883 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3856/8042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:56 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:57.446361 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:57.446999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:57.453913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:57.454417 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:57.454881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:57.455595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:57.456069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:57.456518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:57.592377 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:57.600197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9edff67e-02ac-4c52-acf9-6b80ee545c80 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.157776 Oct 03 12:00:57.600782 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4187/8043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:57 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:58.623310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:58.623934 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:58.630745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:58.631236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:58.631681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:58.632379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:58.633358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:58.633790 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:58.771911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:58.779665 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-469b6a57-e1ff-4061-819c-8e09c86313b5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.160254 Oct 03 12:00:58.780235 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3857/8044] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:58 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:00:59.802952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:00:59.803595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:00:59.811420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:59.811914 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:59.812364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:59.813090 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:00:59.813555 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:00:59.813991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:00:59.954013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:00:59.962447 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2de35e7e-7ea4-4f92-972c-958caa421ab6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.163478 Oct 03 12:00:59.963027 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4188/8045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:00:59 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:00.986462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:01:00.987078 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:00.994038 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:00.994521 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:00.994961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:00.995655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:00.996112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:00.996534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:01.127596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:01:01.135460 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-09781a33-ba8d-433a-9ba1-ec2d865b5155 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.152889 Oct 03 12:01:01.136029 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3858/8046] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:01:00 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:02.159354 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:01:02.160012 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:02.168562 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:02.169163 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:02.169623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:02.170368 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:02.170844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:02.171289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:02.299484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:01:02.308056 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-368dbbba-05b2-4b6e-b31e-1f0d7bb09175 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.152645 Oct 03 12:01:02.308632 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4189/8047] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:01:02 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:03.331156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:01:03.331791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:03.339209 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:03.339700 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:03.340145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:03.340884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:03.341346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:03.341777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:03.473878 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:01:03.483939 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bfef4a28-467e-4614-85a6-e7f0a88015c6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.156684 Oct 03 12:01:03.484622 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3859/8048] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:01:03 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:04.506483 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:01:04.507109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:04.514099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:04.514602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:04.515051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:04.515760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:04.516225 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:04.516664 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:04.679243 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:01:04.688462 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-758e91f0-fe74-4e07-bea4-e44feba722bb tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1692 microversion: 2.1 time: 0.185910 Oct 03 12:01:04.689066 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4190/8049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:01:04 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:05.712155 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:01:05.712787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:05.719648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:05.720149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:05.720597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:05.721334 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:05.721802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:05.722234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:05.908268 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:01:05.916171 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-88eb5396-8956-42b6-bbd8-025626f6094f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1669 microversion: 2.1 time: 0.208466 Oct 03 12:01:05.916761 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3860/8050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:01:05 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1669 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:07.009891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:01:07.012119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:07.018896 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:07.019391 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:07.019844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:07.020550 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:07.021034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:07.021475 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:07.084941 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0caf0989-b690-4ba2-8d54-305f47046955 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action" status: 200 len: 35861 microversion: 2.1 time: 0.078784 Oct 03 12:01:07.085603 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4191/8051] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:01:07 2022] POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action => generated 35861 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:01:07.097997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4b19c4d5-b1c9-4676-83fc-b41965c8314e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:01:07.105449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b19c4d5-b1c9-4676-83fc-b41965c8314e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:07.105940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b19c4d5-b1c9-4676-83fc-b41965c8314e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:07.106611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4b19c4d5-b1c9-4676-83fc-b41965c8314e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:07.131715 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4b19c4d5-b1c9-4676-83fc-b41965c8314e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Going to try to start instance {{(pid=122270) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 12:01:07.173142 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4b19c4d5-b1c9-4676-83fc-b41965c8314e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action" status: 202 len: 0 microversion: 2.1 time: 0.078596 Oct 03 12:01:07.173760 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3861/8052] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:01:07 2022] POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:01:07.183173 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:01:07.184016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:07.191369 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:07.191950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:07.192411 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:07.193162 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:07.193636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:07.198381 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:07.337507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:01:07.345745 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-65c78b89-bc69-4bf5-a017-4be3edf71013 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1678 microversion: 2.1 time: 0.167204 Oct 03 12:01:07.346338 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4192/8053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:01:07 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:08.370827 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:01:08.372220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:08.379279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:08.379789 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:08.380239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:08.380985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:08.381441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:08.381872 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:08.517549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:01:08.525769 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ef47b0c7-d606-405b-b84e-150a0d290367 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1682 microversion: 2.1 time: 0.160101 Oct 03 12:01:08.526341 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3862/8054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:01:08 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:01:42.751592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:01:42.754890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:01:42.759382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=18 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:01:42.760527 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=52 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:01:42.768169 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:42.768670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:42.769149 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:42.769864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:01:42.770336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:01:42.770776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:01:42.843525 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e928ea77-54c6-4807-97ae-b646f0c3ce40 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action" status: 200 len: 60423 microversion: 2.1 time: 0.098249 Oct 03 12:01:42.844102 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4193/8055] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:01:42 2022] POST /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60/action => generated 60423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:02:06.496037 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:06.496591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:06.500711 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=20 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:06.501471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:06.504240 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:06.505733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:06.505965 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:02:06.506348 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:02:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 (ip 10.222.0.27) !!! Oct 03 12:02:06.507557 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:02:06.510135 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:02:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 (ip 10.222.0.27) !!! Oct 03 12:02:06.536592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:06.537434 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:06.538207 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:06.539145 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:06.539618 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:06.540805 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:06.586764 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:02:06.637670 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-554b1323-642b-4903-b00a-e5ea6f7f51f2 req-09ca2ca2-fb2a-45aa-8f6a-daf0ee4c7d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d229172-13d2-4d9f-815e-10ff20f33d60", "tag": "95732f90-71c8-4482-8348-13bbbace8f80"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:02:06.651089 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-554b1323-642b-4903-b00a-e5ea6f7f51f2 req-09ca2ca2-fb2a-45aa-8f6a-daf0ee4c7d15 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:06.651679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-554b1323-642b-4903-b00a-e5ea6f7f51f2 req-09ca2ca2-fb2a-45aa-8f6a-daf0ee4c7d15 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:06.652247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-554b1323-642b-4903-b00a-e5ea6f7f51f2 req-09ca2ca2-fb2a-45aa-8f6a-daf0ee4c7d15 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:06.665777 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-554b1323-642b-4903-b00a-e5ea6f7f51f2 req-09ca2ca2-fb2a-45aa-8f6a-daf0ee4c7d15 service nova] Creating event network-changed:95732f90-71c8-4482-8348-13bbbace8f80 for instance 5d229172-13d2-4d9f-815e-10ff20f33d60 on n-h1-858383-3 Oct 03 12:02:06.683817 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-222276ad-f8e3-40d9-bb77-563ad307fdb1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 204 len: 0 microversion: 2.1 time: 0.190136 Oct 03 12:02:06.685625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-554b1323-642b-4903-b00a-e5ea6f7f51f2 req-09ca2ca2-fb2a-45aa-8f6a-daf0ee4c7d15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188318 Oct 03 12:02:06.686631 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4194/8057] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:02:06.689041 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3863/8057] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 12:02:06 2022] DELETE /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:02:06.697823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:06.698684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:06.706006 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:06.706603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:06.707255 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:06.707955 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:06.708436 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:06.708911 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:06.854994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:06.863602 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ff369d71-fc17-447e-be98-5b1077aec9e4 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1688 microversion: 2.1 time: 0.173221 Oct 03 12:02:06.864488 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4195/8058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:06 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:07.888125 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:07.888752 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:07.895710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:07.896190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:07.896630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:07.897346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:07.897800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:07.898227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:08.101083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:08.109399 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a1197570-16b6-45bb-8e30-e3625a476600 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1688 microversion: 2.1 time: 0.226200 Oct 03 12:02:08.109979 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3864/8059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:07 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:09.135043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:09.135653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:09.142104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:09.142602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:09.143055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:09.143761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:09.144229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:09.144669 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:09.339665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4074db71-f696-4e54-8787-e5ede63450b5 req-8976d2b3-fffc-413b-9e94-a174ba95af1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d229172-13d2-4d9f-815e-10ff20f33d60", "name": "network-vif-deleted", "tag": "95732f90-71c8-4482-8348-13bbbace8f80"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:02:09.357480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4074db71-f696-4e54-8787-e5ede63450b5 req-8976d2b3-fffc-413b-9e94-a174ba95af1b service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:09.358575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4074db71-f696-4e54-8787-e5ede63450b5 req-8976d2b3-fffc-413b-9e94-a174ba95af1b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:09.359491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4074db71-f696-4e54-8787-e5ede63450b5 req-8976d2b3-fffc-413b-9e94-a174ba95af1b service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:09.370287 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:09.373345 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-4074db71-f696-4e54-8787-e5ede63450b5 req-8976d2b3-fffc-413b-9e94-a174ba95af1b service nova] Creating event network-vif-deleted:95732f90-71c8-4482-8348-13bbbace8f80 for instance 5d229172-13d2-4d9f-815e-10ff20f33d60 on n-h1-858383-3 Oct 03 12:02:09.380488 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4074db71-f696-4e54-8787-e5ede63450b5 req-8976d2b3-fffc-413b-9e94-a174ba95af1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045544 Oct 03 12:02:09.382125 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-78ce88a4-c8a6-40eb-a6ab-c3891ef8eb4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 200 len: 1569 microversion: 2.1 time: 0.252016 Oct 03 12:02:09.382894 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4196/8060] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:09 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:02:09.384726 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3865/8061] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:02:10.406220 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:10.406770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 5d229172-13d2-4d9f-815e-10ff20f33d60] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:10.413658 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:10.414156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:10.414613 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:10.415318 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:10.415788 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:10.416232 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:10.430309 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] HTTP exception thrown: Instance 5d229172-13d2-4d9f-815e-10ff20f33d60 could not be found. Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Request method failure captured: Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 HTTP/1.1 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOszcAipcX3qydjowhVim8evWDRy9JRdCD6U-7-l5r4sl2rlhK5H-lZMruxue2w-3Yexy2wZ-xgmknO5EyoPdP3sTJxJRDuEE6a_PFXDfNU4bQhGfO1sLp9NTwjgXVN5wvWQ5L2UAoJj0RbB5wzAxe39_2aOH3LZ3cKmzR3ebCQ-b7r4 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}] Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2da248021bf744bcab832e3de472cf10 Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 5d229172-13d2-4d9f-815e-10ff20f33d60 could not be found. Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '5d229172-13d2-4d9f-815e-10ff20f33d60'} Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d229172-13d2-4d9f-815e-10ff20f33d60 could not be found. Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d229172-13d2-4d9f-815e-10ff20f33d60 could not be found. Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:02:10.431959 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d229172-13d2-4d9f-815e-10ff20f33d60 could not be found. Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Returning 404 to user: Instance 5d229172-13d2-4d9f-815e-10ff20f33d60 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ca96bb11-2652-4e7d-b8e7-a848d1dcd196 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60" status: 404 len: 111 microversion: 2.1 time: 0.031214 Oct 03 12:02:10.438145 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4197/8062] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:10 2022] GET /compute/v2.1/servers/5d229172-13d2-4d9f-815e-10ff20f33d60 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:02:13.657740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-545b64d9-f9d0-48a5-b98a-fe1edcbe90ba tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '.version_select at 0x7f074dcc00d0>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:13.687965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-545b64d9-f9d0-48a5-b98a-fe1edcbe90ba tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-745490409" status: 202 len: 0 microversion: 2.1 time: 0.034377 Oct 03 12:02:13.692888 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3866/8063] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 3 12:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-745490409 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:02:13.722628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a4fa672d-ea38-4998-adc4-99431ff096c1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: .version_select at 0x7f074e56c5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-512751321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq05uhkrFBu50pTCUjcV3tSEmtAVEdKJcRa8RQjRcpleQQRTf5ciHN0J+P3/rcUrQGLIlGBZYy1UUkngtE3XSYz33FzZFHkrtkjLgaYfKmicXF4ZWBQY0ilydz6FH9fGw=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:02:13.739666 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a4fa672d-ea38-4998-adc4-99431ff096c1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:02:13.745208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-a4fa672d-ea38-4998-adc4-99431ff096c1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:02:13.758840 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4fa672d-ea38-4998-adc4-99431ff096c1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [a1154216-782c-479b-bce8-2deba5830e44] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:02:14.766127 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4fa672d-ea38-4998-adc4-99431ff096c1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [a1154216-782c-479b-bce8-2deba5830e44] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 51592. Oct 03 12:02:14.781114 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a4fa672d-ea38-4998-adc4-99431ff096c1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.063184 Oct 03 12:02:14.781729 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4198/8064] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 12:02:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:02:20.019056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:20.024405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-334614263", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "networks": [{"uuid": "127783e2-ef22-4933-afe7-585988e0814a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-512751321", "security_groups": [{"name": "tempest-secgroup-smoke-1933137614"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:02:20.149114 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] validate_networks() for [('127783e2-ef22-4933-afe7-585988e0814a', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:02:20.626410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:02:20.626843 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:02:20.627317 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:02:20.628040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:02:20.628963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:02:20.639164 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:20.639809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:20.640677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:20.641707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:20.642249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:20.642904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:20.666002 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:02:20.672123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Getting quotas for user 2da248021bf744bcab832e3de472cf10 and project 4b9c1f59cf874b918ed5904563994b89. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:02:20.684870 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:02:20.687315 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:02:20.738877 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-519c3a8f-81e7-41f4-b983-dd795b0e7ee1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721544 Oct 03 12:02:20.740242 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3867/8065] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 12:02:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:02:20.751797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8a5a0a6f-edf6-41bb-989a-460341cb34f1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:20.752419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8a5a0a6f-edf6-41bb-989a-460341cb34f1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:20.755487 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=16 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:20.816138 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8a5a0a6f-edf6-41bb-989a-460341cb34f1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:20.825076 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8a5a0a6f-edf6-41bb-989a-460341cb34f1 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1265 microversion: 2.1 time: 0.076569 Oct 03 12:02:20.825796 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4199/8066] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:20 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:21.910213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:21.910833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:21.917165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:21.917655 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:21.918095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:21.919528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:21.919933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:21.920560 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:22.029462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:22.040020 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40f2591c-ff36-4aee-b924-14864ac1c5e6 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1325 microversion: 2.1 time: 0.194915 Oct 03 12:02:22.041737 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3868/8067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:21 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1325 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:23.066872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:23.067504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:23.074859 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:23.075367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:23.075818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:23.076991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:23.077694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:23.078137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:23.221583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:23.230282 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-0000df6b-9ae7-4604-a5ed-10c0dee42e8a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.167491 Oct 03 12:02:23.231677 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4200/8068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:23 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:23.800405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-2a70277f-53f3-4ef0-8e46-ac5ff06fdc27 req-153441d1-0b16-4431-a8ae-45fc33dab5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928ae91b-635c-4cd8-9c25-128e1d1fc5cc", "tag": "71ce3678-f688-47c9-8162-b9ea9a319731"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:02:23.811678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2a70277f-53f3-4ef0-8e46-ac5ff06fdc27 req-153441d1-0b16-4431-a8ae-45fc33dab5c6 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:23.812247 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2a70277f-53f3-4ef0-8e46-ac5ff06fdc27 req-153441d1-0b16-4431-a8ae-45fc33dab5c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:23.812968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2a70277f-53f3-4ef0-8e46-ac5ff06fdc27 req-153441d1-0b16-4431-a8ae-45fc33dab5c6 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:23.825885 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-2a70277f-53f3-4ef0-8e46-ac5ff06fdc27 req-153441d1-0b16-4431-a8ae-45fc33dab5c6 service nova] Creating event network-changed:71ce3678-f688-47c9-8162-b9ea9a319731 for instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc on n-h1-858383-3 Oct 03 12:02:23.830819 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-2a70277f-53f3-4ef0-8e46-ac5ff06fdc27 req-153441d1-0b16-4431-a8ae-45fc33dab5c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034250 Oct 03 12:02:23.831423 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3869/8069] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:02:24.255933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:24.257350 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:24.268186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:24.269034 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:24.269570 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:24.270600 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:24.271079 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:24.271524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:24.414942 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:24.423402 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-47b214f1-a404-4c6b-b3e8-b1c2998dbdb5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.172272 Oct 03 12:02:24.423996 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4201/8070] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:24 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:25.448665 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:25.450014 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:25.456231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:25.456714 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:25.457172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:25.457858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:25.458311 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:25.458731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:25.594682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:25.602431 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-94ba6334-a7d8-4f94-a4dd-6b0c21e6d32b tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.158927 Oct 03 12:02:25.603004 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3870/8071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:25 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:26.625139 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:26.625776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:26.632621 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:26.633150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:26.633603 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:26.634316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:26.634783 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:26.635228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:26.770868 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:26.779430 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-613805ee-22c6-436e-90cd-625f17b45219 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.158228 Oct 03 12:02:26.780026 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4202/8072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:26 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:27.802480 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:27.803095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:27.810194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:27.810678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:27.811115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:27.811809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:27.812263 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:27.812691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:27.940013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:27.947667 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-864b2438-8d90-4775-ba2b-3ae8eab4a38d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.149158 Oct 03 12:02:27.948238 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3871/8073] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:27 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:28.970540 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:28.971098 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:28.978082 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:28.978611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:28.979068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:28.979777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:28.980280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:28.981258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:29.113930 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:29.122233 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e7765b31-4fe3-4c81-8c68-9104a3c410ae tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.155768 Oct 03 12:02:29.122809 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4203/8074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:28 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:30.145330 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:30.145969 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:30.153088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:30.153572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:30.154010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:30.154706 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:30.155160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:30.155583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:30.246872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3d143104-9b4f-43e5-a994-fec12d11d274 req-0c339d5b-a62e-4211-9058-6fc37a552a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928ae91b-635c-4cd8-9c25-128e1d1fc5cc", "name": "network-vif-plugged", "status": "completed", "tag": "71ce3678-f688-47c9-8162-b9ea9a319731"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:02:30.258215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3d143104-9b4f-43e5-a994-fec12d11d274 req-0c339d5b-a62e-4211-9058-6fc37a552a90 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:30.258932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3d143104-9b4f-43e5-a994-fec12d11d274 req-0c339d5b-a62e-4211-9058-6fc37a552a90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:30.259551 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3d143104-9b4f-43e5-a994-fec12d11d274 req-0c339d5b-a62e-4211-9058-6fc37a552a90 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:30.272831 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3d143104-9b4f-43e5-a994-fec12d11d274 req-0c339d5b-a62e-4211-9058-6fc37a552a90 service nova] Creating event network-vif-plugged:71ce3678-f688-47c9-8162-b9ea9a319731 for instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc on n-h1-858383-3 Oct 03 12:02:30.278264 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3d143104-9b4f-43e5-a994-fec12d11d274 req-0c339d5b-a62e-4211-9058-6fc37a552a90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036236 Oct 03 12:02:30.279065 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4204/8075] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:02:30.296281 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:30.305606 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-42a67c11-4c07-45d9-95ea-11985405dd2d tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.164483 Oct 03 12:02:30.306364 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3872/8076] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:30 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:31.327447 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:31.332489 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:31.333262 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:31.339792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:31.340316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:31.340819 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:31.341529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:31.341995 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:31.342440 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:31.476739 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:31.484374 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e77a6cd2-1f70-4800-ba33-d8628e0ef671 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1391 microversion: 2.1 time: 0.158020 Oct 03 12:02:31.484979 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4205/8077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:31 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:32.507172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:32.507788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:32.509768 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:32.510431 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:02:32.517033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:32.517520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:32.517960 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:32.518653 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:32.519112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:32.519538 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:32.648860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:32.657170 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bbc55944-2bba-4e3f-b3f0-78bdb1eab294 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1563 microversion: 2.1 time: 0.153872 Oct 03 12:02:32.657733 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3873/8078] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:32 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:32.679117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:32.680001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:32.687311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:32.687806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:32.688260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:32.688997 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:32.689466 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:32.689915 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:32.822477 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:32.830790 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7c252689-943c-4f32-ba03-5eb3548bcf94 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1563 microversion: 2.1 time: 0.155583 Oct 03 12:02:32.831510 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4206/8079] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:32 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:02:34.401254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7164e21a-0d86-4a49-82d5-9f8754461aea req-54e35025-48e0-4fd2-894b-db4141dcaefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928ae91b-635c-4cd8-9c25-128e1d1fc5cc", "tag": "71ce3678-f688-47c9-8162-b9ea9a319731"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:02:34.409296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:02:34.409927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:02:34.412677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7164e21a-0d86-4a49-82d5-9f8754461aea req-54e35025-48e0-4fd2-894b-db4141dcaefd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:34.413229 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7164e21a-0d86-4a49-82d5-9f8754461aea req-54e35025-48e0-4fd2-894b-db4141dcaefd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:34.413751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7164e21a-0d86-4a49-82d5-9f8754461aea req-54e35025-48e0-4fd2-894b-db4141dcaefd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:34.417066 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:34.417777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:34.418424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:34.419143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:02:34.419608 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:02:34.420045 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:02:34.426325 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7164e21a-0d86-4a49-82d5-9f8754461aea req-54e35025-48e0-4fd2-894b-db4141dcaefd service nova] Creating event network-changed:71ce3678-f688-47c9-8162-b9ea9a319731 for instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc on n-h1-858383-3 Oct 03 12:02:34.432044 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7164e21a-0d86-4a49-82d5-9f8754461aea req-54e35025-48e0-4fd2-894b-db4141dcaefd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034365 Oct 03 12:02:34.432801 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4207/8080] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:02:34.642842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:02:34.651003 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a5fa5762-eb27-4479-bd43-af8f36b14171 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1563 microversion: 2.1 time: 0.258225 Oct 03 12:02:34.651853 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3874/8081] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:02:34 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:09.985270 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:03:09.985868 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 12:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action (ip 10.222.0.27) !!! Oct 03 12:03:09.986563 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:03:09.987343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=40 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:03:09.991833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:03:09.994108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:10.003986 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:10.004485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:10.004966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:10.005675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:10.006146 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:10.006589 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:10.081377 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e19bfd1d-0b81-4da4-9ef0-79a306110969 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action" status: 200 len: 24562 microversion: 2.1 time: 0.098308 Oct 03 12:03:10.082249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4208/8082] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:03:09 2022] POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action => generated 24562 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 12:03:48.847858 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:03:48.848522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=40 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:03:48.853500 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:03:48.854028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:48.861856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:48.862339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:48.862772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:48.863455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:48.863907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:48.864355 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:48.887927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lazy-loading 'flavor' on Instance uuid 928ae91b-635c-4cd8-9c25-128e1d1fc5cc {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:03:48.950581 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-da6899df-fda3-4314-b04f-7910cc3a7595 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action" status: 202 len: 0 microversion: 2.1 time: 0.104419 Oct 03 12:03:48.953293 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3875/8083] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:03:48 2022] POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:03:48.960254 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:48.961023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:48.963710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:03:48.964533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=4 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:03:48.971615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:48.972113 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:48.972602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:48.973517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:48.974047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:48.974518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:49.116981 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:49.124738 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-117a08f9-9576-44b7-8f59-a576df55518f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1690 microversion: 2.1 time: 0.168893 Oct 03 12:03:49.125341 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4209/8084] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:48 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:50.151578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:50.152310 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:50.159013 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:50.159498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:50.159943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:50.160631 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:50.161117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:50.161546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:50.292030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:50.300412 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-aa280e62-0575-4496-ae4a-330f88adb829 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1690 microversion: 2.1 time: 0.154405 Oct 03 12:03:50.301071 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3876/8085] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:50 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:51.324085 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:51.324688 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:51.331745 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:51.332244 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:51.332699 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:51.333445 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:51.333899 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:51.334342 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:51.464711 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:51.472526 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39827b53-08cd-4dc8-a0a3-9d1f45d64d0e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1673 microversion: 2.1 time: 0.152421 Oct 03 12:03:51.473139 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4210/8086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:51 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:52.569897 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:03:52.572097 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:52.578937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:52.579422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:52.579862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:52.580559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:52.581039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:52.581466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:52.641870 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a8eb779b-4074-4070-af81-0a373c562b0a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action" status: 200 len: 38368 microversion: 2.1 time: 0.076061 Oct 03 12:03:52.642491 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3877/8087] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:03:52 2022] POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action => generated 38368 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:03:52.654499 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:03:52.655059 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:52.662216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:52.662720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:52.663180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:52.663890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:52.664363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:52.664830 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:52.730511 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30a517c1-6fb6-4b9b-8902-f9b22018d4e3 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action" status: 202 len: 0 microversion: 2.1 time: 0.079697 Oct 03 12:03:52.734497 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4211/8088] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:03:52 2022] POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:03:52.740228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:52.740953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:52.748640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:52.749166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:52.750162 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:52.751561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:52.752384 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:52.752856 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:53.240117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:53.248053 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-547b2595-e022-4e33-a8bb-30fb8745768e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1679 microversion: 2.1 time: 0.512030 Oct 03 12:03:53.260937 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3878/8089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:52 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1679 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:54.273675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:54.274420 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:54.280580 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:54.281107 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:54.281561 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:54.282269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:54.282737 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:54.283183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:54.414478 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:54.422748 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-df5b45d3-6db5-43eb-8706-e948bfae50e7 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1679 microversion: 2.1 time: 0.154264 Oct 03 12:03:54.423321 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4212/8090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:54 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:55.446175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:55.446791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:55.454441 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:55.454925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:55.455370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:55.456094 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:55.456555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:55.457011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:55.590283 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:55.598475 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-47754bde-8580-44c3-b7dc-3c0bb3c61ec5 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1682 microversion: 2.1 time: 0.156203 Oct 03 12:03:55.599031 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3879/8091] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:55 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:55.693743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:03:55.695950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:55.703143 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:55.703578 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:55.704028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:55.704729 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:55.705215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:55.705652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:55.767102 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9f4cd287-d543-493d-8e1c-0344359fe14a tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action" status: 200 len: 38368 microversion: 2.1 time: 0.077219 Oct 03 12:03:55.767766 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4213/8092] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:03:55 2022] POST /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc/action => generated 38368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 12:03:56.720929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:56.721449 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:56.723672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-caed45d7-ba96-47f5-8045-825e2c98171f req-71659031-713a-4c79-a87a-f344bda05f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928ae91b-635c-4cd8-9c25-128e1d1fc5cc", "tag": "71ce3678-f688-47c9-8162-b9ea9a319731"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:03:56.729108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:56.729682 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:56.730228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:56.731937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:56.732477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:56.733000 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:56.735268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-caed45d7-ba96-47f5-8045-825e2c98171f req-71659031-713a-4c79-a87a-f344bda05f34 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:56.735761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-caed45d7-ba96-47f5-8045-825e2c98171f req-71659031-713a-4c79-a87a-f344bda05f34 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:56.736204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-caed45d7-ba96-47f5-8045-825e2c98171f req-71659031-713a-4c79-a87a-f344bda05f34 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:56.747683 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-caed45d7-ba96-47f5-8045-825e2c98171f req-71659031-713a-4c79-a87a-f344bda05f34 service nova] Creating event network-changed:71ce3678-f688-47c9-8162-b9ea9a319731 for instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc on n-h1-858383-3 Oct 03 12:03:56.753276 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-caed45d7-ba96-47f5-8045-825e2c98171f req-71659031-713a-4c79-a87a-f344bda05f34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033613 Oct 03 12:03:56.754196 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4214/8093] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:03:56.764948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:03:56.850821 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4cfcf55b-1892-4ca5-a9da-f085b0026b4e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 204 len: 0 microversion: 2.1 time: 0.133624 Oct 03 12:03:56.854666 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3880/8094] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 12:03:56 2022] DELETE /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:03:56.865066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:56.865784 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:56.872635 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:56.873187 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:56.873638 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:56.874985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:56.875481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:56.876206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:57.019639 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:57.027828 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-45bf76fc-c943-47f9-b51d-642af2b08458 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1688 microversion: 2.1 time: 0.167624 Oct 03 12:03:57.028423 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4215/8095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:56 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:58.054022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:58.054726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:58.062627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:58.063110 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:58.063548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:58.064262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:58.064721 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:58.065169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:58.267109 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:58.275020 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cc612b71-8a6d-4e26-b907-66b24a001c3f tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1688 microversion: 2.1 time: 0.225350 Oct 03 12:03:58.275596 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3881/8096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:58 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:03:59.230309 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-88a3bf2c-bf31-40ad-9f38-8f3529721cc8 req-32a1c985-6f83-410a-861d-22ab7b654254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928ae91b-635c-4cd8-9c25-128e1d1fc5cc", "name": "network-vif-deleted", "tag": "71ce3678-f688-47c9-8162-b9ea9a319731"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:03:59.241581 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-88a3bf2c-bf31-40ad-9f38-8f3529721cc8 req-32a1c985-6f83-410a-861d-22ab7b654254 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:59.242081 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-88a3bf2c-bf31-40ad-9f38-8f3529721cc8 req-32a1c985-6f83-410a-861d-22ab7b654254 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:59.242535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-88a3bf2c-bf31-40ad-9f38-8f3529721cc8 req-32a1c985-6f83-410a-861d-22ab7b654254 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:59.254562 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-88a3bf2c-bf31-40ad-9f38-8f3529721cc8 req-32a1c985-6f83-410a-861d-22ab7b654254 service nova] Creating event network-vif-deleted:71ce3678-f688-47c9-8162-b9ea9a319731 for instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc on n-h1-858383-3 Oct 03 12:03:59.259710 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-88a3bf2c-bf31-40ad-9f38-8f3529721cc8 req-32a1c985-6f83-410a-861d-22ab7b654254 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033238 Oct 03 12:03:59.260425 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4216/8097] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:03:59.298658 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:03:59.299399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:03:59.306587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:59.307070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:59.307507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:59.308199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:03:59.308666 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:03:59.309123 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:03:59.374010 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da248021bf744bcab832e3de472cf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9c1f59cf874b918ed5904563994b89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:03:59.382353 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4eabc947-4f2f-49f2-98e1-4bb1a407d661 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 200 len: 1350 microversion: 2.1 time: 0.087682 Oct 03 12:03:59.382948 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3882/8098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:03:59 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:00.408142 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:00.408939 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] [instance: 928ae91b-635c-4cd8-9c25-128e1d1fc5cc] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:00.415101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:00.415592 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:00.416047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:00.416743 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:00.417228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:00.417665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:00.430929 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] HTTP exception thrown: Instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc could not be found. Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Request method failure captured: Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc HTTP/1.1 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOszcAipcX3qydjowhVim8evWDRy9JRdCD6U-7-l5r4sl2rlhK5H-lZMruxue2w-3Yexy2wZ-xgmknO5EyoPdP3sTJxJRDuEE6a_PFXDfNU4bQhGfO1sLp9NTwjgXVN5wvWQ5L2UAoJj0RbB5wzAxe39_2aOH3LZ3cKmzR3ebCQ-b7r4 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b9c1f59cf874b918ed5904563994b89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b9c1f59cf874b918ed5904563994b89"}]}] Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 4b9c1f59cf874b918ed5904563994b89 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-411752 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 2da248021bf744bcab832e3de472cf10 Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestNetworkAdvancedServerOps-411752-project Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc could not be found. Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '928ae91b-635c-4cd8-9c25-128e1d1fc5cc'} Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc could not be found. Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc could not be found. Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:04:00.432602 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc could not be found. Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Returning 404 to user: Instance 928ae91b-635c-4cd8-9c25-128e1d1fc5cc could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-596ce337-af37-407c-b3eb-4c6c62c85a8e tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc" status: 404 len: 111 microversion: 2.1 time: 0.031583 Oct 03 12:04:00.438270 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4217/8099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:00 2022] GET /compute/v2.1/servers/928ae91b-635c-4cd8-9c25-128e1d1fc5cc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:04:03.709561 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-57fc9b13-2379-4425-92ec-b05c0027b162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] Calling method '.version_select at 0x7f074e00f040>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:03.730541 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-57fc9b13-2379-4425-92ec-b05c0027b162 tempest-TestNetworkAdvancedServerOps-411752 tempest-TestNetworkAdvancedServerOps-411752-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-512751321" status: 202 len: 0 microversion: 2.1 time: 0.024868 Oct 03 12:04:03.731127 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3883/8100] 10.222.0.27 () {58 vars in 1281 bytes} [Mon Oct 3 12:04:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-512751321 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:04:14.867828 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=18 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:04:14.869124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:04:15.117577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-75a261c4-758e-4659-a338-008f26a26609 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'create', calling method: .version_select at 0x7f074df9cf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-2013896951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyQ6Hh8EkmMzEzgGaltWpGzCddqBPYKchhKDL3tTqmxbKHn8ONpo+Oj4HK7x6ICIA26WlMwdqAfYDkZMzdrdNtCmWV4719PHchPp3+UaYcwn1roxZp92Koq/7yc2/un1Q=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:04:15.142599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-75a261c4-758e-4659-a338-008f26a26609 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:04:15.148678 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-75a261c4-758e-4659-a338-008f26a26609 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for user 0747f26d8b71474e94d8b3df8ab476cb and project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:04:15.185997 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-75a261c4-758e-4659-a338-008f26a26609 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.323748 Oct 03 12:04:15.187586 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4218/8101] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 12:04:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:04:16.144600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:04:16.145396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:04:16.149357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1219552847", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2013896951", "security_groups": [{"name": "tempest-secgroup-smoke-1433253818"}], "networks": [{"uuid": "f0038ce4-e3f8-48ed-95d3-7f7bcfad5c06"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:04:16.293778 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] validate_networks() for [('f0038ce4-e3f8-48ed-95d3-7f7bcfad5c06', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:04:16.710556 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:04:16.711223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:04:16.711869 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:04:16.712291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:04:16.712712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:04:16.722292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:16.722787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:16.723234 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:16.723968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:16.724462 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:16.724929 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:16.743412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:04:16.749486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for user 0747f26d8b71474e94d8b3df8ab476cb and project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:04:16.762600 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:04:16.765540 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:04:16.819100 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9805644c-36f8-4164-9ca9-9e114af347b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676133 Oct 03 12:04:16.819690 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3884/8102] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 12:04:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:04:16.832137 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-12f2d61e-716b-4441-a14f-8e4a0aa1dd6d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:16.833378 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-12f2d61e-716b-4441-a14f-8e4a0aa1dd6d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:16.894808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-12f2d61e-716b-4441-a14f-8e4a0aa1dd6d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:16.903712 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-12f2d61e-716b-4441-a14f-8e4a0aa1dd6d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1247 microversion: 2.1 time: 0.076347 Oct 03 12:04:16.904498 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4219/8103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:16 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:17.927977 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:17.928728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:17.941455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:17.942557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:17.943522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:17.945175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:17.945831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:17.946840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:18.162498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:18.171798 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68068ef2-8954-4327-91d0-e43075763646 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1307 microversion: 2.1 time: 0.248543 Oct 03 12:04:18.172399 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3885/8104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:17 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:19.198881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:19.199516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:19.207568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:19.208077 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:19.208530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:19.209479 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:19.209959 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:19.210405 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:19.428822 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:19.438671 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5e7bac88-b5ca-4026-a06b-4a1e2f3da88d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1373 microversion: 2.1 time: 0.243696 Oct 03 12:04:19.439471 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4220/8105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:19 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1373 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:19.542270 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-62c633c5-91ad-4d02-99e7-56c94fbad300 req-c83393ef-1661-43f5-829e-85b23608f607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:04:19.552945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-62c633c5-91ad-4d02-99e7-56c94fbad300 req-c83393ef-1661-43f5-829e-85b23608f607 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:19.553464 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-62c633c5-91ad-4d02-99e7-56c94fbad300 req-c83393ef-1661-43f5-829e-85b23608f607 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:19.553898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-62c633c5-91ad-4d02-99e7-56c94fbad300 req-c83393ef-1661-43f5-829e-85b23608f607 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:19.565495 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-62c633c5-91ad-4d02-99e7-56c94fbad300 req-c83393ef-1661-43f5-829e-85b23608f607 service nova] Creating event network-changed:82b347ae-e0fc-4fe0-be07-add873f84887 for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf on n-h1-858383-3 Oct 03 12:04:19.571674 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-62c633c5-91ad-4d02-99e7-56c94fbad300 req-c83393ef-1661-43f5-829e-85b23608f607 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104125 Oct 03 12:04:19.572558 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3886/8106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:04:20.466186 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:20.466753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:20.472872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:20.473370 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:20.473821 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:20.474522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:20.474987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:20.475429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:20.612833 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:20.620497 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-81733cb8-414a-49c4-908b-2d8e30974ab4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1373 microversion: 2.1 time: 0.159538 Oct 03 12:04:20.621087 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4221/8107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:20 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:04:21.645953 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:21.646661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:21.652959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:21.653448 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:21.653898 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:21.654594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:21.655717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:21.656213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:21.791871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:21.799869 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-41560888-6f4d-4a5f-b4a0-8766c979f468 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1373 microversion: 2.1 time: 0.159254 Oct 03 12:04:21.804797 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3887/8108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:21 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:22.823556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:22.824191 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:22.831564 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:22.832068 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:22.832519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:22.833259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:22.833733 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:22.834177 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:22.969033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:22.976727 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9ee24979-fa15-48c7-ac81-a6e169bea849 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1373 microversion: 2.1 time: 0.157140 Oct 03 12:04:22.977335 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4222/8109] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:22 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:23.999978 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:24.000596 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:24.007300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:24.007793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:24.008236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:24.008965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:24.009433 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:24.009867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:24.145215 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:24.153335 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-bac193dd-18d6-437c-a577-3ab71b136372 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1373 microversion: 2.1 time: 0.157742 Oct 03 12:04:24.153905 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3888/8110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:23 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:24.728317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-fa4b3d0a-cba2-42e1-b82c-4a1b58b5e060 req-8fd6b7ab-febd-4dbc-b406-08af2e54f8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "name": "network-vif-plugged", "status": "completed", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:04:24.739014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fa4b3d0a-cba2-42e1-b82c-4a1b58b5e060 req-8fd6b7ab-febd-4dbc-b406-08af2e54f8fe service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:24.739512 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fa4b3d0a-cba2-42e1-b82c-4a1b58b5e060 req-8fd6b7ab-febd-4dbc-b406-08af2e54f8fe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:24.739962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-fa4b3d0a-cba2-42e1-b82c-4a1b58b5e060 req-8fd6b7ab-febd-4dbc-b406-08af2e54f8fe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:24.751788 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-fa4b3d0a-cba2-42e1-b82c-4a1b58b5e060 req-8fd6b7ab-febd-4dbc-b406-08af2e54f8fe service nova] Creating event network-vif-plugged:82b347ae-e0fc-4fe0-be07-add873f84887 for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf on n-h1-858383-3 Oct 03 12:04:24.756914 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-fa4b3d0a-cba2-42e1-b82c-4a1b58b5e060 req-8fd6b7ab-febd-4dbc-b406-08af2e54f8fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032508 Oct 03 12:04:24.757521 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4223/8111] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:04:25.175691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:25.176223 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:25.183583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:25.184073 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:25.184509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:25.185238 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:25.185699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:25.186127 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:25.322216 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:25.330620 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6b4b395c-5619-4727-b2b8-59919a6185fa tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1373 microversion: 2.1 time: 0.158945 Oct 03 12:04:25.331210 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3889/8112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:25 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:26.355390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:26.356206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:26.363196 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:26.363696 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:26.364150 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:26.364962 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:26.365450 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:26.365895 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:26.502102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:26.509926 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d11b2c22-ef2b-4f76-b743-35ddc93b4030 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1558 microversion: 2.1 time: 0.159960 Oct 03 12:04:26.510511 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4224/8113] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:26 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:26.533544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:04:26.534199 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:04:26.541226 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:26.541717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:26.542165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:26.542862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:26.543326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:26.543760 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:26.672963 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:04:26.681005 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-768796c7-0ffd-4ce9-af73-d4e8cf9ca10d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1558 microversion: 2.1 time: 0.152011 Oct 03 12:04:26.681588 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3890/8114] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:04:26 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:04:28.301076 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-3a635f09-a53b-4007-ae96-1b236b1b131f req-656a3d93-50e6-43e6-a8d8-1039db2500a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:04:28.306416 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=6 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:04:28.313636 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3a635f09-a53b-4007-ae96-1b236b1b131f req-656a3d93-50e6-43e6-a8d8-1039db2500a3 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:04:28.314453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3a635f09-a53b-4007-ae96-1b236b1b131f req-656a3d93-50e6-43e6-a8d8-1039db2500a3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:04:28.314965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-3a635f09-a53b-4007-ae96-1b236b1b131f req-656a3d93-50e6-43e6-a8d8-1039db2500a3 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:04:28.326218 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-3a635f09-a53b-4007-ae96-1b236b1b131f req-656a3d93-50e6-43e6-a8d8-1039db2500a3 service nova] Creating event network-changed:82b347ae-e0fc-4fe0-be07-add873f84887 for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf on n-h1-858383-3 Oct 03 12:04:28.331999 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-3a635f09-a53b-4007-ae96-1b236b1b131f req-656a3d93-50e6-43e6-a8d8-1039db2500a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 Oct 03 12:04:28.332975 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4225/8115] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:07:05.111533 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:07:05.112423 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:07:05.112795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:05.113565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:05.114396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:05.115061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=34 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:05.116370 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:07:05.116521 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf/action (ip 10.222.0.27) !!! Oct 03 12:07:05.118232 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:07:05.118362 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf/action (ip 10.222.0.27) !!! Oct 03 12:07:05.125734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:07:05.126262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:05.142383 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:05.142904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:05.143342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:05.144041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:05.144497 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:05.144954 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:05.168933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lazy-loading 'flavor' on Instance uuid 96d21b36-3c85-43b6-8cbe-318a7003fcaf {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:07:05.356295 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d041be58-2406-42a1-8e0d-b1ffe5fd4f7c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf/action" status: 202 len: 0 microversion: 2.1 time: 0.246670 Oct 03 12:07:05.357017 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3891/8116] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:07:05 2022] POST /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:07:05.364177 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:07:05.365051 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:07:05.365623 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:05.366628 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=28 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:05.368563 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:07:05.368740 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 12:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf (ip 10.222.0.27) !!! Oct 03 12:07:05.375061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:05.375817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:05.386028 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:05.386529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:05.386985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:05.387700 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:05.388174 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:05.388618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:05.523576 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:05.532115 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8fabb17b-adab-4b51-b435-007d37c82fbc tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.169944 Oct 03 12:07:05.532695 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4226/8117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:05 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:07:06.557288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:06.557907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:06.568459 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:06.568985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:06.569421 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:06.570312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:06.571004 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:06.571435 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:06.572547 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52000. Oct 03 12:07:06.576481 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 51998. Oct 03 12:07:06.714032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:06.721837 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-96b66a70-d84a-4a86-bd9d-23640d4927a3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.170320 Oct 03 12:07:06.722407 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3892/8118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:06 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:07.745306 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:07.745940 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:07.759774 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52010. Oct 03 12:07:07.766132 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:07.766782 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:07.767234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:07.767951 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:07.768414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:07.768876 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:07.770519 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52008. Oct 03 12:07:07.908175 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:07.915879 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22d9de2e-1ee1-4801-8df4-0917f5301bf7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.174525 Oct 03 12:07:07.916454 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4227/8119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:07 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:08.939587 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:08.940157 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:08.947746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:08.947746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:08.947746 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:08.949549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:08.949668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:08.950099 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:09.090528 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:09.099045 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-04b96067-8691-434f-b5de-7431b53492b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.163472 Oct 03 12:07:09.099629 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3893/8120] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:08 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:10.123382 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:10.124055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:10.131265 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:10.131769 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:10.132222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:10.132975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:10.133448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:10.133888 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:10.292721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:10.300713 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-c88f3b3c-55ac-4b8c-a18a-a8ef7e89119d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.181497 Oct 03 12:07:10.301311 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4228/8121] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:10 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:11.324559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:11.325235 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:11.332141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:11.332632 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:11.333111 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:11.333809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:11.334275 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:11.334692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:11.588948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:11.597589 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d63d6d19-9016-4adc-a147-c58a3e737045 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.276944 Oct 03 12:07:11.598176 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3894/8122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:11 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:12.621053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:12.621682 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:12.628593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:12.629130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:12.629583 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:12.630282 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:12.630818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:12.631259 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:12.764257 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:12.772241 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1e29f979-85aa-4f06-a0e0-92e890daf8bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.155092 Oct 03 12:07:12.772853 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4229/8123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:12 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:13.795467 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:13.796055 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:13.803476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:13.803965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:13.804408 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:13.805133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:13.805597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:13.806032 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:14.211974 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:14.220517 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-27079a38-379e-4cbf-9e8b-2223151a0305 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.429034 Oct 03 12:07:14.224493 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3895/8124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:13 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:15.244462 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:15.245094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:15.252811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:15.253321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:15.253777 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:15.254485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:15.254992 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:15.255507 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:15.387934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:15.395730 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5ab59a3f-1f46-4652-a088-c8b5c17dfc0c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.155210 Oct 03 12:07:15.396315 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4230/8125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:15 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:16.419233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:16.419966 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:16.427365 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:16.427849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:16.428292 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:16.429021 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:16.429484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:16.429913 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:16.559217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:16.567112 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-23765182-cdb4-4086-86c6-83fab6e074c0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.151780 Oct 03 12:07:16.567698 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3896/8126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:16 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:17.590648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:17.591454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:17.598573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:17.599061 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:17.599506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:17.600199 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:17.600665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:17.601126 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:17.733043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:17.741213 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-11ff2145-da8b-407b-83ac-2d197188fcb2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1704 microversion: 2.1 time: 0.154446 Oct 03 12:07:17.741781 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4231/8127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:17 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1704 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:18.766051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:18.766679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:18.773592 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:18.774088 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:18.774531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:18.775232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:18.775698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:18.776136 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:18.919379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:18.927630 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5166d806-d87e-4ced-84ad-946cc72c9c33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1704 microversion: 2.1 time: 0.166172 Oct 03 12:07:18.928214 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3897/8128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:18 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1704 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:19.951585 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:19.952205 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:19.959577 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:19.960157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:19.960605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:19.961326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:19.961798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:19.962235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:20.092886 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:20.104872 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-77577b89-1a6a-4d9f-9041-d929a72e319f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1704 microversion: 2.1 time: 0.157112 Oct 03 12:07:20.105885 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4232/8129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:19 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1704 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:21.129156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:21.129767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:21.136565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:21.137076 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:21.137515 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:21.138202 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:21.138654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:21.139083 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:21.267262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:21.275013 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-56a1f052-f44a-49d2-9b39-d5d2dac6c6d0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1704 microversion: 2.1 time: 0.150263 Oct 03 12:07:21.275587 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3898/8130] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:21 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1704 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:21.491714 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "name": "network-vif-plugged", "status": "completed", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:07:21.507271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:21.507776 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:21.508231 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:21.521871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] Creating event network-vif-plugged:82b347ae-e0fc-4fe0-be07-add873f84887 for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf on n-h1-858383-3 Oct 03 12:07:21.525427 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] [f213f004-573d-4cd7-aa0c-ce57a2f3f412] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:07:22.298003 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:22.298943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:22.305962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:22.306439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:22.307163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:22.307874 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:22.308333 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:22.308800 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:22.450190 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:22.459560 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9249bf9b-aa62-4532-bc34-f8ab5f777133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1704 microversion: 2.1 time: 0.165803 Oct 03 12:07:22.461549 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3899/8131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:22 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1704 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:07:22.532960 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] [f213f004-573d-4cd7-aa0c-ce57a2f3f412] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52054. Oct 03 12:07:22.538983 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-ffc1c2cd-f744-4eed-9bbe-5f0119165918 req-72e49354-68df-4e60-873d-1ecacc639a2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.110128 Oct 03 12:07:22.540141 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4233/8132] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:07:23.486312 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:23.487574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:23.496671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:23.497194 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:23.497642 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:23.498358 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:23.498824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:23.499265 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:23.675439 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:23.684652 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cdf8fb82-865c-4b83-96fa-216bea8904b3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.203470 Oct 03 12:07:23.685525 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3900/8133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:23 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:24.712944 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:24.713661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:24.721094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:24.721883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:24.722559 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:24.723610 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:24.724021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:24.724913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:24.879593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:24.888451 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-39aed854-763d-4678-8108-14743f0f4a31 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.181928 Oct 03 12:07:24.897417 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4234/8134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:24 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:25.911933 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:25.913476 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:25.920907 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:25.922397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:25.923090 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:25.924027 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:25.924575 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:25.925225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:26.084279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:26.092402 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7355b0d5-7ccb-4ff3-baa1-51baa1a91649 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.184616 Oct 03 12:07:26.093024 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3901/8135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:25 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:27.116874 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:27.117510 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:27.128492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:27.129168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:27.129872 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:27.130602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:27.131073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:27.131517 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:27.280001 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:27.288670 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-2c7254cc-ff3c-4024-be79-9f58bcd5b467 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.176041 Oct 03 12:07:27.304794 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4235/8136] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:27 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:28.316348 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:28.317046 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:28.323867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:28.324351 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:28.324813 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:28.325681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:28.326143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:28.326568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:28.472866 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:28.482917 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8ac5e607-d855-42ca-84dc-d3b0f7cf6fdd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.173185 Oct 03 12:07:28.484704 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3902/8137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:28 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:29.507201 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:29.507810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:29.515883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:29.516410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:29.516892 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:29.517654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:29.518399 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:29.518851 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:29.692625 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:29.701227 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7cc1df8e-e883-4327-87e4-471f067fe072 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.198119 Oct 03 12:07:29.703020 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4236/8138] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:29 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:30.730149 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:30.730814 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:30.738911 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:30.739410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:30.739853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:30.740581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:30.741072 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:30.741507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:30.911191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:30.919125 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7fbdfb11-a2cc-44ac-93f3-83b76254fa32 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.193026 Oct 03 12:07:30.933074 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3903/8139] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:30 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:31.943805 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:31.944347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:31.951253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:31.951744 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:31.952195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:31.952920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:31.953386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:31.953823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:32.088168 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:32.096403 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eaa630e6-fd34-40ad-8c54-89e64160812f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1699 microversion: 2.1 time: 0.156527 Oct 03 12:07:32.097011 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4237/8140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:31 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:33.123318 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:33.123873 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:33.131284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:33.131777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:33.132221 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:33.132973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:33.133440 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:33.133875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:33.268299 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:33.276174 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-016bcd00-a6bd-4980-9418-68acbd4bd800 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1681 microversion: 2.1 time: 0.156862 Oct 03 12:07:33.276752 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3904/8141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:33 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:34.299599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:34.300250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:34.307423 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:34.307927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:34.308387 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:34.309123 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:34.309597 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:34.310044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:34.438637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:34.446468 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5b3aae53-e9b4-49f8-9bf0-e4ce220ace2c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1681 microversion: 2.1 time: 0.150841 Oct 03 12:07:34.447035 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4238/8142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:34 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:35.467050 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-4dfdb783-1490-47ec-9887-dc49d0aa8745 req-4498f4ea-7e40-4549-915b-45fba0447ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "name": "network-vif-unplugged", "status": "completed", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:07:35.471234 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:35.471999 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:35.473602 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=29 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:35.475419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=27 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:35.479411 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4dfdb783-1490-47ec-9887-dc49d0aa8745 req-4498f4ea-7e40-4549-915b-45fba0447ea4 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:35.479909 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4dfdb783-1490-47ec-9887-dc49d0aa8745 req-4498f4ea-7e40-4549-915b-45fba0447ea4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:35.480354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-4dfdb783-1490-47ec-9887-dc49d0aa8745 req-4498f4ea-7e40-4549-915b-45fba0447ea4 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:35.484301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:35.484301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:35.484301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:35.484655 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:35.485154 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:35.485595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:35.488368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:35.495825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.compute.server_external_events [req-4dfdb783-1490-47ec-9887-dc49d0aa8745 req-4498f4ea-7e40-4549-915b-45fba0447ea4 service nova] Unable to find a host for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf. Dropping event network-vif-unplugged {{(pid=122270) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 12:07:35.496724 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-4dfdb783-1490-47ec-9887-dc49d0aa8745 req-4498f4ea-7e40-4549-915b-45fba0447ea4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033590 Oct 03 12:07:35.497530 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3905/8143] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 12:07:35.503104 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=75 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:07:35.625857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:35.633818 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7001e0c0-50bc-49da-b81c-25b80ae23714 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1624 microversion: 2.1 time: 0.167351 Oct 03 12:07:35.634392 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4239/8144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:35 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1624 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:07:35.657228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:07:35.657821 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:35.664605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:35.665124 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:35.665562 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:35.666243 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:35.666698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:35.667122 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:35.749555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122270) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 12:07:35.812608 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [a887fdda-e6f0-48e0-b74c-5b9b03201d9f] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:07:36.818794 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [a887fdda-e6f0-48e0-b74c-5b9b03201d9f] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52126. Oct 03 12:07:36.822310 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cf6f1006-890c-48cd-b3f0-a4e6815d6486 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf/action" status: 202 len: 0 microversion: 2.1 time: 1.169752 Oct 03 12:07:36.822942 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3906/8145] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:07:35 2022] POST /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf/action => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 12:07:36.831284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:36.831827 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:36.838606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:36.839101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:36.839547 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:36.840253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:36.840720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:36.841237 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:36.975609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:36.983332 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9aeaa1e6-6d92-44c3-924b-244c92cbee2f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1632 microversion: 2.1 time: 0.156060 Oct 03 12:07:36.983899 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4240/8146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:36 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1632 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:07:38.007352 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:38.007997 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:38.015012 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:38.016008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:38.016453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:38.017183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:38.017647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:38.018084 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:38.150297 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:38.159265 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1b8166c4-b56d-4ffe-92aa-f8df350ea5f0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.156621 Oct 03 12:07:38.159859 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3907/8147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:38 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:39.185900 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:39.186441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:39.194922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:39.195870 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:39.196588 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:39.197952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:39.198753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:39.199446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:39.394932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:39.407837 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf99b672-cac1-4b16-83dc-bede5495162e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.226555 Oct 03 12:07:39.424132 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4241/8148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:39 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:40.431579 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:40.432557 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:40.439797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:40.440387 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:40.440928 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:40.441698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:40.442222 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:40.442716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:40.615917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:40.624292 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-cb452995-4ae9-47ee-bbeb-a5a869fa2f0a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.196596 Oct 03 12:07:40.625043 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3908/8149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:40 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:41.649280 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:41.649945 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:41.657722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:41.658227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:41.658689 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:41.659413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:41.659881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:41.660321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:41.804890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:41.818923 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f99fa532-289f-447f-9150-a6d1c6ac4d09 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.173342 Oct 03 12:07:41.819960 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4242/8150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:41 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:42.842613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:42.843191 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:42.851591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:42.852362 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:42.852930 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:42.853731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:42.854220 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:42.854654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:43.014996 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:43.023323 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5a3d53e2-7520-4ceb-a2e5-0687964a3338 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.185209 Oct 03 12:07:43.024005 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3909/8151] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:42 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:44.048074 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:44.048742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:44.055923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:44.056426 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:44.057180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:44.057928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:44.058398 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:44.058838 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:44.202099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:44.215513 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-fd49c9ae-0450-4366-bf8d-467c845de183 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.171754 Oct 03 12:07:44.216826 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4243/8152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:44 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:45.239802 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:45.240532 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:45.247710 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:45.248198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:45.248637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:45.249367 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:45.249825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:45.250249 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:45.406691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:45.419607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9f698c14-0f1f-43ee-b6c0-181080c87a3c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.183824 Oct 03 12:07:45.420567 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3910/8153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:45 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:46.443364 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:46.443952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:46.450820 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:46.451345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:46.451794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:46.452504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:46.453004 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:46.453444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:46.587179 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:46.595458 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-238c2090-835c-47c0-8cd9-31ec853a122c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.156178 Oct 03 12:07:46.596022 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4244/8154] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:46 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:47.618198 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:47.618811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:47.626396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:47.626886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:47.627328 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:47.628024 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:47.628484 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:47.628944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:47.759359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:47.767107 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e9c3c6fd-211a-41fc-bf1f-be0f1176b4b0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.152820 Oct 03 12:07:47.767692 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3911/8155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:47 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:48.790024 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:48.790644 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:48.798156 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:48.798656 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:48.799099 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:48.799793 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:48.800285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:48.800720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:48.930947 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:48.939036 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bf5a0fd5-55fe-45cc-abc9-f32cf31c10bf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.152958 Oct 03 12:07:48.939602 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4245/8156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:48 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:49.962749 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:49.963274 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:49.970070 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:49.970559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:49.971001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:49.971692 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:49.972147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:49.972572 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:50.100662 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:50.108564 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-13ef3941-2515-4a1a-91aa-597ce85b1e8d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.149847 Oct 03 12:07:50.109797 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3912/8157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:49 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:51.131742 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:51.132366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:51.139435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:51.139933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:51.141047 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:51.141759 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:51.142227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:51.142671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:51.282778 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:51.290433 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f8ca2a1d-8710-4b53-830f-c057e56ae84c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.162680 Oct 03 12:07:51.291030 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4246/8158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:51 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:52.315309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:52.315925 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:52.323019 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:52.323506 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:52.323945 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:52.324626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:52.325108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:52.325531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:52.457359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:52.465065 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-32ee9e6a-5ba3-4dcb-9ef8-fe42f8b5cd4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.153805 Oct 03 12:07:52.465639 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3913/8159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:52 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:53.488902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:53.489526 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:53.496336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:53.496864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:53.497313 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:53.498005 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:53.498467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:53.498902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:53.631772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:53.641197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-30256360-1d09-47d3-9ca7-e1bf8a316b86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.156142 Oct 03 12:07:53.641791 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4247/8160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:53 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:54.667407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:54.668030 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:54.674853 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:54.675343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:54.675784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:54.676478 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:54.676976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:54.677409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:54.804965 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:54.813584 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3917ea27-efc4-4594-ab0b-40413e5d60ac tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.150089 Oct 03 12:07:54.814158 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3914/8161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:54 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:55.837533 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:55.838198 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:55.845206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:55.845806 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:55.846261 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:55.846994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:55.847459 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:55.847921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:55.977713 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:55.986168 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-bc2421b5-6f5b-4bc7-a8be-98fda470d426 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.152520 Oct 03 12:07:55.986746 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4248/8162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:55 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:57.009936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:57.010549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:57.018017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:57.018501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:57.018938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:57.019652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:57.020106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:57.020531 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:57.152376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:57.162048 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-5652a457-11dc-4de1-bb5a-ec37479229ba tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.155965 Oct 03 12:07:57.171385 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3915/8163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:57 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:57.652336 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-cf31837a-8ca5-4d0e-bf24-adb93d74f70b req-74e518e3-fd1b-4bc6-8b9a-6662ff620ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "name": "network-vif-plugged", "status": "completed", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:07:57.663366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cf31837a-8ca5-4d0e-bf24-adb93d74f70b req-74e518e3-fd1b-4bc6-8b9a-6662ff620ba2 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:57.663864 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cf31837a-8ca5-4d0e-bf24-adb93d74f70b req-74e518e3-fd1b-4bc6-8b9a-6662ff620ba2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:57.664316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-cf31837a-8ca5-4d0e-bf24-adb93d74f70b req-74e518e3-fd1b-4bc6-8b9a-6662ff620ba2 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:57.678379 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-cf31837a-8ca5-4d0e-bf24-adb93d74f70b req-74e518e3-fd1b-4bc6-8b9a-6662ff620ba2 service nova] Creating event network-vif-plugged:82b347ae-e0fc-4fe0-be07-add873f84887 for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf on n-h1-858383-3 Oct 03 12:07:57.684001 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-cf31837a-8ca5-4d0e-bf24-adb93d74f70b req-74e518e3-fd1b-4bc6-8b9a-6662ff620ba2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 Oct 03 12:07:57.684733 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4249/8164] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:07:58.186844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:58.187410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:58.194884 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:58.195374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:58.195818 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:58.196520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:58.197009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:58.197442 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:58.332091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:58.339778 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-72491d9b-6738-4e02-8c68-94248711a355 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.156947 Oct 03 12:07:58.340347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3916/8165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:58 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:07:59.364602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:07:59.365516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:07:59.372691 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:59.373221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:59.373740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:59.374449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:07:59.374913 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:07:59.375379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:07:59.515402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:07:59.523412 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-021fb96f-d820-4afb-ba66-d7280d77953d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1690 microversion: 2.1 time: 0.163717 Oct 03 12:07:59.539129 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4250/8166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:07:59 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:08:00.545879 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:08:00.546488 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:08:00.553326 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:08:00.553810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:08:00.554246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:08:00.554936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:08:00.555392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:08:00.555826 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:08:00.689058 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:08:00.696828 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ba71a045-16bc-485d-989e-48aa6115bf28 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1677 microversion: 2.1 time: 0.154832 Oct 03 12:08:00.697422 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3917/8167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:08:00 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:09:49.577338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=25 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:09:49.583950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=67 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:09:49.585205 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:09:49.585357 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 12:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf (ip 10.222.0.27) !!! Oct 03 12:09:49.588085 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:09:49.589406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:09:49.591308 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:09:49.592121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:09:49.601679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:49.602190 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:49.602652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:49.603758 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:49.604228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:49.604665 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:49.633263 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:09:49.681936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-5ba2fd84-cb0e-4053-b62f-e9f9bffd7bcf req-12ba9ca4-bed7-4e67-8af7-d43bcf5155ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:09:49.692337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5ba2fd84-cb0e-4053-b62f-e9f9bffd7bcf req-12ba9ca4-bed7-4e67-8af7-d43bcf5155ef service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:49.692850 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5ba2fd84-cb0e-4053-b62f-e9f9bffd7bcf req-12ba9ca4-bed7-4e67-8af7-d43bcf5155ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:49.693291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-5ba2fd84-cb0e-4053-b62f-e9f9bffd7bcf req-12ba9ca4-bed7-4e67-8af7-d43bcf5155ef service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:49.704184 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-5ba2fd84-cb0e-4053-b62f-e9f9bffd7bcf req-12ba9ca4-bed7-4e67-8af7-d43bcf5155ef service nova] Creating event network-changed:82b347ae-e0fc-4fe0-be07-add873f84887 for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf on n-h1-858383-3 Oct 03 12:09:49.710096 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-5ba2fd84-cb0e-4053-b62f-e9f9bffd7bcf req-12ba9ca4-bed7-4e67-8af7-d43bcf5155ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130696 Oct 03 12:09:49.710771 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3918/8168] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:09:49.729625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-855fa7e6-45bb-4062-b3cd-04ac89319a0d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "DELETE /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 204 len: 0 microversion: 2.1 time: 0.153809 Oct 03 12:09:49.730918 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4251/8169] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 12:09:49 2022] DELETE /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:09:49.741271 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:09:49.742379 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:09:49.748906 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:49.749493 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:49.750011 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:49.750808 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:49.752112 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:49.752725 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:49.935133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:09:49.943094 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7c61b02d-0fff-4a19-bcdd-14ed019ce277 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.207561 Oct 03 12:09:49.943681 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3919/8170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:09:49 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:09:50.967180 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:09:50.967907 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:09:50.975722 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:50.976226 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:50.976687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:50.977427 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:50.977898 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:50.978343 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:51.158906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:09:51.167839 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ad72989e-0045-4432-b986-597077ce8c7a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1683 microversion: 2.1 time: 0.204705 Oct 03 12:09:51.168444 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4252/8171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:09:50 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:09:51.981022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-ff65a45b-52f5-4fbd-b55e-03e1ba608dbb req-faae5b8f-00a6-4538-8860-bd50e5506fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d21b36-3c85-43b6-8cbe-318a7003fcaf", "name": "network-vif-deleted", "tag": "82b347ae-e0fc-4fe0-be07-add873f84887"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:09:51.994590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ff65a45b-52f5-4fbd-b55e-03e1ba608dbb req-faae5b8f-00a6-4538-8860-bd50e5506fdf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:51.995446 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ff65a45b-52f5-4fbd-b55e-03e1ba608dbb req-faae5b8f-00a6-4538-8860-bd50e5506fdf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:51.995892 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-ff65a45b-52f5-4fbd-b55e-03e1ba608dbb req-faae5b8f-00a6-4538-8860-bd50e5506fdf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:52.008160 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-ff65a45b-52f5-4fbd-b55e-03e1ba608dbb req-faae5b8f-00a6-4538-8860-bd50e5506fdf service nova] Creating event network-vif-deleted:82b347ae-e0fc-4fe0-be07-add873f84887 for instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf on n-h1-858383-3 Oct 03 12:09:52.014730 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-ff65a45b-52f5-4fbd-b55e-03e1ba608dbb req-faae5b8f-00a6-4538-8860-bd50e5506fdf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037448 Oct 03 12:09:52.015577 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3920/8172] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:09:52.193950 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:09:52.194521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:09:52.201272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:52.201773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:52.202223 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:52.202929 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:52.203397 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:52.203845 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:52.234340 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:52.234829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:52.235284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:52.235771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lazy-loading 'fault' on Instance uuid 96d21b36-3c85-43b6-8cbe-318a7003fcaf {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:09:52.281385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:09:52.289655 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d17cf248-a1ba-4765-9c48-5471a44f1bab tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 200 len: 1337 microversion: 2.1 time: 0.099536 Oct 03 12:09:52.290249 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4253/8173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:09:52 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:09:53.313833 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:09:53.314546 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 96d21b36-3c85-43b6-8cbe-318a7003fcaf] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:09:53.321669 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:53.322163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:53.322614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:53.323313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:09:53.323777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:09:53.324210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:09:53.338309 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] HTTP exception thrown: Instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf could not be found. Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Request method failure captured: Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf HTTP/1.1 Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOs-5D892bxBDyncTPCA2yXZb9syjnUUEzzYGQgc9jyio7ixLsMZgR8Boj0Y3rG0svlEo6Eqiz1QJ-2kBYTGuaci68sL2tdlMatOxFHHerFxE09S-eZcHs9q77_GAYlGKU0fS1_NSVqULB0xtdt-9IFkUhMCleXc_jJjt-tD9xwZ8s5U Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 3b8855e83d7541e8a651abc230f67a1e Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestShelveInstance-1724849587 Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8855e83d7541e8a651abc230f67a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8855e83d7541e8a651abc230f67a1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8855e83d7541e8a651abc230f67a1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8855e83d7541e8a651abc230f67a1e"}]}] Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestShelveInstance-1724849587 Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 3b8855e83d7541e8a651abc230f67a1e Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestShelveInstance-1724849587 Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestShelveInstance-1724849587-project Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 0747f26d8b71474e94d8b3df8ab476cb Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestShelveInstance-1724849587-project Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf could not be found. Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '96d21b36-3c85-43b6-8cbe-318a7003fcaf'} Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf could not be found. Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf could not be found. Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:09:53.339973 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf could not be found. Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Returning 404 to user: Instance 96d21b36-3c85-43b6-8cbe-318a7003fcaf could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-f26acf62-1c1a-468a-a352-7be63f2fe702 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf" status: 404 len: 111 microversion: 2.1 time: 0.032028 Oct 03 12:09:53.346239 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3921/8174] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:09:53 2022] GET /compute/v2.1/servers/96d21b36-3c85-43b6-8cbe-318a7003fcaf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:09:53.509409 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1f66d3b-24f5-431c-8c3a-104625ddba86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '.version_select at 0x7f074df9c550>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:09:53.537028 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1f66d3b-24f5-431c-8c3a-104625ddba86 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2013896951" status: 202 len: 0 microversion: 2.1 time: 0.031348 Oct 03 12:09:53.537581 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4254/8175] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Oct 3 12:09:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2013896951 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:09:53.560832 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4c86de5e-c2b9-4e58-8dc8-b8963236222c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'create', calling method: .version_select at 0x7f074e2a3310>, body: {"keypair": {"name": "tempest-TestShelveInstance-756067297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNSQfd2sHWZrL3afSC6SXYGEOGUxzt/i/cY7LdD6POJoodaQo4fUs8SK790Bg4fnAlG0JPpndxvhP9ENkqu2M5qqMmbu6ook4tjkpjaUk6SCU+7WtYp6sJueBpIpwYHRw=="}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:09:53.576893 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4c86de5e-c2b9-4e58-8dc8-b8963236222c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:09:53.582952 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-4c86de5e-c2b9-4e58-8dc8-b8963236222c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for user 0747f26d8b71474e94d8b3df8ab476cb and project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'key_pairs'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:09:53.609701 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4c86de5e-c2b9-4e58-8dc8-b8963236222c tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053063 Oct 03 12:09:53.610306 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3922/8176] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 12:09:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:10:09.781967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:09.782716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:09.788105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1026949699", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-756067297", "security_groups": [{"name": "tempest-secgroup-smoke-1666622131"}], "networks": [{"uuid": "f0038ce4-e3f8-48ed-95d3-7f7bcfad5c06"}], "block_device_mapping_v2": [{"uuid": "8047e29c-7117-439c-9eb3-76b23a612b8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:10:09.902193 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.network.neutron [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] validate_networks() for [('f0038ce4-e3f8-48ed-95d3-7f7bcfad5c06', None, None, None, None, None)] {{(pid=122269) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:10:10.320041 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Flavor limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:10:10.320509 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Image limits 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:10:10.321029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Flavor pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:10:10.321455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Image pref 0:0:0 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:10:10.321885 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.virt.hardware [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122269) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:10:10.331697 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:10.332197 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:10.332653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:10.333492 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:10.333966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:10.334412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:10.352269 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:10:10.357584 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Getting quotas for user 0747f26d8b71474e94d8b3df8ab476cb and project 3b8855e83d7541e8a651abc230f67a1e. Resources: {'cores', 'ram', 'instances'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:10:10.415337 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Going to run 1 instances... {{(pid=122269) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:10:10.417545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8047e29c-7117-439c-9eb3-76b23a612b8c',volume_size=None,volume_type=None)] {{(pid=122269) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:10:10.539726 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [550b53d0-5cd9-45fe-b521-894f231f725e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:10:11.548624 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [550b53d0-5cd9-45fe-b521-894f231f725e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52472. Oct 03 12:10:11.554074 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3dadc0a7-6681-4ef1-9cc0-d444ba68bd23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.773951 Oct 03 12:10:11.555030 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4255/8177] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 12:10:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:10:11.564437 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=12 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:11.565232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:11.566261 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:11.570559 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-71570e40-d078-4cfc-b8aa-62fa9de4308a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:11.572463 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-71570e40-d078-4cfc-b8aa-62fa9de4308a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:11.636412 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-71570e40-d078-4cfc-b8aa-62fa9de4308a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:11.643935 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-71570e40-d078-4cfc-b8aa-62fa9de4308a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1088 microversion: 2.1 time: 0.081364 Oct 03 12:10:11.644504 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3923/8178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:11 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:12.668351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8b48e12b-0801-4f26-a01a-6f9e990518b1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:12.669022 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8b48e12b-0801-4f26-a01a-6f9e990518b1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:12.725923 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8b48e12b-0801-4f26-a01a-6f9e990518b1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:12.732892 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8b48e12b-0801-4f26-a01a-6f9e990518b1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1088 microversion: 2.1 time: 0.069258 Oct 03 12:10:12.733468 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4256/8179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:12 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:13.756100 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-48b3becf-0537-476c-9779-075f667f5d1d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:13.756824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-48b3becf-0537-476c-9779-075f667f5d1d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:13.814936 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-48b3becf-0537-476c-9779-075f667f5d1d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:13.821965 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-48b3becf-0537-476c-9779-075f667f5d1d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1088 microversion: 2.1 time: 0.070371 Oct 03 12:10:13.822553 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3924/8180] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:13 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:14.845770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-441cc4ef-69b1-4d2a-bdd0-6ff120b30476 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:14.846396 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-441cc4ef-69b1-4d2a-bdd0-6ff120b30476 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:14.899807 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-441cc4ef-69b1-4d2a-bdd0-6ff120b30476 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:14.907325 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-441cc4ef-69b1-4d2a-bdd0-6ff120b30476 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1088 microversion: 2.1 time: 0.066170 Oct 03 12:10:14.908427 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4257/8181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:14 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:15.931018 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:15.931667 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:15.940008 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:15.940498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:15.940995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:15.941679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:15.942139 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:15.942570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:16.003035 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:16.010649 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-78133c26-850f-4cc1-97a2-caff1e140f08 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1138 microversion: 2.1 time: 0.083642 Oct 03 12:10:16.011235 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3925/8182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:15 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:17.033661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:17.034290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:17.041355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:17.041862 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:17.042321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:17.043056 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:17.043557 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:17.043996 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:17.104922 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:17.112440 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d70b6ab4-514c-4df7-b652-920f361502c2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1186 microversion: 2.1 time: 0.082793 Oct 03 12:10:17.113099 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4258/8183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:17 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:18.135745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:18.137244 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:18.145726 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:18.146748 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:18.147428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:18.148370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:18.149133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:18.150284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:18.422980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:18.431004 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0cbf7cca-6c76-4344-9954-90a41d87ddc4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1272 microversion: 2.1 time: 0.299346 Oct 03 12:10:18.431713 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3926/8184] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:18 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1272 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:18.776936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-13e24c04-7cca-4e7f-aad4-292705864694 req-c19638db-9e03-47f9-b56e-d2b509ac08eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951eff56-2d44-4639-bfbe-40ff4a5dd935", "tag": "d39fc96f-1e4b-46e3-8294-f2d88031423f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:10:18.790725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-13e24c04-7cca-4e7f-aad4-292705864694 req-c19638db-9e03-47f9-b56e-d2b509ac08eb service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:18.791518 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-13e24c04-7cca-4e7f-aad4-292705864694 req-c19638db-9e03-47f9-b56e-d2b509ac08eb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:18.792066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-13e24c04-7cca-4e7f-aad4-292705864694 req-c19638db-9e03-47f9-b56e-d2b509ac08eb service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:18.804136 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-13e24c04-7cca-4e7f-aad4-292705864694 req-c19638db-9e03-47f9-b56e-d2b509ac08eb service nova] Creating event network-changed:d39fc96f-1e4b-46e3-8294-f2d88031423f for instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 on n-h1-858383-3 Oct 03 12:10:18.809779 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-13e24c04-7cca-4e7f-aad4-292705864694 req-c19638db-9e03-47f9-b56e-d2b509ac08eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036811 Oct 03 12:10:18.810783 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4259/8185] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:10:19.455372 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:19.455989 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:19.463229 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:19.463723 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:19.464169 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:19.464900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:19.465363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:19.465791 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:19.700967 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:19.710175 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-acd1f9d8-3e6c-4968-99f2-198d30a87a26 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1272 microversion: 2.1 time: 0.258729 Oct 03 12:10:19.711154 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3927/8186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:19 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:20.732101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:20.737048 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:20.737772 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:20.744375 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:20.744908 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:20.745363 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:20.746125 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:20.746608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:20.747078 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:20.881294 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:20.889717 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-889f1e23-c650-4e7d-b73c-26774663dbd2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1272 microversion: 2.1 time: 0.159379 Oct 03 12:10:20.890304 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4260/8187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:20 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:21.914501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:21.915031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:21.923508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:21.924214 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:21.924426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:21.925165 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:21.925777 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:21.926210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:22.066840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:22.074743 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-43c9e481-5923-4c0c-b85c-d7704d6afd9f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1272 microversion: 2.1 time: 0.164627 Oct 03 12:10:22.075342 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3928/8188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:21 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:23.099707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:23.100326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:23.107188 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:23.107684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:23.108136 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:23.108867 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:23.109338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:23.109780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:23.245013 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:23.253470 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3d88fd8d-3690-437b-8708-087083f19a39 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.158251 Oct 03 12:10:23.254313 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4261/8189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:23 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:24.277335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:24.277976 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:24.280605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=4 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:24.286102 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:24.286585 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:24.287029 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:24.287716 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:24.288172 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:24.288626 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:24.418143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:24.426630 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd59ef52-dba7-466d-bf27-852d0b58c7ea tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.153193 Oct 03 12:10:24.427201 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3929/8190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:24 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:25.448849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:25.449467 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:25.452106 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=10 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:10:25.458221 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:25.458706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:25.459152 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:25.459846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:25.460307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:25.460740 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:25.589415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:25.597411 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ed4e22c3-510d-40c5-9db4-26da0301da0b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.152424 Oct 03 12:10:25.597985 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4262/8191] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:25 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:26.620578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:26.621217 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:26.628023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:26.628508 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:26.628987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:26.629681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:26.630138 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:26.630568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:26.762390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:26.770788 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-be62cc41-deb9-4e27-9949-fe8a1fcafffd tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.154081 Oct 03 12:10:26.771366 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3930/8192] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:26 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:27.793620 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:27.794251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:27.801290 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:27.801797 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:27.802256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:27.802965 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:27.803435 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:27.803882 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:27.939328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:27.946995 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-28171870-d217-42b5-9dcc-2cf31c7ba133 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.157367 Oct 03 12:10:27.947562 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4263/8193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:27 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:28.970654 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:28.971296 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:28.978180 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:28.978663 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:28.979106 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:28.979797 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:28.980253 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:28.980679 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:29.111339 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:29.119282 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-506b458e-6bde-40be-bde7-07d1137e769b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.153065 Oct 03 12:10:29.119865 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3931/8194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:28 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:30.142195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:30.142809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:30.149611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:30.150110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:30.150558 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:30.151256 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:30.151720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:30.152153 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:30.283928 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:30.292299 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42fb7e16-9db3-40f3-b747-f61121b5f9c9 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.153872 Oct 03 12:10:30.292902 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4264/8195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:30 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:31.316025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:31.316640 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:31.323610 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:31.324105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:31.324547 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:31.325279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:31.325742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:31.326175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:31.459691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:31.467383 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a97d34c4-732b-4b7c-a155-83bd2ccab7e0 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.155349 Oct 03 12:10:31.467954 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3932/8196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:31 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:32.491615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:32.492245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:32.499119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:32.499619 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:32.500071 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:32.500794 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:32.501858 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:32.502302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:32.641866 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:32.649610 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-42929cef-46df-42f1-a967-73cd1049c7ef tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.161863 Oct 03 12:10:32.650120 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4265/8197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:32 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:33.671957 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:33.672677 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:33.679422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:33.679900 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:33.680337 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:33.681051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:33.681507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:33.681931 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:33.816132 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:33.823905 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-430015bd-c664-4fe7-951d-74a3316e519d tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.155826 Oct 03 12:10:33.824483 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3933/8198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:33 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:34.558771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-a6069971-7826-4dd2-bf51-cd278df2317b req-3f9645e2-2dc3-454f-adc8-0979e6dad0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eff56-2d44-4639-bfbe-40ff4a5dd935", "name": "network-vif-plugged", "status": "completed", "tag": "d39fc96f-1e4b-46e3-8294-f2d88031423f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:10:34.569476 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6069971-7826-4dd2-bf51-cd278df2317b req-3f9645e2-2dc3-454f-adc8-0979e6dad0e5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:34.569994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6069971-7826-4dd2-bf51-cd278df2317b req-3f9645e2-2dc3-454f-adc8-0979e6dad0e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:34.570414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-a6069971-7826-4dd2-bf51-cd278df2317b req-3f9645e2-2dc3-454f-adc8-0979e6dad0e5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:34.583076 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-a6069971-7826-4dd2-bf51-cd278df2317b req-3f9645e2-2dc3-454f-adc8-0979e6dad0e5 service nova] Creating event network-vif-plugged:d39fc96f-1e4b-46e3-8294-f2d88031423f for instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 on n-h1-858383-3 Oct 03 12:10:34.588063 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-a6069971-7826-4dd2-bf51-cd278df2317b req-3f9645e2-2dc3-454f-adc8-0979e6dad0e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033369 Oct 03 12:10:34.588663 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4266/8199] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:10:34.847210 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:34.847834 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:34.854755 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:34.855248 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:34.855694 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:34.856390 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:34.856990 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:34.857426 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:34.998174 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:35.006459 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-65e899c8-fc2b-41b8-ae18-70125027aaaf tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.163809 Oct 03 12:10:35.007048 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3934/8200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:34 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:36.032921 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:36.033679 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:36.039857 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:36.040360 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:36.040846 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:36.041556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:36.042026 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:36.042472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:36.179235 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:36.187378 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f3f2da32-f25c-4ea3-9244-ccb684662c4b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1260 microversion: 2.1 time: 0.160258 Oct 03 12:10:36.187958 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4267/8201] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:36 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:37.210924 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:37.211545 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:37.217940 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:37.218427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:37.218889 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:37.219569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:37.220033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:37.220468 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:37.349927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:37.357765 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-8183a198-dcf8-4e0b-89c6-eda39d821894 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1444 microversion: 2.1 time: 0.150920 Oct 03 12:10:37.358341 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3935/8202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:37 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:37.380385 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:10:37.381044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:10:37.388134 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:37.388632 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:37.389128 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:37.389840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:37.390311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:37.390754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:37.519687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:10:37.527455 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5a122962-c74d-40b0-be30-79b71757f478 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1444 microversion: 2.1 time: 0.150920 Oct 03 12:10:37.528032 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4268/8203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:10:37 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:10:39.470674 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-236c27a9-bb3a-4933-9d92-c96990a56650 req-a3fdcbce-fa37-49d4-9f1d-98b2c92d8ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951eff56-2d44-4639-bfbe-40ff4a5dd935", "tag": "d39fc96f-1e4b-46e3-8294-f2d88031423f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:10:39.480118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-236c27a9-bb3a-4933-9d92-c96990a56650 req-a3fdcbce-fa37-49d4-9f1d-98b2c92d8ec1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:10:39.480597 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-236c27a9-bb3a-4933-9d92-c96990a56650 req-a3fdcbce-fa37-49d4-9f1d-98b2c92d8ec1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:10:39.481061 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-236c27a9-bb3a-4933-9d92-c96990a56650 req-a3fdcbce-fa37-49d4-9f1d-98b2c92d8ec1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:10:39.492393 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-236c27a9-bb3a-4933-9d92-c96990a56650 req-a3fdcbce-fa37-49d4-9f1d-98b2c92d8ec1 service nova] Creating event network-changed:d39fc96f-1e4b-46e3-8294-f2d88031423f for instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 on n-h1-858383-3 Oct 03 12:10:39.497581 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-236c27a9-bb3a-4933-9d92-c96990a56650 req-a3fdcbce-fa37-49d4-9f1d-98b2c92d8ec1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085295 Oct 03 12:10:39.498362 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3936/8204] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:12:33.798774 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:12:33.799700 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:12:33.800520 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:12:33.801289 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=60 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:12:33.806574 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:12:33.807111 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:33.815629 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:33.816200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:33.816645 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:33.817386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:33.817849 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:33.818285 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:33.841719 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lazy-loading 'flavor' on Instance uuid 951eff56-2d44-4639-bfbe-40ff4a5dd935 {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:12:33.911817 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-6f06d01f-e53e-4869-9b1b-7261ca704d23 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935/action" status: 202 len: 0 microversion: 2.1 time: 0.114736 Oct 03 12:12:33.912407 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4269/8205] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:12:33 2022] POST /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:12:33.918705 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:12:33.919582 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:12:33.920501 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=32 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:12:33.921343 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=68 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:12:33.922618 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:12:33.922753 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:12:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 (ip 10.222.0.27) !!! Oct 03 12:12:33.923861 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:12:33.924017 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:12:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 (ip 10.222.0.27) !!! Oct 03 12:12:33.929404 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:33.929841 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:33.938614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:33.939105 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:33.939566 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:33.940259 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:33.940712 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:33.941171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:34.073649 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:34.081372 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd3abbb7-348e-45f5-9509-c4249bd0ec62 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.164589 Oct 03 12:12:34.081950 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3937/8206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:33 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:35.108158 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:35.108902 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:35.116970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:35.117474 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:35.117934 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:35.118637 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:35.119108 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:35.119554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:35.127073 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52602. Oct 03 12:12:35.130253 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52604. Oct 03 12:12:35.257471 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:35.265797 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-4316ae7b-ce6c-4f66-9daa-0a26d198c3f1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.163484 Oct 03 12:12:35.266385 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4270/8207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:35 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:36.289381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:36.290009 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:36.300590 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:36.301108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:36.301548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:36.302246 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:36.302701 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:36.303130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:36.307016 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52610. Oct 03 12:12:36.307711 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52612. Oct 03 12:12:36.439113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:36.446894 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e7a63ed6-c630-4450-a155-e031922d797e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.161447 Oct 03 12:12:36.447475 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3938/8208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:36 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:37.470725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:37.471316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:37.478151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:37.478654 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:37.479119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:37.479825 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:37.480301 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:37.480754 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:37.609145 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:37.617010 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-ebfe3861-ffe9-4a7e-8018-f7e100d31fe5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.150938 Oct 03 12:12:37.617584 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4271/8209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:37 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:38.641668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:38.642280 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:38.649082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:38.649565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:38.649999 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:38.650697 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:38.651152 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:38.651580 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:38.778994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:38.791006 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7f67ec16-c586-408b-b47e-e7222298876b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.153805 Oct 03 12:12:38.791591 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3939/8210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:38 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:39.816410 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:39.816832 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:39.823537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:39.824030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:39.824530 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:39.825209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:39.825677 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:39.826112 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:39.958556 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:39.966549 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cb423639-f120-4887-b2dc-01ba47863730 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.154872 Oct 03 12:12:39.967136 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4272/8211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:39 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:40.989860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:40.990481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:40.997430 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:40.997921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:40.998368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:40.999092 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:40.999565 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:40.999987 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:41.131683 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:41.139439 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b9954125-1d1b-4043-b89a-04b94d4c8307 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.153536 Oct 03 12:12:41.140021 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3940/8212] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:40 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:42.162345 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:42.162968 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:42.170347 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:42.170841 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:42.171317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:42.172055 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:42.172519 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:42.172993 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:42.305402 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:42.314010 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-833c42f4-47d7-4ced-ad56-b4adb5d602ff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.155578 Oct 03 12:12:42.314580 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4273/8213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:42 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:43.337288 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:43.337908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:43.344788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:43.345313 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:43.345765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:43.346453 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:43.346912 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:43.347346 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:43.769535 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:43.777306 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-e8d76c24-b366-4635-a718-8b5da108a937 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.443987 Oct 03 12:12:43.777881 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3941/8214] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:43 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:44.800975 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:44.801541 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:44.808453 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:44.808994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:44.809449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:44.810406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:44.810875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:44.811323 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:44.942984 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:44.950671 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-a2a64556-6d16-4545-a7ca-2c317f7f4707 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.153680 Oct 03 12:12:44.951243 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4274/8215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:44 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:45.974904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:45.975517 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:45.982381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:45.982865 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:45.983324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:45.984606 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:45.985121 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:45.985549 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:46.115007 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:46.122752 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-55eb5104-cfd0-425c-992c-f03510ec6e33 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.151774 Oct 03 12:12:46.123324 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3942/8216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:45 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:47.145357 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:47.145987 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:47.153023 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:47.153516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:47.153969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:47.154709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:47.155176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:47.155618 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:47.298407 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:47.306355 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-64b06c14-74f7-4fce-b631-90a425c69879 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.164925 Oct 03 12:12:47.306929 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4275/8217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:47 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:48.330803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:48.331455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:48.338065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:48.338795 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:48.339240 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:48.340067 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:48.340593 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:48.341133 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:48.477436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:48.485867 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-40c919f4-f42f-4155-8ffb-5e491783f9c5 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1570 microversion: 2.1 time: 0.159682 Oct 03 12:12:48.486438 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3943/8218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:48 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:48.508684 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:12:48.509328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:48.516502 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:48.517043 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:48.517498 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:48.518206 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:48.518675 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:48.519114 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:48.562389 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122269) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 12:12:48.629123 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-665a4ce2-7eba-48d2-99e6-00e858b7d252 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "POST /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935/action" status: 202 len: 0 microversion: 2.1 time: 0.124342 Oct 03 12:12:48.629753 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4276/8219] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:12:48 2022] POST /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:12:48.637877 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:48.638514 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:48.645178 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:48.645671 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:48.646113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:48.646817 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:48.647277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:48.647707 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:48.820304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:48.828220 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c2b2c265-6646-46a9-b9a5-5b495399e9fe tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1518 microversion: 2.1 time: 0.194151 Oct 03 12:12:48.828744 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3944/8220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:48 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:49.331414 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-2828b0f1-d03e-4c60-a24b-cc7a06e1a25f req-559954ab-d466-482d-8aeb-e7cbf1628641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eff56-2d44-4639-bfbe-40ff4a5dd935", "name": "network-vif-unplugged", "status": "completed", "tag": "d39fc96f-1e4b-46e3-8294-f2d88031423f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:12:49.341809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2828b0f1-d03e-4c60-a24b-cc7a06e1a25f req-559954ab-d466-482d-8aeb-e7cbf1628641 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:49.342412 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2828b0f1-d03e-4c60-a24b-cc7a06e1a25f req-559954ab-d466-482d-8aeb-e7cbf1628641 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:49.342791 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-2828b0f1-d03e-4c60-a24b-cc7a06e1a25f req-559954ab-d466-482d-8aeb-e7cbf1628641 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:49.355648 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.compute.server_external_events [req-2828b0f1-d03e-4c60-a24b-cc7a06e1a25f req-559954ab-d466-482d-8aeb-e7cbf1628641 service nova] Unable to find a host for instance 951eff56-2d44-4639-bfbe-40ff4a5dd935. Dropping event network-vif-unplugged {{(pid=122269) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 12:12:49.356516 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-2828b0f1-d03e-4c60-a24b-cc7a06e1a25f req-559954ab-d466-482d-8aeb-e7cbf1628641 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089826 Oct 03 12:12:49.357178 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4277/8221] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 12:12:49.850784 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:49.851409 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:49.858291 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:49.858787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:49.859233 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:49.860455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:49.860944 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:49.861378 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:49.997461 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:50.005995 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-68fff30c-8cc3-4e77-99db-3071185d27e7 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1520 microversion: 2.1 time: 0.159193 Oct 03 12:12:50.006581 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3945/8222] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:49 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:51.029917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:51.030571 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:51.037536 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:51.038032 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:51.038484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:51.039195 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:51.039663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:51.040105 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:51.176817 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:51.185625 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-8907bf32-6d5b-4023-be69-02aa0c2482c6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1520 microversion: 2.1 time: 0.159548 Oct 03 12:12:51.186329 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4278/8223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:51 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:52.210507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:52.211053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:52.218388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:52.219477 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:52.219921 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:52.220627 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:52.221113 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:52.221543 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:52.359793 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:52.368393 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ee9d2bdb-91c7-4d2f-be47-ecc7d66478e4 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1520 microversion: 2.1 time: 0.162213 Oct 03 12:12:52.369014 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3946/8224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:52 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:53.391660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:53.393066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:53.400687 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:53.401208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:53.401661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:53.402379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:53.402969 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:53.403735 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:53.544552 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:53.568444 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f54f8fa0-1f36-48af-b922-757696c72a11 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1520 microversion: 2.1 time: 0.180064 Oct 03 12:12:53.570962 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4279/8225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:53 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:54.591519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:54.592225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:54.599875 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:54.600359 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:54.600811 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:54.601498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:54.601958 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:54.602382 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:54.808938 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:54.817497 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-26acfd9a-dbed-49ed-8f16-f8085103d689 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.229891 Oct 03 12:12:54.818074 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3947/8226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:54 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:55.841660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:55.842236 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:55.849760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:55.850253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:55.850706 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:55.851406 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:55.851894 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:55.852316 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:55.981511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:55.989323 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-54b3e68d-5dff-496c-8a80-975b59f94081 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.151616 Oct 03 12:12:55.989893 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4280/8227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:55 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:57.013005 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:57.013614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:57.020519 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:57.021036 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:57.021474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:57.022160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:57.022613 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:57.023041 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:57.156147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:57.164366 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1bd3e22b-9462-432c-8ed9-7168a4d48283 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.155279 Oct 03 12:12:57.164959 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3948/8228] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:57 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:58.189121 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:58.189755 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:58.196606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:58.197141 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:58.197595 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:58.198302 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:58.198773 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:58.199216 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:58.332537 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:58.340241 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7acde3b8-9340-4aa9-b66c-2001cde41ab3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.155991 Oct 03 12:12:58.340827 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4281/8229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:58 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:12:59.364377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:12:59.365279 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:12:59.374332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:59.374823 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:59.375264 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:59.375968 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:12:59.376428 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:12:59.376883 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:12:59.509130 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:12:59.517190 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-976d012d-3139-4fc3-bfd3-df55e0750535 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.158011 Oct 03 12:12:59.517751 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3949/8230] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:12:59 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:13:00.541311 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:00.541974 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:00.549359 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:00.549863 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:00.550320 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:00.551029 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:00.551503 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:00.551949 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:00.684514 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:00.693208 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-795da86d-6d29-420e-afb7-ba237c4ec302 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.155815 Oct 03 12:13:00.693787 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4282/8231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:00 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:13:01.716150 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:01.716825 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:01.723837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:01.724322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:01.724761 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:01.725471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:01.725927 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:01.726354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:01.862959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:01.871582 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-254fec95-889a-4696-8803-d7d5e474d26e tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.159271 Oct 03 12:13:01.872182 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3950/8232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:01 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:13:02.895642 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:02.896258 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:02.903386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:02.903880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:02.904328 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:02.905057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:02.905521 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:02.905956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:02.910250 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:13:03.042366 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:03.050798 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-99122443-dfff-44f8-aa65-4256d26ef84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.159079 Oct 03 12:13:03.051369 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4283/8233] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:02 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:13:04.074187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:04.074799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:04.077558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=29 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:13:04.083450 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:04.083937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:04.084376 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:04.085095 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:04.085553 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:04.085984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:04.089895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=85 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:13:04.214179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:04.222078 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-1e72a38d-6e80-4d1e-8ca3-de7f063c5105 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.151803 Oct 03 12:13:04.222648 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3951/8234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:04 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:13:05.245978 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:05.246608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:05.248653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:13:05.254037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:05.254538 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:05.254991 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:05.256124 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:05.256247 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:05.256593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:05.387839 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:05.395877 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-22e1ff05-ef0e-4aef-8a07-1b464418c84b tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.153863 Oct 03 12:13:05.396260 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4284/8235] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:05 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:13:05.407424 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eff56-2d44-4639-bfbe-40ff4a5dd935", "name": "network-vif-plugged", "status": "completed", "tag": "d39fc96f-1e4b-46e3-8294-f2d88031423f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:13:05.417916 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:05.418417 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:05.418849 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:05.431813 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] Creating event network-vif-plugged:d39fc96f-1e4b-46e3-8294-f2d88031423f for instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 on n-h1-858383-3 Oct 03 12:13:05.435227 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] [e2b9cc10-981b-49b0-9569-8c91aef47701] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:13:06.419716 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:06.420351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:06.427272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:06.427761 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:06.428211 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:06.428935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:06.429400 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:06.429835 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:06.444144 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] [e2b9cc10-981b-49b0-9569-8c91aef47701] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 52690. Oct 03 12:13:06.447857 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-c0c5762e-be93-4de0-be47-2b53c845ba3f req-61327f07-a0fd-4f6b-8e70-1a4d36d406cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.044848 Oct 03 12:13:06.448876 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3952/8236] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:13:06.565014 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:06.573864 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b4ec07a5-47e6-4939-bc1e-9d373c31f7e3 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.157956 Oct 03 12:13:06.575079 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4285/8237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:06 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:13:07.600039 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:07.600753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:07.607054 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:07.607548 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:07.607994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:07.608690 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:07.609213 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:07.609648 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:07.740377 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:07.748197 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-889ac357-a782-4447-8dd0-45b5f95af762 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1576 microversion: 2.1 time: 0.154063 Oct 03 12:13:07.748795 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3953/8238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:07 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:13:08.771505 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:13:08.772133 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:13:08.779045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:08.779542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:08.779988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:08.780685 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:13:08.781176 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:13:08.781615 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:13:08.915155 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:13:08.924699 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-15c4c171-ef6d-442a-81b3-2d107dab8f9a tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1563 microversion: 2.1 time: 0.157279 Oct 03 12:13:08.925308 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4286/8239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:13:08 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:22.002763 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=5 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:22.004049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=22 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:22.006510 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:22.007017 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:22.008709 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:14:22.009082 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 12:14:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 12:14:22.012844 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=5 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:22.013542 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=13 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:22.018036 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7dff2845-c3ce-4ab7-9c12-f97ac0417e39 req-4d60c4ce-0b0e-4f8c-b353-d285b461bcdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951eff56-2d44-4639-bfbe-40ff4a5dd935", "tag": "d39fc96f-1e4b-46e3-8294-f2d88031423f"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:14:22.031767 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:22.032251 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:22.032687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:22.033455 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:22.041231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:22.041696 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:22.050021 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7dff2845-c3ce-4ab7-9c12-f97ac0417e39 req-4d60c4ce-0b0e-4f8c-b353-d285b461bcdf service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:22.050516 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7dff2845-c3ce-4ab7-9c12-f97ac0417e39 req-4d60c4ce-0b0e-4f8c-b353-d285b461bcdf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:22.050958 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7dff2845-c3ce-4ab7-9c12-f97ac0417e39 req-4d60c4ce-0b0e-4f8c-b353-d285b461bcdf service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:22.063123 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7dff2845-c3ce-4ab7-9c12-f97ac0417e39 req-4d60c4ce-0b0e-4f8c-b353-d285b461bcdf service nova] Creating event network-changed:d39fc96f-1e4b-46e3-8294-f2d88031423f for instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 on n-h1-858383-3 Oct 03 12:14:22.068396 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7dff2845-c3ce-4ab7-9c12-f97ac0417e39 req-4d60c4ce-0b0e-4f8c-b353-d285b461bcdf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067246 Oct 03 12:14:22.069299 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4287/8240] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:14:22.080471 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Going to try to terminate instance {{(pid=122270) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:14:22.169232 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-dc09840d-08d8-4a29-8665-5dbd2da89dff tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "DELETE /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 204 len: 0 microversion: 2.1 time: 0.171698 Oct 03 12:14:22.173417 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3954/8241] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 12:14:21 2022] DELETE /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:14:22.178652 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:22.179823 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:22.186609 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:22.187102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:22.187545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:22.188454 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:22.188948 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:22.189415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:22.345204 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:22.353081 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b266fbc5-d2c4-4676-839b-37b58572eee1 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.178781 Oct 03 12:14:22.353850 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4288/8242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:22 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:23.377799 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:23.378511 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:23.385599 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:23.386089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:23.386530 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:23.387231 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:23.387687 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:23.388115 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:23.529509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:23.537221 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-31fcab26-1194-495d-853f-d9221a6ab3cb tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1569 microversion: 2.1 time: 0.163693 Oct 03 12:14:23.537797 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3955/8243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:23 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:24.562274 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:24.562901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:24.570033 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:24.571322 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:24.571795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:24.572529 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:24.574241 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:24.574704 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:24.682307 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:24.690486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf59ba03-1370-478a-8fb0-a4118bc1b4e2 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1382 microversion: 2.1 time: 0.132650 Oct 03 12:14:24.691081 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4289/8244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:24 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1382 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:24.719776 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b3647c0b-9167-443f-9431-a125583617c8 req-f139a83f-55ba-43a8-b090-1d30da975a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951eff56-2d44-4639-bfbe-40ff4a5dd935", "name": "network-vif-deleted", "tag": "d39fc96f-1e4b-46e3-8294-f2d88031423f"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:14:24.731075 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b3647c0b-9167-443f-9431-a125583617c8 req-f139a83f-55ba-43a8-b090-1d30da975a43 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:24.731554 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b3647c0b-9167-443f-9431-a125583617c8 req-f139a83f-55ba-43a8-b090-1d30da975a43 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:24.731984 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b3647c0b-9167-443f-9431-a125583617c8 req-f139a83f-55ba-43a8-b090-1d30da975a43 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:24.743842 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b3647c0b-9167-443f-9431-a125583617c8 req-f139a83f-55ba-43a8-b090-1d30da975a43 service nova] Creating event network-vif-deleted:d39fc96f-1e4b-46e3-8294-f2d88031423f for instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 on n-h1-858383-3 Oct 03 12:14:24.749626 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b3647c0b-9167-443f-9431-a125583617c8 req-f139a83f-55ba-43a8-b090-1d30da975a43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033577 Oct 03 12:14:24.750238 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3956/8245] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:14:25.714844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:25.715481 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:25.722321 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:25.722811 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:25.723253 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:25.723952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:25.724413 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:25.724881 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:25.786906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:25.795871 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-5d178587-f4b7-44f1-ab8f-1e528834a244 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1219 microversion: 2.1 time: 0.084553 Oct 03 12:14:25.797900 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4290/8246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:25 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:14:26.824637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:26.825396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:26.831651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:26.832141 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:26.832578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:26.833303 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:26.833762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:26.834189 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:26.897410 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:26.905195 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-a82e13ba-9a9f-4fff-aa99-6b8b3c273976 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1219 microversion: 2.1 time: 0.085745 Oct 03 12:14:26.905771 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3957/8247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:26 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:27.929690 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:27.930245 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:27.937683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:27.938335 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:27.938798 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:27.939524 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:27.940000 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:27.940455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:28.008522 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:28.016731 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-89bf997c-22d4-4b58-8f50-71c01996b031 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1219 microversion: 2.1 time: 0.091787 Oct 03 12:14:28.017355 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4291/8248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:27 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:29.040166 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:29.040831 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:29.047563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:29.048302 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:29.048837 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:29.049573 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:29.050031 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:29.050522 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:29.082108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:29.082591 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:29.083033 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:29.083481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.objects.instance [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lazy-loading 'fault' on Instance uuid 951eff56-2d44-4639-bfbe-40ff4a5dd935 {{(pid=122270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:14:29.125306 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0747f26d8b71474e94d8b3df8ab476cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8855e83d7541e8a651abc230f67a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:29.133789 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-eb656b01-c71f-4fc0-833f-0d2eb5bbdde6 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 200 len: 1224 microversion: 2.1 time: 0.098208 Oct 03 12:14:29.134358 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3958/8249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:29 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:30.156890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:30.157535 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] [instance: 951eff56-2d44-4639-bfbe-40ff4a5dd935] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:30.165268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:30.165780 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:30.166233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:30.166956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:30.167429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:30.167875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:30.181384 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] HTTP exception thrown: Instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 could not be found. Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Request method failure captured: Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 HTTP/1.1 Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOs-5D892bxBDyncTPCA2yXZb9syjnUUEzzYGQgc9jyio7ixLsMZgR8Boj0Y3rG0svlEo6Eqiz1QJ-2kBYTGuaci68sL2tdlMatOxFHHerFxE09S-eZcHs9q77_GAYlGKU0fS1_NSVqULB0xtdt-9IFkUhMCleXc_jJjt-tD9xwZ8s5U Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 3b8855e83d7541e8a651abc230f67a1e Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestShelveInstance-1724849587 Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8855e83d7541e8a651abc230f67a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b8855e83d7541e8a651abc230f67a1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b8855e83d7541e8a651abc230f67a1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b8855e83d7541e8a651abc230f67a1e"}]}] Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestShelveInstance-1724849587 Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 3b8855e83d7541e8a651abc230f67a1e Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestShelveInstance-1724849587 Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestShelveInstance-1724849587-project Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 0747f26d8b71474e94d8b3df8ab476cb Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestShelveInstance-1724849587-project Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 could not be found. Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '951eff56-2d44-4639-bfbe-40ff4a5dd935'} Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 could not be found. Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 could not be found. Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:14:30.183312 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 could not be found. Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Returning 404 to user: Instance 951eff56-2d44-4639-bfbe-40ff4a5dd935 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-3fb15ec3-eb90-4787-a98b-037ce751868f tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935" status: 404 len: 111 microversion: 2.1 time: 0.031885 Oct 03 12:14:30.189419 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4292/8250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:30 2022] GET /compute/v2.1/servers/951eff56-2d44-4639-bfbe-40ff4a5dd935 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:14:30.355338 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-933d1b54-0811-45b7-8c26-11495afb4260 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] Calling method '.version_select at 0x7f074e2c0b80>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:30.387607 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-933d1b54-0811-45b7-8c26-11495afb4260 tempest-TestShelveInstance-1724849587 tempest-TestShelveInstance-1724849587-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-756067297" status: 202 len: 0 microversion: 2.1 time: 0.036853 Oct 03 12:14:30.388270 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3959/8251] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Oct 3 12:14:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-756067297 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 12:14:47.639458 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=12 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:47.640209 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=28 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:47.845374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f10cf115-16c4-4430-bbc4-6797bd5ecb4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Action: 'create', calling method: .version_select at 0x7f074e20cca0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1156791496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeTyn9DO1x8wV2Cfn50zeuEm6uyK24PPjjN+pJ+OEIDCuS6o6rEHCs3M3t8D9U+d9B4+fum1WlnotXUu3R2Mjnf8zSsHQPT6jvqQVcRZokPRwaq7lr3H+/VQ8j/XpoqbA=="}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:14:47.861964 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f10cf115-16c4-4430-bbc4-6797bd5ecb4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Getting quotas for project 181500598207441b90bd82dc565f2609. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:14:47.867818 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.quota [None req-f10cf115-16c4-4430-bbc4-6797bd5ecb4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Getting quotas for user 8fa33e58c8084c60b634c2a566e6905c and project 181500598207441b90bd82dc565f2609. Resources: {'key_pairs'} {{(pid=122269) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:14:47.897516 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f10cf115-16c4-4430-bbc4-6797bd5ecb4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.263016 Oct 03 12:14:47.898127 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4293/8252] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Oct 3 12:14:47 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:14:48.873232 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:48.874040 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:14:48.878381 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1389478939", "imageRef": "f290423a-28bb-43d3-ba8c-d44fc0f72e5f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1156791496", "security_groups": [{"name": "tempest-secgroup-smoke-346963738"}], "networks": [{"uuid": "73c32d16-eb6f-47f2-ac8f-15ad70cb66f3"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:14:48.989569 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] validate_networks() for [('73c32d16-eb6f-47f2-ac8f-15ad70cb66f3', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:14:49.748332 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:14:49.748781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:14:49.749322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:14:49.749738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:14:49.750154 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:14:49.759474 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:49.759959 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:49.760399 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:49.761160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:49.761622 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:49.762053 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:49.779828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Getting quotas for project 181500598207441b90bd82dc565f2609. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:14:49.787762 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Getting quotas for user 8fa33e58c8084c60b634c2a566e6905c and project 181500598207441b90bd82dc565f2609. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:14:49.798225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:14:49.800609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f290423a-28bb-43d3-ba8c-d44fc0f72e5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:14:49.851691 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-ec7b27b0-f84b-4cd4-8556-6c7e828c28ec tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.980346 Oct 03 12:14:49.852453 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3960/8253] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 12:14:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:14:49.864848 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-09cfc8f6-607e-4030-afd9-80f214933b6c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:49.865808 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-09cfc8f6-607e-4030-afd9-80f214933b6c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:49.928367 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-09cfc8f6-607e-4030-afd9-80f214933b6c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:49.936053 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-09cfc8f6-607e-4030-afd9-80f214933b6c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1249 microversion: 2.1 time: 0.075772 Oct 03 12:14:49.936622 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4294/8254] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:49 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:14:50.959335 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-99b6b4b4-053d-4b60-b866-b8dfc4e09678 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:50.961491 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-99b6b4b4-053d-4b60-b866-b8dfc4e09678 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:51.080324 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-99b6b4b4-053d-4b60-b866-b8dfc4e09678 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:51.093439 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-99b6b4b4-053d-4b60-b866-b8dfc4e09678 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1249 microversion: 2.1 time: 0.137269 Oct 03 12:14:51.096347 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3961/8255] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:50 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:52.121338 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cd9c1c11-9b94-400c-ac5e-201d1f01a90a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:52.122045 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cd9c1c11-9b94-400c-ac5e-201d1f01a90a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:52.237271 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cd9c1c11-9b94-400c-ac5e-201d1f01a90a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:52.244490 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cd9c1c11-9b94-400c-ac5e-201d1f01a90a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1249 microversion: 2.1 time: 0.127762 Oct 03 12:14:52.245089 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4295/8256] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:52 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:53.267163 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c6343d3f-f204-425a-9d49-efad5d640f21 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:53.267815 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c6343d3f-f204-425a-9d49-efad5d640f21 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:53.322605 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c6343d3f-f204-425a-9d49-efad5d640f21 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:53.330442 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c6343d3f-f204-425a-9d49-efad5d640f21 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1249 microversion: 2.1 time: 0.066959 Oct 03 12:14:53.331021 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3962/8257] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:53 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:14:54.353985 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:54.354611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:54.362484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:54.362973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:54.363425 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:54.364122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:54.364586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:54.365044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:54.428122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:54.440484 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-de7d170c-2e48-4475-83d4-56a66905aed5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1253 microversion: 2.1 time: 0.087994 Oct 03 12:14:54.440484 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4296/8258] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:54 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1253 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:55.464354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:55.465006 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:55.475753 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:55.476239 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:55.476681 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:55.477422 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:55.478091 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:55.478457 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:55.544740 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:55.552589 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-18ccdd48-b6a8-4e29-b4d1-9a94538ffa75 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1307 microversion: 2.1 time: 0.092889 Oct 03 12:14:55.553202 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3963/8259] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:55 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:56.408856 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-165fe13e-19e6-483e-8d47-a31b1f6e161a req-3f1a118d-d62c-4ca7-9913-86a4324bd78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04db0c85-2082-482e-95d7-bc62a3629d01", "tag": "c27d6013-7d94-4b87-bf80-29ea1927e4a0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:14:56.426109 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-165fe13e-19e6-483e-8d47-a31b1f6e161a req-3f1a118d-d62c-4ca7-9913-86a4324bd78a service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:56.426611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-165fe13e-19e6-483e-8d47-a31b1f6e161a req-3f1a118d-d62c-4ca7-9913-86a4324bd78a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:56.427064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-165fe13e-19e6-483e-8d47-a31b1f6e161a req-3f1a118d-d62c-4ca7-9913-86a4324bd78a service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:56.438717 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-165fe13e-19e6-483e-8d47-a31b1f6e161a req-3f1a118d-d62c-4ca7-9913-86a4324bd78a service nova] Creating event network-changed:c27d6013-7d94-4b87-bf80-29ea1927e4a0 for instance 04db0c85-2082-482e-95d7-bc62a3629d01 on n-h1-858383-3 Oct 03 12:14:56.443855 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-165fe13e-19e6-483e-8d47-a31b1f6e161a req-3f1a118d-d62c-4ca7-9913-86a4324bd78a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038910 Oct 03 12:14:56.444685 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4297/8260] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:14:56.575734 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:56.576994 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:56.583729 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:56.584227 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:56.584680 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:56.585937 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:56.586403 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:56.586839 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:56.728195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:56.735964 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-11bf7b02-754a-4024-96ef-de5ac61b8ee0 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1374 microversion: 2.1 time: 0.164428 Oct 03 12:14:56.736544 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3964/8261] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:56 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:57.759741 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:57.760484 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:57.766933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:57.767376 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:57.767829 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:57.768569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:57.769066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:57.769506 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:57.908792 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:57.916733 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-53fb974d-2944-46e6-8eeb-cd2e03406169 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1374 microversion: 2.1 time: 0.162642 Oct 03 12:14:57.917326 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4298/8262] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:57 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:14:58.939736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:14:58.940357 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:14:58.947236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:58.947728 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:58.948179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:58.948904 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:14:58.949370 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:14:58.949807 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:14:59.089354 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:14:59.097234 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-d00d5c92-dc3d-438c-a80a-9bc2b6365818 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1374 microversion: 2.1 time: 0.161685 Oct 03 12:14:59.097807 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3965/8263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:14:58 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:15:00.121601 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:15:00.123016 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:15:00.131227 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:00.131760 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:00.132218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:00.132994 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:00.133455 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:00.133901 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:00.269390 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:15:00.277660 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-d95e6b50-236f-4989-9fd8-c940fc4c0ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1374 microversion: 2.1 time: 0.161236 Oct 03 12:15:00.278430 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4299/8264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:15:00 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:15:01.301342 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:15:01.301895 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:15:01.305089 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:15:01.310158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:01.310651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:01.311360 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:01.312065 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:01.312520 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:01.312979 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:01.448581 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:15:01.456397 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-77c3152a-cb48-4f4b-bde3-79ca443dfb34 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1374 microversion: 2.1 time: 0.159184 Oct 03 12:15:01.457002 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3966/8265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:15:01 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:15:01.829215 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-55e6760b-40b9-4e5a-8bc5-908a88c7d3ad req-bf3bdccc-07e5-4377-ae3f-bd19cfa75972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db0c85-2082-482e-95d7-bc62a3629d01", "name": "network-vif-plugged", "status": "completed", "tag": "c27d6013-7d94-4b87-bf80-29ea1927e4a0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:15:01.839671 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55e6760b-40b9-4e5a-8bc5-908a88c7d3ad req-bf3bdccc-07e5-4377-ae3f-bd19cfa75972 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:01.840233 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55e6760b-40b9-4e5a-8bc5-908a88c7d3ad req-bf3bdccc-07e5-4377-ae3f-bd19cfa75972 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:01.840683 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-55e6760b-40b9-4e5a-8bc5-908a88c7d3ad req-bf3bdccc-07e5-4377-ae3f-bd19cfa75972 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:01.851922 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-55e6760b-40b9-4e5a-8bc5-908a88c7d3ad req-bf3bdccc-07e5-4377-ae3f-bd19cfa75972 service nova] Creating event network-vif-plugged:c27d6013-7d94-4b87-bf80-29ea1927e4a0 for instance 04db0c85-2082-482e-95d7-bc62a3629d01 on n-h1-858383-3 Oct 03 12:15:01.857206 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-55e6760b-40b9-4e5a-8bc5-908a88c7d3ad req-bf3bdccc-07e5-4377-ae3f-bd19cfa75972 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031869 Oct 03 12:15:01.857816 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4300/8266] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:15:02.479908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:15:02.480523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:15:02.487405 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:02.487890 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:02.488331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:02.489043 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:02.489504 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:02.489932 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:02.622862 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:15:02.630558 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3a625c9b-49a2-42df-92e1-d38704c4b817 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1374 microversion: 2.1 time: 0.154667 Oct 03 12:15:02.631125 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3967/8267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:15:02 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:15:03.654890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:15:03.655593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:15:03.657611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=8 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:15:03.663936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:03.664441 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:03.664926 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:03.665634 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:03.666103 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:03.666546 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:03.797095 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:15:03.804863 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-94314125-9673-4363-b4c7-4b562f196f6e tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1559 microversion: 2.1 time: 0.154324 Oct 03 12:15:03.805430 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4301/8268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:15:03 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:15:03.827389 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:15:03.827962 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:15:03.829803 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=10 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:15:03.836736 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:03.837308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:03.837738 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:03.838423 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:03.838871 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:03.839294 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:03.968406 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:15:03.976189 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-df3fc8e8-64b5-4f2c-a40f-efc11bcb360d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1559 microversion: 2.1 time: 0.152690 Oct 03 12:15:03.976756 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3968/8269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:15:03 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:15:05.657092 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-20ae035e-0b87-4f35-a8dc-69fd13f70258 req-0559dfff-aad5-40da-838d-5326e51193b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04db0c85-2082-482e-95d7-bc62a3629d01", "tag": "c27d6013-7d94-4b87-bf80-29ea1927e4a0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:15:05.666920 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-20ae035e-0b87-4f35-a8dc-69fd13f70258 req-0559dfff-aad5-40da-838d-5326e51193b5 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:15:05.667429 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-20ae035e-0b87-4f35-a8dc-69fd13f70258 req-0559dfff-aad5-40da-838d-5326e51193b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:15:05.667897 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-20ae035e-0b87-4f35-a8dc-69fd13f70258 req-0559dfff-aad5-40da-838d-5326e51193b5 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:15:05.679971 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-20ae035e-0b87-4f35-a8dc-69fd13f70258 req-0559dfff-aad5-40da-838d-5326e51193b5 service nova] Creating event network-changed:c27d6013-7d94-4b87-bf80-29ea1927e4a0 for instance 04db0c85-2082-482e-95d7-bc62a3629d01 on n-h1-858383-3 Oct 03 12:15:05.685371 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-20ae035e-0b87-4f35-a8dc-69fd13f70258 req-0559dfff-aad5-40da-838d-5326e51193b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085925 Oct 03 12:15:05.686232 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4302/8270] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:17:42.513013 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:17:42.513921 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 12:17:42.514698 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:17:42.515489 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=38 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:17:42.516413 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:17:42.516648 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01/action (ip 10.222.0.27) !!! Oct 03 12:17:42.517832 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:17:42.517985 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01/action (ip 10.222.0.27) !!! Oct 03 12:17:42.518945 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:17:42.519074 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01/action (ip 10.222.0.27) !!! Oct 03 12:17:42.524316 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-181777947"}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:17:42.526699 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:17:42.542047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:17:42.542558 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:17:42.543001 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:17:42.543713 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:17:42.544175 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:17:42.544637 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:17:42.744458 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-9bb44e5b-94d6-4374-a1fc-df6de7a34f4c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "POST /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01/action" status: 202 len: 0 microversion: 2.1 time: 0.232978 Oct 03 12:17:42.745340 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3969/8271] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:17:42 2022] POST /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 12:17:48.724220 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:17:48.725062 n-d-858383-3 devstack@n-api.service[122269]: ERROR oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 12:17:48.725771 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:17:48.726415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=30 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:17:48.728758 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:17:48.728957 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 12:17:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 12:17:48.731708 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 12:17:48.731876 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 12:17:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 12:17:48.733444 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:17:48.733580 n-d-858383-3 devstack@n-api.service[122269]: Mon Oct 3 12:17:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 12:17:48.756066 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-87f639d8-dfca-4084-9097-efd255be1ad5 req-a05895df-c1ba-493d-b029-44480ea42e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db0c85-2082-482e-95d7-bc62a3629d01", "name": "network-vif-plugged", "status": "completed", "tag": "c27d6013-7d94-4b87-bf80-29ea1927e4a0"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:17:48.767222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-87f639d8-dfca-4084-9097-efd255be1ad5 req-a05895df-c1ba-493d-b029-44480ea42e20 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:17:48.767710 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-87f639d8-dfca-4084-9097-efd255be1ad5 req-a05895df-c1ba-493d-b029-44480ea42e20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:17:48.768151 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-87f639d8-dfca-4084-9097-efd255be1ad5 req-a05895df-c1ba-493d-b029-44480ea42e20 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:17:48.779150 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-87f639d8-dfca-4084-9097-efd255be1ad5 req-a05895df-c1ba-493d-b029-44480ea42e20 service nova] Creating event network-vif-plugged:c27d6013-7d94-4b87-bf80-29ea1927e4a0 for instance 04db0c85-2082-482e-95d7-bc62a3629d01 on n-h1-858383-3 Oct 03 12:17:48.785941 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-87f639d8-dfca-4084-9097-efd255be1ad5 req-a05895df-c1ba-493d-b029-44480ea42e20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063913 Oct 03 12:17:48.786594 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4303/8272] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:18:03.451118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:18:03.452044 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:18:03.457397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-222536891", "imageRef": "7f4a2eb4-aa8b-4b43-a166-44357c53e854", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1156791496", "security_groups": [{"name": "tempest-secgroup-smoke-346963738"}], "networks": [{"uuid": "73c32d16-eb6f-47f2-ac8f-15ad70cb66f3"}]}} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:18:03.486270 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53168. Oct 03 12:18:03.487097 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53170. Oct 03 12:18:03.571611 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.network.neutron [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] validate_networks() for [('73c32d16-eb6f-47f2-ac8f-15ad70cb66f3', None, None, None, None, None)] {{(pid=122270) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 12:18:03.938486 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Flavor limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 12:18:03.938917 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Image limits 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 12:18:03.939397 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Flavor pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 12:18:03.939810 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Image pref 0:0:0 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 12:18:03.940228 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.virt.hardware [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 12:18:03.949630 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:03.950119 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:03.950563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:03.951304 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:03.951765 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:03.952195 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:03.969668 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Getting quotas for project 181500598207441b90bd82dc565f2609. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 12:18:03.974867 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.quota [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Getting quotas for user 8fa33e58c8084c60b634c2a566e6905c and project 181500598207441b90bd82dc565f2609. Resources: {'cores', 'ram', 'instances'} {{(pid=122270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 12:18:03.987301 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Going to run 1 instances... {{(pid=122270) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 12:18:03.989860 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7f4a2eb4-aa8b-4b43-a166-44357c53e854',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 12:18:04.041227 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-16877a9c-3d02-4dab-8769-395592ee49e8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.592213 Oct 03 12:18:04.041886 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3970/8273] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Oct 3 12:18:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 12:18:04.053749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e6d6659a-3f6b-449c-a56e-0a3db272d563 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:04.054707 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e6d6659a-3f6b-449c-a56e-0a3db272d563 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:04.057932 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:18:04.058705 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:18:04.073413 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [170bb458-6a9a-4899-bcfe-ddfa42573d13] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53188. Oct 03 12:18:04.087383 n-d-858383-3 devstack@n-api.service[122269]: INFO oslo.messaging._drivers.impl_rabbit [-] [df45f248-0da1-412f-9b08-1ce5ed78d9d6] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53186. Oct 03 12:18:04.121523 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e6d6659a-3f6b-449c-a56e-0a3db272d563 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:04.129197 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e6d6659a-3f6b-449c-a56e-0a3db272d563 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1248 microversion: 2.1 time: 0.079753 Oct 03 12:18:04.129761 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4304/8274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:04 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:05.153028 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:05.153583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:05.161678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:05.162160 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:05.162595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:05.163451 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:05.164516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:05.164973 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:05.232855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:05.242816 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-6146cba9-94f8-4886-a2f9-1fe47c01581d tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1300 microversion: 2.1 time: 0.095174 Oct 03 12:18:05.243396 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3971/8275] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:05 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:06.267544 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:06.268218 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:06.276927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:06.277431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:06.277891 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:06.278660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:06.279094 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:06.279554 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:06.481351 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:06.493273 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-58e4d369-00b6-48d6-9a5c-de7fdbc9996c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.230445 Oct 03 12:18:06.494131 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4305/8276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:06 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:06.904026 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-18ec4436-3263-4bcb-a7af-716e2a272388 req-d8b73266-8308-460e-b28d-cb5e4dc44ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db0c85-2082-482e-95d7-bc62a3629d01", "name": "network-vif-unplugged", "status": "completed", "tag": "c27d6013-7d94-4b87-bf80-29ea1927e4a0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:18:06.914731 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-18ec4436-3263-4bcb-a7af-716e2a272388 req-d8b73266-8308-460e-b28d-cb5e4dc44ec1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:06.915717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-18ec4436-3263-4bcb-a7af-716e2a272388 req-d8b73266-8308-460e-b28d-cb5e4dc44ec1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:06.916242 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-18ec4436-3263-4bcb-a7af-716e2a272388 req-d8b73266-8308-460e-b28d-cb5e4dc44ec1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:06.928401 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-18ec4436-3263-4bcb-a7af-716e2a272388 req-d8b73266-8308-460e-b28d-cb5e4dc44ec1 service nova] Creating event network-vif-unplugged:c27d6013-7d94-4b87-bf80-29ea1927e4a0 for instance 04db0c85-2082-482e-95d7-bc62a3629d01 on n-h1-858383-3 Oct 03 12:18:06.934359 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-18ec4436-3263-4bcb-a7af-716e2a272388 req-d8b73266-8308-460e-b28d-cb5e4dc44ec1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145427 Oct 03 12:18:06.934984 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3972/8277] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:18:07.518030 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:07.519443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:07.526814 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:07.527661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:07.528331 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:07.529207 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:07.529750 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:07.530272 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:07.683049 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:07.691561 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e1f87b4a-7da7-4735-bf6f-7f7d4950c498 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.177768 Oct 03 12:18:07.693184 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4306/8278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:07 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:08.718886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:08.719568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:08.725842 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:08.726363 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:08.726801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:08.727498 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:08.727948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:08.728368 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:08.893567 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:08.901213 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-c349ebdd-ab24-4328-af09-7d8eab87bd09 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.187519 Oct 03 12:18:08.901785 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3973/8279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:08 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:09.925906 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:09.927693 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:09.938667 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:09.939612 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:09.940463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:09.942568 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:09.943661 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:09.944465 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:10.098504 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:10.109869 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-cf6bd391-3020-4ab2-95f4-a4b688fcd411 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.189603 Oct 03 12:18:10.110567 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4307/8280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:09 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:18:11.137720 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:11.138427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:11.154042 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:11.154536 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:11.154983 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:11.155688 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:11.156147 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:11.156578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:11.297023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:11.305382 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-7bbb7218-19c4-4366-a98f-37f8cd2a9ae5 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.171889 Oct 03 12:18:11.305980 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3974/8281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:11 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:12.331485 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:12.332130 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:12.342415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:12.342925 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:12.343379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:12.344101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:12.344572 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:12.345044 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:12.499802 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:12.507970 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b12981b2-dd5d-48c2-a9c3-24ddd100bedd tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.180662 Oct 03 12:18:12.508860 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4308/8282] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:12 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:13.531533 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:13.532429 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:13.541158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:13.541948 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:13.543197 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:13.544167 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:13.544661 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:13.545205 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:13.696171 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:13.704033 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-b56c7fcf-da87-4064-9aa8-0cdae19d6bc8 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.176436 Oct 03 12:18:13.704616 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3975/8283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:13 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:14.727889 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:14.728542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:14.731386 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell0:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:18:14.737213 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:14.737721 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:14.738210 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:14.738933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:14.739446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:14.739840 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:14.870500 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:14.878159 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-eec4dcce-1032-4fbf-88c9-5c1f911d2e43 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.154180 Oct 03 12:18:14.878739 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4309/8284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:14 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:15.901563 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:15.902183 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:15.904146 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:18:15.904855 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell0:SELECT=6 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:18:15.911809 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:15.912300 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:15.912742 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:15.913466 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:15.913961 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:15.914401 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:16.044786 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:16.052506 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-103e3f8a-8504-41e4-94f9-fd544c837285 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.155507 Oct 03 12:18:16.053122 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3976/8285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:15 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:17.076332 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:17.076973 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:17.083880 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:17.084372 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:17.084843 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:17.085542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:17.086586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:17.087025 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:17.215709 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:17.223382 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-7dd36dc6-7476-4d42-ba8b-50257a743df6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.151047 Oct 03 12:18:17.223956 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4310/8286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:17 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:18.247570 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:18.248187 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:18.255093 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:18.255583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:18.256025 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:18.256717 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:18.257196 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:18.257629 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:18.391886 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:18.399514 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-427c26ec-78d0-47f9-82ca-b9c3a2e2a7be tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.155837 Oct 03 12:18:18.400097 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3977/8287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:18 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:19.422693 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:19.423308 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:19.431824 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:19.432651 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:19.433336 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:19.434322 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:19.434788 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:19.435225 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:19.474599 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-10ae7f45-2933-4fe1-a01c-6f62aab02d25 req-37fe31ce-58fb-44e8-9af7-3c7226622c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df74c14-5341-4519-9dfa-ad270c1e44ee", "tag": "188b958f-d0b3-4198-bab4-51431d8665b4"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:18:19.486549 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-10ae7f45-2933-4fe1-a01c-6f62aab02d25 req-37fe31ce-58fb-44e8-9af7-3c7226622c84 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:19.487064 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-10ae7f45-2933-4fe1-a01c-6f62aab02d25 req-37fe31ce-58fb-44e8-9af7-3c7226622c84 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:19.487770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-10ae7f45-2933-4fe1-a01c-6f62aab02d25 req-37fe31ce-58fb-44e8-9af7-3c7226622c84 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:19.499937 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-10ae7f45-2933-4fe1-a01c-6f62aab02d25 req-37fe31ce-58fb-44e8-9af7-3c7226622c84 service nova] Creating event network-changed:188b958f-d0b3-4198-bab4-51431d8665b4 for instance 2df74c14-5341-4519-9dfa-ad270c1e44ee on n-h1-858383-3 Oct 03 12:18:19.505321 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-10ae7f45-2933-4fe1-a01c-6f62aab02d25 req-37fe31ce-58fb-44e8-9af7-3c7226622c84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109913 Oct 03 12:18:19.505928 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4311/8288] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:18:19.581503 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:19.589234 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-2db38b20-5546-405d-9b86-84e228c61734 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.170353 Oct 03 12:18:19.589809 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3978/8289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:19 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:18:20.613148 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:20.613875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:20.621627 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:20.622117 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:20.622608 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:20.623310 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:20.623774 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:20.624208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:20.759268 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:20.769252 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-47c30820-aa5d-4274-94b9-f75d7f1ed2f2 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.160418 Oct 03 12:18:20.769839 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4312/8290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:20 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:21.792576 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:21.793179 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:21.799946 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:21.800436 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:21.800899 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:21.801595 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:21.802051 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:21.802482 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:21.936577 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:21.944504 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-4cebeb82-3fca-44e7-bf3c-ced71dc7117c tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.155981 Oct 03 12:18:21.945139 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3979/8291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:21 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:22.967208 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:22.967844 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:22.974751 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:22.975260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:22.975717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:22.976463 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:22.976970 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:22.977415 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:23.108606 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:23.116308 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-f000aefb-80d5-4474-8645-1573d7244081 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.153069 Oct 03 12:18:23.117415 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4313/8292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:22 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:24.139507 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:24.140118 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:24.146985 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:24.147469 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:24.147910 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:24.148676 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:24.149158 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:24.149586 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:24.279705 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:24.287483 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-fd4bdf01-a2ae-4f18-ba7b-720abffe563b tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.151860 Oct 03 12:18:24.288055 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3980/8293] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:24 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:24.878717 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [req-7f2f8ef7-145d-4f05-a85a-46f2b376b2ff req-4ad0ab21-f427-4320-adef-615402a6ddf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df74c14-5341-4519-9dfa-ad270c1e44ee", "name": "network-vif-plugged", "status": "completed", "tag": "188b958f-d0b3-4198-bab4-51431d8665b4"}]} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:18:24.889681 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7f2f8ef7-145d-4f05-a85a-46f2b376b2ff req-4ad0ab21-f427-4320-adef-615402a6ddf1 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:24.890166 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7f2f8ef7-145d-4f05-a85a-46f2b376b2ff req-4ad0ab21-f427-4320-adef-615402a6ddf1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:24.890611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [req-7f2f8ef7-145d-4f05-a85a-46f2b376b2ff req-4ad0ab21-f427-4320-adef-615402a6ddf1 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:24.901773 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.compute.server_external_events [req-7f2f8ef7-145d-4f05-a85a-46f2b376b2ff req-4ad0ab21-f427-4320-adef-615402a6ddf1 service nova] Creating event network-vif-plugged:188b958f-d0b3-4198-bab4-51431d8665b4 for instance 2df74c14-5341-4519-9dfa-ad270c1e44ee on n-h1-858383-3 Oct 03 12:18:24.906638 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [req-7f2f8ef7-145d-4f05-a85a-46f2b376b2ff req-4ad0ab21-f427-4320-adef-615402a6ddf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032038 Oct 03 12:18:24.907239 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4314/8294] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:18:25.309161 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:25.309773 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:25.317047 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:25.317544 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:25.317992 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:25.318691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:25.319156 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:25.319589 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:25.457656 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:25.466013 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-17c41259-e954-4af6-a820-297b028fd81a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.160824 Oct 03 12:18:25.466610 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3981/8295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:25 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:26.490935 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:26.491653 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:26.497952 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:26.498448 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:26.498903 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:26.499602 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:26.500070 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:26.500511 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:26.632611 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:26.640486 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b63f76fa-1378-467e-ac62-a80361a6b162 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1373 microversion: 2.1 time: 0.154558 Oct 03 12:18:26.641114 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4315/8296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:26 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:27.662774 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:27.663407 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:27.671023 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:27.671509 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:27.671949 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:27.672639 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:27.673143 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:27.673574 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:27.806647 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:27.814675 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-0b923a56-262a-481d-8a83-cdf456bbb282 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1558 microversion: 2.1 time: 0.155793 Oct 03 12:18:27.815253 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3982/8297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:27 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:27.842672 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:18:27.843222 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:18:27.850051 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:27.850542 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:27.850988 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:27.852200 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:27.852662 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:27.853120 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:27.987102 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:18:27.995317 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-9a176e37-e221-42ed-b9db-41578b78a170 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1558 microversion: 2.1 time: 0.156558 Oct 03 12:18:27.995883 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4316/8298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:18:27 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:18:29.860049 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-92d776f0-c18a-4f5f-8221-fe62dbf4370b req-a724ee02-4982-4db9-9443-779f56e48f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df74c14-5341-4519-9dfa-ad270c1e44ee", "tag": "188b958f-d0b3-4198-bab4-51431d8665b4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:18:29.870578 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-92d776f0-c18a-4f5f-8221-fe62dbf4370b req-a724ee02-4982-4db9-9443-779f56e48f86 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:18:29.871284 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-92d776f0-c18a-4f5f-8221-fe62dbf4370b req-a724ee02-4982-4db9-9443-779f56e48f86 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:18:29.871781 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-92d776f0-c18a-4f5f-8221-fe62dbf4370b req-a724ee02-4982-4db9-9443-779f56e48f86 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:18:29.882804 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-92d776f0-c18a-4f5f-8221-fe62dbf4370b req-a724ee02-4982-4db9-9443-779f56e48f86 service nova] Creating event network-changed:188b958f-d0b3-4198-bab4-51431d8665b4 for instance 2df74c14-5341-4519-9dfa-ad270c1e44ee on n-h1-858383-3 Oct 03 12:18:29.887949 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-92d776f0-c18a-4f5f-8221-fe62dbf4370b req-a724ee02-4982-4db9-9443-779f56e48f86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031753 Oct 03 12:18:29.888532 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3983/8299] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:20:43.527073 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=28 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:20:43.528355 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=64 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:20:43.610053 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1623934406"}} {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:20:43.612438 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:20:43.618430 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:20:43.618927 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:20:43.619374 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:20:43.620069 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:20:43.620545 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:20:43.621010 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:20:43.985489 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-caf84dea-fdd9-46b6-ae36-d737c5914134 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "POST /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee/action" status: 202 len: 0 microversion: 2.1 time: 0.460240 Oct 03 12:20:43.986130 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4317/8300] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Oct 3 12:20:43 2022] POST /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 12:20:49.641943 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 03 12:20:49.643965 n-d-858383-3 devstack@n-api.service[122270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 03 12:20:49.644678 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:20:49.645652 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=72 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:20:49.646470 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:20:49.646613 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 12:20:49.648568 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:20:49.648568 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 12:20:49.650594 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 12:20:49.650723 n-d-858383-3 devstack@n-api.service[122270]: Mon Oct 3 12:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 03 12:20:49.673943 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-2f6532ec-ac9d-4c99-8c5e-f127af65dee0 req-ead03fd3-1529-484b-a253-7bf9b4b86955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df74c14-5341-4519-9dfa-ad270c1e44ee", "name": "network-vif-plugged", "status": "completed", "tag": "188b958f-d0b3-4198-bab4-51431d8665b4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:20:49.685980 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f6532ec-ac9d-4c99-8c5e-f127af65dee0 req-ead03fd3-1529-484b-a253-7bf9b4b86955 service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:20:49.686460 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f6532ec-ac9d-4c99-8c5e-f127af65dee0 req-ead03fd3-1529-484b-a253-7bf9b4b86955 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:20:49.686891 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-2f6532ec-ac9d-4c99-8c5e-f127af65dee0 req-ead03fd3-1529-484b-a253-7bf9b4b86955 service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:20:49.697405 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-2f6532ec-ac9d-4c99-8c5e-f127af65dee0 req-ead03fd3-1529-484b-a253-7bf9b4b86955 service nova] Creating event network-vif-plugged:188b958f-d0b3-4198-bab4-51431d8665b4 for instance 2df74c14-5341-4519-9dfa-ad270c1e44ee on n-h1-858383-3 Oct 03 12:20:49.704669 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-2f6532ec-ac9d-4c99-8c5e-f127af65dee0 req-ead03fd3-1529-484b-a253-7bf9b4b86955 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066060 Oct 03 12:20:49.705309 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3984/8301] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:21:03.718251 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_api:SELECT=2 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:21:03.719101 n-d-858383-3 devstack@n-api.service[122269]: DEBUG dbcounter [-] [122269] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:21:03.723809 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:03.723986 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-f3a64322-48bd-450c-ad0e-7a01c434cdd5 req-1f4f12f8-0bce-4c2b-b4aa-2bbbb12856cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df74c14-5341-4519-9dfa-ad270c1e44ee", "tag": "188b958f-d0b3-4198-bab4-51431d8665b4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:21:03.724449 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:03.730801 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_cell1:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:21:03.731555 n-d-858383-3 devstack@n-api.service[122270]: DEBUG dbcounter [-] [122270] Writing DB stats nova_api:SELECT=2 {{(pid=122270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:21:03.740567 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:03.741119 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:03.741277 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f3a64322-48bd-450c-ad0e-7a01c434cdd5 req-1f4f12f8-0bce-4c2b-b4aa-2bbbb12856cd service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:03.741787 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f3a64322-48bd-450c-ad0e-7a01c434cdd5 req-1f4f12f8-0bce-4c2b-b4aa-2bbbb12856cd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:03.742057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:03.742392 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-f3a64322-48bd-450c-ad0e-7a01c434cdd5 req-1f4f12f8-0bce-4c2b-b4aa-2bbbb12856cd service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:03.742967 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:03.743444 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:03.743890 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:03.754566 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a28d25c-e909-4728-828f-cbfe38bb683e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53556. Oct 03 12:21:03.756583 n-d-858383-3 devstack@n-api.service[122270]: INFO oslo.messaging._drivers.impl_rabbit [-] [f08dfc8e-13dd-47d8-b35c-b85beb5ee9bd] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 53558. Oct 03 12:21:03.758590 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-f3a64322-48bd-450c-ad0e-7a01c434cdd5 req-1f4f12f8-0bce-4c2b-b4aa-2bbbb12856cd service nova] Creating event network-changed:188b958f-d0b3-4198-bab4-51431d8665b4 for instance 2df74c14-5341-4519-9dfa-ad270c1e44ee on n-h1-858383-3 Oct 03 12:21:03.763585 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-f3a64322-48bd-450c-ad0e-7a01c434cdd5 req-1f4f12f8-0bce-4c2b-b4aa-2bbbb12856cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044312 Oct 03 12:21:03.764403 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3985/8302] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:21:03.776749 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:21:03.870207 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-349b6461-10f5-4734-a009-2fbf85c8d23a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 204 len: 0 microversion: 2.1 time: 0.154716 Oct 03 12:21:03.870924 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4318/8303] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 12:21:03 2022] DELETE /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:21:03.879609 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:03.880309 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:03.886594 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:03.887082 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:03.887516 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:03.888236 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:03.888691 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:03.889140 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:04.121828 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:21:04.129731 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-53ded19b-c98f-4b85-8e0f-a9b6cea72f8a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1683 microversion: 2.1 time: 0.254364 Oct 03 12:21:04.130314 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3986/8304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:21:03 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:21:05.155202 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:05.155917 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:05.161936 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:05.162431 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:05.162875 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:05.163573 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:05.164037 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:05.164472 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:05.347810 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:21:05.360437 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-e0ccea1d-96cd-4c86-8b03-4a6a4ef3eb11 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1683 microversion: 2.1 time: 0.210270 Oct 03 12:21:05.361062 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4319/8305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:21:05 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:21:06.173056 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-67665fd9-1841-4ed7-a0c9-9fb0d9c63ee1 req-a7a4365a-2893-4eb8-92ba-4c6a04611fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df74c14-5341-4519-9dfa-ad270c1e44ee", "name": "network-vif-deleted", "tag": "188b958f-d0b3-4198-bab4-51431d8665b4"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:21:06.183269 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-67665fd9-1841-4ed7-a0c9-9fb0d9c63ee1 req-a7a4365a-2893-4eb8-92ba-4c6a04611fbe service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:06.183745 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-67665fd9-1841-4ed7-a0c9-9fb0d9c63ee1 req-a7a4365a-2893-4eb8-92ba-4c6a04611fbe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:06.184173 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-67665fd9-1841-4ed7-a0c9-9fb0d9c63ee1 req-a7a4365a-2893-4eb8-92ba-4c6a04611fbe service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:06.197295 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-67665fd9-1841-4ed7-a0c9-9fb0d9c63ee1 req-a7a4365a-2893-4eb8-92ba-4c6a04611fbe service nova] Creating event network-vif-deleted:188b958f-d0b3-4198-bab4-51431d8665b4 for instance 2df74c14-5341-4519-9dfa-ad270c1e44ee on n-h1-858383-3 Oct 03 12:21:06.204100 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-67665fd9-1841-4ed7-a0c9-9fb0d9c63ee1 req-a7a4365a-2893-4eb8-92ba-4c6a04611fbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089399 Oct 03 12:21:06.205437 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3987/8306] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 12:21:06.387593 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:06.388228 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:06.395446 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:06.395956 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:06.396418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:06.397183 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:06.397663 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:06.398110 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:06.432224 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:06.432725 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:06.433422 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:06.433883 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.objects.instance [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lazy-loading 'fault' on Instance uuid 2df74c14-5341-4519-9dfa-ad270c1e44ee {{(pid=122269) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 12:21:06.480212 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:21:06.489216 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-1b5c5ae7-360f-4f43-8d0c-5bc35da3f5d7 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 200 len: 1338 microversion: 2.1 time: 0.105288 Oct 03 12:21:06.489820 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4320/8307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:21:06 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:21:07.514902 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:07.515614 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 2df74c14-5341-4519-9dfa-ad270c1e44ee] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:07.521908 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:07.522396 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:07.522840 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:07.523534 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:07.523995 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:07.524427 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:07.537608 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.wsgi [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] HTTP exception thrown: Instance 2df74c14-5341-4519-9dfa-ad270c1e44ee could not be found. Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Request method failure captured: Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: request: GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee HTTP/1.1 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: Accept: application/json Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: Accept-Encoding: identity Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: Connection: close Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: Content-Length: 0 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: Content-Type: application/json Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: Host: 10.222.0.27 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: Openstack-System-Scope: None Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: User-Agent: python-urllib3/1.26.12 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Auth-Token: gAAAAABjOtIy_XgwnxcYIQMr5LJ1_STaPXWaLhnZZcrQD1conBSESGVv77FpXj4ShGS6TdtOp5ebl9rT0WUHwOvoJVillzYRYyOKronhjvSwd5AXKz9DPNJsiCFFfSoKkqtIWXiljSoM7CYs1ECDFBL4tM2xv_eDFhN_nX9a-GYt8i1jrccnJHU Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Id: None Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Domain-Name: None Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Identity-Status: Confirmed Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Is-Admin-Project: True Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Id: default Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Domain-Name: Default Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Id: 181500598207441b90bd82dc565f2609 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Project-Name: tempest-TestSnapshotPattern-778273485 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Role: reader,member Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Roles: reader,member Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181500598207441b90bd82dc565f2609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_181500598207441b90bd82dc565f2609"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/181500598207441b90bd82dc565f2609"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181500598207441b90bd82dc565f2609"}]}] Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant: tempest-TestSnapshotPattern-778273485 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Id: 181500598207441b90bd82dc565f2609 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-Tenant-Name: tempest-TestSnapshotPattern-778273485 Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-User: tempest-TestSnapshotPattern-778273485-project Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Id: default Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Domain-Name: Default Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Id: 8fa33e58c8084c60b634c2a566e6905c Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: X-User-Name: tempest-TestSnapshotPattern-778273485-project Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: method: > Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: exception: Instance 2df74c14-5341-4519-9dfa-ad270c1e44ee could not be found. Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: action_args: {'id': '2df74c14-5341-4519-9dfa-ad270c1e44ee'} Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df74c14-5341-4519-9dfa-ad270c1e44ee could not be found. Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df74c14-5341-4519-9dfa-ad270c1e44ee could not be found. Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:21:07.539258 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df74c14-5341-4519-9dfa-ad270c1e44ee could not be found. Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: ERROR nova.api.openstack.wsgi Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Returning 404 to user: Instance 2df74c14-5341-4519-9dfa-ad270c1e44ee could not be found. {{(pid=122270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-3fcf9afe-bd08-420d-b673-470bfbcfdc0a tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee" status: 404 len: 111 microversion: 2.1 time: 0.031563 Oct 03 12:21:07.545388 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3988/8308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:21:07 2022] GET /compute/v2.1/servers/2df74c14-5341-4519-9dfa-ad270c1e44ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 12:21:09.143057 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:09.143586 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:09.145568 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-b2af17f5-a88c-4f7a-a780-c5ed7f764159 req-66e86e92-fc59-4680-9487-1a588b55923d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04db0c85-2082-482e-95d7-bc62a3629d01", "tag": "c27d6013-7d94-4b87-bf80-29ea1927e4a0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:21:09.150605 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:09.151122 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:09.151569 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:09.152284 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:09.152753 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:09.153418 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:09.157971 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2af17f5-a88c-4f7a-a780-c5ed7f764159 req-66e86e92-fc59-4680-9487-1a588b55923d service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:09.158583 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2af17f5-a88c-4f7a-a780-c5ed7f764159 req-66e86e92-fc59-4680-9487-1a588b55923d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:09.159108 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-b2af17f5-a88c-4f7a-a780-c5ed7f764159 req-66e86e92-fc59-4680-9487-1a588b55923d service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:09.170839 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-b2af17f5-a88c-4f7a-a780-c5ed7f764159 req-66e86e92-fc59-4680-9487-1a588b55923d service nova] Creating event network-changed:c27d6013-7d94-4b87-bf80-29ea1927e4a0 for instance 04db0c85-2082-482e-95d7-bc62a3629d01 on n-h1-858383-3 Oct 03 12:21:09.177387 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-b2af17f5-a88c-4f7a-a780-c5ed7f764159 req-66e86e92-fc59-4680-9487-1a588b55923d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034926 Oct 03 12:21:09.178705 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3989/8309] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:21:09.181831 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Going to try to terminate instance {{(pid=122269) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 12:21:09.262675 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-dc4ac4b8-efd7-4b21-aa9d-f0604e552e71 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "DELETE /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 204 len: 0 microversion: 2.1 time: 0.123289 Oct 03 12:21:09.263822 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4321/8310] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Oct 3 12:21:09 2022] DELETE /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 12:21:09.273117 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:09.274104 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.compute.api [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122270) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:09.282069 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:09.282772 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:09.283395 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:09.284481 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:09.285625 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:09.286262 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:09.437022 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.policy [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122270) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:21:09.445704 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-daba2ccf-b5e0-427f-87cb-5b6813a307a6 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1684 microversion: 2.1 time: 0.176985 Oct 03 12:21:09.446310 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3990/8311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:21:09 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 12:21:10.470698 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:10.471326 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:10.478157 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:10.478660 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:10.479118 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:10.479826 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:10.480317 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:10.480795 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:10.618720 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.policy [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa33e58c8084c60b634c2a566e6905c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '181500598207441b90bd82dc565f2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122269) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 12:21:10.627148 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-b1e8b0aa-799b-4b8a-ad29-7ddcddeb8f51 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 200 len: 1565 microversion: 2.1 time: 0.160797 Oct 03 12:21:10.627719 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4322/8312] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:21:10 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 12:21:10.903331 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [req-19881767-7c83-4e9e-9e21-22d5d6afaa77 req-512a7ce2-a30d-4a67-98c7-016c657762ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db0c85-2082-482e-95d7-bc62a3629d01", "name": "network-vif-deleted", "tag": "c27d6013-7d94-4b87-bf80-29ea1927e4a0"}]} {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 12:21:10.915470 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-19881767-7c83-4e9e-9e21-22d5d6afaa77 req-512a7ce2-a30d-4a67-98c7-016c657762ab service nova] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:10.915947 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-19881767-7c83-4e9e-9e21-22d5d6afaa77 req-512a7ce2-a30d-4a67-98c7-016c657762ab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:10.916374 n-d-858383-3 devstack@n-api.service[122270]: DEBUG oslo_concurrency.lockutils [req-19881767-7c83-4e9e-9e21-22d5d6afaa77 req-512a7ce2-a30d-4a67-98c7-016c657762ab service nova] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:10.929388 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.compute.server_external_events [req-19881767-7c83-4e9e-9e21-22d5d6afaa77 req-512a7ce2-a30d-4a67-98c7-016c657762ab service nova] Creating event network-vif-deleted:c27d6013-7d94-4b87-bf80-29ea1927e4a0 for instance 04db0c85-2082-482e-95d7-bc62a3629d01 on n-h1-858383-3 Oct 03 12:21:10.935950 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [req-19881767-7c83-4e9e-9e21-22d5d6afaa77 req-512a7ce2-a30d-4a67-98c7-016c657762ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036497 Oct 03 12:21:10.936585 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3991/8313] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Oct 3 12:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 12:21:11.650800 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '>' {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:11.651353 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.compute.api [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] [instance: 04db0c85-2082-482e-95d7-bc62a3629d01] Fetching instance by UUID {{(pid=122269) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 12:21:11.658770 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:11.659260 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:11.659837 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:11.660443 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Acquiring lock "5d809412-179d-487a-a3ff-24b9afa0366c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 12:21:11.660933 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 12:21:11.661379 n-d-858383-3 devstack@n-api.service[122269]: DEBUG oslo_concurrency.lockutils [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Lock "5d809412-179d-487a-a3ff-24b9afa0366c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 12:21:11.675007 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.wsgi [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] HTTP exception thrown: Instance 04db0c85-2082-482e-95d7-bc62a3629d01 could not be found. Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Request method failure captured: Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: request: GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 HTTP/1.1 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: Accept: application/json Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: Accept-Encoding: identity Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: Connection: close Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: Content-Length: 0 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: Content-Type: application/json Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: Host: 10.222.0.27 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: Openstack-System-Scope: None Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: User-Agent: python-urllib3/1.26.12 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Auth-Token: gAAAAABjOtIy_XgwnxcYIQMr5LJ1_STaPXWaLhnZZcrQD1conBSESGVv77FpXj4ShGS6TdtOp5ebl9rT0WUHwOvoJVillzYRYyOKronhjvSwd5AXKz9DPNJsiCFFfSoKkqtIWXiljSoM7CYs1ECDFBL4tM2xv_eDFhN_nX9a-GYt8i1jrccnJHU Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Id: None Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Domain-Name: None Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Identity-Status: Confirmed Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Is-Admin-Project: True Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Id: default Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Domain-Name: Default Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Id: 181500598207441b90bd82dc565f2609 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Project-Name: tempest-TestSnapshotPattern-778273485 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Role: reader,member Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Roles: reader,member Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181500598207441b90bd82dc565f2609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_181500598207441b90bd82dc565f2609"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/181500598207441b90bd82dc565f2609"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/181500598207441b90bd82dc565f2609"}]}] Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant: tempest-TestSnapshotPattern-778273485 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Id: 181500598207441b90bd82dc565f2609 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-Tenant-Name: tempest-TestSnapshotPattern-778273485 Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-User: tempest-TestSnapshotPattern-778273485-project Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Id: default Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-User-Domain-Name: Default Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-User-Id: 8fa33e58c8084c60b634c2a566e6905c Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: X-User-Name: tempest-TestSnapshotPattern-778273485-project Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: method: > Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: exception: Instance 04db0c85-2082-482e-95d7-bc62a3629d01 could not be found. Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: action_args: {'id': '04db0c85-2082-482e-95d7-bc62a3629d01'} Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: {{(pid=122269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04db0c85-2082-482e-95d7-bc62a3629d01 could not be found. Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04db0c85-2082-482e-95d7-bc62a3629d01 could not be found. Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 12:21:11.676694 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04db0c85-2082-482e-95d7-bc62a3629d01 could not be found. Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: ERROR nova.api.openstack.wsgi Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: DEBUG nova.api.openstack.wsgi [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Returning 404 to user: Instance 04db0c85-2082-482e-95d7-bc62a3629d01 could not be found. {{(pid=122269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: INFO nova.api.openstack.requestlog [None req-293d91ee-bf96-44fd-a04a-9023e16e759f tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01" status: 404 len: 111 microversion: 2.1 time: 0.031336 Oct 03 12:21:11.681966 n-d-858383-3 devstack@n-api.service[122269]: [pid: 122269|app: 0|req: 4323/8314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Oct 3 12:21:11 2022] GET /compute/v2.1/servers/04db0c85-2082-482e-95d7-bc62a3629d01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 12:21:11.837523 n-d-858383-3 devstack@n-api.service[122270]: DEBUG nova.api.openstack.wsgi [None req-31998e95-e0a3-4764-b9f7-78a0900b4d66 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] Calling method '.version_select at 0x7f074ea0d040>' {{(pid=122270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 12:21:11.870969 n-d-858383-3 devstack@n-api.service[122270]: INFO nova.api.openstack.requestlog [None req-31998e95-e0a3-4764-b9f7-78a0900b4d66 tempest-TestSnapshotPattern-778273485 tempest-TestSnapshotPattern-778273485-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1156791496" status: 202 len: 0 microversion: 2.1 time: 0.037684 Oct 03 12:21:11.871550 n-d-858383-3 devstack@n-api.service[122270]: [pid: 122270|app: 0|req: 3992/8315] 10.222.0.27 () {58 vars in 1257 bytes} [Mon Oct 3 12:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1156791496 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)